Showing posts with label HELP. Show all posts
Showing posts with label HELP. Show all posts

Tuesday, March 14, 2017

#Wikidata - Who is Eric D. Wolff?


Eric D. Wolff is one of three authors of a paper called "Original Issue High Yield Bonds: Aging Analyses of Defaults, Exchanges, and Calls". They won the 1989 Smith Breeden Prize and the Wikipedia article has a red link for Mr Wolff, no link for Mr Paul Asquith and a blue link for  David W. Mullins, Jr.

The simplest thing to do is add an item for all the missing authors, connect them to the awards and be done. As they wrote a paper, it is reasonable to expect a VIAF registration and it was possible to find Mr Asquith.

The question is not if Mr Wolff is notable; he is as he won a prize. The question is how to reliably connect him and others to external sources. Making this effort improves quality for Wikidata; it is quality in action.
Thanks,
      GerardM

Sunday, June 22, 2014

#Wikidata - #Russia; member of the State Duma

There is great information about the current members of the State Duma. It is available on the website of the Duma. It is available in Russian and English. The only thing in the way of a claimed copyright is that you refer back to the website.

At this time Wikidata did not know that members of the Duma are politicians. A process is underway to make them members of the Duma in the first place (357 and counting).

It is important to know who represents the power that is inherent in a parliament and, it such information should not only be available for the usual countries like those in the "West". We should know about the Chinese, Russians, Iraqi, Indonesian, Filipino, Lybian .. parliamentarians. These people make a difference, they get in the news for good and bad reasons.

They are all notable.
Thanks,
       GerardM

#Wikidata - Places in #Iran

Bon Chenar is the first entry on a list prepared by Amir. The list is about places in Iran where there is an article on the English Wikipedia and an article on the Persian Wikipedia. Obviously it needs to be merged. There are thousands and thousands of places in Iran .. all with double entries in Wikidata and all in need of merging.

Amir produces reports, Magnus made a game out of it but in the end it needs people to mark all of these places as being the same or not. People who know English and Persian..

When these items are merged, the statements are combined. It is the best of times to curate the statements that have been made. However, when do you start improving things when it is so obvious that it will need to be done again and again?
Thanks,
       GerardM

Saturday, May 24, 2014

#Wikimedia-#Labs its script kiddies and its public

Labs is the home of many tools. These tools are often essential to workflows or they show people information that they cannot get in any other way. When you want to work on people who died in 2014, you use this script. When you want to have information about 土门岭村, a village in China, you use Reasonator.

Labs has three types of public; there are the heroes who develop tools, there are the people who use these tools to generate more data and there are the consumers of all the information that becomes available.

They all have one thing in common. For them to function Labs has to be operational.

When Labs is not always available, when the quality of service suffers, the tools will not get the exposure they seek. Script kiddies will not generate more data and the public will not share in the information that should be available to them.
Thanks,
     GerardM

Wednesday, March 19, 2014

#GSOC - #DBpedia and #Wikidata


The most interesting Google Summer of Code proposal I have seen for 2014 is this one.
4.7. Clean DBpedia datasets and import in Wikidata
The student who will take this task will be responsible for two things:
Clean up the DBpedia errors based on the output of Databugger (http://databugger.aksw.org) or similar. With this the student will generate a more sparse but cleaner dump of DBpedia that will be of general use.
Communicate with the Wikidata community in order to coordinate the import of (parts of) the cleaned datasets and re-use the connections of DBpedia to fetch additional data for Wikidata import.
Mentors: Dimitris Kontokostas, Magnus Knuth (co-mentor)
As far as I am aware they are still looking for a candidate to choose this project. This project is totally relevant and it is exactly the kind of repeatable process that Wikidata should have. By having this project done to DBpedia standards, it is ensured that the baseline will be stable and the results will be repeated regularly.
Thanks,
      GerardM

Friday, February 07, 2014

#Reasonator - the hundred lines of code that support #English

When Magnus told me that there are only 100 lines of code abstracted to support English, I thought that it is something to share with you. What can you do with these 100 lines to support *YOUR* language?
Thanks,
      GerardM

NOTE this is incomplete, but most of it. abstraction will continue.
Full code is here:
            
            // ENGLISH
            language_specs['en'] = new lang_class ;

            language_specs['en'].employers = function ( d ) {
                this.listSentence ( {
                    data : d ,
                    start : function() { h.push ( { label:s_he+' worked for ' } ) } ,
                    item_start : function(cb) { cb(); h.push ( { label:' ' } ) } ,
                    date_from : function(cb) { h.push ( { label:'from ' } ) ; cb({no_prefix:true}) } ,
                    date_to : function(cb) { h.push ( { label:'until ' } ) ; cb({no_prefix:true}) } ,
                    qualifiers : { job:function(qv){h.push ( { before:'as ' , q:qv[0] , after:' ' } )} } ,
                    item_end : function(num,sep) { h.push ( { label:sep+(num+1<d.length?'for ':'') } ) } ,
                    end : function() { h.push ( { label:'. ' } ) }
                } ) ;
            }

            language_specs['en'].position = function ( d ) {
                this.listSentence ( {
                    data : d ,
                    start : function() { h.push ( { label:s_he+' was'+(is_dead?'':'/is')+' ' } ) } ,
                    item_start : function(cb) { cb(); h.push ( { label:' ' } ) } ,
                    date_from : function(cb) { h.push ( { label:'from ' } ) ; cb({no_prefix:true}) } ,
                    date_to : function(cb) { h.push ( { label:'until ' } ) ; cb({no_prefix:true}) } ,
//                    qualifiers : { job:function(qv){h.push ( { before:'as ' , q:qv[0] , after:' ' } )} } ,
                    item_end : function(num,sep) { h.push ( { label:sep } ) } ,
                    end : function() { h.push ( { label:'. ' } ) }
                } ) ;
            }

            language_specs['en'].member = function ( d ) {
                this.listSentence ( {
                    data : d ,
                    start : function() { h.push ( { label:s_he+' was'+(is_dead?'':'/is')+' a member of ' } ) } ,
                    item_start : function(cb) { cb(); h.push ( { label:' ' } ) } ,
                    date_from : function(cb) { h.push ( { label:'from ' } ) ; cb({no_prefix:true}) } ,
                    date_to : function(cb) { h.push ( { label:'until ' } ) ; cb({no_prefix:true}) } ,
//                    qualifiers : { job:function(qv){h.push ( { before:'as ' , q:qv[0] , after:' ' } )} } ,
                    item_end : function(num,sep) { h.push ( { label:sep } ) } ,
                    end : function() { h.push ( { label:'. ' } ) }
                } ) ;
            }

            language_specs['en'].alma = function ( d ) {
                this.listSentence ( {
                    data : d ,
                    start : function() { h.push ( { label:s_he+' studied at ' } ) } ,
                    item_start : function(cb) { cb(); h.push ( { label:' ' } ) } ,
                    date_from : function(cb) { h.push ( { label:'from ' } ) ; cb({no_prefix:true}) } ,
                    date_to : function(cb) { h.push ( { label:'until ' } ) ; cb({no_prefix:true}) } ,
                    item_end : function(num,sep) { h.push ( { label:sep } ) } ,
                    end : function() { h.push ( { label:'. ' } ) }
                } ) ;
            }
          
            language_specs['en'].field = function ( d ) { this.simpleList ( d , his_er+' field of work include'+(is_dead?'d':'s')+' ' , '. ' ) ; }
            language_specs['en'].cause_of_death = function ( d ) { this.simpleList ( d , 'of ' , ' ' ) ; }
            language_specs['en'].killer = function ( d ) { this.simpleList ( d , 'by ' , ' ' ) ; }
            language_specs['en'].sig_event = function ( d ) { this.simpleList ( d , s_he+' played a role in ' , '.' ) ; }

            language_specs['en'].spouses = function ( d ) {
                this.listSentence ( {
                    data : d ,
                    start : function() { h.push ( { label:s_he+' married ' } ) } ,
                    item_start : function(cb) { cb(); h.push ( { label:' ' } ) } ,
                    date_from : function(cb) { cb(); h.push ( { label:' ' } ) ; } ,
                    date_to : function(cb) { h.push ( { label:'(married until ' } ) ; cb() ; h.push ( { label:') ' } ) } ,
                    item_end : function(num,sep) { h.push ( { label:sep } ) } ,
                    end : function() { h.push ( { label:'. ' } ) }
                } ) ;
            }

            language_specs['en'].children = function ( d ) {
                this.listSentence ( {
                    data : d ,
                    start : function() { h.push ( { label:his_er+' children include ' } ) } ,
                    item_start : function(cb) { cb() } ,
                    item_end : function(num,sep) { h.push ( { label:sep } ) } ,
                    end : function() { h.push ( { label:'. ' } ) }
                } ) ;
            }
          
          
            language_specs['en'].firstSentence = function () {
                h.push ( { label:$('#main_title_label').text() , before:'<b>' , after:'</b> ' } ) ;
                h.push ( { label:(is_dead?'was':'is') , after:' a ' } ) ;
                this.listNationalities() ;
                this.listOccupations() ;
                h.push ( { label:'. ' } ) ;
                if ( h.length == 3 ) h = [] ; // No information, skip it.
            }

Monday, January 27, 2014

#Reasonator - the need for speed

If Reasonator is to work well and has to continue to work well, it has to scale and be as efficient as possible. Magnus has done a lot of work recently to improve its responsiveness. As it is, it does get its data from elsewhere and it is all about efficiently handling requests for information.

These are three results of the recent improvement in performance. 
Johann Sebastian Bach (Q1339)Wikidata : 18 sec (no images, no related items)
Old Reasonator : 12 sec (14 with images)
New Reasonator : 6 sec (9 sec with images)
Mammillaria (Q311120)Wikidata : 5 sec (no images, no taxon tree, no related items)
Old Reasonator : 8 sec (11 with images)
New Reasonator : 7 sec (10 sec with many more images)
Cambridge (Q350)Wikidata : 7 sec (no images, no location tree, no maps, no related items)
Old Reasonator : 8 sec (9 with images)
New Reasonator : 7 sec (10 sec with many more images)
The data is retrieved from Wikidata using the available APIs. There are two ways to look at that; you either accept what you are given OR you know that WDQ is able to provide the same data but faster. WDQ is as you read on Magnus's blog all of Wikidata but running completely in memory. At start time it is only 868MB RAM in size.

Help is welcome to make Reasonator and WDQ scale and to improve its user experience. Its page view statistics indicate a bight future and therefore an urgent need to consider all of this. Things that are considered are:

  • using puppet for better management and multiplexing the services provided
  • fixing memory leaks
  • packaging WDQ and Reasonator
We expect that Wikidata will be able to cope with us in bringing the best information available to us.
Thanks,
      GerardM


Sunday, January 05, 2014

#Eusebio

Eusebio is one of the #soccer greats. Today brought us the news that he died at the age of 71. He was a formidable player and he was awarded the European golden shoe twice.

This award is presented each season to the leading goalscorer in league matches from the top division of every European national league. Eusebio was the best in the seasons 1967–68 and 1972–73.

It is not obvious how to indicate soccer seasons as a qualifier for these awards in Wikidata. The closest are articles about soccer in the year....
Thanks,
      GerardM

Sunday, December 29, 2013

#Wikidata - how to reach its tipping points

If #Wikidata is to be useful, it has to be usable. What it is usable for, depends on who is using it and in what way. The information about Muhammad Shah, a mogul from India, is easier to digest when formatted by the Reasonator than by looking at the raw information in Wikidata. There is more information in a Wikipedia articles BUT, there are only 16 Wikipedias who have an article about him.

Currently there are labels in 19 languages for Muhammad Shah and consequently most of the Indian languages will not find him in their language.

Most people will not care that much about this mogul. They are more interested in what is in the news. The references shown are related to what is considered to be in the news in any language. Once people added labels missing in their language, items that are likely to be of interest can now be found. At the same time, everywhere where the associated items are referenced, these labels will be available as well.

Doing this helps build enough information for Wikidata to become usable in a language. But it still needs to be used. That is at this time very much a tripping point.

Adding Wikidata Search to a Wikipedia search helps. It gives Wikidata an application. More applications are possible. A separate place where the Wikidata information is leveraged would help. In this way pictures from Commons can be found, information presented by the Reasonator and articles in the available languages.

The beauty of Wikidata is that it takes so little effort to have a big effect. However, this effect is only realised when Wikidata is used. The question is very much what are we going to do to reach the tipping points and bypass the tripping points.
Thanks,
      GerardM

Saturday, September 14, 2013

About #political parties in #Wikidata

Adding data to Wikidata does not have much of a priority. Yes, there are some people who run bots but when you can only run bots and rely on the quality of the programming it is not nice.

Within the pywikipedia.bot environment it is the harvest_template.py that has the most potential. At this moment I am running a script that adds one political party to people who have the template "Infobox Officeholder" on their Wikipedia article. These are people like Nancy Pelosi or Moritz Leuenberger I am adding the first political party mentioned for them.

I am really happy that I am running a hacked version of the software; two bugs that are show stoppers for the autonomous running of the software have been fixed in my version of the software. I can only hope that some real work will be done. A list of all the problematic content would be nice.
Thanks,
      GerardM

Wednesday, August 28, 2013

The #Catalan #Wikipedia provides great information

Adding information to #Wikidata means that you want to use the existing items with interwiki information. When you find red links in the English Wikipedia, it is easy to think that there is no information in Wikipedia. It really pays to check the interwiki links of the article that contains all the red links.

The Catalan Wikipedia I find is really good at providing information on the Islamic rulers that are part of Spanish and North African history.It means that when I add information I need to take their existing articles in consideration.

I got the impression that the Zayyadin dynasty were "caliphs". So I created an "Zayyadin caliph" item. My hope is that someone will change it to "emirs" when this is wrong.
Thanks,
      GerardM


Friday, August 23, 2013

Paper cuts for #Wikidata

Quite a while ago Ubuntu did a paper cuts initiative the idea is to come up with those things that would make the user experience so much better. Those things that make people happy.

I love the idea and, I will think hard of the things for a Wikidata paper cuts. I wonder if external tools like geneawiki and reasonator will be in scope.. They are really motivating when working on Wikidata.

What would you like to see improved in the Wikidata functionality ???

I am very likely to blog more about the "paper cuts".
Thanks,
       GerardM

Tuesday, August 06, 2013

What to do when #Wikipedia does not provide the information

King Abd al-Rahman of #Morocco was a nephew of the king that preceded him. His father of mother were probably brothers of king Slimane. As long as I do not know exactly how they are related, the genealogy tool made by Magnus will not show all the rulers of the Alaouite dynasty.

Wikipedia does not have this information.
  • I googled
  • I went to the library
  • I asked on Facebook in a SIG with many people from Morocco
So far I do not have my answer. I am really curious what the best way is for finding answers to a question like this one.
Thanks,
        GerardM

Friday, August 02, 2013

#Ramadan 1434

Not that long ago #Wikidata gained the functionality of adding dates as an assertion to an item. It is really nice because it is now possible to indicate when a person was born or died.

At this moment we are in the last week of the month of Ramadan, in the year 1434. When you check a calendar forthis month, you may notice that Ramadan is partly in the month of July and August 2013.

When you are adding assertions to Wikidata relating to Islam or Arabic history, you will find that many sources use the Islamic calendar and not the Gregorian dates. As a consequence you have to convert them to Gregorian before you can enter them into Wikidata.

To solve this Wikidata could accept Islamic dates. It just takes some programming. With a little bit of help from Google you can find PHP code like I did. It will probably provide basic functionality. I cannot tell.

The question is, is there someone who is willing to write the code in Wikidata so that it will provide support for Islamic dates? I am sure there will be all kind of issues to resolve.
Thanks,
       GerardM

Saturday, May 25, 2013

#WMhack - #Wikidata and #Lua to the rescue

When you want to know if all the articles on a specific subject have been written, you need something that actually helps. Wikidata helps because it knows about subjects and knows if there is an article in a language.

The Lua code shown below is "trivially easy" to create ... when you know Wikidata and Lua. For me it is a life saver; it allows me to build a list and use it on any Wikipedia.

It shows the Wikidata label used in the local language and, it shows if there is an article in the local Wikipedia. Really powerful stuff if you need this functionality.



The next challenge is to create the Lua module on every Wikipedia..
Thanks,
      GerardM

Thursday, May 23, 2013

#Wikipedia articles do not always fit #Wikidata needs

At #Wikidata you can add all kinds of nifty attributes to all kinds of subjects. But it can be VERY confusing.

When you read for instance the Wikipedia article about the Umayyad Caliphate, you will find illustrations for two distinct understanding of the word.

There is a map that shows the area that was the Umayyad Caliphate and, you find a map showing the genealogy or the Umayyads. These concepts are related but they are not the same thing. I could argue that all the soldiers, civil servants, the artisans and scientists defined the Umayyad Caliphate as much as the Caliphs themselves did.

The Umayyads are also a family that includes Caliphs, Emirs and many others including spouses, princes and princesses. Some of them lived during the Umayyad Caliphate, others during the Emirate of Cordoba.

In Wikidata the term "Umayyad Caliphate" is now used to indicate that some people are part of a "Noble family". There should be something like "Umayyad family". It is easy to create such an entry.. Should terms like these be the "red links" for new Wikipedia articles ?
Thanks,
       GerardM

Tuesday, May 07, 2013

#Lua template wanted for use of #Wikidata in #Wikipedia

Denny said some magical words to me;

  • you can convert a list of Wikipedia wiki links to links to Wikidata using Lua. 
  • you can check if there is an article on THIS Wikipedia
  • you will show the Wikidata data when there is no article
He even said that it is not hard to do and provided this as a pointer.

I am preparing a Wikidata workshop and I would be REALLY pleased when this list was available doing all the song and dance mentioned above. There are so many other lists that could benefit from this as well. 

I am convinced that such functionality will motivate people to write stubs and articles on subjects that are important to them. I am also convinced that it is a powerful incentive to create data that accomplishes things like this.
Thanks,
     GerardM

Saturday, January 05, 2013

#Wikidata needs #localisation

A lot of hard work has gone in developing Wikidata. It is getting at a stage where the localisation of the "Wikibase - client" extension (only fourteen messages) needs to be done.

Of particular interest is the localisation in Hungarian; they are likely to get the Wikidata functionality implemented as one of the first.

As always, localisation of software is done at translatewiki.net. As always there is more that you can do for your language.
Thanks,
      GerardM

Saturday, May 12, 2012

#Font subsets IV

After installing #Fontforge, I still have to use it for real. The problem I want to solve is to reduce an existing font in size and reduce its use to only one script.

There are many fonts around that include everything and the kitchen sink too. When the only thing that is needed is a specific font for use on a specific webpage, it does not make sense to send the excess bulk as well.

Fontforge as a tool is intended to build fonts. My intention of reducing a font in size is a use case that seems not to be what the tool is there for. I do not know the tool really so I am looking for help. The ultimate goal is to have efficient web fonts for every script.
Thanks,
     GerardM

Tuesday, February 28, 2012

#Zulu is one of the 50 biggest languages

The Zulu language is spoken by many people so much so that it is one of the 50 most spoken languages in the world. You would assume that a Wikipedia in the Zulu language should be a thriving affair. Sadly, this is not the case. A request has been made for the Zulu Wikipedia to be closed.

The argument for closure is compelling: since the start in 2003 only 273 articles have been written and most activity is by bots, vandals and from people cleaning up the mess. A week ago I found someone willing to localise the Babel extension in Zulu but I am afraid that is as much as I can expect.

Good news is that the South African chapter has been registered. They are our local people on the ground. Some of them may speak Zulu and take pity on what is at the moment a failed project. Any subject needs articles any article needs improvement and yes, the localisation of the most used MediaWiki messages would be very welcome.
Thanks,
     GerardM