Sunday, July 30, 2017

#Wikidata - Mrs Helen M. Duncan is not the only geologist

There are many ways of updating Wikidata. Individual statements for individual items are made. They are worthwhile but on the grand scale of things they have little impact. Another approach is to seek sets of data that can be updated all at the same time.

Mrs Duncan is among others relevant to the Smithsonian Institute. The approach of adding loads of data for many people has the advantage that when the same issue like Mrs Duncan not being identified as a geologist, is fixed for many people at the same time.

To do this, I identified a category that implied the missing statement and I used PetScan to add all of the missing data in one go. Together with Mrs Duncan I made 1005 humans a geologist.

These are small numbers, they hardly register. But as it is, there are Wikidata administrators actively preventing edits because Wikipedia cannot cope with the volume of changes in its recent changes. 

There is no plan, no timetable for the underlying problem to be solved. Wikidata people are told not to make mass edits. It is however the only way to make a real difference and make Wikidata halfway usable.

There are two options:
  • improving Wikidata as fast as we can and in the best way possible - as a consequence changes at Wikidata will not all be visible in some Wikipedias
  • allow Wikidata to edit to the extend that Wikipedias can keep up with the volume of changes - as a consequence people will go away and new projects will not start
There is a prima facie case to be made for the edits to be seen in the Wikipedias. Its efficacy has not been studied and some say that the user interface sucks too much to be useful. Arguably keeping these changes is based on beliefs/assumptions and not on established facts. 

We should imho make all the edits we can make and when the Wikipedia recent changes are to be salvaged, give it the highest priority particularly at the Wikipedia end. It sucks that we can not provide all changes to them but hey that's life. 
Thanks,
      GerardM

Wednesday, July 26, 2017

#Wikidata - in #defence of Erika Herzog

On Facebook, Erika made a few comments that were not well received. A few really positive things did come out as a result but there is a need to defend Erika and her central argument. She asked if there had been a process of consulting the English Wikipedia community because the user interface of Wikidata is so poor. She said:
"... But I am pretty sure a lot of En Wikipedia editors are going to be sort of upset about this shift that requires them to actually edit Wikidata without a form input method (on WikiMarkup). Is there a form input on Visual Editor for this?"
On Facebook she is attacked for all the wrong reasons. A Wikimedia functionary asks: "How is this a Wikidata matter? English Wikipedia is where you want to discuss this." Erika's answer is spot on: "Actually no it's not. I'm tired of this response. It's not helpful or realistic. This is a Wikidata item in terms of buy-in and outreach to incorporate more Wikipedia editors. It's disingenuous to posit otherwise. This needs to be a discussion on both sides, and I think the onus is more on the Wikidata side as the usability and UX is poor at best."

One positive outcome of the Facebook thread is that it is mentioned that there is a method under development to edit Wikidata from Wikipedia templates. However welcome, it is going to introduce its own problems because the primacy of the data remains at Wikidata. The user interface of Wikidata is indeed awful. As one of the more prolific Wikidata editors I only use it for editing. For displaying the data I use Reasonator exclusively. Compare this with this for instance and you will see why.

The reason for this are applicable priorities. The WMF has too many concurrent ambitions for Wikidata and the staff is overextended. When the question is if Wikidata is sufficiently user friendly for an average Wikipedian, the answer is no. At this time Wikidata cannot cope with all the changed committed to it as it is, the wise words of Johan Cruyff apply; every disadvantage has its advantage.
Thanks,
      GerardM

Sunday, July 23, 2017

#Wikidata - Franziska Michor and #notability

Because of Facebook I read something about Franziska Michor. What triggered me was that she received an award. Her occupation, biomathematician, does not even exist (yet) on Wikidata.

To understand what a biomathematician does, it is great to watch the TedMED presentation by Mrs Michor. It gets me to the question of notability; I was amazed that Mrs Michor did not have a presence on Wikidata. I do not know if TEDMed is part of the TED project we had and I have no clue how to add this presentation.

The problem with an ever increasing scope of Wikidata, the challenge becomes less one of introducing data but more of maintaining data. This is particularly true when you look at Wikidata from a mathematical point of view. With Mrs Michor there are several datasets that gained notability and can do with some tender loving care: biomathematicians, TEDMed talks and the Vilcek Prize for Creative Promise.
Thanks,
     GerardM

Saturday, July 22, 2017

#Wikidata - Prix de Coincy and Raymond Benoist


The Prix Coincy is an award conferred by the French Botanical Society. The first time it was awarded was in 1904 according to the French article but the first botanist who is known to have received it, got it in 1906. He was Edmond Gustave Camus a red link in the French article but he has articles in several Wikipedias.

Botany is one of those subjects that have appeal; people care about plants, how they are named and consequently many botanists have articles in multiple Wikipedias. This became obvious when all the red links and black links in the article were entered in Wikidata. Like Mr Camus most already existed and just had to be associated with this award.

There are a few items that are not that obvious; Raymond Benoist is one. The French article has it that he received the award but there is no source and at that the only source for the award is the French article. Another issue is with the 1949 award; they are likely three people, one is Louis Quentin, the others Henri and Madeleine Stehlé. Nothing wrong with being bold I suppose..
Thanks,
     GerardM


Sunday, July 16, 2017

#Wikidata Tool - The #Awarder

The Awarder is a tool I use everyday to add people known to have received the award to Wikidata. Its use is straight forward:
  • find a list of award winners, a list that includes the person and the year it was conferred
  • copy the source text into the awarder
  • identify the wiki the data is from
  • identify the award by its Wikidata identifier.
  • open the results in "quick statements" for processing. 
Easy. When done properly the result is as good as the information from the Wikipedia it came from.

There are a few points. Some lists, like the one on the John Wesley Powell award, have the year on a line and the data is implied for the following text. The results is ten people identified. There are a few red links in there for instance for "George M. Hornberger" and Awarder has identified him so that I can click on a button to find him in Wikidata. As I did not, I added him in Wikidata for later processing. Awarder does not identify organisations as award winners so I had to add the identifier for for instance the "California Department of Transportation". John Galetzka is the award winner for 2016. He is a "black link" so I identified him in the tool with brackets and as a result I could add him as well.

For fifteen award winners it is now known that they won the award. Slowly but surely it adds to the relevance of these people in Wikidata and the missing award winners become easier to identify for the implied notability.
Thanks,
       GerardM

PS thank you Magnus for a great tool

Friday, July 14, 2017

#Wikidata VS #Wikipedia - the issue with input, output

I was told that I should not talk about quality because "on the basis of my work I did not give a good example". Basically I was told to stop what I am doing. As I have written a lot about quality and argued how we can achieve greater quality it is not funny nor is it appreciated but the guy has a point.

With 2,304,191 edits there must be a lot that is wrong in what I have done. No matter how careful I am, the percentage of errors that is to be expected means that with 6% there must be at least some 138,252 errors that I introduced. The problem is that depending on your outlook this is acceptable or it is not. When in stead of me 100 people did the same work, the result would have been the same; together they would have introduced around 138,252 errors as well.

I totally agree that we need to bring our errors down. There are three steps where errors have their origin; input, process and output.
  • My input is based on the Wikipedias; their content all have their own issues. They all operate on their own little islands; there is no or little coordinated effort to make the quality of the information we provide a collective ambition.
  • My process is based on identifying what I want to work on; typically awards, often the enrichment of data around one person. For tools I mainly use what Magnus provides; they provide superior usability. Reasonator makes Wikidata statements intelligible, it provides superior disambiguation and automated descriptions. Awarder adds both the year and the person who received an award. It allows me to effectively cover a lot of ground. They are the tools I use most, others like PetScan are also invaluable.
  • There is too much output I generate and consequently I do not care for individual edits. I justify them all for the process, the routines I follow. I added "Claudia Wills" based on the information in the article of the eponymous award. Like other notable birdwatchers, Mrs Wills does not have her own article and I added her to complement the information on the award.
We share in the sum of knowledge and when the quality of what we provide is to improve, our movement has to become dedicated to the quality of all our information. The typical Wikipedian does mostly care about his or her own project and that is fine; we do not need all of them in an effort to improve our overall quality. The effort I propose can be hidden from view.

A Wikipedia article contains many links; they are blue, red or black. All the blue links are implicitly linked to Wikidata items. Many issues become evident when they can be compared with the links in articles in other Wikipedias or Wikidata. Some Wikis have additional links and they can be mapped to red links and black links. This prevents problems when articles are written with the name suggested in this link.

Once articles on a same subject in many Wikipedias are linked, all kinds of additional functionality become easier; one that is close to my heart is when a new award winner becomes known..
Thanks,
      GerardM

Saturday, July 08, 2017

#Wikimedia project - #PlantsAndPeople

#Wikidata is a great to encourage collaboration and reporting for Wiki projects. The results of projects like the Black Lunch Table have been encouraging so for; reports for articles in multiple languages, gender ratios were possible because of the Wikidata link.

A new initiative is PlantsAndPeople. There have been editathons in the past and more are planned. It is about both people and plants so the kind of questions that may be asked will be quite interesting. For instance how many taxons were described by the people in the project and how many people were honoured in taxon names.

At this moment the people who are the subject of editathons are added. This list will grow slowly but surely and only once it is done, it can replace list in Wikipedia. It will take quite some time to get there because it makes sense to add additional data as well. This is the best way to quickly improve the quality of the data involved. So far quite a number of mycologists and ethnobotanists have been added. A question has been raised in Wikidata about people named in taxons and a picture that should be in Commons is waiting for someone else to transfer it.

When you are interested; join in the fun.
Thanks,
      GerardM

Wednesday, July 05, 2017

#Wikipedia - there once was a lady from #Estonia

Once upon a time there was a Wikipedian from Estonia. He decided to write about a fellow countryman, Kersti Kaljulaid. When your Estonian is as good as mine, it is not a name you remember or a person you are likely to have come across.

At the time this was the same for the English Wikipedians; she could not be notable because there were not enough sources in English.. So for all the good reasons the article was in danger. Our Estonian Wikipedian said: "wait a week". A week later Mrs Kaljulaid was the president of Estonia.

I have taken the liberty to add additional data in Wikidata. Mrs Kaljulaid received two awards and others award winners have been added. No sources for them in English either. To be brutally honest, incidents like this prove why English Wikipedia is only a subset of the sum of all knowledge. Because of this insistence on English sources, English Wikipedia can not cover the sum of all knowledge. People who seek reputable information on foreign subjects will not find it.
Thanks,
       GerardM

Sunday, July 02, 2017

Comparing #Wikipedia using blue, red and black links

There are reasons to compare Wikipedia articles on the same subject in multiple languages. When you just want to read, you may find additional information in another language but as you can imagine, the content should be largely the same. Consequently, the links in an article should go to articles that are about the same topic.

One problem with "blue" links is homonymy. You write a subject in the same but they are not the same; John Doe is one example. Finding these issues, issues that are surprisingly common, can be done by a bot using the Wikidata identifiers for the linked articles.

When there is no article to link to, there is no implicit link to Wikidata. There are two options; we can fake a link by accepting the red or a "black" link as synonymous or we can link a red or a "black" link to Wikidata. The latter is precise and has additional benefits.

When all links are associated with Wikidata items, it is obvious what links in what language are missing or are additional. They are of interest because they may imply potential information to be added to articles or they may point to errors even vandalism. Another benefit is that it helps establish a baseline for a NPOV or neutral point of view without a need to understand the language.
Thanks,
      GerardM

Saturday, July 01, 2017

#Wikipedia - Blue, red and black links

Lists in Wikipedia, like this list of award winners of the Tony Kent Strix award on the right exist as blue, red and "black" links. At the moment only an article in English exists about the award and based on past experiences it is likely that other award winners are known in other Wikipedias.

Based on the information in the article, it was easy enough to add the missing information in Wikidata for all the "black links". When you now compare the information in Wikidata with the Wikipedia article, it is feasible to link fixed text to a Wikidata item. This makes it feasible to trigger a warning once a blue link is possible based on new  Wikidata information. In this way a link to Jack Mills is already likely.

When we can compare the information in an article with data in Wikidata, there is an additional way to compare the information and prevent errors and vandalism. Wikidata is after all superior in its use as a tool for disambiguation.
Thanks,
     GerardM


Friday, June 30, 2017

#Wikidata - Rina Spigt en een prijs van de #VARA

Two years ago I blogged about the J.B. Broekszprize and the VARA. It mentioned a Mr Hof and the fact that it is assumed that this Mr Hof received the award in 1995.

Mrs Spigt was awarded the prize for a radio series about Mary Zeldenrust-Noordanus according to the Dutch Wikipedia article. She is the only one for whom it was not known in what year she received the award.

The best way of finding out? I asked her. Mr Spigt is on Facebook. It is an effective way of digging up some facts.

I always illustrate a blogpost so I googled for images and found this image of Mrs Spigt with her father. Another fact established. I did ask Mrs Spigt if she wanted additional information in Wikidata. A picture is welcome for instance. When you do ask, you may get confirmation about facts. Maybe not sourced in the Wikipedia way but nevertheless correct.
Thanks,
      GerardM

Thursday, June 29, 2017

#Wikimedia - Funding #Wikieducation is problematic

How can you not love WikiEducation.. It has a great reputation bringing the editing of Wikipedia to curricula. When you check out their Twitter account, their blog, their results they do an awesome job.

You can once you realise it is instrumental in maintaining the existing bias that favours English and English Wikipedia. Realistically you cannot even blame them for it because they define their operations as limited to the USA and Canada.

Still there are problems.
* People assume that the example of using university students to write articles is to be followed. For most of the Wikipedias there is too little content. The type of articles is not what is needed, more basic articles are needed.
* The Wikimedia Foundation has a huge bias for the English Wikipedia and consequently the 70% of the word population who do not speak English are underserved and less than 50% of the traffic of the WMF is English Wikipedia.

The solution is not to defund Wiki Education. A solution will only come once the WMF acknowledges that they have a diversity problem, a problem they do not acknowledge.
Thanks,
      GerardM

PS Does Wiki Education support French?

Saturday, June 24, 2017

#Wikipedia - Sister projects in search results

The Wikipedia Signpost informs that the discovery team extended the results for search on Wikipedia. New is that English Wikipedia now includes results from
Wikisource, Wiktionary, Wikiquote and  Wikivoyage and that is indeed welcome news.

There is one puzzling part in the information; "Wikidata and Wikispecies are not within the scope of this feature." It is puzzling because including Wikidata search results is where search has been augmented for years in many Wikipedias including the English Wikipedia by the people who added this little bit of magic Magnus provided.

As you can see in the screenshot of the search for Wilbur R. Leopold, an award was conferred on him and the origin of this factoid is the article on the award. Thanks to Wikidata, information is available for Mr Leopold. There are so many references in Wikidata that have no article in a Wikipedia or any other project that from a search perspective it is probably the next frontier.

When wiki links, red links and even black links can be associated with Wikidata items, it becomes even easier to add precision to the search results. Adding these links is the low hanging fruit to improved quality in Wikimedia projects anyway. 
Thanks,
     GerardM


Sunday, June 18, 2017

#Wikidata - John P. A. Ioannidis and his awards

I am a self confessed award junkie. They are imho important because they are an indication of who is notable and who is less so.

Three awards are associated with professor Ionannidis in Wikidata. One award was also conferred on Hans Rosling and this gives me added confidence in Mr Ionannidis and other recipients of the Chanchlani Global Health Research Award.

Professor Ionannidis throws cold water on much of the practice of scientific practice and consequently on its practitioners. One of his papers has the title: Why most published research findings are false and it is inherently a challenge as well to what we write in the Wikipedias and Wikidata.

At Wikidata a wholesale import is happening of papers, science facts and its authors. This is a great idea, particularly when papers that dismiss much of the nonsense papers gets a prominent place. The result will be that the Neutral Point Of View gets an other twist; it balances what we include with actual science.
Thanks,
     GerardM

Saturday, June 17, 2017

#Wikidata vs #GeoNames - the first to throw a stone

Wikidata has some vocal people vilifying GeoNames. They insist that no data from GeoNames is included in Wikidata because "the quality is so bad". In my last post I wrote down assertions about Wikidata. One of them is that "Never mind how "bad" an external data source is, when they are willing to cooperate on the identification and curation of mutual differences, they are worthy of collaboration".

I wrote an email to Markc Wick, the founder of GeoNames and with his permission I can publish our mail exchange.

Hoi,The import of data from GeonNames into Wikipedia has been controversial. People say that the quality of the GeoNames data is not "good enough". It resulted in the deletion of thousands of articles from the Swedish Wikipedia. I am not Swedish, I did not follow their discussions but the problem is it sours collaboration with other parties because "their data might not be 100%".
This happened in the past, I care for the future. In Wikidata we do link to GeoNames (example Almere [1]).
There are several ways in which we can help each other and potentially even benefit from a collaboration. Wikidata is licensed with a CC-0 license and therefore GeoNames can have all our data and do with it as they please.
My initial proposal is for a comparison of the shared data. The data where GeoNames differs from Wikidata is potentially problematic. Concentrating on these differences together will improve both our and your data.
Would you be interested?
Thanks,
       GerardM
       Gerard Meijssen
His answer is everything I could hope for:
Hi Gerard
Thanks a lot for your email. A couple of weeks ago I have started to parse the wikidata extract and look for the matching attributes. Unfortunately I got interrupted and have not yet looked at the result of the parsing. I will continue as soon as I find the time.
The goal is to add the wikidata identifier to the alternatenames table with pseudos language code 'wkdt'. What I have noted so far is that sometimes the geonameids in wikidata go the wrong concept. For instance going to the city feature when the article is speaking about the administrative division or vice versa. This is one of the things I would like to check before adding the wikidataid as alternatename. GeoNames also has links to wikipedia.
I don't think wikipedia should import all geonames features, not all of them are relevant enough to justify a wikipedia article.
Best Regards 
Not only is there an interest to collaborate; Marc is checking the links in Wikidata referring to GeoNames and as can be expected he finds issues. As I asserted, this is to be expected and collaboration is the only way forward for optimal results.
Thanks,
      GerardM

Tuesday, June 13, 2017

#Wikidata some assertions

Wikidata is no different from any community, there are differences of opinion. Everybody has his or her own perspective but there are assertions that can be made that have a more universal resonance. 

The assertions below represent the underlying arguments I use in my blog posts and in the discussions I take part of. They are the ones I feel are not necessarily "political" or have a negative impact.
Thanks,
       GerardM
  1. There is no data store without problems, this includes Wikipedia and Wikidata.
  2. The data we hold is best understood by applying set theory. The data in Wikidata consists of many subsets; probably the most valuable subset for the WMF are the interwiki links.
  3. The error rate in each subset can be assessed and is by definition different from the overall Wikidata error rate
  4. The absence of data often indicates a bias in the data Wikidata holds. A good example is the lack of data relevant to the global south.
  5. Given the huge influx of data from Wikipedia, the biggest imports have been from English Wikipedia and it is one reason for the existing biases in Wikidata.
  6. An absence of data prevents the application of tools. Tools may suggest writing a Wikipedia article, tools may compare data with other sources.
  7. Concentrating on the differences between Wikidata and any other data source is the most optimal way of improving the quality of existing data in either data set.
  8. Having an application for the data in Wikidata is the best way for improving the usefulness for a subset of data.
  9. Each contributor to Wikidata works on the data set(s) of his/her own choice, these data sets interact in the whole of Wikidata. This may raise issues and this can not always be avoided.
  10. Examples of problematic data must be seen in the light of the total of the data set they are part of. Statistically they may be irrelevant.
  11. Never mind how "bad" an external data source is, when they are willing to cooperate on the identification and curation of mutual differences, they are worthy of collaboration
  12. Wikidata improves continually and as such it is "purrfect" but it will never be perfect.

Monday, June 12, 2017

#Causegraph, an other way of looking at #Wikidata


Causegraph is a tool to visualize and analyze cause/influence relationships using Wikidata. If you have not seen it yet, give it a spin.

Randomly looking at the galaxy of relations, I found a Charles Frédéric Bassenge, he is in Wikidata because he is the father of Pauline Runge. He is in Wikidata because she has an entry in WikiTree. What amazes me most is the quality of the data for the father and his absence in WikiTree. 

Causegraph works on the basis of there being a direct relation between two persons. For Jacob Palis, the doctoral students and doctoral advisers are included and not the other TWAS award winners.

What is really good is that it is regularly updated. It would be even better when it was a Labs tool. This might enable real time updates .. <grin> there is always a wish for more and better </grin>
Thanks,
       GerardM

Sunday, June 11, 2017

How #Wikipedia gets into @Africa


This is a map showing how fiber is getting into Africa. The blind spots is where the Internet does not go. The red lines is where the future for the Wikimedia lies.
Thanks,
        GerardM

#Wikidata - Premio Almirante Álvaro Alberto

The Premio Almirante Álvaro Alberto is named after admiral Álvaro Alberto da Mota e Silva. They are both notable for their own reasons.

The award was mentioned in an article on the German Wikipedia for César Camacho. The award was not known to Wikidata and was added. The website of the conferring organisation gives me the impression that it is the "National Council for Scientific and Technological Development" and part of the Brazilian ministry of sciences. When you look for it in Wikidata, it is embarrassing.

The admiral is probably a child of his time. He was military and also a very relevant scientist. As a military man he held the rank of vice admiral and as a scientist he was twice the president of the academy of scientists. He was also very much involved in the Brazilian nuclear program.

When you consider the notability of Brazil, it is astounding how little is known in Wikidata. Many politicians have been added for Brazil; national senators and deputies. 

Brazil is one of the top twenty countries in the world I think, when you consider any and all of the "lesser" countries it is obvious that we know even less. When Wikipedia and by inference Wikidata is about the sum of all knowledge, there is a lot of white space where all our tools have no impact.
Thanks,
     GerardM

Saturday, June 10, 2017

#Wikidata - #diversity of #science - Professor Govind Swarup

Professor Swarup received the TWAS prize. The TWAS Prize is an annual award instituted in 1985 by The World Academy of Sciences to recognise excellence in scientific research in the global South. It follows that when attention is given to scientists like Mr Swarup, it should be easy to link to other scientists, particularly those from the global south.

With twenty two awards Mr Swarup does not disappoint. Many of the awards are from India; one of the conferring organisations, the Indian Science Congress Association, lists 41 awards. Its rule that a scientist can now receive only one award in his lifetime indicates how many scientists are recognised by the ISCA.

Making the TWAS prize winners more complete by adding the awards helps to improve the diversity of scientists. It is not only women who have not been fully recognised it is also the scientists from the global south.
Thanks,
      GerardM