Showing posts with label Wikibase. Show all posts
Showing posts with label Wikibase. Show all posts

Saturday, September 27, 2025

Moving forward with Amir's "Internal Links in #Wikipedia" presentation

At Wikimania 2019, my friend Amir presented "Internal Links in Wikipedia". It provides a wonderful expose of what is problematic with the existing functionality with blue and red links in all our Wikipedias. At the end of 2024, technically things have moved forward, this blog post's intention is to provide arguments what a local Wikibase for wiki links will bring to both editors and readers and why it does not need to be controversial. By definition, changes made to Wikipedia are controversial. 

Functionally, every link red or blue should remain exactly as is. Technically, every blue link refers to one article and every article SHOULD have an item at Wikidata. Every link, blue or red, may be referred to from many places and SHOULD be about only one concept. For every destination there MAY be a link to an item at Wikidata. At this time we have no way of knowing if there is only one concept and if there is an item at Wikidata for that concept.

Many years ago Wikidata solved a similar problem. Wikidata was an instant success because it replaced the interwiki functionality. The solution proposed today is similar and only possible now that Wikidata can be "federated" with many instances of a Wikibase. 

All destinations for both red and blue links will be known in a local Wikibase federated with Wikidata. Any destination may be linked to a Wikidata item but the name of the local article/destination will remain unique. Thanks to this federation, disambiguation support may be provided based on what is known both locally and globally when a new link is created. It will know about the synonymy for each subject.

This change does not need to be controversial because like with the interwiki links, people can opt out of this new functionality. When only a subset of the editor community becomes involved, the quality of all links will improve quickly. With the interwiki links fixed, Wikidata was ready to become a knowledge base. As the wiki links in the local Wikibases get in shape, the Wikidata knowledge base may be used to signal that articles should be in specific categories, or that red links could be added in summation articles like in articles about an award.

Our dependence on Wikipedia editors will remain key but tools like the Wikidata knowledge base are available to bring us the data that enables us with information that is up to date and improves the connections between all our articles. Manually checking wiki links is a Sisyphean task, with tooling it becomes manageable and worthwhile.

Thanks,

      GerardM

Thursday, November 14, 2024

Red pill and blue pill - Wikipedia is it a binary choice?

As far as the English Wikipedia is concerned, there is no red nor a blue link for the 2024 awardees of the Brewster medal. Its information ends in 2021. The German Wikipedia is up to date. There are no articles for RenĂ©e A. Duckworth and for Juan C. Reboreda on both Wikipedias, the German has two red links.

When you maintain information like this, there are three options. You can include an awardee in text or as a link and as luck will have it the link will turn red or blue. This is complicated because a link may have homonyms. With a red link you will only know an homonym issue once an article is created, with a blue link you may know immediately.

The Wikimedia Foundation solved a similar problem a long time ago for another type of link, the "interwiki link".  The solution is Wikidata. It works because there is only one identifier for every topic and every article needs a link to a Wikidata item to have a more global relevance.

Thanks to the ongoing development of Wikidata, there is the Wikibase. We should do a similar job for the red and blue links. It will do away with the false friends problems in Wikipedia. It will improve quality for each Wikipedia and it will improve the quality of Wikidata. Any data related updates that are not strictly local will remain at Wikidata because that helps us in the sharing of the sum of all knowledge.

When a new a link is to be added in any of the 333+ Wikipedias, it starts with disambiguation.. Is the subject already known in any of the other Wikipedias? If not a new Wikidata item will be created and extend options in any future disambiguation. If it is, available information and references are available from the start and consequently a Scholia, a Reasonator or any other generated view of the information may become available dependent on the policies of a Wikipedia.

Implementing such a Wikibase is not really problematic because all the blue links still refer through the local Wikipedia article to Wikidata. The red links are the more tricky bit. They are opened up once they are linked to a Wikidata item. 

With such a Wikibase in place, we can start doing the smart things. The Brewster medal, Q612041, could have a red or blue link to all the awardees. When they don't the article is to be reported for maintenance..

Cool?

     GerardM

Sunday, October 27, 2024

The fallibility of notability

When Wikidata will be split up in a "science" part and "all the rest", scientists who have a Wikipedia article will need to be part of the "rest" as well. This is necessary as all Wikipedia articles have a link to Wikidata because of the "interwiki" mechanism.

It follows that there will be an over abundance of USA scientists and there will  hardly be any scientists of Africa or South America. 

Some data about scientists is likely to be considered to be part of "all the rest" awards for instance. Are these scientists who received an award to be known in two data sets? Some scientists had a career as an athlete.. an other reason for duplication. It is hard enough to maintain the interwiki links and existing duplication within Wikidata, it will become exponentially more difficult when another data set is added.

When the creation of Wikimedia Commons was considered, similar good reasons led to hesitation and prevented us to bite the bullet for quite some time. Commons started with the creation of a Wiki, a MediaWiki patch that showed a picture in a Wikipedia and it then took a long time for most of the duplicate pictures to be only in Commons. It was not technically perfect but it was done perfect in the wiki way.

I hope that we will bite the bullet this time as well. With a new unrestricted wikibase, the old batch jobs can be dusted off and make good for the years of academic data we missed. I pray that Scholia will become functional soon after. 

I will still be able to do my Wikidata thing.. projects like African politicians, Muslim countries and their rulers (past and present).. Awards that can do with an update obviously including science awards.. I will not be bored but maybe I will be working .. maybe not.

Thanks,

       GerardM

Monday, March 04, 2024

A Red&Blue Wikibase disambiguation on the English Wikipedia

Mark Edward Hay is an American marine ecologist. There is a Wikipedia article about him in two languages and there is an article in Wikispecies. Consequently there is an item in Wikidata.

In a template it says: "[[Lowell Thomas Award]] (2015)". The link it a redirect to [[Lowell Thomas]] the man the award is named after. This is accepted practice in Wikipedia and it is not a problem. The redirect page has 23 links to articles mostly of people who received the same award.

With a Red&Blue Wikibase for the English Wikipedia, it will be possible to associate a relation with the award. This could fit in a template and additional red links can be added based on the source. 

When a Wikipedia adds new links, it is done by typing in the name of an potential article. Given that people who received an award are notable, consequently new blue links are highly likely to occur. New red links are entered in a template so there is this implied relation. 

At Wikidata an item for the Lowell Thomas award was recently added because of Mr Hay. It currently only refers to one recipient; Mr Hay. The 23 relations known at the en:red&blue are more than welcome to be added to Wikidata. Red links are more tricky as Wikidata is a superset of data of all the Wikipedias  articles of all Wikipedia and then some. 

So when Wikidata already knows about a recipient, it can make a red Wikibase link blue. When any Wikipedia adds the Lowell Thomas Award as a link, all the information can be populated from Wikidata making it much easier to have sanity checks indicating where data may be right or wrong..

  • Hidden data in redirection articles are given an additional use
  • Data available in multiple Wikipedias is actually shared making knowledge more complete
  • Data only available in one Wikipedia becomes more generally available
So what is not to like?
Thanks,
      GerardM

Thursday, February 29, 2024

A Red&Blue Wikibase for the red, blue and black wikilinks of each @Wikipedia

Wikipedia uses blue links to maneuver between its articles. When there is no article it is called a "red link". This text based functionality works reasonably well but it has important limitations.

  • article names are constructs that makes them unique
  • disambiguation pages need to be maintained
  • there are false positives linking to the wrong articles

When you know your Wikipedia history well, one of the most effective innovations was to remove the interwiki links from the Wikipedias and replace them with links to Wikidata. Wikidata makes use of identifiers and as a consequence the change of an article name has no effect, this ensures that articles on the same subject remain properly linked.

The Wikidata project uses the Wikibase software and this enables the "federation" of multiple databases. This means that data may exist in multiple databases but it all work together. 

Suppose that you replace both the blue links and the red links in a Wikipedia with identifiers of a separate Wikibase. Almost all blue links will implicitly be linked to a Wikidata item and Wikidata already knows about the relations between blue links it has items for. Consequently a Wikipedia Red&Blue Wikibase will be richly populated from the start.

Every Wikipedia remains autonomous and we keep it that way. But we DO know more at Wikidata because it is a superset of all Wikipedias. So when a Wikipedia knows about an award, so does Wikidata. When Wikidata knows about more recipients, it is suggested to include them as red links. It must be a suggestion because a Wikipedia may have another script, another naming convention for names and this has to be correct before it becomes available as text in the Wikipedia proper. 

When a label is correct for a Wikipedia, it is obvious that there is to be a link to the item AND that the label can be used for that language as well. With 200+ Wikipedias enriching Wikidata in this way, both the multilingual and the multicultural quality & quantity of Wikidata will sky rocket.

  • Wikipedias remain autonomous in their content
  • Wikidata will progress from a technically multi lingual project to a functional multi lingual project
  • Disambiguation will be technically available for all accepted Red&Blue labels
  • Known relations with a reference will be available with a reference to every Wikipedia.

So what is not to like?

Thanks,  GerardM

Sunday, May 29, 2016

#Wikipedia #citations - LibraryBase

The general idea is that if Wikipedia articles are to be believed, citations ensure the quality of the statements made. The quality of the sources is therefore important. When a specific publication has a problem, a problem like reproducibility or a known conflict of interest of the author or the organisation he stands for, it follows that the publication as a source becomes problematic.

The problem with sources in Wikipedia is that like all the rest they are buried in the articles. As sources are typically known in the text through templates, it becomes possible to harvest all this and put it in a database. When things get into a database it becomes possible to analyse the data and find the authors that are problematic, refer back to the articles and remedy the inherent conflict in the article.

Take Mr Ray Hilborn for instance. He is under attack for his conflict of interest by Greenpeace. Consequently his POV needs to be collaborated by independent sources and all his science is suspect. It is wonderful to harvest all the data about sources from all the Wikipedias but there is no point to it when it does not lead to something useful.

There is a lot of money going around to confuse issues and serve specific interests. When sources are available to us all, it becomes possible to mark publications for the quality that they have. When sources are not reproducible, it follows that you can not build arguments on top of those. It then becomes possible to consider basic stuff and no longer confuse a Neutral Point of View with what is patently false.
Thanks,
       GerardM