Showing posts with label red links. Show all posts
Showing posts with label red links. Show all posts

Thursday, February 29, 2024

A Red&Blue Wikibase for the red, blue and black wikilinks of each @Wikipedia

Wikipedia uses blue links to maneuver between its articles. When there is no article it is called a "red link". This text based functionality works reasonably well but it has important limitations.

  • article names are constructs that makes them unique
  • disambiguation pages need to be maintained
  • there are false positives linking to the wrong articles

When you know your Wikipedia history well, one of the most effective innovations was to remove the interwiki links from the Wikipedias and replace them with links to Wikidata. Wikidata makes use of identifiers and as a consequence the change of an article name has no effect, this ensures that articles on the same subject remain properly linked.

The Wikidata project uses the Wikibase software and this enables the "federation" of multiple databases. This means that data may exist in multiple databases but it all work together. 

Suppose that you replace both the blue links and the red links in a Wikipedia with identifiers of a separate Wikibase. Almost all blue links will implicitly be linked to a Wikidata item and Wikidata already knows about the relations between blue links it has items for. Consequently a Wikipedia Red&Blue Wikibase will be richly populated from the start.

Every Wikipedia remains autonomous and we keep it that way. But we DO know more at Wikidata because it is a superset of all Wikipedias. So when a Wikipedia knows about an award, so does Wikidata. When Wikidata knows about more recipients, it is suggested to include them as red links. It must be a suggestion because a Wikipedia may have another script, another naming convention for names and this has to be correct before it becomes available as text in the Wikipedia proper. 

When a label is correct for a Wikipedia, it is obvious that there is to be a link to the item AND that the label can be used for that language as well. With 200+ Wikipedias enriching Wikidata in this way, both the multilingual and the multicultural quality & quantity of Wikidata will sky rocket.

  • Wikipedias remain autonomous in their content
  • Wikidata will progress from a technically multi lingual project to a functional multi lingual project
  • Disambiguation will be technically available for all accepted Red&Blue labels
  • Known relations with a reference will be available with a reference to every Wikipedia.

So what is not to like?

Thanks,  GerardM

Monday, September 14, 2020

A new tool implies changes for me .

A list like this is wonderful and it has always been a list where I either only import existing office holders or attempt to "do them all".  Typically I did the first few, making a point to include the incumbent. 

I added this template {{PositionHolderHistory|id=Q**}} to all the items for an office in my African politicians project.  You find the template on the talk page and like the Listeria lists, they show past and present office holders.

I still prefer my method of including the "red links" in Wikidata but it is a wiki and there is so much more to do.. What I started to do with office holders from Togo is that for those I will not link to predecessors and successors, I will at least show the dates they were in office. 

It looks much better in Listeria too. 

Thanks, GerardM

Sunday, July 26, 2020

Data in Red - A holistic view on the bias for the English language and for AngloAmerican subjects

First a definition; "When data is biased, we mean that the sample is not representative of the entire population". This approach successfully underpins the Women in Red project currently a percentage of 18.51% women in English Wikipedia has been achieved. Compare the coverage of Anglo-American politicians with the politicians from the whole of Africa, the bias in the data at Wikidata is already obvious, it will then have numbers attached to it.

This is not a problem for Wikidata alone and yes, we can have a project and include a lot of data to get to a growth percentage as we did for the Women in Red. Worthwhile in its own right but in this way we do not forge a closer relation with its "premier brand Wikipedia". It would be mere stamp collecting.

The best argument for having data in Wikidata is that it is used. This is done in self selecting Wikipedias through global info boxes and lists. Interwiki links are used on every Wikipedia. Integrating the necessary functionality is a meta/technical affair and firmly for the Wikimedia Foundation to own. 

The functionality to make this happen implements an existing idea with additional twists.
  • Pictures for the subject are linked to courtesy of Special:MediaSearch
  • Automated descriptions are provided in every language to aid disambiguation. At first the functionality by Magnus is used and it is to be replaced with improved descriptions provided by Abstract Wikipedia
  • A Reasonator like display is provided to inform on the data we have on an item.
  • Suggestions for the inclusion in categories and lists are provided based on Wikidata definitions for categories and lists.
  • To help people find sources, alternate sources, Scholia is included when there are papers about the subject. Once existing citations are available, they are an additional resource
In essence this is a toolset that you can opt into as an individual and/or it is the standard for a project. Particularly for the smaller projects this will prove to be really valuable; it will prevent false friends, it indicates heavily linked items that do not have an article. It stimulates the addition of labels because it is beneficial in finding illustrations. 

This proposal is relatively low tech and it will bring our many communities together by providing widely the information that is available to us.
Thanks,
     GerardM

Thursday, July 23, 2020

What to love in English Wikipedia

This list of commissioners of the Arusha Region is great, it provides the basic information that enables me to include this information in Wikidata. It can be assumed that they are all from Tanzania, politicians and human as well. 

What I love in English Wikipedia are lists like this. It is more than likely that for every Tanzanian region there will be a similar list and as a consequence we can include all these fine politicians to Wikidata, list them in whatever Wikipedia.

As more politicians for Tanzania or any other African country are added, politicians will pop up who have held multiple offices. This will be explicit in Wikidata and in Wikipedia you could use Special:WhatLinksHere.

Technically there is not much stopping us from associating red links with Wikidata items. This is the same guy used in the "WhatLinksHere" and you find him in this list that is a work in progress as well. 

Think this through.. With lists like this in any Wikipedia, these people are findable, linkable. It will be possible to state in text what a given commissioner did and, there will be no ambiguity because of the link. 

So I love English Wikipedia for the rich resource of information it is. I love its editors who provide us with the information that enables the reuse of data. I will rejoice when it is recognised that we can do much more. When we accept that together, as an ecosystem, we are in a position where we actually share the sum of all knowledge that is available to us.
Thanks,
        GerardM

Saturday, June 15, 2019

@Wikipedia - could give a clue to #deleted articles

Even deleted Wikipedia articles have "false friends". In a list of award winners a Mr Markku Laakso used to have an article. This Mr Laakso was actually a conductor and not the diabetes researcher the list was there for. For whatever reason, the article for the conductor was deemed to be not notable and it was deleted.

When you are NOT a Wikipedia admin, there is no way to know what was deleted.

One solution is for all blue, red and black links to refer to Wikidata items. When an article is deleted, the Wikidata item is still there making it easy to prevent cases of mistaken identity like with Mr and Mr Laakso.

A more expanded proposal you may find here.
Thanks,
     GerardM

Sunday, February 17, 2019

@WikiResearch - Nihil de nobis, sine nobis

There is this wonderful notion how Research is going to tell us what to do in light of the strategic Wikimedia 2030 plans. Wonderful. There is going to be this taxonomy of the information we are missing.

Let me be clear. We do need research and the data it is based on, it is to be available to us. There is no point in a future taxonomy of missing knowledge when we have been asking for decades : "what articles are people looking for that they cannot find". If there is to be a taxonomy what else should it be based on?

When we are to fill in the gaps of what Wikipedia covers, we can stimulate more new articles by indicating what traffic they get in the first month. Stimulate our readers to learn more by showing what Wikidata has to offer and show its links to texts in other languages. It may even result in new stubs even articles in "their" language. This technology has been available for years now.

The WikiResearch is full of arguments on the importance of citations and Wikidata as the platform for all Wikipedia sources, why then are the WikiResearch papers not in Wikidata from the start. What is it, that WikiResearchers consider that Wikidata is not about them? Just as it is about any other subject Wikidata covers? What is it that makes their work less findable (FAIR) than what is known to have been published as open content by the NIH?

The point I want to make is that no matter how well intended it is what the WikiResearch aims to achieve, they lose the interest, involvement and commitment of people like me, the people they need to get the results they aim for.

Yes do research, but we should not wait for its results, we know how to stimulate people to write new articles.
Thanks,
      GerardM

Saturday, November 18, 2017

#Wikipedia vs #Wikidata - the George Polk Awards

Some Wikipedians consider Wikidata inferior, so much so that they agitate towards a policy that bans Wikidata in "their" Wikipedia. They are welcome to their opinion.

I do bulk imports from Wikipedia and all the time I suffer the consequences. Some three to four percent of their data is wrong for all kinds of reasons, reasons that are manageable with proper tooling.

The George Polk Award is an award for journalism and it got my attention again because the International Consortium of Investigative Journalists received it for their work on the Panama Papers. I noticed that many people listed who had been awarded the Polk Award did not have articles in Wikipedia, that many of the link in the list of award winners pointed to the wrong person and that many award winners did not even have a "red link".

I am in the process of checking all the links and adding the date for the award. I found many issues among them a civil war general and many others false friends. I am adding items for the people who do not have an English article and, I have to check each of them because several do have articles in other languages. It is a lot of work and it is not as useful as it could be because Wikipedia hates Wikidata and we do not collaborate, we do not work together.

There is a Listeria list of winners and slowly but surely it will contains the information that is similar to the English Wikipedia list article. Similar but not the same;
  • the false friends will not be there, 
  • there will be no red or black links
  • people who won the award twice will be missing
Why do this, why spend so much time on one big list? Well, in this day and age of "fake news" we should celebrate journalism but having all this information in Wikidata allows for all kinds of tools as well. We can check for false friends, we can check if the articles on the award winners include the award but also if there are "winners" who are not known in this list and in the source available for the George Polk winners..

I am not a Wikipedian and truthfully I hate the endless and senseless bickering that is going on. So let me work on the data, make it available to tools. Now you Wikipedians, you may choose not to show Wikidata data in your infoboxes but you will not make your errors go away without collaboration. Yes, you can quote a source but when your data is not in line with what the source states, having a source does not do you good, effectively you provide fake information.

My request to the reasonable people at Wikipedia and Wikidata, let us work together and see how we can improve quality. Lets link wiki links (blue, red and black) to Wikidata and improve the quality of what is on offer first.
Thanks,
       GerardM

Friday, July 14, 2017

#Wikidata VS #Wikipedia - the issue with input, output

I was told that I should not talk about quality because "on the basis of my work I did not give a good example". Basically I was told to stop what I am doing. As I have written a lot about quality and argued how we can achieve greater quality it is not funny nor is it appreciated but the guy has a point.

With 2,304,191 edits there must be a lot that is wrong in what I have done. No matter how careful I am, the percentage of errors that is to be expected means that with 6% there must be at least some 138,252 errors that I introduced. The problem is that depending on your outlook this is acceptable or it is not. When in stead of me 100 people did the same work, the result would have been the same; together they would have introduced around 138,252 errors as well.

I totally agree that we need to bring our errors down. There are three steps where errors have their origin; input, process and output.
  • My input is based on the Wikipedias; their content all have their own issues. They all operate on their own little islands; there is no or little coordinated effort to make the quality of the information we provide a collective ambition.
  • My process is based on identifying what I want to work on; typically awards, often the enrichment of data around one person. For tools I mainly use what Magnus provides; they provide superior usability. Reasonator makes Wikidata statements intelligible, it provides superior disambiguation and automated descriptions. Awarder adds both the year and the person who received an award. It allows me to effectively cover a lot of ground. They are the tools I use most, others like PetScan are also invaluable.
  • There is too much output I generate and consequently I do not care for individual edits. I justify them all for the process, the routines I follow. I added "Claudia Wills" based on the information in the article of the eponymous award. Like other notable birdwatchers, Mrs Wills does not have her own article and I added her to complement the information on the award.
We share in the sum of knowledge and when the quality of what we provide is to improve, our movement has to become dedicated to the quality of all our information. The typical Wikipedian does mostly care about his or her own project and that is fine; we do not need all of them in an effort to improve our overall quality. The effort I propose can be hidden from view.

A Wikipedia article contains many links; they are blue, red or black. All the blue links are implicitly linked to Wikidata items. Many issues become evident when they can be compared with the links in articles in other Wikipedias or Wikidata. Some Wikis have additional links and they can be mapped to red links and black links. This prevents problems when articles are written with the name suggested in this link.

Once articles on a same subject in many Wikipedias are linked, all kinds of additional functionality become easier; one that is close to my heart is when a new award winner becomes known..
Thanks,
      GerardM

Sunday, July 02, 2017

Comparing #Wikipedia using blue, red and black links

There are reasons to compare Wikipedia articles on the same subject in multiple languages. When you just want to read, you may find additional information in another language but as you can imagine, the content should be largely the same. Consequently, the links in an article should go to articles that are about the same topic.

One problem with "blue" links is homonymy. You write a subject in the same but they are not the same; John Doe is one example. Finding these issues, issues that are surprisingly common, can be done by a bot using the Wikidata identifiers for the linked articles.

When there is no article to link to, there is no implicit link to Wikidata. There are two options; we can fake a link by accepting the red or a "black" link as synonymous or we can link a red or a "black" link to Wikidata. The latter is precise and has additional benefits.

When all links are associated with Wikidata items, it is obvious what links in what language are missing or are additional. They are of interest because they may imply potential information to be added to articles or they may point to errors even vandalism. Another benefit is that it helps establish a baseline for a NPOV or neutral point of view without a need to understand the language.
Thanks,
      GerardM

Saturday, July 01, 2017

#Wikipedia - Blue, red and black links

Lists in Wikipedia, like this list of award winners of the Tony Kent Strix award on the right exist as blue, red and "black" links. At the moment only an article in English exists about the award and based on past experiences it is likely that other award winners are known in other Wikipedias.

Based on the information in the article, it was easy enough to add the missing information in Wikidata for all the "black links". When you now compare the information in Wikidata with the Wikipedia article, it is feasible to link fixed text to a Wikidata item. This makes it feasible to trigger a warning once a blue link is possible based on new  Wikidata information. In this way a link to Jack Mills is already likely.

When we can compare the information in an article with data in Wikidata, there is an additional way to compare the information and prevent errors and vandalism. Wikidata is after all superior in its use as a tool for disambiguation.
Thanks,
     GerardM


Saturday, March 18, 2017

#Wikidata - the #Rome Prize

The Rome Prize is given to a high number of Americans artists. It is awarded every year to 15 artists and 15 scholars, they stay for an extended period in Rome. The first awards were given in 1905.

The award winners are mentioned in many articles, when there is no article yet, there is a red link. New articles are written all the time so problems can be anticipated.

The problem is in names; different people bearing the same name. When new articles are written, there is no consideration for these red links. Articles are written. When an article is written for a Rome Prize winner, he or she may be included on the category for Rome Prize winners and that works well.

Some will say that Red Links are bad. They have a point. However it is all in the delivery. When there is no article, it does not follow that there is no information. The information could already be in Wikidata and I added a few statements for 2016 winners..
Thanks,
     GerardM


Saturday, January 21, 2017

#Wikipedia - Support understanding the #gender gap

#Wikidata needs to mature. #Wikipedia needs to mature. They both have wishes they aim to fulfil that escapes them. The gender gap is such an issue and it can be used to illustrate how both will mature when they cooperate.

When you want to know how many articles are expected to be written at a given point you need to analyse the red links. They indicate articles that are likely notable and indicate a structural need in Wikipedia. To do that you need data and you need a tool.

When links exist for every red link to an item in Wikidata, you have both the data and a tool. This will help Wikipedia with its disambiguation, and it will show up what a Wikipedia is missing. It is a tool that may drive people to write articles about the missing links.

All the red links will now link to Wikidata and articles in other Wikipedias. It also allows for people to add statements to Wikidata so that facts about those items are known. For instance that it is about a woman. When statements to awards, professions and events are known, there is added weight to write an article.

In this way two purposes are served; researchers have better tools that help them understand the gender gap and it will help people who care about he gender gap work on reducing that gap.

Technically it is not that complicated to achieve. If there is a problem with this proposal it may be that Wikipedians need to understand that this is not a power grab but a way to improve quality and efficiency of their project.
Thanks,
      GeratdM

Friday, April 08, 2016

#Wikidata - labelling and the ArticlePlaceholder

The ArticlePlaceholder is a Wikimedia extension. It has huge potential to rapidly increase the available information in any and all Wikipedias because Wikidata has more data than any Wikipedia has articles. The big initial issue: How to translate the labels into the language of a Wikipedia.

There are many approaches and the initial one is to concentrate on "red links" first. With "red links" linked to Wikidata items, the ArticlePlaceholder may express the data as information for that Wikipedia. That is one big incentive to write the missing article :). Missing labels associated with properties may be added to localise all the information available on an item

It then becomes interesting; What to do next? There are the categories, the lists associated with articles. It would work, it would rapidly expand the number of items linked through ArticlePlaceholders. It would also rather quickly expand the number of items that seek a translation of their label. These can be found and sorted in order of prevalence.

Another approach would be to add labels as many labels as possible in Wikidata. When this results in terms that can be found, ArticlePlaceholders may be created when they are requested. When we keep track of the requests for ArticlePlaceholders, we can even prioritise the writing of missing articles.

Adding labels can be done in multiple ways; we can use dictionaries, we can transliterate. We can even use bots to do all this automagically for us. The biggest difference will be made when we seek and find collaboration. For most languages there are schools where students need to write papers. Particularly in the smaller projects this may make a huge difference. As they research their topic, they can localise all the missing labels starting from a "Concept cloud" for a subject.

Once this work gets underway, small Wikipedias will rapidly increase the number of subjects that are being served. The big question is not if it will be worthwhile but how it will affect Wikipedia article writing.
Thanks,
       GerardM

Sunday, January 10, 2016

#Wikipedia - a 20% error rate

The one thing that makes Wikipedia strong are its wiki links. When they work they are great.. when they work they are.

The article on the Spearman Medal is a case in point. This medal is conferred by the British Psychological Society to psychologists. There were 19 links and two were wrong. One link was to a soccer and one to a football player. The award is conferred since 1965 so there ought to be quite a number of red links

With two sportsmen attributed to winning the Spearman Medal there was an error rate of 20%. With all the red links it is easy to be more informative using Wikidata. With such statistics it is obvious to make the argument that replacing links with links through Wikidata will enhance quality in the English Wikipedia.

This is unlikely to happen. Wikipedians seem to be more concerned in finding fault elsewhere than considering the quality of their own project. Particularly when "outsiders" point them to the error in their ways. It is psychology in action. 
Thanks,
      GerardM

Monday, January 04, 2016

#Wikipedia - the lowest hanging fruit from #Wikidata

Contrary to what people think, at this time Wikidata could provide the most value particularly to the big Wikipedias by replacing the current red links. Red links are really simple. When an article exists, it will link it and that is exactly where things go wrong; when an article is added for a homonym, you need disambiguation. This is where Wikidata makes a difference.

Wikidata is ready because it includes all the articles of all Wikipedias and thereby its capacity to disambiguate is superior. Moving existing red links to Wikidata items may be automated because articles in other languages may have that link already. New red links in articles are checked for a need for disambiguation and when there is no need, a new Wikidata item is created.

In the Reasonator the concept cloud shows links as used in Wikipedia articles. Typically these links could exist as statements on the item. For Mr Ormel, a Dutch psychiatrist, there is only one article so it is not a complicated example. In the text there is (now) a red link to Mr Frank Verhulst. There is now an item for Mr Verhulst and as people convert red links, the statements on the item may be reflected in a tool like the concept cloud.

Another benefit is that links can be verified by tools like Kian. When a subject is about psychiatry for instance, a link to a person who was a football professional all his life is likely wrong and in need for disambiguation.

Arguably changing the red links in Wikipedia can be easily enhanced using information from Wikidata. It will improve quality in a meaningful and measurable way. Many of the functional parts already exist and it is therefore mainly a task of cobbling things together.
Thanks,
     GerardM


Monday, July 13, 2015

#Wikidata - more great statistics

When you want to know what Wikidata data is about, you find it in the statements "instance of" and "subclass of". The illustration is part of a set of new statistics by Zolo. It concentrates on these instances and statistics and a big surprise is that there are still so many more items without one (32.6%). The statistics by Magnus show that only 19.07% of all items have no statement.

The great thing of the new statistics page is that it shows pie charts for many Wikipedias. English Wikipedia for instance for instance does not know about 1.5 million people Wikidata knows about. When you analyse this, you get into the domain of set theory. These people can already be subdivided in the following way:
  • people only en.wp knows about
  • people en.wp knows about as well as others
  • people en.wp does not know about but another wp does
  • people no Wikipedia knows about
  • items Wikidata does not recognise as people
People and unidentified items are half the pie for Wikidata. In all cases they are pretty well connected to articles in whatever project and provide a perfect opportunity to provide information. I blogged about it before, wikilinks and red links are obvious targets for links to other information not only for people but also for people.

Many people have #Babel information on their user page. They thereby indicate their proficiency in a language. When a Wikipedia does not have an article, why not provide an article in a known language? When there is no article why not provide at least the information that is available? It will help an editor write a new article, it will provide a reader with at least some information.

The point is that we should share in the sum of all available knowledge because we can.
Thanks,
     GerardM



Sunday, December 14, 2014

#Wikipedia - The Time Jumpers


Recently one of the Time Jumpers, Dawn Sears, died. She was married to one of the other band members; Kenny Sears he is the one playing the fiddle to the right.

According to her Wikipedia article, she is indeed married to a Kenny Sears. This is however a redirect to someone else. The husband is known on the Time Jumpers article as Kenny Sears (fiddler), it is a red link.

It is easy enough to add an item for Mr Sears in Wikidata and link him to both the Time Jumpers and to his wife. It would be good when the Wikipedia red link could be linked to Wikidata. When red links are linked to Wikidata, it is possible to relate them to existing items. In this way information is available that can be used as information for a possible article. To bring this article to an editor it just needs to be presented on the red link. That is easy enough.
Thanks,
      GerardM

Monday, March 24, 2014

#Wikipedia MOS:DABRL#Red_links

If the title is immediately clear to you, it may be that you have immersed yourself in Wikipedia lore to an extend that may not be healthy. For the rest of us, it is about the use of red links. Wikipedia policy has a lot of red tape and it is often not clear and obvious. For instance: "A link to a non-existent article (a "red link") should only be included on a disambiguation page when an article (not just disambiguation pages) also includes that red link." The problem here is that a link to a disambiguation page is not a red link.

The "Redwd" template is a game changer when you are considering the whole notion of red links. Technically it is not a red link. It is a template that includes the functionality of a red link. It refers to both Wikidata and to Reasonator and consequently it demonstrates that information exists on a similar level as a "stub". Like a stub, the information can be expanded by adding statements in Wikidata.

The difference between a stub and a Reasonator page on the same subject is, that when statements have been added, new information will show in all Wikipedias that use this functionality. It will show when an item is selected when "expanded Wikidata search" is used.

There is an additional opportunity; disambiguation pages are comparable to the result of a search using the Reasonator. Often Reasonator has more results than what can be found on a disambiguation page. The opportunity exists to add a link to Reasonator from each "disambiguation" page.

Oh and by the way, the policy needs a makeover.
Thanks,
       GerardM

Tuesday, January 21, 2014

#Reasonator is red lining your #data

#Wikipedia has its red links and following this great example, Reasonator has its red lines.

A Wikipedia red link suggests that there is room for another article. Wikidata already knows much about the missing information, to do this it falls back to whatever fall back language is indicated and ultimately it falls back to English. All this to share in the sum of all knowledge.

What is missing is a label. As you may know Reasonator operates in any language. By red lining a label, it is suggested to add a label in the selected language. Once this label has been added to Wikidata, it will be used everywhere where an item is used.

Now consider that we replace Wikipedia red links with the information served up by Reasonator... Don't you think it is a big step up from serving nothing at all?
Thanks,
       GerardM

Thursday, December 19, 2013

#Awards and #Wikidata

When people are awarded for their accomplishments, it is proof positive of their notability. The Breakthrough Prize in Life Sciences is in the news because the awards for 2014 have been announced.

At this time, Wikidata has a complete list of all the award winners. All these people are known to be human, their sex has been defined and obviously they are known to be the winner they are. Obviously there is more to be known about all of them.

There is no category for these award winners yet. The content of such a category could be defined by the result of a query; it might include local red-links but it does include all the winners of this award.
Thanks,
       GerardM