Showing posts with label tools. Show all posts
Showing posts with label tools. Show all posts

Tuesday, April 27, 2021

How to find pictures of a თახვი (it means beaver) or a Wisent? Please help!!

Wikimedia Commons is the biggest repository of freely licensed media files. It serves a global multi lingual community editing Wikipedia and it has the ambition to serve students as well. When you live in Georgia and you don't speak English, you search for a "თახვი" and this picture is all that you find.

There is a tool for that. Hay's sdsearch does a good job when its interface is localised. Sadly, no such luck for Georgian. Wikimedia produced a tool as well; Special:MediaSearch does a good job. You have to know that the tool exists and when you do, you find that for Dutch it does not work at all. 

It is suggested that you can change the preferences for best result. I fail at getting the results that Special:MediaSearch used to provide. There is no documentation.. Please Help!!

Thanks, GerardM

Monday, September 14, 2020

A new tool implies changes for me .

A list like this is wonderful and it has always been a list where I either only import existing office holders or attempt to "do them all".  Typically I did the first few, making a point to include the incumbent. 

I added this template {{PositionHolderHistory|id=Q**}} to all the items for an office in my African politicians project.  You find the template on the talk page and like the Listeria lists, they show past and present office holders.

I still prefer my method of including the "red links" in Wikidata but it is a wiki and there is so much more to do.. What I started to do with office holders from Togo is that for those I will not link to predecessors and successors, I will at least show the dates they were in office. 

It looks much better in Listeria too. 

Thanks, GerardM

Sunday, February 10, 2019

#Wikidata - A quick and dirty "HowTo" to improve exposure of a subject in Wikidata

When you want to expose a particular subject, any subject, in Wikidata. This is the quick and dirty way to expose much of what there is to know. There are a few caveats. The first is that the aim is not to be complete, the second that it is biased towards scientists who are open about their work at ORCiD.

You start with a paper, a scientist. They have an DOI / ORCiD identifier and, they may already be in Wikidata. First there is the discovery process of the available literature and the authors involved. The SourceMD tool is key; with a SPARQL query or with a QID per line, you run a process that will update publications by adding missing authors or it will add missing publications and missing authors to known publications.

When you treat this as an iterative process, more authors and publications become known. When you run the same process for (new) co-authors, more publications and authors become known that are relevant to your subject.

To review your progress, you use Scholia. it has multiple modes that help you gain an understanding of authors, papers, subjects, publications, institutions.. You will see the details evolve. NB mind the lag Wikidata takes to update its database. It is not instant gratification.

A few observations, your aim may be to be "complete" but publications are added all the time and the same is true for scientists. People increasingly turn to ORCiD for a persistent identifier for their work. The real science is in designating a subject to a paper. Arguably the subject may be in the name of the article but as an approach it is a bit coarse. I leave that to you as your involvement makes you a subject "specialist".
Thanks,
       GerardM

Thursday, November 15, 2018

Bringing more #science to @Wikidata

Slowly but surely more scientific papers and their authors find their way into Wikidata. Particularly when scientists have staked their claims in ORCiD, adding is easy and obvious.

It is easy because in ORCiD every author, paper, organisation et al have their own unique identifiers. So when you add a paper, all authors who claimed to be author are already linked.

Earlier today, I added papers and co-authors for Jaume Piera. As a consequence Laura Recasens was added today and as you can see in the illustration of her co-authors, several new authors popped up as a consequence.

To do this I use a combination of tools. Reasonator is my preferred tool to display data; for scientists it tells me if he or she is known to be an author. When there are, Scholia presents the scholarly author information. Of particular relevance to me is the co-author presentation. For co-authors shown in white, no gender is given in Wikidata and when the name is an initial and a surname, I will look up the ORCiD information to find a full name. Typically that is how people are known in ORCiD.

I use the SourceMD tool for two purposes; "creating and amending papers for authors" and to "add metadata from ORCiD authors to Wikidata". It is processed in a batch job, I run one job for up to 15 authors at a time and it takes forever to run.

Other people run other jobs, a particular hat tip to Daniel Mietchen who makes sure that recent publications find their way into Wikidata and finds many other reasons to improve on what we have. All this would not be possible without the many tools by Magnus and for Scholia I do thank Finn Årup Nielsen thanks to this evolving presentation, science as a process comes alive.

There is more to do; the Wikipedia citation are in a separate database and much of its data may be found in Wikidata.. Who will merge them. Publications do cite other publications, it is a field I am not really interested in.. They are added so there must be a tool.

When you are interested in a particular scientist, a particular paper.. Just use the tools and slowly but surely we all make Wikidata a great tool to represent science fact.
Thanks,
      GerardM

Friday, October 19, 2018

#Wikidata - the missing #Elsevier papers

It started with a Twitter tweet.. "There is also a professor Elsevier". A search found that Professor Cornelis J. Elsevier works at the "Universiteit of Amsterdam". He did not exist at Wikidata and there was only one paper to be found for him.

Adding this one paper was done with the "Resolve Authors" tool. The Scholia tool for Mr Elsevier showed a few co-authors and in addition to this several "missing co-authors" could be found.

In order to show more papers for Mr Elsevier, more papers needed to be imported into Wikidata. This can be done for authors with an ORCiD identifier, particularly the ones with no known gender. So far they did not get much TLC. Just running the "SourceMD tool" for them will add additional papers and associate other authors to these papers as well.

This is an iterative process and I focused for no particular reason on Mrs Barbara Milani. Processing her co-authors meant that more co-authors came out of the woodwork. At this time, 13 new authors with an ORCiD identifier popped up. Once they are processed more papers will be known to Wikidata and given their relation to Mrs Milani a reasonable chance that these papers link to Mr Elsevier as well.

At this time Mr Elsevier is known to have 7 publications.
Thanks,
        GerardM

Sunday, November 19, 2017

#Wikidata vs #Wikipedia - Rukmini Maria Callimachi

Mrs Callimachi did not only win the Polk Award, she is both a journalist and a poet and did not only win journalism awards. One of the awards, the Michael Kelly Award is hidden on the Wikipedia article of Michael Kelly. 

This article is about how Wikidata and English Wikipedia can help each other. The Wikipedia article lists seven awards and this makes it easy to add other award winners for them as well.

Thanks to Magnus' awarder, this is fairly easy but some awards hide out as part of an article and the award has to be added in Wikidata.  It may be one reason why later awards are missing. The religious award she is said to have won, it is a different award with a similar name. The award and the organisation that confers it had to be created.

The point, we can compare data at a Wikipedia with what we have on Wikidata. They should match. When they do not, there is an issue. Copying the data from Wikipedia is easy and it is the obvious thing to do. When Wikipedians decry the quality of Wikidata, they should reflect on why this is the case. When we collaborate, we will slowly but surely improve our quality. In the final analysis our aim is the same; share in the sum of all knowledge.
Thanks,
      GerardM

Wednesday, August 16, 2017

#Wikipedia - #BlackLunchTable / Brooklyn Hip Hop

The Black Lunch Table project has an editathon on August 20th. It will focus on on important but underrepresented New York Hip Hop/rap artists.

In preparation they have created entries in Wikidata for artists with and without a Wikipedia article. In this way they can prepare information for the editors to use in their articles.

Magnus created a new tool and it shows who edited Wikidata. As a result we can create a query for the edits for the New York Hip hop event for the month of August.

It shows who has been doing all the work.
Thanks,
      GerardM

Monday, June 12, 2017

#Causegraph, an other way of looking at #Wikidata


Causegraph is a tool to visualize and analyze cause/influence relationships using Wikidata. If you have not seen it yet, give it a spin.

Randomly looking at the galaxy of relations, I found a Charles Frédéric Bassenge, he is in Wikidata because he is the father of Pauline Runge. He is in Wikidata because she has an entry in WikiTree. What amazes me most is the quality of the data for the father and his absence in WikiTree. 

Causegraph works on the basis of there being a direct relation between two persons. For Jacob Palis, the doctoral students and doctoral advisers are included and not the other TWAS award winners.

What is really good is that it is regularly updated. It would be even better when it was a Labs tool. This might enable real time updates .. <grin> there is always a wish for more and better </grin>
Thanks,
       GerardM

Monday, May 22, 2017

#Wikimedia - Presenting #authors in #Scholia

In a fairly rapid pace more and more literature and its authors are included in Wikidata. Many publications are used as sources in a Wikipedia and others get included because scientific "facts" supported by sources find their way in Wikidata as well.

Scholia is a tool that indicates where authors fit in (it does more <grin> but this blog post is only about this </grin>).

When multiple publications are known for an author, it shows the distribution of the publications in time, the number of pages (when known), venue statistics, a co-author graph, the topics, associated images, a topics-works matrix, education, employer/affiliation, academic tree, locations, citation statistics, citations by year and finally citing authors. There are two ways of expressing an opinion, it is exhaustive or it is a bit much. Whatever your choice, a tool like Scholia is awesome. Just the thought that Wikidata already has a relevance that justifies a tool like this.
Thanks,
      GerardM

Monday, May 08, 2017

#Wikipedia - #German #Science #Awards

There are many different awards known on the German Wikipedia. The category for Science awards alone includes some 366 entries.

For whatever reason most of the implied data has not been transferred to Wikidata. It is probably because there are no or few categories for people who received an award. This is where Awarder, yet another tool by Magnus can make a difference.

The Aby Warburg Prize for instance included much information and by running the tool missing recipients were added including the date it was awarded. The Adolf Windaus Medal did not know any recipients and it takes as long to add all of them. When you run on data from both the German and the English Wikipedia, the result is even better as it was for the Berlin-Brandenburg Academy Award.

To complete the information, there is the "conferred by" and the "named after" property to consider as well as looking for people the Wikipedia does not know. You then find the missing links and people known on another Wiki project. It is easy to add new items for the "red links".

The Albrecht-Ludwig-Berblinger-Preis is a redirect. There are no links in the article for the people who were awarded an award. Adding an item for the award is easy adding at least one recipient is easy as well. This is where Awarder does not help.

The Augsburger Wissenschaftspreis für Interkulturelle Studien award information is in two parts. The first part with data until 2007 can be read by the Awarder. The second part includes a more complex table and cannot be read. In the past the Linked Items tool did the job. It did not include all the associated dates but it did produce a list of all the Wikilinks. They could be processed by PetScan.

Adding information like this from the German Wikipedia takes some effort. In this way we improve the global reach of Wikidata. For awards like the August-Lösch-Ehrenring there is the occasionally new information in the sources for the award. At some stage bots will pick up new information added in Wikidata to make suggestions to Wikipedia editors.

As a rule the quality of Wikipedia articles like this is good and it is worth the effort to promote science.
Thanks,
      GerardM

Tuesday, August 23, 2016

#Wikidata - Colorado Women's Hall of Fame

There is a continuous effort underway in #Wikipedia to celebrate notable women. When women are seen as a role model, it is obvious that they deserve attention.

The Colorado Women's Hall of Fame is an organisation that celebrates women and every year 10 more women are included. The article on the organisation includes a list and it includes many red links. So more can be done, not only in Wikipedia but also in Wikidata.

As Wikidata is maturing, SPARQL is now of sufficient quality that many of the tools developed by Magnus are transitioning to SPARQL. This takes time and at the same time some tools are discontinued or do not fully function any more. Linked Items is one such tool. It creates a list of items that are found in a Wikipedia text. It is ideal when a text based file full of wiki links exist. It is just a matter of copying in the links and it will generate a list with Wikidata items for you. It is then needed to restrict the items that are used and it was possible to use WDQ the engine that could when SPARQL for Wikidata was a distant dream. Sadly it does not work anymore.

A solution is taking the list of items and copying to Petscan, the tool Magnus favours. It uses SPARQL and it is something of a Swiss army knife for data. When you are used to earlier tools like Autolist, many of the assumptions are wrong and it takes time to discover how the tool works. It does and that is why there are a large number of women who are known to be on the Colorado women's hall of fame.
Thanks,
      GerardM

Thursday, March 03, 2016

#Wikidata - to share the sum of all data

The BBC featured an article about all the battles of the world in space and time. The cool thing is that the people from Nodegoat used data from Wikidata and DBpedia and consequently the article is not about Wikidata but about what you can do with its data.

Nodegoat enables people to bring data together and visualise it in a way so that people can comprehend it. The BBC article describes the "Geography of Violence map"; it includes data about all known battles ever that include place and time information. Most of the data is from DBpedia and some of it is from Wikidata.

There are two issues to consider;
  • Nodegoat available for everyone 
  • curating data from DBpedia and Wikidata
When Nodegoat is available at Wikimedia Labs, it will enable people to come up with new ideas, presenting data that is otherwise obscure. They will find that much data is missing or wrong and at Wikidata they can improve the data as they see fit. Lab1100 is considering what license for Nodegoat and when we would make Nodegoat available at Labs, it would give them a firm push towards a free license.

DBpedia is a real strong project; it has gleaned a lot of data from Wikipedia and its quality is high. When there is an error in the data you can only change it in Wikipedia and wait for DBpedia to update. With Wikidata you can update the data itself. The data that is included was largely retrieved with similar routines used by DBpedia so it actually makes sense to collaborate with DBpedia and have them update Wikidata as well.

When the sum of all data is available to all and when many tools are available to leverage the data, more people will have incentives to improve the underlying data. Sharing the sum of all data and providing tools that make a difference is the best way to fulfill our mission.
Thanks,
        GerardM

Sunday, October 25, 2015

#Wikidata - #Blazegraph does it matter?

In an argument that is hardly of relevance for all of us, issues about Wikidata centre around a tool called blazegraph. The tool is server based and as we do not all have a spare server to run a tool like this what does it take to make this relevant?

When issues with a tool have an impact on Wikidata, it is hardly a problem for the rest of us. When people make points like this they are in "insularly thinking mode", it is self centred on them and their ivory tower peers.

This mode of thinking can also be found in their tools that puts them in places where mere mortals do not venture. When asked, Wikimedia Labs is maybe for later. At issue is that integration of such tools for the rest of us is not considered. Labs is exactly there to have all the tools and share result and integrate for better results.

When tools like Blazegraph are only available in proprietary settings, arguments about this kind of proprietary use should be irrelevant. This does not need to be. All it takes is the installation of Blazegraph in a Wikimedia Labs setting for the "rest" of us.
Thanks,
      GerardM



Monday, September 28, 2015

#Wikidata - ten questions about #Kian

The quality and quantity of Wikidata relies heavily on technology. When the people who develop their tools collaborate, the results increase exponentially. Amir has made his mark in the pywikibot environment and now he spreads his wings with Kian.

I have mentioned Kian before and I am happy that Amir was willing to answer some questions now that has over 82,000 edits.
Enjoy,
      GerardM

What is Kian
Kian right now is a tool that can give probability of having certain statement based on categories but the goal is to become a general AI system to serve Wikidata.
Why did you write Kian
Huge number of items without statement always bothered me and I thought I should write something that can analyse articles and take out some data out of articles.
How is Kian different from other bots
It uses AI to extract data, I have never seen something like this in Wikipedia before. The main advantage of using AI is adaptability. I can now run Kian on languages that I have no idea about them. 
Another advantage of using AI is having probability which can be useful in lots of cases such as generating list of mismatches between Wikipedia and Wikidata that shows possible mistakes in Wikidata or Wikipedia.
Is there a point in using Kian iteratively
With each run of Kian Wikidata becomes better. After a while we would have so much certainty in data that we can assure Wikipedia and other third party users using our data is a good thing
What can Kian do other bots cannot do
First is generating possible mistakes and building a quality assurance workflow. 
Another one is adaptability of adding broad range of statements with high accuracy.
What can Kian do for data from Wikipedias in "other" languages
We can build a system to create these articles in languages such as English since using Kian now we have data about those articles.
Let me give you an example: Maybe there is an article in Hindi Wikipedia, we can't read this article but Kian can extract several statements out of that article. Then using resonator or other tools we can write articles in English Wikipedia or other languages.
What question did I fail to ask
Plans about Kian. What I'm doing to make Kian better. Hopefully we would have a suggesting tool using Kian very soon.
What does it take for me to use Kian
We have a instruction in github you only need an account in Wikimedia Labs
Does Kian use other tools
Yes, right now it uses autolist which makes it up-to-date.
What is your favourite tool that is not a bot
Autolist, Wikidata can't go on without this tool.

Sunday, September 06, 2015

#Wikidata - #StrepHit, the package damaged the message

When a good idea is posted, the message of the announcement can completely blow it away.

First the good news. StrepHit has the potential of becoming a valuable tool for new content for Wikidata. It is all about Natural Language Processing and consequently it is all about harvesting facts from text. The idea is to harvest structured facts and provide references for statements and harvest references for existing statements. This is really welcome, it may prove to be important.

For the bad news, the plan is based on a number of awful assumptions that prevent it from being taken seriously at first glance.

The best thing the authors can do is appreciate that what they are building is a tool. A tool that analyses text, a tool that can be trained to do a good job. A tool that can be integrated with other tools. A tool that is not defined by particular use cases or assumptions.


When it runs in an optimal way, it is much like Kian. It runs and makes changes to Wikidata directly. This week it added 21.426 statements with a very high rate of certainty. Problematic data is identified and lists are created and this is where people are invited to make a difference.


Kian works in the Wiki way, it does its thing and it invites people to collaborate. It does not assume that people have to do this that or the other. Contrast this with StrepHit where the author suggests that people should not be allowed to add statements without references. If that is not enough, it will not even add data to Wikidata but considers the data it generates a "gift" and condemns its data to the "Primary sources tool". It is a sad place where valuable data lingers that is not finding its way into Wikidata.


StrepHit and tools like it may become valuable. Its value will be in a direct relation to how it integrates in other tools.  When it does it will be great, otherwise it will sit in its corner gathering dust.
Thanks,
      GerardM

Thursday, April 09, 2015

#Wikidata items without a statement


Most problematic in Wikidata are the items without a statement. They may be connected to articles in many projects but the main issue is that it is hard to add statements with confidence when you do not know what they are about.,

I blogged about datathons and one result is a new tool by Magnus that can be of an enormous help; It shows items without statements for a language and they are sorted by the number of sitelinks they hold. There is a link to the Reasonator and it is really useful because it shows some text when you hover over a sitelink.

It is yet another tool that is worthy of attention in Mangus's tour of the Wikidata ecosystem. The example you see above is for Dutch, this one is for Nepali.
Thanks,
       GerardM

Thursday, February 19, 2015

Where people died; a perspective on diversity


A wonderful new view is available thanks to Vizidata. It shows where people were born and were people died. The data is from a Wikidata dump so it is sadly static. Given that it is from Wikidata, you can safely assume that the data also exists in a Wikipedia ...

Italy is well pronounced in this view. It is because a lot of effort went into extracting data from the Italian Wikipedia. It follows that all the people the Italians care for are included as well. The fun thing of a view like this is that it is a historic view of what Wikidata covers and does not cover..

Apparently hardly anyone died in Africa in all the centuries.
Thanks,
      GerardM

Friday, December 12, 2014

#Wikidata - Hans Wallat, conductor

According to the English Wikipedia Mr Wallat was awarded the Musikpreis der Stadt Duisburg. It is a "red link". The German Wikipedia has an article about this award. It lists all the winners of this award.

Using the Linked Items tool, it is trivially easy to add statements for the winners of this award. For all but three; they are red links on the German Wikipedia, it is easy enough to add the items for them.

Arguably they are notable because they complete the list of all the winners for this award. Adding dates is icing on the cake..

On the English Wikipedia it is nice to link to the Reasonator for the award. It links to a Reasonator page for the awardees. It is how we can share in the sum of all available knowledge.
Thanks,
     GerardM

Saturday, November 15, 2014

#Wikidata - Jens Brugge; a judge from Norway

Mr Brugge, a high court judge from Norway died. According to the article about him, his lineage is illustrious. Many generations in the Brugge family were quite notable.  It can be seen in GeneaWiki2 and, it can be shown inline or in a separate window from the Reasonator.

There is an increasing amount of genealogical information available in Wikidata. The value of all this data is not in having it, it is in using it. At this time 29,337 people are known to have a father and 13,336 people are known to have a mother. Obviously, these numbers will only increase and become more complete. Would it not be wonderful to share this information in Wikipedia articles as well?
Thanks,
     GerardM

Tuesday, October 28, 2014

#Wikimedia - Men at work; preparing a #presentation III - #WCN2014

The bane of every live demonstration is when the software just does not work. My intention is to show #Wikidata in action. Demonstrate the Reasonator and AutoList2. When the experience of the last few weeks is anything to go by, I have a 50% chance of a reasonable result on the day.

There are many factors that can play up. Time outs at Wikidata are no exception at the moment and when Wikidata does not play ball, everything downstream from it suffers as a consequence. It means that I may not have a recent list of recent deaths because ToolScript does not function.

AutoList2, relies on WIDaR. It relies on being able to contact Wikidata reliably. Without this, AutoList2 does not run.

The subject of my presentation is firmly solution oriented. I can always fall back on screenshots. That feels like cheating.
Thanks,
      GerardM