Showing posts with label Open Library. Show all posts
Showing posts with label Open Library. Show all posts

Saturday, July 03, 2021

The promise of things to come that is in @Wikicite

Wikicite is for me the biggest disappointment of all the Wikimedia projects. A disappointment not because it is not worthwhile, not because it did not bring us insights about what happens in English Wikipedia but because all the papers, conferences and data did not result in a transformation into active user stories. Closest comes Scholia where it identifies Wikipedia articles where a scholarly paper is used as a reference. 

Wikicite conferences have come and gone. They brought the best and brightest minds together discussing all kinds of ideas, all kinds of research. Once the papers were presented, the assertions discussed and analysed, when the conference was done they went home. From what I can observe in Wikimedia land, not much has changed.

Wikimedia Foundation has a real good friend in the Internet Archive. It already does much of what Wikicite could do. It archives everything that is used as a reference. When a reference goes dark, it links the reference to the backup. In FatCat it has information on scholarly papers and many of the papers, in Open Library it has information on books and many of the books. Many bots originating from the IA run on many Wikimedia projects. 

When it is up to me, I would have Wikicite as a joint project of the Internet Archive and the Wikimedia Foundation. A joint project will be based on the existing reality that is in the Internet Archive. Wikicite and Wikimedia projects bring it additional data, a public and additional user stories. Funding from the Wikimedia Foundation enables the development that such a synergy brings.

Data for all the citation in English Wikipedia linked to scholarly papers was available. We know in Wikidata, in FatCat, in Orcid, in Scopus how to disambiguate authors. When all this data gets integrated, a user story mentioned in a previous blog post is not fancy and easily becomes best practice. Thanks to collaboration with the Internet Archive there is less duplication of effort and the sum of the shared knowledge we hold is so much bigger; we can provide an even better service to our public. 

Sunday, August 04, 2019

Helping @Wikipedia readers find their read, one author, one publication at a time

Reading is what the public of Wikipedia does and in a way, every Wikipedia is an invitation to further reading. Wikipedia is an encyclopedia and by definition, its coverage of a subject is limited. Its reliability is defined by its sources and they themselves are typically a subset of what may be read about that subject.

The quality of the invitation for further reading differs. How do we invite people to read a Shakespeare in Dutch, German, Malayalam, Kannada even English?

The primary partner in this quest for further reading; the local library. We can put all of them on a map and invite people to go there or to probe its website for further reading. Having them all in Wikidata with their coordinates puts libraries and what they stand for on the map. We can invite them to use services like OpenLibrary or WordCat, the bottom line; people read.

In this people first approach, the user interface is in the language people want to read their book in. It follows that the screen may be sparse. When it is to be a success, it is run like a business. We have statistics on libraries, people seeking, books found and a perspective in time. It is about people reading books not about transliterating books. Our business model: people reading. Funding is by people, organisations who care about more reading by more people. The numbers entice people to volunteer their efforts making more books, publications available in the language they care about.

To make this happen, the WMF takes the lead enabling and maintaining such a system and partnering with any and all organisations that care about this, organisations like the OCLC and the Internet Archive.

We will succeed when we make the effort.
Thanks,
       GerardM

Sunday, September 30, 2018

#WikiCite: Edith Abbott; THE REAL JAIL PROBLEM

According to #Wikipedia, Edith Abbott was a pioneer in the profession of social work with an educational background in economics.She published, books and scholarly articles, and "The Real Jail Problem" was singled out in the article for special mention.

There is a link in the article, and I am happy to report that thanks to the Internet Archive, it and some 500.000 more scholarly articles may be found there. They are part of the early JSTOR papers and they are now freely available. It is however not the publication by Mrs Abbott, it is by a Robert H. Gault.

Having scientific papers available is wonderful. It is important and it is unlikely they will get lost. However, there is a difference between being lost and being findable. Mr Gault is notable, there was no mention of him in Wikidata, one of his publications was.. Mr Gault is findable when you look him up in VIAF.

However, the article you want to read, a pamphlet according to Mr Gault is where? A book with the same subject can be found at Open Library. The subject of the book is as potent as it was in the day. The arguments are not dissimilar.

Arguably, when you want to cite your sources, they first have to be knowable, then findable and finally readable. Wikidata is making more and more of a difference. When we collaborate with the Internet Archive, we can make those JSTOR papers findable as well. Slowly but surely all these sources becomes findable. Its authors become notable and we will free us from the curse of only reading the latest research.
Thanks,
       GerardM

Thursday, December 28, 2017

#Wikidata - Cyrus J. Colter and G. B. Lancaster - #diversity

Cyrus J. Colter was inducted on the Black Literary Hall Of Fame in 1999. He has a Wikipedia article in Japanese and his Wikidata item has been expanded with a link to Open Library and VIAF

According to a tweet, G. B. Lancaster was once one of New Zealand's most popular writers. When you google her, you find that G.B. Lancaster is a pseudonym for Edith Joan Lyttleton. For Mrs Lyttleton there is now a link to Open Library as well.

From a diversity point of view, both Mr Colter and Mrs Lyttleton represent minorities. Giving attention to either increases the diversity of Wikidata. Linking both authors to the Open Library has the most inclusive effect. There is now a bigger public for the books they have written.
Thanks,
      GerardM

Thursday, December 14, 2017

A purposeful #strategy for #Wikidata

A strategy for Wikidata? Obvious, it is all about having a purpose. It is not about policies, it is not about what we need or expect of others but it is about the purpose you, I and others have for us to collaborate on in an inclusive Wiki and data project.

The implication of making the purposes of our community rule supreme are huge. Purpose like so many other things can be measured. When people have a purpose for Wikidata and actually use it, their need for quality is self evident. They will invest their time and effort in fulfilling their purpose. The one question is how to fit in the many purposes that exist for Wikidata.

Take for instance the objective of Lsjbot for a rich Wikipedia in the Cebuano language. He uses data from an external database to create articles. Data from these articles are imported later through the Cebuano Wikipedia in Wikidata. This is seen by some as controversial because of the need to integrate data that often already exists. The purpose is obvious; rich information in the Cebuano language. The solution is obvious as well; let Lsjbot use the data at Wikidata to generate the information for the Cebuano Wikipedia. GeoNames is happy to collaborate with us on this, so when we care to collaborate and welcome its data at the front door, we can mix'n'match the data into Wikidata, curate the data where necessary and share improved quality widely, not only on the ceb.wp.

The Biodiversity Heritage Library Consortium is working extremely hard to expose their work to the general public. Over a million illustration found their way to Flickr. Fae imported many of these to Commons and most if not all the associated publications can be read on the Internet Archive or on its website. Their content is awesome, check for instance their Twitter account. We can import all the BHL books in Wikidata, we are importing all associated authors using Mix'n'Match. The images are in Commons but how is this brought together? How do we add value for the BHL and as important, for our shared public?

The Internet Archive is a Wikimedia partner. It provides essential services for us with its "Wayback machine". It is how we can still refer to references that used to be online. One other venture of the Internet Archive is its Open Library.  What we already do for the Open Library is linking their authors and by inference books to the libraries of the world through VIAF. We could share this information with the Wikipedias so that its readers may find books they can read. (Talk about sharing the sum of all knowledge).

Both the IA and the BHL want people to read. They (also) provide scientific publications that may be read to prove the points Wikipedia authors make in articles. Both can be big players strengthening the value of citations in WikiCite. At this time its strength is particularly in the biomedical field and it is already attracting bright people to Wikidata. As data from other fields finds its way, people like Egon and Siobhan will find their way. This will make Wikidata even more inclusive.

To make this future work, to become more inclusive, we should trust people more particularly when they indicate why they use Wikidata. The Black Lunch Table is a great example. The description at Wikidata says: "visual artists of the African diaspora initiative that includes Wikipedia editathons and outreach". One way of knowing how effective this initiative is is the history page of its listeria list. It shows a steady growth of information added. When you analyse it further you find artists added and selected for new editathons. Truly a great example of Wikidata having a purpose.

A strategy based on purpose, is a strategy based on trust. Not blind trust, but the kind of trust where it is seen that people are committed to improve both quantity, quality and usefulness of the data they identify with.
Thanks,
      GerardM

Tuesday, October 10, 2017

#Wikipedia discovers #OpenLibrary

On Facebook, Dumisani Ndubane posted his discovery of Open Library:
I just discovered that The Internet Archive has a book loan system, which gives me access up to 5 books for 14 days. So I have a library on my laptop!!! This is awesomest!!!
And it is. Anybody can borrow books from the Open Library (is is part of the Internet Archive). What Dumisani did not know at the time is that there are books in other languages to be found as well.

Dumisani found out by accident; he googled for an ebook called "Heart of darkness" by Joseph Conrad. What Dumisani did not know at the time is that the Open Library includes books in many languages. His next challenge: find the books in Xitsonga, and tell his fellow Wikipedians about it.
Thanks,
      GerardM

Saturday, September 02, 2017

#Wikimedia - Where I make a stand / where I stand for

I was told that my priorities are not the shared priorities of our movement; this by a pivotal person in the WMF. I consider this a personal affront and I will spell out what I stand for and where I make a stand. When you want to personally verify the veracity of my commitment; read my blog and check out my involvement. I have blogged for over 10 years and the basics/citations are all there to find. I consider my position very much in line with what our movement is there for.

==Share in the sum of all knowledge==
This is the overarching aim of our movement. At this time we are congratulating ourselves with what we have achieved so far. There is a lot to celebrate particularly for the English reading world.

===Everything but English===
Given that only 40% of the world population can read English, our successes need to be measured for what we do for all the people in the world. I do not care for good intentions, I care for what can be observed. Financially there is no break down available on the amount spend on English versus the amount spend on all the rest. This is imho a diversity issue as potent as the gender gap. All the arguments why "English first" are structurally no different from any other "my group first" arguments. Just compare the amounts given to US American chapters versus the Indian chapter. In addition you may or may not consider the cost of the software that is developed with English Wikipedia in mind.

===Internationalisation and localisation===
I have searched briefly for "internationalisation" in the 2030 strategy papers. Could not find it. It is however the bedrock of Wikipedia. It is vital for any and all of the individual features of MediaWiki.

When you consider Wikimedia partners like the Internet Archive and their Open Library, we do not even consider how much we will to achieve when together we reach out to the other 60% as well. Our internationalisation platform is open to our open source partners and translatewiki.net is in my opinion a strategic resource.

===Partners===
The successes of our GLAM partnerships prove collaboration serves mutual interests. There are plans to improve Commons, a key part is the Wikidatification that will open up Commons, not only in English but also in any and all other languages. Where we could make more of a difference is help where our partners indicate what is relevant to them. We can show them the effect of the cooperation in any language. At this time what we show is limited to images. This is something we should expand on.

====Internet Archive====
The Internet Archive provides a vital service to our Wikipedias. Its Wayback Machine allows us to proof that references that used to be on the Internet existed. Effectively it is an import tool when the aim is to prevent misinformation. Its Open Library has two parts. The part I am interested in is making free e-books available to readers. We would do better when we collaborate just a bit more and help them with their internationalisation and localisation.

====OCLC====
The libraries of this world collaborate in the OCLC and share their links in one system; the Virtual International Authority File. In its WorldCat sytem, the idea is that people can find books in the library near to them. Thanks to the references to local libraries, it is always possible to know if a book, an author is known in whatever country. Important is for us to improve cooperation and the visibility of this collaboration for our readers and editors.

===Bringing things together===
I have helped bring data from Wikidata, OCLC and Open Library together. I am seeking the disambiguation of Open Library content using existing links to the Library of Congress to the VIAF and consequently to Wikidata. I am adding award winners because they provide arguments what articles to write or improve. Currently I am adding Dutch literature awards to show the Dutch National Library that this information exists and can be used. Recently I added botanical awards to show a group of botanists how small tasks like this add relevance.

===Outspoken stuff===
  • I am not a Wikipedian and consequently arguments specific to any Wikipedia are problematic, mostly irresponsible.
  • I care about diversity; issues around the gender gap do get extra attention from me but it is a secondary consideration.
  • I care about usability and use Reasonator and tools like Petscan and Awarder. The necessity to use Reasonator for so many years is proof perfect that usability does not have much of a priority. Having seen previous attempts at usability, I will consider it once it is available.
  • I expect that there will be more use for our data. Quality is key and collaboration on a meta scale is what will make this possible.
  • Wikidata is particularly useful in English. Theoretically other languages may profit from its multilingual nature. Institutional (WMF) interest is needed to improve this use of Wikidata. 
  • While I respect many efforts of the WMF, I find that its concentration on English Wikipedia has a very negative effect on a micro scale. It is not all bad but it is this division of labour and money that prevents us from having the most bang for our buck.
Thanks,
      GerardM

PS I resent that I felt the need to write this blogpost.

Saturday, August 26, 2017

#OpenLibrary - Charles Horn and its other volunteers

There are several reasons why Open Library and Internet Archive deserve attention. They provide downloadable books in many language and their Wayback machine comes to the rescue when links in references in Wikipedia go stale. Have a look at the presentation from Wikimania 2017 (from11:46).

The Internet Archive is officially one of the partners of the Wikimedia Foundation. When you ask who in the Wikimedia Foundation is the goto person for contacts with Internet Archive, there is no answer. It is as if there is no structure in contacts with our partners even when it plays dividends to collaborate in a more structured way. When you consider the "Coleman Boat" it is just as if the macro elements are totally missing and it is left for the micro elements to make the difference.

Macro effects of collaboration with the Open Library would be:
  • references are made to downloadable eBooks from Wikipedia - People read books
  • localisation are made at translatewiki.net - People read books in "other" languages 
  • books at Open Library are in Wikidata - links to eBooks are available
  • identifiers are widely shared and widely curated -  work of volunteers has the biggest impact
At a micro level, collaboration is happening. Charles Horn, a volunteer at Open Library is a stellar example. Charles added identifiers to Wikidata and VIAF in the Open Library database. He provided us with a large file of redirects and was instrumental in removing multiple identifiers to Open Library for authors.  He recently produced a Wikidata query to find duplicates and the Wikidata community was made aware of this maintenance work. 

Many of the macro opportunities become possible when conditions at Open Library are met. One big issue is the need for disambiguation and de-duplication. This is not helped with the massive amounts of data involved and the lack of data on the individual author level. While individuals like Charles have an immense effect, it is in the collaboration on a macro level where even bigger differences can be made. Consider; many books include identifiers like an ISBN or a link to the Library of Congress. So it is possible to leverage a tool developed at the Wikimedia Foundation to retrieve associated meta data or to find associated data at the OCLC.

It takes just a bit of friendly prodding from the macro people at the associated organisations, some reassurance that there is support for these efforts and there will be a lot of talent at the micro level making a big difference. Cooperation and coordination is what the organisations are to provide and we will share more of the knowledge that is available to all who come looking.
Thanks,
       GerardM

Sunday, August 20, 2017

#Wikidata - Martin Reints and {{Authority control}}

Martin Reints received the Herman Gorter Award in 1993. There is a Wikipedia article about him and consequently he was known in Wikidata. There was no "authority control" information for Mr Reints in Wikidata yet and this was quickly remedied.

The most interesting part is that the VIAF registration for Mr Reints already included a link to Wikidata. Proof perfect that librarians are actively working on keeping their house in order. There was an Open Library entry for Mr Reints and the Dutch article had a link to the DBNL-website for Dutch language authors.

Open Library I found is very much about books. Their data on the books they have is great; identifiers like ISBN-10 or ISBN-13 and links to the online catalog of the Library of Congress. This makes a lookup at the OCLC for identifiers of all the authors easy and disambiguation becomes more effective.

Wikidata is very much about data. You can query Wikidata for all the winners of the Herman Gorter Award and it the results you can add the links to VIAF or to the Open Library. This ability to query makes all kinds of applications possible like: "what books written by authors who won the Nobel Prize are available in your library?"
Thanks,
      GerardM

Saturday, August 19, 2017

#OpenLibrary and winners of the Herman Gorter Award

If you want to know if the Open Library is of relevance in other languages, you have to do some research. I wanted to find out if there are publications by the authors who won the prestigious Herman Gorter Award?

This award was conferred from 1945 to 2002 often to multiple authors. The first author not known to Open Library is H. C. ten Berge. He received the Herman Gorter award in 1964. There were several authors where Wikidata did not have a link yet for Open Library.

Now consider this: what if we could query Wikidata for all the authors and their publications in Open Library? 

Just a little bit more metadata about books, publications is what we need.. It is not really a big deal, only a few million additional records..

Many if not most of the books at Open Library have links to authorities like the Library of Congress. This makes it possible to link these books through the OCLC to "your library system". It knows about authors and that is what makes it possible to use tools in stead of people to enrich Wikidata and open up all that is in the Open Library for all of us.
Thanks,
       GerardM

Saturday, August 05, 2017

#Wikidata - Harriet Martineau and some social opportunities

When you do not already know about Mrs Martineau, do read one of the many Wikipedia articles, she is considered to be the first female sociologist and introduced many subjects into sociology that were up to that time not considered.

The picture is a crop of a painting at the National Portrait Gallery by Richard Evans. The picture is known at Wikidata, at Commons the Creator template is missing.

At the Biodiversity Heritage Library Mrs Martineau was know for her book a complete guide to the English lakes. It was the only book known for her at Open Library.  Given the relevance of Mrs Martineau this was strange and sure enough she was known as "Martineau, Harriet" and changing the link to the book was easily done.

At Wikidata meanwhile, there was a hidden link to Mrs Martineau to Open Library thanks to all the good work of the Freebase volunteers. Approving the change was obvious.

At Wikidata there is now a link to both VIAF, to the BHL, to OL for Mrs Martineau and to over 20 more sources. The BHL has links to both Open Library and VIAF. When the links differ, it becomes obvious where work needs to be done.

The result is a better service for all the people who make use of any or all of these resources. We truly should collaborate and strengthen our partners, the partners we share data with.
Thanks,
      GerardM

Sunday, April 02, 2017

#Wikimedia - First a #strategy, then #Action

The people at Open Library have books they love to share. They are in the process of opening what they have even more.

In a previous post it was mentioned that there is a JSON document to getting information on authors like Cicero. There are many works by Cicero and today they have a JSON document in production for the books as well.

So what possible scenario is there for the readers of any Wikipedia; they check in Open Library what books there are for Cicero (or any other authors). They download a book and read it.

Where we are:
  • there is an API informing about authors and their books at Open Library based on the Open Library identifier.
  • an app can now be build that shows this information
    • this app could use identifiers of other "Sources" like Wikidata, VIAF or whatever on the assumption that Wikidata links these "Sources".
    • this app could show information based on Wikidata statements in any language using Wikidata labels.
    • this app may download the book (maybe not yet but certainly in the future)

What next:
  • investigate the JSON and see what we already can do with it
    • publish the results and iterate
  • Add more identifiers of authors known to Open Library to Wikidata
    • there are many OL identifiers in the Freebase information; they need to be extracted and a combined list of Wikidata identifiers and OL identifiers allows OL to curate it for redirects and we can then publish.
  • Raffaele Messuti pointed to existing functionality that retrieves an author ID for Wikidata and VIAF using an ISBN number.
    • Open Library knows about ISBN numbers for its books. When it runs the functionality for all the authors where it does not have a VIAF identifier it can enrich its database and share the information with Wikidata.
    • Alternatively someone does this based on exposed information at Open Library.. :)
  • We add a link to Open Library in the {{authority control}} in Wikipedia
  • We could add information for nearby libraries like they do in Worldcat [1].
  • We can measure how popular it is; how many people we refer to Open Library or to their library.
At the Wikimedia Foundation we aim to share in the sum of all knowledge. We aim to enable people acquire information. Making this happen for people at Wikipedia, Open Library and their library is part of this mission we just have to be bold and make it so.
Thanks,
      GerardM

Saturday, April 01, 2017

#Wikimedia - Sharing all #knowledge

It is strategy time at the Wikimedia Foundation. For me the overarching theme is: "Share in the sum of all knowledge". Ensuring that knowledge, information is available is not only an objective for us, it is an objective we share with organisations like the Internet Archive and the OCLC.

One of the activities of Open Archive is the "Open Library". It provides over the Internet access to books that are free to read. At Wikidata we include links for authors that are known to the Open Library so all it takes is for a Wikipedia to have a {{authority control}} on its authors and a link to Open Library has been provided.

When you work together, a lot can be achieved. A file with identifiers for authors has been sent to the OCLC en Open Library. The reaction is that in the JSON for these authors Open Library includes a link to both VIAF (a system by the OCLC) and Wikidata. This is the JSON for Mr Richard W. Townshend.

The next step is to optimise the process of including identifiers for both VIAF and Open Library. What we bring in is our community. We have done a lot of work using Mix'n Match. We do add identifiers when it seems opportune and we already function as a stepping stone between Open Library and the OCLC. So when we can target attention in Mix'n Match per language, it already is a lot easier to make a match. It may be possible for the OCLC and Open Library to match authors through publications and in that way technology is a deciding factor.

In the end there is only one point to all this: share in the sum of all knowledge. We all have a part to play.
Thanks,
       GerardM

Thursday, March 23, 2017

#Wikipedia vs #Wikidata - Quality and low hanging fruit

When Wikipedia is to be the best, it has to understand and preserve its quality. When Wikidata is to be the best, it has to understand and preserve its quality. Both Wikipedia and Wikidata are wikis but their quality and how it manifests itself are utterly different. At the same time they intersect and this is where we find low hanging fruit.

In Wikidata we have "Author"s and subclasses of author. Many of them have a VIAF identifier and this means that libraries know about them. Information like VIAF is shown in the English Wikipedia when there is an {{authority control}} template. It shows nothing when there is nothing to show but it will update Wikipedia when the information is added to Wikidata.

The low hanging fruit:
  • English Wikipedia - All articles about someone who is known as an author of any kind gets the template.
  • Wikidata - For all the items for someone who is known as an author of any kind we seek the VIAF identifier.
  • OCLC - All the libraries in the world will be updated with a link to Wikidata within a month. This will make it easy for a librarian to find Wikipedia articles in any language.
  • Open Archive - It has a project called "Open Library" and it has freely licensed e-books. Wikidata includes Open Library identifiers. OCLC and OL have links combined with Wikidata identifiers. As these numbers include, people in libraries or from Wikipedia could find authors with free books.
  • other Wikipedias - they could include VIAF and OL identifiers as well. Open Library has books in languages other than English..
We live in an interconnected world. Wikimedia quality is in not being on an island but increasing the reach and enabling our readers.
Thanks,
      GerardM

Saturday, March 18, 2017

Authors, the #OpenLibrary, #Wikidata and libraries

The Open Library is part of the Internet Archive. It makes books available for you to read. That is awesome and that is why Open Library is a natural ally of the Wikimedia community.

At our end we can do more of the things that we do anyway and share what we do. The good news is that Wikidata has a CC-0 license. The people at Open Library can use everything that we do and they do not even have to bother to say thanks.

When we add more Open Library identifiers and VIAF identifier to Wikidata we connect them, us and all the libraries in the world. Yes, individual libraries may have different ways of spelling an author's name but using these connections disambiguation slowly but surely becomes a thing of the past for Open Librarians.

What will we have in return? All the books at Open Library of these authors become available to our readers and editors. We are already in the process of adding identifiers to Wikidata for Open Library. For all the authors that have been connected, we can provide our identifiers to Open Library. This helps them with their outreach and disambiguation.

Through Wikidata more and more authors become connected to VIAF. This allows the librarians of the world to share these freely licensed books with their readers. A clear win-win situation don't you think?
Thanks,
       GerardM