Tuesday, November 29, 2011

#MediaWiki release 1.18 is out

The new MediaWiki stable release has been announced and, the list of new features is impressive. When you have your own MediaWiki installation, you definitely want to consider upgrading.

There are several innovations that are quite relevant:
  • jQuery is included as standard and, it is used
  • several new languages have been added
  • several extensions are now included as part of the distribution
  • the qqx messages trigger a screen that helps identify specific messages
add &uselang=qqx at the end of the URL
An "in your face" message is often hard to identify. Adding &uselang=qqx to the URL will provide you with the information you need to identify the message at translatewiki.net for localisation or local modification. For the localisers this is a very significant tool.

Given that extensions are included in the new release, it will be a good idea to have three extensions included in the next release for Wikis that do not have English for its user interface. They are:
In this way a language will always be up to date with the latest localisations, it will be supported with input methods and fonts that make the Wiki accessible to as wide a group of people as we can make it. What would be really awesome is when new and improved keyboard methods and fonts can be distributed in a similar way as the messages...
Thanks,
      GerardM

Saturday, November 26, 2011

A #translation sprint and an intro to #MediaWiki hacking

The verdict on the records is out; the day is not done yet. The biggest thing was when a Panjabi woman was thrilled to be able to just type Panjabi in the Symbiosis computer lab.

This was a revelation shared by other people in the room for other languages. Supporting many Indic languages is available for many operating systems. Never mind how cool it is to support you with Narayam and WebFonts, it is much better to have support local on your local device. This not only provides you with the support you deserve in Wikipedia but also in all the applications you might run. You know what, installing this is not that hard.

At this time 40+ new people created a profile at translatewiki.net, many people have experienced that it is not that hard to support Free Software by helping themselves make the software available in their own language.

The second part of the day, the technical part was too short but many people got a clue what MediaWiki and its infrastructure is about. For us to be in Pune has been a privilege and, it is really cool to see the functionality we are so passionate about being used in earnest.
Thanks,
      GerardM

Friday, November 25, 2011

#Translation sprint in Pune is one for the whole world

The #Wikimedia #Localisation team is in Pune #India. Tomorrow we have a translation sprint at the University and our intention is to seriously beat some records. The record for the most translations in an hour, the record for the most translations in a day, the record for the most contributions of translators in a day; they are all up for grabs and we intent to break them.

We expect some 50 people at the university.  They are going to translate and they are all going to start together. Our team is available to explain, support, authorise. But when we can do it for the people in Pune, we can also do it for the people of India who want to help us. When we are at it, we can do it for people from where-ever.

When we are done at the university, we will be flying home. Happy to see our family again but we are not the only ones who support the translatewiki.net community. It will be interesting to see how we cope, how well the server copes and how hard it will be to break the record now and in the future.

So help us today, localise for your own language and break every record we have in our book.
Thanks,
        GerardM

Thursday, November 24, 2011

The #Tifinagh script for #Berber languages can be typed

In the #Wikimedia #Incubator, the Tifinagh script is used for one of the Berber languages. It is the original script for these languages and it is there to be used. Using it is hard when your computer does not support it.

The Narayam extension does allow the use of input methods on top of an international keyboard. When the Tifinagh script is to be supported, it helps when an organisation is putting its weight behind a particular input method. For the Tifinagh script it is the Royal Institute for the Amazight culture; they defined a keyboard, they provide a manual on how to use it and we are happy to support this keyboard in Narayam.

The Royal Institute produced many beautiful fonts; it would be nice when we find that we can use these as well and truly promote the use of the Amazight culture worldwide.
Thanks,
         GerardM

Wednesday, November 23, 2011

Hackasaurus or let's edit #HTML

Wikisyntax; it has people wake up screaming at night. Developers hate to touch the MediaWiki parser. Rumour has it there is maybe only one maybe two who have a fighting chance to work on it.

When Hackasaurus was introduced to me, it provided me with a tool to see how a page with multiple languages shows what expected HTML looks like: showing a language tag for content that is different from its surrounding content.

<p lang="nl"> and finally </p>
The fun thing of this tool is that you can change things easily. It is meant to be easy as it is intended to teach kids HTML. We specified the language in the "p" tag. It is very much a visual editor and even adults love it. Some people say; you can do with HTML-5 everything that wikisyntax allows you to do. As wiki syntax was meant to hide the HTML, it would be nice to consider if we have not come full circle and drop the Wikisyntax and just use the later version of HTML.
Thanks,
       Gerard

Narayam will look like this

The #India hackathon produced excellent results; one of the highlights was the online keyboard for Narayam. It will need some modifications but it at least allows you to SEE where these bleeding keys are on an International keyboard.

The day after the hackathon we tried to install the patch only to find that some files were sadly lacking. The good news is that after a few e-mails there is not only a screenshot but the missing files are now available to us as well. A big thank you to Abhijeet Pathak for his contribution and his kind support.
Thanks,
     GerardM

Monday, November 21, 2011

#Agile is about getting functionality out

Many software development projects fail to get functionality in a timely manner. Often all functionality is released all together and it has to function to the nth degree. Usually it doesn't and usually the users of the new functionality grumble and object. The Wikimedia Localisation team does not produce everything in one go. What it does is produce functionality that is described in a story
Alolita wants to edit to localise the translatewiki.net user interface in Hindi and uses the Narayam functionality to mimic a Devanagari keyboard. She is not able to type blind and she uses a mock-up of the keyboard to find the keys she needs to press
In Agile this is called an "user story" and for us it is part of the Narayam "epic story". This story is analysed, it is divided in tasks, they are given points and every fortnight it is decided what stories to implement in the next sprint. Those stories can be quite rough around the edges consider; a story that takes as a premise that the user can type Hindi blindly is already in production.

The point of the stories is that they describe precise functionality and this is what is realised in a limited time frame. These stories are selected at the beginning of a sprint and consequently not only does new functionality get frequently realised and implemented, priorities for what the language team is to do are also constantly re-assessed.

Our hope is that our users; the Wiki communities will find us responsive. Our aim is to make the gap  between the user-experience in English and any other language as small as we can make it.
Thanks,
      GerardM

Sunday, November 20, 2011

The #Wikipedia challenge for an AppStore


When an application has been developed, tested and ready, it gets into an AppStore. Except that a developer develops and when he is done it still needs to be localised.

As Wikipedia exists in over 270 languages, you can imagine that the localisation for any application is a continuous process at translatewiki.net. The challenge for all the AppStores; support this continuous stream of new localisations.

Even existing users of a Wikipedia application may be in need for new and improved localisations. Really how are these stores going to cope ??
Thanks,
      GerardM

Typing made easier for six languages

The #MediaWiki Narayam extension provides keyboard mapping. This means that when you have an International keyboard the keystrokes will be mapped to what it would be on a keyboard with another layout. This is a great help when you can type blind.


The Mumbai Hackathon has provided us with new keyboard methods for Urdu, Panjabi, Gujarati, Bodo, German and Marathi. All these keyboard methods are available now for testing in translatewiki.net.

Photo Victor Vigras
These keyboard methods are a step towards making it as easy to use MediaWiki in these languages as it is to use MediaWiki in English. This challenge is one for the Localisation team. The challenge to enhance the usability for English is outside its remit; this is what all the other developers are working on but keeping up with their good work will keep the team occupied.
Thanks,
       GerardM

Saturday, November 19, 2011

Hackathon #India day one

With a large group like this, with so much talent a lot can be done in one day. When the achievements of the days were presented it was quite a lot.



  • Kiwix has been localised in four languages
  • The new Lohit fonts were loaded on translatewiki.net and tested
  • new bugs for the Lohit font were discovered and bugs were reported
  • an SMS gateway for sending Wikipedia articles was tested
  • an input method was created for Marathi
  • the Android app for MediaWiki is now supported at translatewiki.net
Thanks,
     GerardM

Getting the knack of Narayam

Narayam provides input methods to several languages of India. This is seen with keen interest by many Wikimedia communities. Their need for an input method is no less profound then for their language.

At the India hackathon people expressed interest to create an input method for Marathi or Panjabi. At the WikiConference India there was interest to create an input method for the Angika language.

When technical people and language people get together, they can do awesome stuff. The language people know what it should look like while the technical people can make it happen. Doing this in an organised way however is the difference between a hack and a solution.

To create solutions we have our language support teams; once hacks are tried and tested, when it meets with all the initial requirements hacks can become a solution when they are passed on to downstream applications. When a Marathi keyboard method has been defined, why not have it also in a Linux distribution or defined in the applicable ISO standard.

Yes, it is great to start with hacks but our languages are not only used in MediaWiki for Wikipedia.
Thanks,
      GerardM

Friday, November 18, 2011

WebFonts are ready for your comments


At the WikiConference #India, one of the main topics is support for the languages of India. The government of India acknowledges in its best practices that not everybody speaks English. MediaWiki may not be used by the Indian government, but it certainly aspires to bring these best practices in reality. In summary, we aim to make Wikipedia and all its sister projects as easy to edit in for instance Malayalam or Orya as English.

One of the stumbling blocks for us is that many of the computers sold did not come with support for the Indic fonts or with the keyboard mappings for Indic languages. The "Localisation team" worked hard to overcome these two very basic issues. For many languages the Narayam extension is now live and allows people to type. The next phase is providing WebFonts. Web fonts are fonts send to your computer with the data for the articles. 

Providing web fonts can only happen by us when fonts are available for a language and when these fonts are freely licensed. Luckily the fonts used by the Linux operating system are freely licensed and we are happy to provide these as well as other fonts to you.

At this time we are testing the use of WebFonts at translatewiki.net and we intent to bring WebFonts in production for all Wikimedia projects in Indic languages on December 12. We will start off with WebFonts for the Indian languages and other languages will follow at a later date. In the run-up to production day, we need you to assess the fonts for us. the questions we have are:
  • do these fonts represent the script as defined in the latest Unicode specification
  • are the characters readable
  • are you comfortable with the user interface that allows you to configure WebFonts
  • is the default we have chosen for your language the best freely licensed font available
Given that our aim is to bring information to everyone, you will appreciate that our prime objective is to enable more readers and help more people to find their way to our projects. We are quite happy to use any font that meets with our technical requirements when it is freely licensed. 

To help you assess the options available to your language, there should be a page called WebFonts that contains a copy of the India article in your language. 
Thanks,
      GerardM

Thursday, November 17, 2011

#Intrernationalisation - #India Government best practices

I was pointed to a PDF about "best practices for e-government applications for India". It is a wonderful document. Many of its messages are completely applicable for MediaWiki and supporting the languages for all our Wiki projects.

A few choice quotes:
  • It’s a simple question to ask when you build applications: Who is the user?
  • Most of us don’t speak English
  • Applications that are simple, seamless and complete for every user in India

When Wikipedia is to achieve its purpose, we can paraphrase another great line:
It is our objective now to demonstrate everything stated above available to all Indians regardless of their knowledge of English. It will be native to users’ experience and expectations.
The underlying infrastructure is ready and the implementation can be done. The outcome is cost-effective delivery of useful services to all people using the internet.
Thanks,
      GerardM

Tuesday, November 15, 2011

Gender distinction for the #Portuguese language


Making a difference based on gender is not the #Wikipedia thing. In selected situations it is however a #MediaWiki thing. Gender and particularly linguistic gender distinguishes how a man or a woman is addressed or referred to. For several languages the “User” name space will be named differently depending on the gender set in the user preferences.

When our messages support gender, it becomes possible to address people using natural language. This improves readability and consequently it makes MediaWiki a more friendly environment.


For the Portuguese language this has been implemented recently. Changing a name space is different from programmatic changes; it requires someone who can configure the servers. This means that Portuguese did support gender before it is just that one of the more visual aspects of the user interface supports gender.


Supporting gender is an iterative process. Many MediaWiki messages pre-date gender support and at translatewiki.net we get a steady stream of requests to support gender in specific messages on our “Support” page. With so many Portuguese speaking ladies becoming aware of our gender support, they must find occasions where messages could address them even better.


We welcome any lady from any language (as well as any gentlemen) to help us improve the MediaWiki experience and point out more messages that can do with a bit of genderification.
Thanks,
       GerardM

Monday, November 14, 2011

#MediaWiki code review leads to refactoring

Once software is written, it needs review. When you get a great review, it may include both specific instructions and general suggestions. Krinkle did a wonderful job reviewing the current iteration of the WebFonts extension and his instructions and suggestions equally apply to other applications we are working on.

This realisation that instructions and suggestions are equally relevant in other code is powerful; it also indicates that the existing code is written in a consistent way. For the Localisation Team it is not that surprising as it does its part in the development and the maintenance of coding standards particularly for internationalisation and localisation.

Given that all Wikimedia developers are reviewing each others code and given that every one has its strenghts and weaknesses, quality is achieved by reviewing widely. For many Wikimedia developers reviewing code of other developers is a reminder that they grew into their role because of the people who mentored them and reviewed their code.
Thanks,
       GerardM

Sunday, November 13, 2011

#CLDR, the name of languages in Serbian is in lower case

At #Translatewiki.net we prefer to use information from the CLDR. Sometimes we get a query why a specific message that uses CLDR information is incorrect.
Is there any parser that converts the words between it to lowercase? Value of $1 variable in this message, in Serbian, should be lowercase. So, Translation statistics for Serbian would be Статистика превода за Српски, which won't be gramatically correct since language names in Serbian are written lowercase.
We use the names of languages from the CLDR and we encourage our localisers, our languages support teams to look at the content of the CLDR because we do use it in our MediaWiki software.

When the data as provided by the CLDR is problematic, we can hack it. The fact is that we really really do not like to do that.
Thanks,
      GerardM

Holy cow, mobile devices morph #Wikipedia

Communicating that Wikipedia will change is the surest way to get into a fight. As far as I am  concerned, Wikipedia has to change and one of the best reasons why Wikipedia has to change is because people are using different devices to access a MediaWiki site.

Yes, Wikipedia will have to change drastically but how will it change? One of the early signals is in what happens in the mobile development. Brandon gave a "brown bag" meeting in the office. It has been recorded and really, if you do not want to be surprised, look at the recording, chew on it and look again.


It has things on recent changes, interwiki links, allow for editing or not. The behaviour on devices is discussed and really I recommend you watching it. Watch it again and rethink all the things that are taken as the Wikipedia gospel. It is good that things are reconsidered, revisited and reimplemented.

Mobile is where we grow, what we need to be support more and more in the future.
Thanks,
       GerardM

Friday, November 11, 2011

#Wikimedia highlights for October

Many people are eager to know how the Wikimedia Foundation is doing. Every month there is a long publication in English with everything you want and do not want to know. It can be translated, but it is considered too much of a burden on our translator community. In order to get the main message out anyway, there are highlights that are available for translation at Meta.

Once a translation is ready, the highlights can be referred to on the local village pumps of the projects for a language.


The latest Wikimedia highlights, the one for October, are looking for translators. When you make a request for translation, the translator should easily be guided to what needs doing. Two improvements to the original request have been implemented;
  • When you click on the article link, you will see the text in the language you prefer
  • When you click on the translate link, you will be shown the text fragments for your language
Meta is a multi-lingual project and it can be expected that people have set their user preferences to their mother tongue. When they do, we can provide them with translations when we have them.
Thanks,
     GerardM

Thursday, November 10, 2011

The page views for #Wikipedia in #India

With a new server collecting the page views data, anomalies are of interest. Do they represent reality or do they indicate something that is wrong. The page view statistics for the Indic languages show anomalies; check the growth for Marathi and Malayalam; not only do they outpace the Hindi Wikipedia, when you extrapolate the numbers for November, compared to the already impressive numbers for October it appears to be too good to be true.


We do expect the Indic languages to do well. The size of the traffic compared to the number of people who speak these languages is really small. When these numbers prove to be correct, it will be really interesting to learn what triggered this.
Thanks,
       GerardM

NB the traffic numbers for English are not restricted to India.

Thank you Domas ! - #Wikipedia stats are here again

As our projects mature, the amount of data they generate grows. The infrastructure needed to manipulate data grows as a consequence. The result is that hardware solutions provided by some of our finest reach the end of the line. Domas has provided us with hardware where the raw data of our traffic was stored. A whole infra structure of statistics depended on it.


This included the official Wikimedia statistics. This is where the need for a Wikimedia data solution became all too obvious. In moments of very heavy traffic, the old server could not cope and finally it just run out of steam. With the new solution, we will have more consistent data and we have more of a growth path. Obvious because the WMF is now in control of the whole chain.

Finally a word of thanks to Domas. As a result of his generous gift we have a lot of statistical data starting at a time where statistics did not have the priority it has today.
Thanks,
       GerardM