ILUG-C monthly meet – Saturday, 14 Oct 2017


Hi,

Indian Linux Users Group, Chennai [ ILUGC ] is spreading awareness on
Free/Open Source Software (F/OSS) in Chennai since January 1998.

We usually meet on the second Saturday of every month, and for the
month of October we shall meet on Saturday, October 14, 2017 at 1500
IST.

Venue: Classroom No 1,
Aerospace Engineering,
Near Gajendra Circle,
IIT Madras.
Link for the Map: http://bit.ly/iitm-aero

Time  : OCt 14, 2017  3.00 – 6.00 PM

Talk Details:

Talk – 1

Topic – Install/demo Tamil TTS

Description :
Recently, we found ways to install Tamill TTS provided by IITM donlab
and SSN college of Engineering, Chennai

Here is the install script  – https://github.com/tshrinivasan/tamil-tts-install

Will demonstrate the install process

Duration : 30 min

About speaker – T Shrinivasan tshrinivasan@gmail.com , Ebooks
publisher at FreeTamilEbooks.com

Talk – 2

Mini workshop using a TelegramBOT to translate strings for OpenStreetMaps.org

We are dreaming about Maps in Tamil, for long time.

Imagine your mobile phone or GPS device, shows the maps in Tamil,
displays the roads, interesting places in Tamil, It shows routes and
says the street names and directions in Tamil while driving.

The dream can come into real as we have most of the required technologies.
OpenStreetMaps to provide maps, many apps like streetcomplete,
osmcontribute to add streetname and interesting places, Tamil TTS to
say everything in tamil.

The major thing we need is we need all the strings in Tamil.
OSM supports language tags and we can give any string in any language,
along with its translation on other languages.

To enable the translation process of existing strings in OSM, we are
working on a telegram bot. Now, it is easy to contribute to OSM via
translation, with mobile or with web browser.

The bot will be released for public tomorrow with its source code.

It will ask for your osm username, and  then for translate or verify.
The strings will be translated by google translator as first step.
That is not perfect fully. so, we need people to verify it,

You can see a string with its translation. Then say it right or wrong.
once three people confirmed a string it as right, it will be
confirmed. The incorrect strings will be displayed for translation.

Once the strings are completed, they will be uploaded to OSM using a
bot account.

Will release the bot tomorrow.

Come with
your smartphone.
Install Indic Keyboard or Sellinam for Tamil Typing.
Register at openstreetmaps.org

Let us have a translation workshop for openstreetmaps.org

Thanks for the team.

Dinesh Karthik – dineshkarthik.r@gmail.com
Srikanth Logic – srik.lak@gmail.com
Syed Khaleel Jageer – jskcse4@gmail.com
Shrinivasan – tshrinivasan@gmail.com

Duration – one hour

Topic – 3:

Any lighting talks, QA session, etc.

Entry Free. All are welcome.

Advertisements

Installation script for Tamil Text to speech System


The Tamil TTS system provided by IITM and SSN College of Engineering, has a lengthy installation process.

I have written them here. https://goinggnu.wordpress.com/2017/09/20/how-to-compile-tamil-tts-engine-from-source/

It may not be easy to follow and you may find some issues. To make the life easier, I have created shell script, to automate the entire process.

Here it is – https://github.com/tshrinivasan/tamil-tts-install

System requirements:

Ubuntu 16.04

How to execute:

git clone https://github.com/tshrinivasan/tamil-tts-install.git

cd tamil-tts-install

Edit the file, install-tamil-tts.sh

Fill the following details.

DOWNLOAD_PATH=/home/ubuntu/tts/packages #to download the required packages

COMPILE_PATH=/home/ubuntu/tts/compiled # to place the compiled files and folders

Register here http://htk.eng.cam.ac.uk/download.shtml and get a username and password

HTKUSER=htkuserchennai

HTKPASSWORD=sgqY=t=M

Then, execute the file as

bash install-tamil-tts.sh

How to convert a text to audio?

export FESTDIR=/usr

cd COMPLIE_PATH ssn_hts_demo/scripts/complete “தமிழ் வாழ்க” linux

This will convert the text and store as wav in

ssn_hts_demo/wav/1.wav

you can play it with any audio player.

The full details of what is on the compile process is explained here. https://goinggnu.wordpress.com/2017/09/20/how-to-compile-tamil-tts-engine-from-source/

To hear a demo on how the tamil TTS system sounds, click here

Thanks for IITM Team – Prof Hema  and Anju for their great support on helping us to get installed the tamil TTS system.

 

StreetComplete – Android app to add Missing Street Names in OpenStreetMaps


I am thinking of bringing OpenStreetMaps.org in Tamil. Imagining a world, where a GPS device or smartphone, showing paths in Tamil and giving instructions in Tamil to the driver.

To achieve this, we need all the street names to be filled in OpenStreetMaps.org

I checked for the streets in my area, Tambaram, Chennai. Found that there are many street names are missing. Editing the street names on the browser seems difficult for the lazy me.

Was looking for any alternate ways to add streets in OSM. Found the Open Source android app “StreetComplete“.

Cover art

It simply shows the streets that dont have a name and ask to enter a name for it. Thats all.

  StreetComplete (Unreleased)- screenshot thumbnail

  StreetComplete (Unreleased)- screenshot thumbnail

  StreetComplete (Unreleased)- screenshot thumbnail

   StreetComplete (Unreleased)- screenshot

From the description of the app.

 

Help to improve the OpenStreetMap with StreetComplete!

This app finds incomplete and extendable data in your vicinity and displays it on a map as markers. Each of those is solvable by answering a simple question to complete the info on site.

The info you enter is then directly added to the OpenStreetMap in your name, without the need to use another editor.

As it says, it is really simple to add details like street names, road types, shops opening hours etc.

Install this app in your android phone and help OpenStreetMaps to have all the street names. It will lead to various super projects like “Maps in our language” and more.

Help to to build truely open maps.

Few links to explore:

http://wiki.openstreetmap.org/wiki/StreetComplete

https://play.google.com/store/apps/details?id=de.westnordost.streetcomplete

Source : https://github.com/westnordost/StreetComplete/

Minutes – Hackathon on OpenSource Software for Tamil Language


We conducted a Hackathon on OpenSource Software for Tamil Language, last sunday.

Mohan, Rajesh, Gowtham, Ragunath and myself gathered. I have already listed few project ideas on my blog.

https://goinggnu.wordpress.com/2017/03/03/project-ideas-part-1-looking-for-contributors/
https://goinggnu.wordpress.com/2017/04/22/project-ideas-part-2-looking-for-contributors/
https://goinggnu.wordpress.com/2017/03/04/let-us-create-maps-in-tamil/

Mohan worked on fixing the Tamil Text-to-Speech engine, provided by IITM. It was an android app. As the source code was given, Mohan made it as a command line application. He tried to build a web application on top of that.

Here is the sourcecode : https://github.com/mentamizh/flite_hts_tamil

Mohan

Rajesh kumar worked on building a web based report for Ebooks download counts on https://ta.wikisource.org

Source : https://github.com/rajeshkumargp/TamilWikisourceEbooksReportWebApp

I hosted it in a tools server provided by wikimedia labs : https://tools.wmflabs.org/shrinitools/TamilWikisourceEbooksReportWebApp/

Rajesh Kumar

I started to work on adding Tamil Books from ProjectMadurai site ( http://www.projectmadurai.org/pmworks.html ) to ElasticSearch, for analysing text from various authors. I did adding books and searching books via commandline. But, when tried to explore via kibana, the visualization tool, it failed. Still exploring on that. If done, we can do analysis on various authors text.

Gowtham, is a 2nd year BE(CSE) student. He explored on web scrapping with mechanize and beautifulsoup using python. He will be doing creating mobi files daily by scrapping few news sites. He will continue this by next month, once exams are over.

Gowtham

Ragunath, was translating strings from English to Tamil, to create Tamil Maps using http://OpenStreetMaps.org

Ragunath

The day was very interesting. Happy to meet Rajeshkumar. I know him for 5 years. He was one of the initial contributors for http://Kaniyam.com site. We had met on a training 3 years ago. Happy to see him as a contributor for open source projects.

We got some special guests too. Atul Jha, Naresh, TamilThenee came in person and wished the team. Got many calls from abroad too. Siva from USA, Dr.Sudhakar from UK, and more.

We are thinking on conducting similar events every month. We should plan prior and announce atleast one week ago, so that you can plan and attend the event.

Thanks for all the participants. Special thanks to the venue provider Dr.Semmal.

 

Dr. Semmal

Here are few more snaps – https://goo.gl/photos/EWd1NwZ7y1WFyg5X7

 

Note:

The venue,

Manavai Mustafa Memorial,
A E 103, 6th Street, 10th Main Road
Anna nagar West, Chennai – 600040

is open for such event for Tamil development (500Rs/event) . We can use it for hackathons, gatherings, meetings, book reviews, book releases etc. It can accommodate 20 people. It has air conditioned. Airtel wifi is available.

Send a mail to naalayatamil@gmail.com to book the venue.

 

 

Open Source Projects for Tamil – Hackathon – Sunday – April 23 – Chennai


Are you looking for an interesting project to do?
Can you share some time and your programming skills for Tamil Language?
Do you like to meet the fellow open source contributors in Chennai?

Here is a Hackathon for Open Source Projects for Tamil.

Date : April 23, 2017, Sunday
Time : 10.00 am – 5.00 pm

Venue :
Manavai Mustafa Memorial,
A E 103, 6th Street, 10th Main Road
Anna nagar West, Chennai – 600040

Contact : T Shrinivasan 98417 9546 Eight

Send a mail to tshrinivasan@gmail.com
to confirm your participation.

Wondering what projects you can do?

Pick anything from here.

https://goinggnu.wordpress.com/2017/03/03/project-ideas-part-1-looking-for-contributors/
https://goinggnu.wordpress.com/2017/04/22/project-ideas-part-2-looking-for-contributors/
https://goinggnu.wordpress.com/2017/03/04/let-us-create-maps-in-tamil/

or, you can come with your own ideas and implement there.

Come, let us contribute to Tamil with our programming skills.

Filed a RTI to get info on Tamil TTS by IITM and SSN


I blogged on the topic “How to ask IITM to release IndicTTS as Free/Open Source Software?” recently.

Had a good discussion about this on the ILUGC mailing list too.
https://www.freelists.org/post/ilugc/How-to-ask-IITM-to-release-IndicTTS-as-FreeOpen-Source-Software

As a followup on this,  filed a RTI on this.

We can request for any information online in the portal https://rtionline.gov.in itself. Registration asks for our address and phone number. Then we can fill the request form.

Note : The content box does not allow Question mark and URL.

Asked for the below information.

1.
Is there any government policy or G.O to release the software developed by or funded by Department of Electronics and Information Technology (Deity) and Ministry of Communication and Information Technology (M CIT) as Free/Open Source software

2. Is IITMadras funding SSN engg college to develop a Tamil Text to speech software

3. If so, how much is the funded amount

4. Send me the project plan, roadmap, and cost splitups for the development

5. There is a open source android app for Tamil text to speech at IITM site. (IITM donlab site)
This is very very old. But the latest development by SSN college available at  [ speech DOT ssn DOT edu DOT in ]  is very new and works well. Why it is not released as Free/Open Source Software with source code

6. When can we get the latest Tamil Text to speech software from SSN college, as free/open source software with source code

Once submitted, paid Rs 10 via its online payment gateway. It was smooth.

Received an acknowledgment as below.

https://i0.wp.com/storage9.static.itmages.com/i/17/0310/h_1489149948_9704514_0b02428daa.jpeg

Fine. Let me wait for 30 days for the responses.

Will share the results here.

 

 

 

Celebrate 42 lakhs downloads of Free Tamil Ebooks with Us


4milliondownloads

On July 26, 2013, we started the FreeTamilEbooks.com Project, to create and share Tamil Ebooks in Creative Commons license. We release the ebooks in 4 formats, ePub, Mobi, A4 PDF and 6 inch PDF, so that we can read the books on any device like kindle, boko, nook, android, iOS, Desktop, Laptops etc.

Read more about he project here – http://freetamilebooks.com/about-us/

We added the download counters for each book. But wanted a full report on downloads count. Waited for three years. My wife, Nithya was learning Python programming. Gave this as assignment to get the report of all the books download count. She wrote a script, which crawls all the book pages, get the contents, search for the download counts, add in a report.

Here is the report –
http://freetamilebooks.com/htmlbooks/download-report.html

Here is the source code-
https://github.com/nithyadurai87/fte-ebooks-download-counter

With this report, we can see the most downloaded books on file type wise,and total wise.

Good. Found that there is a number for total download count too.

It says as  4228868 now. This is 42,28,868 i.e 42 lakhs, 4.2 million.

Wow. 🙂

Never thought that we will reach so many readers. This means there are good Tamil readers are there around the world, who are ready to read the good contents.

Tons of thanks for all the contributors, writers and readers for making this project as a useful one for the Tamil readers.

kindle-woman-reading

Thanks to the following communities, who are behind this project.

With all the technical and content support from all around the world, the project is growing well.

If you are interested in contributing to the project, join our forum and share your interest.

Join our forum here-
https://groups.google.com/forum/#!forum/freetamilebooksforum

Image source-
https://theeventscalendar.com/celebrate-4-million-downloads-with-us/
http://cbdsports.com/

Let us create Maps in Tamil


Maps. I have seen them in school days only on charts, globe at HM Desk and on Atlas books.

The growth of Maps is very exponential. Nowadays, Maps plays a important role on transportation. Along with GPS, now we can reach most parts of the world without even asking a single question to anyone.

The GPS devices says the right path in English. It has been a long question for me to look for Tamil announcements on GPS. To build such system, we need Maps in Tamil. Then Text to speech system.

How can we build Maps in Tamil or such non-english languages?

My friend Srikanth Lakshmanan < srik.lak AT gmail DOT com > explored on this and found some answers.

See his results here

h_1488649559_2669274_5a8c1fee0f

https://api.mapbox.com/v4/srikanthlogic.714e671e/page.html?access_token=pk.eyJ1Ijoic3Jpa2FudGhsb2dpYyIsImEiOiJuQ1RYS3pjIn0.7YUMcAQAc4A7T703-yAu2g#3/23.08/78.31

He wrote about it here.
http://blog.srik.me/2016/10/04/indic-maps-using-mapzen-tangram-openstreetmap/

He uses Mapzen,Tangram and OpenStreetMaps.

The results are impressive.

explore this repo for https://github.com/srikanthlogic/tangrams-indic
and contribute for further development.

What next?

We need Tamil strings for all the English strings. All the city names, town, street, nagar areas are only in English.

We have to translate all of them in Tamil.

Started a project in https://translate.zanata.org/ for a community contributed translation.

Testing it to incorporate with google translate api so that we can translate the missing words only.

The tests are going here.

https://translate.zanata.org/webtrans/translate?project=TamilMap&iteration=1&localeId=ta&locale=en-US&dswid=-8936#view:doc;doc:tamil-map.txt

Will announce once all the test are completed.

Is there any already a collection of English city, street names and equivalent tamil translation available online ?

or can we ask TamilNadu government to give if it has such a collection?

Can MozillaTN or such communities can lead this to have this map translation as one of their activities? So that we can get more volunteers and take it to other languages too.

Share your thoughts on this.

Dreaming my mobile shows route to a new area in Tamil and GPS says the route in Tamil. Can you see the same dream? Come. Let us make it real.

Project Ideas – Part 1 – Looking for contributors


contribute to open source க்கான பட முடிவு

I am listing here few project ideas and requirements. If you are interested in contributing to any open source project, consider these to start with.

I am giving an intro about each of them in this series of blog posts.

Add your comment here if you pick any of the project to do, so that others can join with you.

1. Clean up Epub files.

We create epub files for FreeTamilEbooks.com by using Calibre. It creates epub files with lot of extra span and other tags. We need to remove all the unwanted tags from those epub files.

Create a command line or web application to clean up the given epub files.

If you are writing in python, plan to create a calibre plugin to clean the epub files.

2.  Download reports for Tamil Wikisource Ebooks

http://ta.wikisource is providing ebooks downloads.

In this database, all language wiki source ebook downloads are stored.

http://tools.wmflabs.org/wsexport/logs.sqlite

Create a web application or command line application to get the details of tamil books and create a download
count report for each book.

Create similar report as http://freetamilebooks.com/htmlbooks/download-report.html

 

3. Improve FreeTamilEbooks android app

The android app for FreeTamilEbooks has some bugs.
https://github.com/jskcse4/FreeTamilEBooks/issues

Use the App and read the issues.
Fix them.

 

4. OCR4WikiSource – Create a web application

OCR4WikiSource is a command line application that connects google ocr and wikisource.
It sends the pdf files to google drive, ocr it, gets text, sends to wikisource.

Create a web application to upload any pdf file, send to google via google vision api, get text, send to wikisource.

Links:
Here is the requirement.
https://github.com/tshrinivasan/OCR4wikisource/issues/89

Few links about it.
https://goinggnu.wordpress.com/2015/12/28/announcing-ocr4wikisource/

https://goinggnu.wordpress.com/2015/09/30/automating-google-ocr-with-python/

https://meta.wikimedia.org/wiki/WikiConference_India_2016/Submissions/Introduction_to_OCR4WikiSource

Discussion with wikipedia developers on this.
https://phabricator.wikimedia.org/T120788

Google Vision API
https://cloud.google.com/vision

Explore the links

https://github.com/GoogleCloudPlatform/cloud-vision

http://terrenceryan.com/blog/index.php/working-with-cloud-vision-api-from-php/

https://github.com/thangman22/google-cloud-vision-php

http://blog.aimanbaharum.com/2016/04/21/ocr-with-google-cloud-vision-api/

 

5. FlipBoard like application for Tamil

Flipboard is a web, mobile app which gives latest content on user selected topics. Create such application for providing tamil content from web on various topics. Content contributors should give links for good articles with relevant categories, tags. Users should subscribe to categories and read the latest content.

 

6. Firefox plugin for tamil wikisource proofreading

 

Tamil wikisource is having around 2000 public domain ebooks, OCRed by google OCR. We have to proofread those books manually.
QuickWikiEditor is a Firefox plugin that enables on the page editing of wiki content.
https://addons.mozilla.org/en-US/firefox/addon/quickwikieditor/

Need to extend this plugin, to send the error words and the corrected words to a remote web application. From there, we can get the list of error words, search for them in entire ta.wikisource.org, replace with the corrected words automatically using bots.

Extend the plugin and create a web application to get the words collection from the plugin.

 

7. Fix the Tamil TTS by IITM

IIT Madras and SSN college, released a Text to speech application for Tamil, as an android application. You can get the source at
https://www.iitm.ac.in/donlab/tts/

It is very initial version. Not as good as the latest  web version available at http://speech.ssn.edu.in/

 

Still, we can learn, extend the initial version.

Explore the android app, get the C code out of it, create a command line app or web app as having the c code as backend.

 

8. Web application to add details about ebooks in a xml file, in github.
We release Tamil ebooks at FreeTamilEbooks.com

We store all the details about the books in a XML file.

This file is source for Android and iOS apps for FreeTamilebooks.

Once an ebook is released, we have to update the xml file manually, which is tough for non-tech contributors.

Need a web application to get the ebooks details in a form, then add those details in XML file and commits to the repo automatically.

 

9. Add ebooks automatically in GoodReads.com

We can add the details about the ebooks in FreeTamilebooks.com to GoodReads.com

We have to fill a long form manually.
Need a command line or web application to simplify this process or automate it for adding info about the books in FreeTamilEbooks.com

10. Build a SAAS version of planet kind of RSS aggregation software.

 

Most tech communities need a planet kind of RSS aggregation software. They have to buy a VPS, install planet software and add the RSS feeds.

It will be good, if we build a SAAS version of planet or similar software, so that they can simply sign in, add rss feeds and start using it.

There are more ideas. Written them somewhere on my notebooks. Will collect them and share soon.

All the projects should be released as Free/Open Source software only.

If you are interested in doing any of the things said above, comment here.

email me to tshrinivasan AT gmail DOT com to know more details on any of the project.

Why are you not using an application in your language?


Last week, listened a conversation between two of my friends, Khaleel and Navin.

Khaleel is contributing to Mozilla community by doing localization. i.e translating the strings on the user interface of Mozilla products like firefox in Tamil. Navin is a tech guy, who likes to read Tamil anywhere.

localization க்கான பட முடிவு

image source – http://www.softwaretestingclass.com/what-is-globalization-internationalization-and-localization-in-software-testing/

 

“Hi Navin, Do you know that the firefox in your mobile and computer can be converted to Tamil?” Khaleel Asked.

“Yes dude. I have heard about it. Tried few times. But, the tamil interface gave me some issues. So reverted back to English UI”. Navin replied.

 

khaleel

Khaleel

“Oh. Is it? It is just a habital issue. You are so used to English. I never faced any issues on using Tamil interface. What are the issues you faced?” Khaleel asked.

“New words to learn. All the new words make me to feel very unfriendly.” This is Navin.

“Yes. We have to learn something new. When dont hesitate to learn new words in English, why do we feel tired to learn new words in Tamil? Did you born with all the english words as File, Edit, Options menu? ”

“Agreed. It is just a one time learning to matching the words. Still, Laziness prevents me.”

“Fine. What are the other issues?”

“Seeking for help on any issues, is one big issue. When I am in Tamil interface, if somethings goes wrong, I have to search internet with the proper english words. When I do translate from Tamil to English, it goes wrong and not getting answers. On such times, I have to find menus, for switching languages. It is hidden somewhere deeper. Once I switched to english, I am not coming back to tamil interface to avoid a pressure on emergency”.

“True. For that only, we are trying to bring entire documentation in Tamil itself. Then, you can search in Tamil itself”. Khaleel answered. “To make you to use tamil interface, what we have to do?” Khaleel asked.

navin

Navin

Here comes an important answer from a different point of view, from a good user.

“The switching of languages in the interface should be one click or a simple gesture. Why you guys are buried that option in a deep menu?” Navin asked.

While listening this conversation, I searched and found on how to switch languages for Firefox and Libreoffice.

To change the UI of firefox to a new language:

Unlike themes, enabling a language pack in the Add-ons Manager only does the languages it provides available. To change the preferred language for the interface:

  1. In the address bar, type about:config and press Enter.
    • The about:config “This might void your warranty!” warning page may appear. Click I accept the risk! to continue to the about:config page.
  2. In the FilterSearch field, type intl.locale.matchOS.
  3. If the intl.locale.matchOS preference has a value of true, double-click it to toggle its value to false.
  4. Clear the FilterSearch field, and type general.useragent.locale.
  5. Double-click the general.useragent.locale preference, and enter the code of the language you want to use. This page lists most of the language codes used for Mozilla localizations.
  6. Click the menu button New Fx Menu and then click Quit Close 29 .

When you start Firefox again, you will see the interface in the new specified language.

source : https://support.mozilla.org/t5/Manage-preferences-and-add-ons/Use-the-Firefox-interface-in-other-languages-with-language-packs/ta-p/23542#w_how-to-change-the-language-of-the-user-interface

For libreoffice,   Tools▸Options▸Language settings▸Languages▸Language Of: User interface (applied after restart).

source: https://ask.libreoffice.org/en/question/61894/how-do-i-change-the-default-language-from-french-to-english/

Like this, KDE and Gnome have their own deep menus to change the language. For most of them, we have to restart the application or logout/login or restart the entire system.

“Why there is no one click or one gesture switching of user interface languages? If there is such option, I can use all the application in Tamil itself. Whenever I get any issues, I will hover on UI or do some gesture to know the equivalent English words, search for them, get answers, fix issues, switch back to Tamil interface.” Navin explained.

All he said is true. Being an old times contributor of localizing Gnome, KDE in Tamil, today I am not using them in Tamil. Suffering by the same issue what Navin explained.

Found that Firefox has a useful addon to switch languages easily. Simple Locale Switcher

https://addons.mozilla.org/en-US/firefox/addon/simple-locale-switcher/

This seems useful. But why do I have to restart entire firefox with all my 80 tabs, just to know how to mention something on another language?  When KDE or gnome ask me to logout and login, I never think to switch a language.

Thanks Navin and Khaleel for bringing out a wonderful design issues with the application architecture.

When a software supports localization, switching language should be as one click.

This should be implemented on the software, then only new people will start using the localized application without any hesitation.

Till then, we have to keep on worrying why the new people are not using the local language interfaces.

I will report this as a feature request for kde, gnome, firefox and libreoffice. If you are interested in contributing to any open source software, implement this feature to it or report this as feature request in their issue tracking system.

What do you think on this issue? What are the other possible solutions? Share your thoughts in the comments and start discussing about this with your tech communities.