Notices


Reply
Thread Tools
Posts: 12 | Thanked: 148 times | Joined on Apr 2011
#1


MIR Translator is an application for translating text in photos taken by the N900 camera. It experiments with novel interactive techniques to perform text recognition. Currently the app supports translation to and from over 30 different languages. Video Demo: http://www.youtube.com/watch?v=VT-XsUPXCFA

Requires internet connection to work.

Package is available in extras-devel. Be sure to restart after installation if FCam drivers were not previously installed.
Maemo packages URL: http://maemo.org/packages/view/mir-translator/

The app relies on the text recognition happening off the device and in the cloud. This allows the application to support the maximum number of languages possible while keeping the install size as small as possible (~1.5 MB). It also improves response times, given a fast connection and server side.

Features:
-A viewfinder is used to capture images with the camera. The user selects text to translate.
-If the recognition is erroneous, the user is able to correct the recognition via manual segmentation, manual thresholding, and manual candidate selection.
-Supports more than 30 input and output languages.

Limitations:
-Somewhat limited performance. This is because the recognition service resides in the cloud as a web service. I am hosting the service myself, so server capacity / speed is as a result limited.
-Recognition accuracy is currently quite dependent on the quality of the input image. That is, images should be well and evenly lit and have good contrast. It's best if the text is sharp, with typographic-like fonts and non-complex backgrounds.

This project fell out of a project I was doing in school (its actually my first maemo app!). I've recently adapted it to be deployed publicly, so its in an early development phase. Naturally there will probably be some bugs, and there is much room for optimization. I don't expect the application to be powerful enough for the general case of translating arbitrary text-- but simpler cases should be do-able. Deploying it publicly is fun and I'm hoping it speeds feedback + development.

I'm keeping the web service up and running on my own student funds -- its not cheap! Any and all small donations are greatly appreciated (Donate Link: Donate). Hope you enjoy the app!

Last edited by mhsueh; 2011-04-15 at 00:31.
 

The Following 103 Users Say Thank You to mhsueh For This Useful Post:
aanckar, abuelmagd, ahmadamaj, ajack, alextootchie, alienhead, AlMehdi, anapospastos, anders_gud, Andy1210, arora.rohan, Bartus, bigears5000, Bingley Joe, Blaizzen, Bundyo, Captwheeto, casper27, cfh11, Chrome, codeMonkey, Crogge, Crugath, csaba93, debernardis, deegore, demolition, Descalzo, drangina, epninety, esiravegna, excelar8, flash, fw190, Garcel, generationally, gionni88, gordonshowers, hathoda, ikirk, immi.shk, imo, int_ua, ivanrajkovic, ivgalvez, ivyking, japa-fi, jd4200, jhwan, Ken-Young, kent_autistic, klinglerware, lieronet, lolloo, LordVan, lorenzo, Luigi Brosse, MaddogG, MaDless, malkavian, Mara, mathiasp, Mentalist Traceur, mikemx, MINKIN2, MohammadAG, mrsellout, mvuori, MyNokiaN900, niloy, nman, ny-hardcore, optional106, OVK, Pigro, Pillum, pthomas22, rainmaster, reinob, rfeese, ryusilva, SalmanAbbas, shazosbourne, sjgadsby, SSLMM, Stonik, strange1712, SuperDumb, techno2001, Tensuke, tHMZ, ThomasAH, Tiboric, tushyd, v13, vdx29, Veleno, Wikiwide, woody14619, wumpwoast, xkkkx
Posts: 183 | Thanked: 33 times | Joined on Aug 2010
#2
Will try this out! Thanks for your efforts!!
 
zehjotkah's Avatar
Posts: 2,361 | Thanked: 3,746 times | Joined on Dec 2007 @ Berlin - Love this city!!
#3
do you plan to take part at the MeeGo Coding Competition 2011?
You really should!
 
Posts: 356 | Thanked: 172 times | Joined on Jan 2010 @ Canada
#4
Ummm.. WOW! Very nice looking app. Can't wait to give this a try.
 
Posts: 195 | Thanked: 102 times | Joined on Feb 2010 @ Vancouver, Canada
#5
Is it possible to make the app work offline with no internet?
 
Tensuke's Avatar
Posts: 28 | Thanked: 3 times | Joined on Sep 2010
#6
How much space would it take up for all the languages? Just english?
 
Posts: 12 | Thanked: 148 times | Joined on Apr 2011
#7
As far as recognition, It will take some work, though not overly much, to make the app run completely locally. It might be ~2-3MB per language, so around 90MB total, plus an additional 150MB or so for the Asian languages, which require much more data to support. Alternatively, one might just choose a few languages to support and then download support for additional ones as needed.

I'm not sure about the translation part though, right now that depends on the web...

One of the things I might try next for the app is to enable completely local processing as an option.
 

The Following 21 Users Say Thank You to mhsueh For This Useful Post:
Posts: 141 | Thanked: 51 times | Joined on May 2010 @ Netherlands
#8
This looks fantastic.
 
Alfred's Avatar
Posts: 855 | Thanked: 612 times | Joined on Oct 2010 @ Germany
#9
maybe somehow link it with Mstardict\qstardict dictionaries?
__________________
Reps are just one click away: Extras | Extras-Testing | Extras-Devel | My-Maemo | CSSU |
Transform your lock screen into a weather forecast Thanks button ================>
 

The Following User Says Thank You to Alfred For This Useful Post:
laasonen's Avatar
Posts: 565 | Thanked: 618 times | Joined on Jun 2010 @ Finland
#10
It has broken my camera twice. Both times I needed to reboot to get it working again :/

I have kernel-power and CSSU.
 
Reply

Thread Tools

 
Forum Jump


All times are GMT. The time now is 20:30.