[DEVEL] Saera: Siri clone for Maemo5, Harmattan and Sailfish OS
 

I couldn't find one, so I decided to make my own. Saera can do some tasks (such as setting alarms etc) and make some conversation, although not very well (might someone be interested in helping with the A.I.?)
Saera uses Pocketsphinx for voice recognition, eSpeak to talk and PyGTK for the GUI.

http://s17.postimage.org/o2sbhkpjj/saera_i.png

To install, you will need these packages:
What Saera can do right now:

• tell you the time, both where you are and in a few major cities (more will be added)
• greet you
• Verify she's working, if you say "testing"
• Take a picture, if the lens cover is open and the camera app isn't
• Take a picture of you with the front camera
• tell you the meaning of life, the universe and everything
• tell you random facts about the N900
• call a phone number (buggy)
• tell you where you are if you're lost
• search for food near you
• read you new emails as they come in
• set alarms (note that I haven't got them to boot the device if it's off yet)
• play and pause music (although you can't play a song by name yet - that will come.)

Edit [2015-07-19 4:16 pm]: Added support for Sailfish OS.

Edit [2012-12-31 2:28 pm]: Added support for N9/N950.

Edit [2012-06-16 11:55 pm]: Initial support for answering in other languages.

Edit [2012-06-11 3:14 pm]: Improved recognition accuracy

Edit: Latest source files attached.

Mod edit:
Changed thread title

Re: [Announce] Saera: Siri clone for Maemo 5
 

Wow, gonna test it out for sure!

Good luck building it :)

Re: [Announce] Saera: Siri clone for Maemo 5
 

Is it possible to pin a specific voice command to an arbitrary command-line? I would use that in so many ways! Very happy that someone is writing a Sphinx "GUI" :)

Re: [Announce] Saera: Siri clone for Maemo 5
 

Yes it is; in fact, that is a good deal easier than trying to parse the input for meaning.

I'm just collecting everything into one place, and I'll upload the zip later this evening.

Re: [Announce] Saera: Siri clone for Maemo 5
 

Any way we could get this for Harmattan?

Re: [Announce] Saera: Siri clone for Maemo 5
 

Would be happy to see source code, so i hope other devs would jump in

Re: [Announce] Saera: Siri clone for Maemo 5
 

Now I have pull the n900 out and add this....makes,me wonder why i even have an n9.

Re: [Announce] Saera: Siri clone for Maemo 5
 

Sure! Where is the source?

Re: [Announce] Saera: Siri clone for Maemo 5
 

Interesting project! Long live N900!

Re: [Announce] Saera: Siri clone for Maemo 5
 

Unfortunately I do not have an N9, and I don't have the money to get one. If someone else is interested in getting it running though, it should be simoke in theory. Is pocketsphinx in the N9 repos?

I'll upload the source when I get home this evening; I don't have it here, just my screenshot.

Re: [Announce] Saera: Siri clone for Maemo 5
 

there is some package sphinx and log of #harmattan @ freenode gave this :

Re: [Announce] Saera: Siri clone for Maemo 5
 

here we go, i think it's the same package — http://harmattan-dev.nokia.com/pool/...free/s/sphinx/

Re: [Announce] Saera: Siri clone for Maemo 5
 

Great idea taixzo, I'll be sure to check it out too :)

I'm not 100% sure from your first post, but has Saera actually been released? If not, it could be eligible to be entered into one of the 5 main categories in the maemo.org coding competition which is due to start next week (Monday) onwards.. I think Saera could make a great candidate - apps like these usually do very well and we have a lot of N950s and N9s available as prizes.

However if it has been released we do have an "updates to existing applications" category, so if you do any major code changes or functional updates over the next 3 months I'd encourage you to enter Saera :) It doesn't cost anything to enter, and who knows maybe you'll win yourself a new device :)

So I'd definitely encourage you to check out the wiki and see if Saera qualifies :)

Re: [Announce] Saera: Siri clone for Maemo 5
 

Thank you for that! I had not thought of submitting it, but as I haven't released it yet I will submit it to the competition.

FYI, your link points to the image rather than the page. ;)

Re: [Announce] Saera: Siri clone for Maemo 5
 

I'm curious what is peoples pocketsphinx dictation aquracy {mine is very low)
and i couldn't find a simple solution to increase.

Re: [Announce] Saera: Siri clone for Maemo 5
 

I'm working on this. Pocketsphinx's default model (hub4wsj) was generated from a large number of sentences from the Wall Street Journal. The problem here is that while this gives a good foundation of grammar, it has many words unlikely to be used in normal speech (such as 'Uzbekistan'). These other words make for poor accuracy. On the other hand, one can hand-build a list of words and a simple grammar that works well for voice commands, but not well for more general speech (as we want Saera to handle). I think the best option may be to make a new large dictionary, but create it from a more relevant data source, such as TMO for example. In the meantime I'm just using the default wsj model until I can replace it with something better.

Re: [Announce] Saera: Siri clone for Maemo 5
 

Here is the source at the moment. Not much works with the AI; Saera currently recognizes the following things:

• Hello
• Test/Testing
• Remind me X
• Put on some music
• What is the answer to life the universe and everything

I don't have hooks into the system yet, so neither reminders or music control actually work. Also, accuracy is fairly poor, for the reasons I just posted. Saera seems to run a good deal slower than the Pocketsphinx demo that the voice recognition is based on, so I will see what I can do to speed that up.

To run: extract zip on N900. In x-terminal, cd to that directory and run

Re: [Announce] Saera: Siri clone for Maemo 5
 

This is AMAZING to actually someone is doing this, i have a N9 but seriously how to compile or even edit that code, But I AM 100% eager to test this for the N9... If your interested im always available

Re: [Announce] Saera: Siri clone for Maemo 5
 

It should not need compiling, as it is python code. Actually, it runs equally well on my desktop; if someone has an N9 and can install gstreamer0.10-pocketsphinx, pocketsphinx-utils and whatever the dictionary package is called (it's something like pocketsphinx-ln-en-hub4), this may run on Meego without modification.

Re: [Announce] Saera: Siri clone for Maemo 5
 

You could try to combine it with Maemo Profiler, which is already capable of triggering a good number of actions.

Re: [Announce] Saera: Siri clone for Maemo 5
 

would any one like to make a deb out of it so that it can reach to the repos and then every one can share the joy ?

Re: [Announce] Saera: Siri clone for Maemo 5
 

saera doesnot open ::



BusyBox v1.20.1 (Debian 1.20.1power1) built-in shell (ash)
Enter 'help' for a list of built-in commands.

~ $ sudo gainroot
Root shell enabled


BusyBox v1.20.1 (Debian 1.20.1power1) built-in shell (ash)
Enter 'help' for a list of built-in commands.

/home/user # cd MyDocs/saera/
/home/user/MyDocs/saera # python saera.py
process 1970: arguments to dbus_connection_get_data() were incorrect, assertion "connection != NULL" failed in file dbus-connection.c line 5757.
This is normally a bug in some application using the D-Bus library.
process 1970: arguments to dbus_connection_set_data() were incorrect, assertion "connection != NULL" failed in file dbus-connection.c line 5721.
This is normally a bug in some application using the D-Bus library.
Aborted
/home/user/MyDocs/saera #

Re: [Announce] Saera: Siri clone for Maemo 5
 

Try running it as normal user "user" (i.e. without "sudo gainroot").

Re: [Announce] Saera: Siri clone for Maemo 5
 

finally, something that does speech to text. i've been wanting something like this for the longest time on the n900.


voice-dialing here we come! :)

Re: [Announce] Saera: Siri clone for Maemo 5
 

another problem::




BusyBox v1.20.1 (Debian 1.20.1power1) built-in shell (ash)
Enter 'help' for a list of built-in commands.

~ $ cd /home/us
user/ usr/
~ $ cd /home/user/MyDocs/saera/
~/MyDocs/saera $ python saera.py
Traceback (most recent call last):
File "saera.py", line 239, in <module>
app = Saera()
File "saera.py", line 75, in __init__
self.init_gst()
File "saera.py", line 190, in init_gst
+ '! pocketsphinx name=asr ! fakesink')
glib.GError: no element "vader"
~/MyDocs/saera

Re: [Announce] Saera: Siri clone for Maemo 5
 

I like the prospect of this!

I don't know how pocketsphinx works but you said it needs dictionary to recognise words. does this mean that a dictionary can contain regional dialects or accents?
I have a Geordie accent, which, along with others accents such as Scottish or Welsh, means that most speech recognition engines have a major problem understanding me unless I speak queens-english to match it's dictionary of pronunciation.

My last attempt to do anything speech-related was when i had a SideWinder Headset and voice software.. I was able to type the phonetic version of how it would sound eg If I said "Sword", it would be "Saud" phonetically..

Re: [Announce] Saera: Siri clone for Maemo 5
 

Hi Mohammed Muid I'm not sure but maybe you try to install first pocketsphinx(apt-get install pocketsphinx) and espeak gui client(extras-devel)and then again try with zip folder(saera).For espeak gui client you had installed before python-gtk2 and python-gobject
regards

Re: [Announce] Saera: Siri clone for Maemo 5
 

Good, will take a look as soon as I can grab my notebook!
I have something in mind...

Re: [Announce] Saera: Siri clone for Maemo 5
 

You need gstreamer0.10-pocketsphinx.

Re: [Announce] Saera: Siri clone for Maemo 5
 

there is no such file as pocketsphinx. i installed espeak and espeakgui. bt same problem

Re: [Announce] Saera: Siri clone for Maemo 5
 

I could, although it seems like overkill to create whole new profiles just to run commands. I was planning on just using dbus instead.

I will make a deb when I figure out packaging, but I don't want to put it in the repos until it is working a bit better.

I believe pocketsphinx supports alternate pronunciations. However, I think you would have to create an entire new dictionary with those new pronunciations in it (hopefully someone will prove me wrong here).

The package is called pocketsphinx-utils. I suggest you just install all packages with "pocketsphinx" in the name until I figure out which ones it actually requires.

Re: [Announce] Saera: Siri clone for Maemo 5
 

Look here friend:
~ $ sudo gainroot
Root shell enabled

BusyBox v1.10.2 (Debian 3:1.10.2.legal-1osso30+0m5) built-in shell (ash)
Enter 'help' for a list of built-in commands.

/home/user # apt-cache search pocketsphinx
python-sphinxbase - Sphinx base libraries - Python module
libsphinxbase-dev - Development files for Sphinx base libraries
libsphinxbase1 - Sphinx base libraries
python-pocketsphinx-dbg - lightweight speech recognition - Python module (debug version)
libpocketsphinx1 - lightweight speech recognition - library
gstreamer0.10-pocketsphinx - lightweight speech recognition - GStreamer plugin
pocketsphinx-utils - lightweight speech recognition - command-line tools
python-pocketsphinx - lightweight speech recognition - Python module
libpocketsphinx-dev - Development files for Pocketsphinx.
pocketsphinx-zh-tidigits - lightweight speech recognition - Mandarin acoustic models
pocketsphinx-lm-en-hub4 - Lightweight speech recognition - HUB4 language model
pocketsphinx-hmm-en-tidigits - lightweight speech recognition - TIDIGITS models
pocketsphinx-lm-zh-hant-gigatdt - Lightweight speech recognition - Traditional Chinese language model
pocketsphinx-hmm-en-hub4wsj - Lightweight speech recognition - English acoustic model
/home/user #

Re: [Announce] Saera: Siri clone for Maemo 5
 

i could open it. then when i click on the mike it closes. but i could write. be it says. "i dont understand sorry." loser

Re: [Announce] Saera: Siri clone for Maemo 5
 

any hope saera for N9?

Re: [Announce] Saera: Siri clone for Maemo 5
 

If it closes when you tap thi mic, do you get an error in the terminal? It may be missing some package.

Again, I've addressed this. It's possible in theory, but I have no way of testing it because I don't have an N9.

Re: [Announce] Saera: Siri clone for Maemo 5
 

i install espeek,espeek gui,python-gtk2,python-gobject,gstreamer0.10-pocketsphinx,python-pocketsphinx,pocketsphinx-utils. then extract zip file and move all files to a folder named siri and then:

BusyBox v1.10.2 (Debian 3:1.10.2.legal-1osso30+0m5) built-in shell (ash)
Enter 'help' for a list of built-in commands.

~ $ root


BusyBox v1.10.2 (Debian 3:1.10.2.legal-1osso30+0m5) built-in shell (ash)
Enter 'help' for a list of built-in commands.

Nokia-N900:~# cd /home/user/MyDocs/siri
Nokia-N900:/home/user/MyDocs/siri# python saera.py
Traceback (most recent call last):
File "saera.py", line 13, in <module>
import pygst
ImportError: No module named pygst
Nokia-N900:/home/user/MyDocs/siri#

what's wrong with it?

Re: [Announce] Saera: Siri clone for Maemo 5
 

First of all, you probably need to install python-gst0.10. Second, you shouldn't run this as root.

Re: [Announce] Saera: Siri clone for Maemo 5
 

I install install python-gst0.10.
when I run as sudo gainroot:
$ sudo gainroot
Root shell enabled


BusyBox v1.10.2 (Debian 3:1.10.2.legal-1osso30+0m5) built-in shell (ash)
Enter 'help' for a list of built-in commands.

/home/user # cd /home/user/MyDocs/siri
/home/user/MyDocs/siri # python saera.py
process 2608: arguments to dbus_connection_get_data() were incorrect, assertion "connection != NULL" failed in file dbus-connection.c line 5757.
This is normally a bug in some application using the D-Bus library.
process 2608: arguments to dbus_connection_set_data() were incorrect, assertion "connection != NULL" failed in file dbus-connection.c line 5721.
This is normally a bug in some application using the D-Bus library.
Aborted
/home/user/MyDocs/siri #

and when I run as root
......
-var
-varfloor 0.0001 1.000000e-04
-varnorm no no
-verbose no no
-warp_params
-warp_type inverse_linear inverse_linear
-wbeam 7e-29 7.000000e-29
-wip 0.65 6.500000e-01
-wlen 0.025625 2.562500e-02

FATAL_ERROR: "fe_sigproc.c", line 397: WTF, 5406.250000 < -31.250000 > 6093.750000
Nokia-N900:/home/user/MyDocs/siri#

when I run it as root for the firs time it opens and when I clicked on microphon it closed,

Re: [Announce] Saera: Siri clone for Maemo 5
 

INFO: feat.c(848): Initializing feature stream to type: '1s_c_d_dd', ceplen=13, CMN='prior', VARNORM='no', AGC='none'
INFO: cmn.c(142): mean[0]= 12.00, mean[1..12]= 0.0
ERROR: "acmod.c", line 84: Must specify -mdef or -hmm
Segmentation fault
~/MyDocs/saera $

this is the end of the xterm output after i clicked the mich

Re: [Announce] Saera: Siri clone for Maemo 5
 

Just don't run as root at all!