Emoji SMS not be received
 

I've had a few problems when I've not been receiving SMS txt messages. it's been intermittent but I have new narrowed it down to those that contain any Emoji symbols in them. i need seem to get them. i've also checked the events db and the message isnt in their either. has anyone else come across this?

Re: Emoji SMS not be received
 

Oh, it's probably the same problem I discovered on N9 while back.

Handling of the emoticons charset generated by Lumia range of devices, for example, fails in the receive/decode phase of the message and processing is aborted.

Why this is really bad is because the sender of the SMS gets the network confirmation that the message has been succellifully delivered, but the receiver never sees a trace of the message...
(well there is a syslog entry saying "cellular: csd[653]: SMS-lib .648529> utils_tpdu_data_parse(): Error decoding TPDUs. Discarding message" ... but a normal user would never look into syslog anyway!)

This breaks the trust paradigm of SMS, the undeniability of receiving a message.

Funny thing is, this was discovered/reported when N9 was still under maintanance but it was never corrected, even though it violates the 3GPP specification on charater message processing...

Re: Emoji SMS not be received
 

BS! :)

SMS is and was never intended as a reliable means for sending texts between users. For all intents and purposes it's like sending a datagram per UDP. If it doesn't arrive, or arrives mangled, it's your problem.

Re: Emoji SMS not be received
 

@juiceme is it possible to patch / intercept the decoding? I'm a software developer (C/C++ since 1990s) so might be able to fix the bug?

Also whereabouts is the syslog located in Maemo?

Re: Emoji SMS not be received
 

well, BS yourself :D:D

You are basically correct in drawing an analogy there between an UDP datagram and a SMS message; both are just messages that are "sent there, godspeed", however, on top of both you could build reliable protocols, and the keyword here is the ACK.

When you send an SMS, and never receive any kind of confirmation, you are in the dark; it might be that the recipient got the message or not, you'll never know.

But if you get the confirmation of delivery message, you well can be 100% sure the message was received by the UE of the B-subscriber, and it signalled the RNC of its location area that the message has been received, loud and clear.

Now this problem here we are discussing breaks that paradigm; the message is received correctly by the UER-B signalling stack, and an acknowledge is sent to RNC counterpart. However, after that, the message is silently destroyed, never to be seen by the recipient.

This is a clear A-class pronto that should be corrected soonest. And if not, hurried by redhat-flag and 2nd-tier management escalation...

Re: Emoji SMS not be received
 

Sorry, I only can comment this from Harmattan point-of-view, never having had the pleasure of owning a N900 device.
On Harmattan the buggy piece of code resides in /usr/lib/libsms.so.0.0.0 but as that is proprietary closed piece of code there's no way I can fix it...

If I had the source, I am sure I could fix da bug, test it, and package a correction in 2 hours tops ( + the time to set up my scratchbox installation, it's been while since I last compiled anything for Harmattan and it sure has rotted a bit...)

This is prime example why closed source is evil. The bug is probably just string length check failing when decoding input that contains multibyte characters... :(
The correct way for the messaging stack to handle this kind of exception is definitely not throwig its spoon to the corner and start crying, it should try to salvage the bits of the message it can decode, and replace the rest with "garbage chars"
On Symbian this works as expected, the multibyte chars end up looking like squiggly boxes but the 7-bit ascii part of the message is shown correctly.

Re: Emoji SMS not be received
 

Syslog is located in /var/log/syslog if you have it installed.
http://wiki.maemo.org/Documentation/.../maemo5/syslog

Re: Emoji SMS not be received
 

@juiceme i know that closed source is frustrating but there is another way here. Take a look at this:
maemo.org/community/maemo-developers/advice_wanted_on_the_best_way_to_package_cell_broa dcast_sms_bugfix_for_closed_libsms_library/

This looks like a possible approach!

Re: Emoji SMS not be received
 

Possible but tedious :(

The thing is, you'd have to fulfill all dependencies, both in and out the library. It's doable but I don't like that approach.

Re: Emoji SMS not be received
 

Was anyone able to figure this out? I recently confirmed the same problem receiving emojis sent from an iPhone to my n900.

At the very least, even if the payload was logged somewhere I could write a script to periodically read it and add the message to the rt-event DB.

Re: Emoji SMS not be received
 

For anyone who may be following this thread, I was successfully able to get emoji SMSs on my phone using T. Perl's fix: http://thp.io/2014/emojifix/

Additionally, I copied the /home/user/* files from the Harmoji .deb into my home directory and I can even view the emojis. Here's the .deb file: https://code.google.com/p/harmoji/downloads/list

I did a full backup of my OS before doing this as he mentioned that it isn't tested in the n900 and I would recommend the same. However, it doesn't look like the modifications can do anything but break SMS for you, which is reversable by coping back your libsms-* so file.

Re: Emoji SMS not be received
 

Thank you!!!

Re: Emoji SMS not be received
 

mikegioia, just to get this clear...
1-install Harmoji .deb
2-un-tar libsms-utils and run patcher script
3-receive(and make?) emoji SMSs?
(edit) see correct instructions downthread

Re: Emoji SMS not be received
 

Can somebody set up step by step how to fix it . Thanks :)

Re: Emoji SMS not be received
 

1. wget https://thp.io/2014/emojifix/emojifix-bin.tar.gz
2. tar xzvf emojifix-bin.tar.gz
3. cd emojifix-bin
4. ./patcher /usr/lib/libsms-utils.so.0.0.0 libemojitils.so.0
5. cp /usr/lib/libsms-utils.so.0.0.0 /usr/lib/libsms-utils.so.0.0.0.orig
6. cp libemojitils.so.0 libsms-utils.so.0.0.0 /usr/lib/
# Now for the ability to read emojis
7a. Download/Extract the deb or tar then navigate to the fonts dir. It will look something like the below.
harmoji_0.6.6_armel.deb\data.tar\home\user\.fonts\https://harmoji.googlecode.com/files....6.6_armel.deb
or if you don't know how to extract deb files
7b. Download the tar'd fonts then extract https://www.dropbox.com/s/e9656lbkm3...ji.tar.gz?dl=0
8. cp AndroidEmoji.ttf SoftbankOSXMLEmoji.ttf /opt/usr/share/fonts/.
9. Reboot

Re: Emoji SMS not be received
 

Can you explain step 2 to 6 little more precise .
Thanks :)

Re: Emoji SMS not be received
 

That part is where the buggy original libsms-utils is replaced by the one with correct handling of unicode emojis.

Re: Emoji SMS not be received
 

They're just commands so you should be able to copy and paste but I'll try to expand.

Steps are done on the n900.

2. Extract the file :
(Note: You have to be in the same directory as the file you downloaded)
3. Navigate to the newly created directory :
4. Run the binary patcher :
5. Make a backup of the lib you're about to replace :
6. Copy the the newly created fix and patched lib files to /usr/lib/ :
(Note: You will need permissions for this)

Re: Emoji SMS not be received
 

If we wanted to add an emoji to our SMSs would we need to write a keyboard plugin?
Trying to think of other way to get them into a SMS, maybe cut/paste from text file?

Even if we dont have a way to send emoji this receive fix needs to be included in CSSU so emoji SMSs are not just ignored by the N900 but ack'ed as received to sender.

Re: Emoji SMS not be received
 

Cut/paste of emoji from http://getemoji.com and wikipedia into the N900's SMS conversations appear properly when pasted but is causing me to get unsendable SMSs, receive mightg work, can't tell though as wife and I both have N900s.

Re: Emoji SMS not be received
 

Thanks . I have problem to get permissions on step 4 . So how do i get permission . I have downloaded the ageis hack and are in root in the terminal app .but get denied on step 4

Re: Emoji SMS not be received
 

Yes i fix it . Now i can use my N9 as my main phone .
Thanks to IIew . :) :D

Re: Emoji SMS not be received
 

Has anyone made any progress in making an emoji soft keyboard for the N900 which resulted in sendable emoji?
I believe it would not be too difficult, like mapping any keyboard, perhaps they are in the wiki somewhere?
The problem remains getting the N900 to send the emoji in a working SMS, as above I have cut/pasted emoji and the sms fails to upload

Re: Emoji SMS not be received
 

I would believe it is not the keyboard but the language settings/support selected for SMS? At least I remember a setting like that from my Symbian phones (which is not available on N900).

Re: Emoji SMS not be received
 

AFAIK there isn't any patch to allow you to send emojis for n900.
Do you have some output via syslog of the failed sent SMS?
It's probably a similar issue, though it might be a lot harder to fix than just receiving.

Edit:
Got the following error messages when trying to send an emoji.
Also when copying an emoji into the text box the char count gets all messed up. Shame rtcom-messaging-ui is also closed.

Re: Emoji SMS not be received
 

Llew, just curious where are you getting the sample emojis?
I don't find anything at /var/log/syslog so apparently Maemo places that somewhere different or I would try emoji from several sources and post results. So far I have just cut/paste from the wikipedia article on emoji.
With the fix given in this thread installed do others receive emoji form other phones? I only have the two N900s in the house and no other mobile phones.

Re: Emoji SMS not be received
 

I just copied an emoji from a sms that I received from an iPhone user.
This is the emoji i used.
😃
When I try to send the above emoji to an iPhone user the rtcom-messaging-ui doesn't show the failed text until the delivery fails.
So to answer your question no the n900 can't send emojis to other non-n900 either but it can receive with the fix in this thread.

Re: Emoji SMS not be received
 

Same goes for the N9, just tested.
Whereas I tried to send from N9 to N900 (not iPhone) so I assume sending to service already fails, and not specific end device.

--edit
At least you may immediately notice during writing whether the SMS is deliverable.
On N9: the number of still available chars (#SMS) switches to 0(0) if there is an 'invalid' emoji in the SMS.
On N900 the number switch to an out-of-range high value.
In case you delete this emoji from SMS the numbers go back to a normal value, e.g. 159(1).

Re: Emoji SMS not be received
 

Hi!
We found a fix for sending SMSes with Emoji for N9, which might work on N900 too.
I proposed an alternative fix for N9 (http://talk.maemo.org/showpost.php?p...3&postcount=42), which, to my surprise, also fixed the problem with sending SMSes with Emoji characters (http://talk.maemo.org/showpost.php?p...0&postcount=56). The same fix (replacing UCS-2 with UTF16 directly in libsms-utils) might also fix the problem on N900 too (I don't have N900, so I can't try).

Re: Emoji SMS not be received
 

I used the method peterleinchen suggested but I wasn't able to get a sms to send.
I tried twice :
a sms with just an emoji failed to send
a sms with text and emoji disappeared into the void

I didn't try just copying the binary though.

Can anyone else confirm if it's working or not for the n900?

Re: Emoji SMS not be received
 

Now it is fully working.

Thanks to thp
http://talk.maemo.org/showthread.php...5&postcount=71
http://talk.maemo.org/showthread.php...7&postcount=72

and hedayat
http://talk.maemo.org/showthread.php...2&postcount=63

Re: Emoji SMS not be received
 

Im having trouble finding the emojifix-bin file for N900 emoji sms fix ?
Seems that the links are not working anymore.
((
https://thp.io/2014/emojifix/emojifix-bin.tar.gz
))
Can somebody point me in the right direction.

Thank you

Re: Emoji SMS not be received
 

You could try this thread: http://talk.maemo.org/showthread.php?t=94027

There are .debs for N9 posted in the end of the thread, I am not certain if the same is true for N900.

Re: Emoji SMS not be received
 

So...
even with a patched libsms the errors are still happening and the N900 discards the received messages...

Someone would try?
Pick an android phone and send to an N900 the following emoticon:
http://emojipedia.org/lg/g4/baby-angel/

That should correspond to:
http://www.iemoji.com/view/emoji/100/people/baby-angel


The result:
sms-manager[]: GLIB WARNING ** default - Error decoding TPDUs. Discarding message

WITHOUT ANY notification.

At the moment i'm trying to get at least a message about this using a dbus-script:
/usr/local/bin/incoming-sms.sh * * Phone.SMS IncomingSegment

Re: Emoji SMS not be received
 

Ok so i messed up, i missed the two lines with the two files attached in another post. It works fine now !

N900
((((
dpkg -i libsms-utils0_0.5.17.3+0m7_armel.deb
dpkg -i libsms-utils0_0.5.17.3+0m7_armel-mod.deb
and then add fonts AndroidEmoji.ttf and SoftbankOSXMLEmoji.ttf to /opt/usr/share/fonts/
REBOOT
))))
Sorry and ty all

Re: Emoji SMS not be received
 

In fact the right encoding is:
http://unicode-search.net/unicode-na....pl?term=ANGEL
http://www.iemoji.com/view/emoji/100/people/baby-angel

Re: Emoji SMS not be received
 

for n900 see:
https://thp.io/2014/emojifix/

as root:
and reboot.

Re: Emoji SMS not be received
 

All files a down please reup thank you

Re: Emoji SMS not be received
 

take a look here
https://talk.maemo.org/showthread.php?t=94027&page=14

Re: Emoji SMS not be received
 

Apparently the freetype library shipped with Maemo5 (a modified 2.3.9 version) has no support for color embedded bitmaps (color emoji).

For those who would still like to enjoy some of the newer emojis in use on modern smartphones, you can replace AndroidEmoji.ttf with the Black&White / SVG EmojiOne package (in OTF format):

https://github.com/emojione/emojione...ojione-svg.otf