maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   Maemo 5 / Fremantle (https://talk.maemo.org/forumdisplay.php?f=40)
-   -   Modest fixes for PR1.2 (https://talk.maemo.org/showthread.php?t=56634)

DrWilken 2010-07-24 20:03

Re: Modest fixes
 
To clarify what the command does I'll try to explain it piece by piece here... ;)

tar is the command (actually short for Tape ARchiver originally used to backup/restore to/from tapes).

xzf are options:
x for extract (unpack).
z filters the archive through gzip (filename ends in .gz because it's gzipped).
f for file (Could also be a device. A tape drive for example). In this case the filename is modest-3.4.2-baxyp-1.tar.gz.

-C / means Change directory to / before extracting (otherwise the contents would be extracted to current directory. I.e. where you are now).

Put it all together and it gives You:
Code:

tar xzf modest-3.4.2-baxyp-1.tar.gz  -C /
For almost any command on Linux You can write --help after the command to see the options... ;) Like this:
Code:

tar --help

peter696 2010-07-26 10:26

Re: Modest fixes
 
ok guys, noob question

I've rooted my device, downloaded the file and placed it in the "highest" location I can (where all the main folders are), entered the code into terminal but it comes up with "tar: can't open '...':no such file or directory". So a little confused on what to do...any help?

baxyp 2010-07-26 11:14

Re: Modest fixes
 
Make sure you are in the same directory where you copied the .tar.gz file. Type ls in terminal window, to see the files in current directory. Type pwd to display the path of the current directory. Use cd to change current directory.

DrWilken 2010-07-26 11:21

Re: Modest fixes
 
It doesn't matter where You place the .tar.gz file as long as You use the -C option (read what I wrote above)... ;)

As baxyp says, just make sure You're in the same location as the file when running the tar command (or use /path/to/filename instead of just filename).

Quote:

Originally Posted by peter696 (Post 765019)
downloaded the file and placed it in the "highest" location I can (where all the main folders are)

It's probably in MyDocs then... ;) Run this:

Code:

root
tar xzf /home/user/MyDocs/modest-3.4.2-baxyp-1.tar.gz  -C /


The Sand 2010-07-28 03:40

Re: Modest fixes
 
I had to do a bit of searching because I ran into trouble following the instructions. I thought I would post what I found in case others are having trouble.

When I put in sudo gainroot I got a message that said, “Enable RD mode if you want to break your phone.” After further research I found out you have to have “rootsh” installed from the Application Manager before the sudo gainroot command will work. After I installed rootsh I tried installing.

For installation I followed these instructions (including having to install mc) from ceroberts75 on the Nokia forum: the direct link to the thread is http://discussions.europe.nokia.com/...il/m-p/731938#

"once you download the file. save it to your main memory.

then, open xterm

sudo gainroot

mc

(midnight commander will open) ---if you dont have midnight commander then type: apt-get install mc

then on the left, you will automatically be in the user/home directory, go the right window (just tap on it) and scroll down to "MyDocs" and hit enter, then scroll down until you see the modest-3.4.2-baxyp-1.tar.gz file. tap on it once to highlight it.

then tap on "copy" at the bottom right and then "ok" to allow it to copy it over to the user/home directory.

close mc

open xterm

sudo gainroot

you will see the directory go to user/home

then copy this code in: tar xzf modest-3.4.2-baxyp-1.tar.gz -C /

after you put it in, and hit enter, it should look like this on your screen:

user/home: tar xzf modest-3.4.2-baxyp-1.tar.gz -C /
user/home:

then close xterm

reboot your phone

you will notice that your pop email and even the imap is much faster at rendering and actually seems to cache the email instead of constantly having to repopulate it every time.

he said that instead of it syncing 3 times everytime you check your email, it is syncing only 1 time, making it faster. my guess is that since it is doing 1/3 the work that the battery should be slightly better too.

this is process i had to do it with as even in root, it would not find the package unless i moved it first.

this package is also supposed to make the sms better, but i didnt have any issues with sms other then the length of time to load the contacts after pressing "to" so i have not noticed any difference.

hope that helps."

The above instructions worked for me… I am very grateful I have any incoming POP3 mail because I had none. Days would pass with my N900 updating nothing for POP3. Thanks to the creator of the fix and to ceroberts 75 for his detailed instructions!

My “wish” for mail in the future – when my other smartphones pull mail from Yahoo they don’t make Yahoo’s server “unavailable” for about 4 minutes. The N900 does. Hopefully that will be fixed in the future…

Sandy

The Sand 2010-07-28 06:00

Re: Modest fixes
 
I lost something after the fix. In settings I have "Leave messages on server" which it did. But when I decided to delete a message it would then delete from the server. That feature is no longer working after the fix...

Clearly I would rather have incoming mail than the ability to delete from server... but I wanted to mention it anyway.

Sandy

JonWW 2010-07-28 17:58

Re: Modest fixes
 
Quote:

Originally Posted by The Sand (Post 767368)
I lost something after the fix. In settings I have "Leave messages on server" which it did. But when I decided to delete a message it would then delete from the server. That feature is no longer working after the fix...

Clearly I would rather have incoming mail than the ability to delete from server... but I wanted to mention it anyway.

The "feature" you think you lost was infact a critical bug.

Alot of people have lost emails as a result of this bug, me included. It was quickly sorted by Nokia. This version has that bug fixed, plus how it checks for emails, as the automatic checking failed.

If you only ever check emails on the phone the don't select "Leave messages on server" then each time you check for emails they will be transfered to the phone and removed from the server.

Alot of people want a record of all their emails on their PCs, but will normaly view them on there phone, then delete them after reading knowing that they still would end up on their PCs. This wasn't happening.

The Sand 2010-07-30 20:02

Re: Modest fixes
 
I think mine was doing something else...

Before this fix the mail would show up on the N900 as well as the computer (because I had "Leave on server" selected.) Just like it should. If I then deleted the email from the N900 it took it off the server (Yahoo to be more specific,) only from the Inbox as we are talking about POP3.

In other words it was doing what Outlook does - pulling mail, then deleting off server (Yahoo) when deleted from Outlook - which is in Advanced Settings in Outlook.

I was surprised I had that feature from the N900 - but I did. It's a very nice feature to have. That left after this fix... bu as I said above, it's more important I have incoming mail automatically.

What is proving to be a real bummer - the server "take out" issue caused by the N900. - it makes Hotmail/Yahoo"unavailable" (not Gmail)... and if you try to access your mailbox via the web you can't for several minutes (up to 5.) In turn it affects Outlook, if you have Yahoo/Hotmail through Outlook (which can crash if you decide to pull mail when it's unavailable) and the Blackberry can't pull anything either. It's making things harder...

Sandy

Kechit 2010-07-30 20:20

Re: Modest fixes
 
Thanks for this....performance certainly seems to have improved....I can access my mails a lot faster.

The Sand 2010-07-30 21:24

Re: Modest fixes
 
1 Attachment(s)
Quote:

Originally Posted by JonWW (Post 768090)
The "feature" you think you lost was infact a critical bug.

Alot of people have lost emails as a result of this bug, me included. It was quickly sorted by Nokia. This version has that bug fixed, plus how it checks for emails, as the automatic checking failed.

If you only ever check emails on the phone the don't select "Leave messages on server" then each time you check for emails they will be transfered to the phone and removed from the server.

Alot of people want a record of all their emails on their PCs, but will normaly view them on there phone, then delete them after reading knowing that they still would end up on their PCs. This wasn't happening.

After further thought I realize what I call a "feature" you call a "bug."

In other words... nobody like it. I did though.

So "Leave on the server" means the mail will ALWAYS remain on the server whether you delete it from the N900 or not.

I wanted it to be left on the server when pulled onto the N900 - but then I want it deleted from the server when I delete from the N900.

Really, most 3rd party email clients have the ability to delete from server - Outlook, Windows Mail, the Blackberry... it's usually in settings. I have attached a printscreen of Outlook settings. On the Blackberry it asks you if you would like to delete the email from "Handheld" or "Handheld and Mailbox" - the "mailbox" being the server.

I liked that feature - it would be nice if their was a further option to enable it...

Sandy

JonWW 2010-07-30 22:06

Re: Modest fixes
 
Quote:

Originally Posted by The Sand (Post 770736)
After further thought I realize what I call a "feature" you call a "bug."

"Leave on server" means just that when there are no other options, no matter how much you like the option you can't have the phone deleting peoples email with out them knowing about it, therefore it's a bug.

Quote:

Originally Posted by The Sand (Post 770736)
So "Leave on the server" means the mail will ALWAYS remain on the server whether you delete it from the N900 or not.

That is what "Leave on server" means, so no confusion there then. It doesn't mean delete from server.

Quote:

Originally Posted by The Sand (Post 770736)
I wanted it to be left on the server when pulled onto the N900 - but then I want it deleted from the server when I delete from the N900.

Options required.

Quote:

Originally Posted by The Sand (Post 770736)
Really, most 3rd party email clients have the ability to delete from server - Outlook, Windows Mail, the Blackberry... it's usually in settings. I have attached a printscreen of Outlook settings.

I liked that feature - it would be nice if their was a further option to enable it...

But it's not in the N900's options, so it still shouldn't do it, sorry.

This bug was disgust here.
Here is the bug report that I started about the problem.
If you read comment #2 you will see probably the best solution for most peoples requirments.

Nokia don't seem to be interested in following on with what seemed to be standard practice in most of there other emailing phones in giving you a choice of how to delete your mail.

The Sand 2010-07-30 22:32

Re: Modest fixes
 
Quote:

Originally Posted by JonWW (Post 770780)
But it's not in the N900's options, so it still shouldn't do it, sorry.

I would never argue with that. I completely agree. I am arguing for the "options" to do it.

In the end... It's completely ridiculous to have a smartphone that can't delete from the server unless you access the account from the web. It's an embarrassment really...

There are so many bugs in the email client it's staggering. Maybe report this one. When deleting email from Gmail's inbox it goes to "All" mail - from there you have to select "move" to get it to the trash - Once in trash you can finally delete it. In other words, "delete" in Gmail doesn't work. I won't go on that Bug website, I hate that place - if you are a member maybe you can report that bug.

Sorry for the misunderstanding... hoping in the future, with the right options, that bug turns into a usable feature!

Sandy

DrWilken 2010-07-30 22:37

Re: Modest fixes
 
Quote:

Originally Posted by The Sand (Post 767279)
you will see the directory go to user/home

It's /home/user... Not user/home... ;)

On Linux (and other "UNIX" variants) /home contains all non-root user's home directories by default (root's homedir is normally /root).

On Maemo the "normal" (unprivileged) user is called user so therefore the home directory for this user is placed in /home/user... ;)

The Sand 2010-07-30 22:49

Re: Modest fixes
 
Those directions were copied and pasted from ceroberts 75 off the Nokia Forum. Here is the link:

http://discussions.nokiausa.com/t5/M.../731938#M15913

Without him I could not have done this fix... so if he is wrong in any way - you need to post it on the above link...

I did get it done though... and was very grateful.

Thanks for clarifying what is correct - it's always nice to learn something ;)

Sandy

DrWilken 2010-07-30 22:56

Re: Modest fixes
 
As long as You understood it he did a good job... That's what counts in the end... ;)

He DID state it correct later on though:

Quote:

sudo gainroot
cd /
tar xzf /home/user/MyDocs/.documents/modest-3.4.2-baxyp-1.tar.gz
The above is just another variant of what I mentioned earlier (and he uses the "Documents" (.documents)* folder instead of MyDocs in his example)... ;)

* When You use the built-in File Manager it shows the folder as Documents but it's actual name (as show in Xterm or when mouting via Windows) is .documents ... :) Pretty confusing. Don't know why they did it that way. The same goes for Images (.images), Sounds (.sounds) and Videos (.videos)... ;)

The Sand 2010-07-30 23:29

Re: Modest fixes
 
Once again, thanks for explaining. I was in over my head with this fix being a Windows user.

Most of the time you just live with bugs - but no POP3 incoming email rendered my phone just short of useless...

I am very grateful for the fix - to anybody and everybody that contributed in any way!

Thanks,
Sandy

baxyp 2010-07-31 00:38

Re: Modest fixes
 
Quote:

Originally Posted by The Sand (Post 767279)
...
My “wish” for mail in the future – when my other smartphones pull mail from Yahoo they don’t make Yahoo’s server “unavailable” for about 4 minutes. The N900 does. Hopefully that will be fixed in the future…

This is probably caused by the fact that modest stays connected to the mail server after send/receive (until server times out and disconnects it).

The Sand 2010-07-31 01:09

Re: Modest fixes
 
It appears to be only POP3. I doesn't happen with Gmail... you can be in Gmail on the N900 actively using it, and at the same time, access Gmail via the web.

For POP3 the server "unavailable" is proving a trial if you are pulling that POP3 account onto other smartphones or Outlook... if you hit send/receive during the "black out" Outlook will give you an error message when it's being nice - and crash when it's not.

So I hope somebody looks into it...

Sandy

bayernhan 2010-08-01 00:54

Re: Modest fixes
 
Quote:

Originally Posted by baxyp (Post 722013)
i did put together a custom version of modest, to fix some bugs that pr1.2 introduced: Send/receive and email notifications not working with pop3 accounts and messages deleted from server regardless of "leave messages on server" setting.
Latter was fixed in git already, for former i had to come up with some patches. I did make some performance improvements too, to reduce the time it takes to check for messages: Original version checked 3 times in a row when send/receive button was pressed in headers window :) now it does it only once.

The patched version, which is in attachment, is based on http://gitorious.org/modest/modest modest-3.4 branch. To install, copy this file to n900, become root and unpack it:
Code:

tar xzf modest-3.4.2-baxyp-1.tar.gz  -c /
this will overwrite /usr/bin/modest.launch and /usr/lib/camel-lite-1.2/camel-providers/libcamelpop3.so. Reboot your phone.

To uninstall, just reinstall modest and libcamelpop3 from pr1.2:
Code:

apt-get --reinstall install libtinymail-camel-1.0-0 modest
i have tested it with my pop3 and gmail accounts and it seems to be working fine, but i cannot give any guarantees, use at your own risk.

i beg you sir please please fix the gpu drivers to enable vsync!!!!!

baxyp 2010-08-01 01:31

Re: Modest fixes
 
Quote:

Originally Posted by bayernhan (Post 771750)
i beg you sir please please fix the gpu drivers to enable vsync!!!!!

:) I would very much like to see these fixed, too, but unfortunately, GPU drivers are closed source. And besides, broken vsync is not the only problem, real buffer swaps are missing too (emulated with blits).

jacktanner 2010-08-01 01:41

Re: Modest fixes
 
baxyp, thanks for your very hard work. i'm a bit paranoid about installing a modest with patches that aren't upstream, though. have you pushed your work upstream and/or to bugzilla?

qwerty12 2010-08-01 01:43

Re: Modest fixes
 
Quote:

Originally Posted by jacktanner (Post 771765)
baxyp, thanks for your very hard work. i'm a bit paranoid about installing a modest with patches that aren't upstream, though. have you pushed your work upstream and/or to bugzilla?

Looking at those patches, there's really nothing to be paranoid about.

P.S. baxyp, G_STRFUNC!

soeiro 2010-08-02 23:12

Re: Modest fixes
 
@baxyp

Inspired by your patches I've grabbed Modest sources and start to look for a way to skip large emails in POP3. But the code is already there. It reads the msg_size_limit from gconf and then it should skip those messages. I went there and included a 100KB limit to test it but it didn't work: the N900 still lists the >100KB emails in the inbox...

Now, the question. Did you see, in any place in modest code, some way of making it behave like this (for POP3)?
1) Skip mails larger then the gconf option (it seems to be already there)
2) When downloading, download the full messages, instead of only the headers, skipping the large emails, of course.

Hrw 2010-08-05 08:25

Re: Modest fixes
 
I built latest tinymail (1.1.92) and modest 3.4.8. Works but segfaults randomly :(

jcompagner 2010-08-05 09:24

Re: Modest fixes
 
baxyp, did your changes get pushed to git?

Also i see in the logs that there are still changes now and then, it would be great if somebody now and then could make a new build that we then can use.. (i really hate that modest is part of the firmware update, why oh why oh why)

Gusse 2010-08-05 11:54

Re: Modest fixes
 
Quote:

Originally Posted by baxyp (Post 722251)
Ok, I uploaded debian packages to another server, libtinymail-camel is too large for an attachment:

libtinymail-camel-1.0-0_1.1.91-baxyp.1_armel.deb
modest_3.4.2-baxyp.1_armel.deb

Anyway, I do not recommend those as these broke my ability to apt-get another packages later. libtinymail-camel contains other camel libs in addition to libcamelpop3 and this may break something. The tar.gz method should be fine until PR1.3 and considering how long it took for 1.2, I think there is time :)

Is there a way to re-install original files and then do unpacking of tar-file (i.e. undo apt-get breakdown)?

baxyp 2010-08-05 11:55

Re: Modest fixes
 
No, my changes are not in git, but both problems, should be resolved there already. Performance improvement patch, which is basically one liner to disable redundant mail checks, could be pushed to git though. I'm not sure I'm doing the right thing there, but it seems to work. Maybe it is better to make a separate bug report about modest checking mail 3 times when send/receive is pressed and let the original developers work on a proper solution. It amazes me though that they have missed such a very obvious flaw. When you run modest with debugging on you can easily see the redundant action taking place (export CAMEL_DEBUG=all; modest) ...

jcompagner 2010-08-05 16:09

Re: Modest fixes
 
problem is, and i still am "profiling" that a bit.
But it seems that checking mail kost quickly 10MB of data!!
I still dont get how that even is possible. But i have a very expensive phone bill because of that, At least it has to be Modest (dont know anything else). Also a co worker of mine told me the same story, he was through 20MB of data in notime..

ToJa92 2010-08-05 16:14

Re: Modest fixes
 
Quote:

Originally Posted by Gusse (Post 776486)
Is there a way to re-install original files and then do unpacking of tar-file (i.e. undo apt-get breakdown)?

apt-get install --reinstall modest
Should do it.

Gusse 2010-08-05 18:34

Re: Modest fixes
 
Quote:

Originally Posted by ToJa92 (Post 776718)
apt-get install --reinstall modest
Should do it.

No luck with that or
Code:

apt-get --reinstall install libtinymail-camel-1.0-0 modest
Code:

/home/user # apt-get install --reinstall modest
Reading package lists... Done
Building dependency tree     
Reading state information... Done
Reinstallation of modest is not possible, it cannot be downloaded.
You might want to run `apt-get -f install' to correct these:
The following packages have unmet dependencies:
  mp-fremantle-generic-pr: Depends: modest (= 3.2.13-3+0m5) but 3.4.2-baxyp.1 is to be installed
                          Depends: libtinymail-camel-1.0-0 (= 1.1.90-svn4193+0m5) but 1.1.91-baxyp.1 is to be installed
E: Unmet dependencies. Try 'apt-get -f install' with no packages (or specify a solution).

Anyway, this not a big problem cause modest is working fast and without any problems. Just checking if there is a way to go back to normal PR1.2 and then implement tar-file fix.

E: Would this do more harm than good?
Code:

apt-get --purge remove libtinymail-camel-1.0-0 modest

kenshail 2010-08-12 19:39

Re: Modest fixes
 
Quote:

Originally Posted by baxyp (Post 722013)
I did put together a custom version of modest, to fix some bugs that PR1.2 introduced: send/receive and email notifications not working with POP3 accounts and messages deleted from server regardless of "Leave messages on server" setting.
Latter was fixed in git already, for former I had to come up with some patches. I did make some performance improvements too, to reduce the time it takes to check for messages: original version checked 3 times in a row when send/receive button was pressed in headers window :) Now it does it only once.

The patched version, which is in attachment, is based on http://gitorious.org/modest/modest modest-3.4 branch. To install, copy this file to N900, become root and unpack it:
Code:

tar xzf modest-3.4.2-baxyp-1.tar.gz  -C /
This will overwrite /usr/bin/modest.launch and /usr/lib/camel-lite-1.2/camel-providers/libcamelpop3.so. Reboot your phone.

To uninstall, just reinstall modest and libcamelpop3 from PR1.2:
Code:

apt-get --reinstall install libtinymail-camel-1.0-0 modest
I have tested it with my POP3 and gmail accounts and it seems to be working fine, but I cannot give any guarantees, use at your own risk.

Did you get rid of the RSET that modest annoyingly sends before closing the smtp session??

baxyp 2010-08-12 20:03

Re: Modest fixes
 
No, I did not touch any of the commands it sends to server. What's the problem with RSET ?

kenshail 2010-08-13 18:07

Re: Modest fixes
 
Quote:

Originally Posted by baxyp (Post 784586)
No, I did not touch any of the commands it sends to server. What's the problem with RSET ?

RSET clears the received data from the smtp server object before it has chance to be used.

RFC821 states
"
RESET (RSET)
This command specifies that the current mail transaction is
to be aborted. Any stored sender, recipients, and mail data
must be discarded, and all buffers and state tables cleared.
The receiver must send an OK reply.
"

baxyp 2010-08-13 18:26

Re: Modest fixes
 
Does it cause any problems or is it just an unnecessary command before the connection gets closed ?

kenshail 2010-08-13 18:37

Re: Modest fixes
 
Yes
I use the Perl smtp server libraries in my smtp servers. They complete the smtp session (up to QUIT) before making the payload available to the calling process.The result is that the RSET deletes the payload (from, to and data) before it can be read. I have had to disable the RSET function of the servers to enable the N900 to work with them. I have checked an outlook express smtp session and cant see a RSET command. It is highly likely that smtp servers that process the incoming data as it arrives, during the session would be immune to the RSET but the RFC suggest that it is only to be used in failed sessions so I cant see why it should be sent in a successful session.

jacktanner 2010-08-13 18:43

Re: Modest fixes
 
kenshail, have you filed a bug report regarding this with the modest folks?

kenshail 2010-08-13 18:55

Re: Modest fixes
 
No, I guess I should.
I am also seeing a problem over gsm:
Modest seems to skip to the QUIT without delivering the DATA when there is a slow connection. Its as if there is a timeout where it gives-up on a slow connection. Ironically there is no RSET in that situation. The N900 (quite correctly) declares it a "fail".
I haven't used the modes reporting procedure before so will try it.

ceroberts75 2010-08-19 03:46

Re: Modest fixes
 
i just reflashed my device and have this file in my n900 folder.


just like before and on my other units, i have done your command

tar xzf modest-3.4.2-baxyp-1.tar.gz -C /


yes...2 spaces after gz and 1 after C.


i get the following

[code]

tar: modest-3.4.2-baxyp-1.tar.gz: Cannot open: No such file or director
tar: Error is not recoverable: exiting now
tar: Child returned status 2
tar: Exiting with failure status due to previous errors
/home/user #

Saturn 2010-08-19 18:10

Re: Modest fixes
 
Hi,

It would be great if someone could backport the fix of
https://bugs.maemo.org/show_bug.cgi?id=8919

thx

Crashdamage 2010-08-19 18:45

Re: Modest fixes
 
Quote:

Originally Posted by ceroberts75 (Post 791302)
[code]

tar: modest-3.4.2-baxyp-1.tar.gz: Cannot open: No such file or director

You must not be in the correct directory. Make sure you 'cd' to the exact location of the file before untarring the file.


All times are GMT. The time now is 00:40.

vBulletin® Version 3.8.8