maemo.org - Talk

maemo.org - Talk (https://talk.maemo.org/index.php)
-   General (https://talk.maemo.org/forumdisplay.php?f=7)
-   -   Wikipedia (offline) on the 770? (https://talk.maemo.org/showthread.php?t=3140)

schmolch 2006-09-23 13:20

Wikipedia (offline) on the 770?
 
Does anyone know a way to put a (reduced) offline-version of the wikipedia on the 770?

schmolch 2006-09-23 15:42

Wikipedia offers static html dumps on download.wikimedia.org/static.
The german wikipedia dump is 1.4GB compressed with 7z and uncompressed it is probably way way way bigger than 2GB (somewhere i have read that a 1.9GB english 7z is 27GB uncompressed).
And this does not include any images! (AFAIK)
I would not hesitate to buy another 2GB Card to have the wikipedia with me all the time because many times i walk around and wonder about things i see and it would be super-awesome if i could look it up immediately.
Now, do you think one could format the Card with this compressed filesystem thingie which the 770 uses internally and can anyone possible guess how much space you could save this way if all you put on it are html-files?
html seems to compress nicely, right?

aleksandyr 2006-09-23 16:51

http://encyclopodia.sourceforge.net/en/index.html

They've got a readable format that clocks in at around 1.1GB for an English wikipedia set (admittedly an older one, 5/2006.)

FTR those aren't static HTML, they're an XML format that MediaWiki can import. Running MediaWiki on the 770 is certainly possible, it's just a bad idea.

schmolch 2006-09-23 17:38

Are you suggesting to take those ebooks and import them into a full mediawiki installation on a 770?
That does not only seem like a bad idea to me but more like insanity ;)

schmolch 2006-09-24 11:37

Doesnt look good.
The 2 most promising projects, wik2dict and wiki2plucker seem to be abandonend or not updated since months.
The commercial readers are not available for the 770 and the static html is way too big (>15GB for the german wikipedia) even if you would put it on a jffs2.

aleksandyr 2006-09-24 16:33

I was referring to the dumps they offer.

jffs2 is Journaling Flash FileSystem version 2. Squashfs is what you're looking for.

No, I'm saying that porting the concept of encyclopodia would work, weighing in at around a gig and change.

schmolch 2006-09-24 19:44

aleksandyr, can you do that by next weekend ;) ?

But there is new hope, i just tried squashfs and it compressed a 180MB dir with html-files from the static wikipedia down to 21MB.
The full german static wikipedia uncompressed was around 20GB, im still cutting stuff out like discussions and user-pages (just what i could see scrolling by that looked unnecessary) and i guess it will go down to like 15GB.
That would result in 1.7GB with squashfs :-)

Assuming this all works out i would have to get squashfs-support into the 770's kernel, does anyone know how to do that?
I know how to compile a kernel but i neither have the kernel-config nor do i know how to create that image-file which is flashed into the 770.

Nightmare 2006-09-25 14:21

There is a german mobil offline Wikipedia with 790 MB for:
Palm OS, Symbian OS, Pocket PC 2000/2002/Windows Mobile 2003, Windows 95 until XP and Windows CE

http://www.libri.de/shop/shortcut/wikipedia

link from:
Kostenloses Wikipedia-eBook für Handy, PC und Handheld
http://www.heise.de/newsticker/meldung/78634

schmolch 2006-09-25 14:43

You need a mobipocket reader for this one and this doesn't work on the 770 because
a.) the reader is not available for 770 and they dont care to make one
b.) fbreader can read un-drm'ed mobipocket ebooks but not this one because it uses a unsupported compression method.

schmolch 2006-09-25 17:34

There is a HowTo about making your own kernel on maemo.org but i have not yet managed to patch the kernel with squashfs. The patching reports no problems but the squashfs-support is not there :-(

schmolch 2006-09-25 18:23

I patched and flashed the kernel, i could see the squashfs-module was built but im not positive that everything is alright with it. modprobe doesnt work on the 770.
I tried to mount a squashfs-image with "mount -t squashfs -o loop file.image /dir" but i got a "no such device error".
I got the same error before i patched the kernel.

Im out of ideas for the moment, maybe someone can inspire me?

aleksandyr 2006-09-25 18:24

I really don't like kernel patching: perhaps try squashfs as a module?

Offline applications (except offline navigation applications!) are kind of a low priority for me, as I have a BT cellphone and unlimited data plan.

That said, I will throw some cycles at it, as the heavy lifting should already be done ;)

http://code.plkr.org/ep/ seems Very interesting, by the by.

schmolch 2006-09-25 18:29

Hmm, i think i am a little confused about this kernel-config thing.
I looked at the default kernel-config and could not find squashfs and assumed its not in there. So i patched the kernel and after some more wondering i just added CONFIG_SQUASHFS=m into the config myself.

And yes, the plucker thing looks great and i would certainly pay for it but it has not been updated since may, i hope its not abandoned.

schmolch 2006-10-08 12:16

it works now.
-o loop is not supported by the mount-command on the 770 but somebody from the mailinglist made a binary of losetup which lets you work around that.

Now with squashfs i could shrink the german wikipedia (no pictures, discussions, user-pages...) to 1.75GB and can barely fit that on my 2GB card but hopefully i will find more stuff to delete so that i can fit a few other things onto the card as well.

aleksandyr 2007-03-14 20:17

Re: Wikipedia (offline) on the 770?
 
I will state, for the record, I still hate webapps.

For those interested, please take a look at:
http://users.wpi.edu/~chaos/wiki.squashfs (63MB)

Mount this (or unsquashfs it, but that will more or less quadruple it!) and you'll have a small subset of articles (from Wikipedia-on-CD-2006) and a working JavaScript-based search engine. Runs quite sexily on my N800 in unsquashed form, haven't -quite- gotten squashfs working yet.

My next project will be a http://wikifilter.sourceforge.net/ distribution that will target the 2GB cards and include a more powerful search feature, etc.

Enjoy!

bergie 2007-03-19 08:59

Re: Wikipedia (offline) on the 770?
 
These guys have an offline Wikipedia for CDs:

http://www.moulinwiki.org/

If I understood correctly, they have also experimented with Wikipedia for Nokia 770.

cybe 2007-03-19 11:09

Re: Wikipedia (offline) on the 770?
 
Another alternative:- http://sdict.com/en/

(there's atleast one other thread about this on this forum btw)


All times are GMT. The time now is 19:57.

vBulletin® Version 3.8.8