Debian Etch, Rebuilt: 6,451 .debs for Maemo 5

[jebba]

Hey,

* I rebuilt all Debian Etch source packages with the Maemo 5 SDK and sdbmock.

* 10,220 Source packages processed.

* 6,451 .debs produced.

* The job ran for 8 days.

* They have not been run through maemo-optify yet--I will test the fix for the recursive symlink bug[1] when ready.

* They were compiled against the current maemos-extras repository. They have no dependencies other than that. In other words, no package within the rebuild depends on anything else in the rebuild--this is the first pass.

* I could batch import packages that don't already exist in extras-devel. I think this would be rad.

* Download locations (temporary):
Directory: http://obra.freemoe.org/freemoe-etch/
Install file for N900: http://obra.freemoe.org/obra.install
/etc/apt/sources.list:
deb http://obra.freemoe.org/ freemoe-etch/

* Thx Ed for sbdmock help.

* Have fun.

[1] https://bugs.maemo.org/show_bug.cgi?id=7707

[nightfire]

Outstanding! You are the man! :)

Just grabbed a bunch of packages I've been longing for but too lazy to recompile. Thanks!

[filologen]

This is truly appreciated:-) Thanks for taking the time to do this!

[nightfire]

The last pocket computer I had was a Zaurus c760. It was waaaaay ahead of its time, and so close to what I thought it could be. But it just wasn't there yet.

Today I got my exchange sync working, which was my last remaining issue. And now, jebba puts up a Debian repo with more packages than existed for even openzaurus/angstrom.

A gcc toolchain, perfectly functioning radios, slick and responsive UI, office integration, razor sharp 80x25 console window, X11, iptraf, joe, ssh -X, unison, bluetooth headphones for those morning walks... everything works!

I am too happy. :) This might be the nerdiest thing I've ever said, but I feel like I'm about to wake from a dream..lol.

[jebba]

* http://thread.gmane.org/gmane.comp.handhelds.maemo.devel/24237

* http://wiki.maemo.org/User:Jebba/Etch

Practicing my loops.

[asys3]

Great job!

But got an error from my progam manager when importing the install file.

Is the install file working for maemo5?

Hope to get it working.

asys3

[jebba]

Is the install file working for maemo5?

Yes.

Hope to get it working.

try try try again? ;)

You may need a decent chunk of free space on / to get the archive list.

[406NotAcceptable]

Maybe I am missing something here, but Debian Lenny has armel packages. I have used the lenny repository on the N900 to install a few things e.g. Nano, Aircrack, and macchanger. I guess there may be more packages in your repository :/

A nice effort and contribution though!

[asys3]

Sorry, still does not work for me.
Programmanager fails in adding the catalog.

In
/etc/apt/sources.list.d/hildon-application-manager.list

I found the line
deb http://obra.freemoe.org/ freemoe-etch

which seems to be incorrect because from a shell I get:

#apt-get update
E: Malformed line 9 in source list /etc/apt/sources.list.d/hildon-application-manager.list (dist parse)

I thing either a directory is missing on your server or the install file is incorrect.

asys3

[Hrw]

Etch was released at beginning of 2007 which makes it about 3 years old. Adding release freeze means that software has ~3.5 year now.

I know that for Maemo5 it is fresh new stuff (as there are pre-Etch components in rootfs) but I hope that at least Maemo6 will finally be rebased to something more fresh (Lenny for example).

[mymybib]

Hi asy3,
put this line in your /etc/apt/sources.list.d/hildon-application-manager.list

deb http://obra.freemoe.org/ freemoe-etch user

[406NotAcceptable]

Etch was released at beginning of 2007 which makes it about 3 years old. Adding release freeze means that software has ~3.5 year now.

I know that for Maemo5 it is fresh new stuff (as there are pre-Etch components in rootfs) but I hope that at least Maemo6 will finally be rebased to something more fresh (Lenny for example).

I think that answers my query as to why you would port from Etch!

Since Lenny already has components for the armel architecture, I would expect Maemo 6 to be based on that.

[asys3]

Hi asy3,
put this line in your /etc/apt/sources.list.d/hildon-application-manager.list

deb http://obra.freemoe.org/ freemoe-etch user

With this apt-get update goes some steps further but says:

W: Failed to fetch
http://obra.freemoe.org/dists/freemoe-etch/user/binary-armel/Packages
404 Not Found

asys3

[jebba]

With this apt-get update goes some steps further but says:

W: Failed to fetch
http://obra.freemoe.org/dists/freemoe-etch/user/binary-armel/Packages
404 Not Found

asys3

Ya, there is no "user" in the path. Just try deleting whatever you have in your catalogs for this repo and then click on this file:

http://obra.freemoe.org/obra.install

This is known to have the correct path, so you don't have to (and shouldn't) change anything.

[jebba]

Maybe I am missing something here, but Debian Lenny has armel packages. I have used the lenny repository on the N900 to install a few things e.g. Nano, Aircrack, and macchanger. I guess there may be more packages in your repository :/

Actually rebuilding them against the same root/libraries as are on the device is far cleaner and less likely to have conflicts.

[asys3]

Ya, there is no "user" in the path. Just try deleting whatever you have in your catalogs for this repo and then click on this file:

http://obra.freemoe.org/obra.install

This is known to have the correct path, so you don't have to (and shouldn't) change anything.

Sorry, no.

As I posted above the program manager fails in adding that catalog.
Did anyone get it working?

If I try apt-get update with that catalog apt-get complains about an parse error (see above).

As I understand it dist and component must be set in a catalog.
...and the corresponding direcories must exist on the repository server.
Or you leave component/dist empty and put the repo in the root dir.

Could you post the URL of the binary packages?
I couldn't find them under
http://obra.freemoe.org
Some are under sources (?!) but not all.

asys3

[jebba]

Sorry, no.

As I posted above the program manager fails in adding that catalog.
Did anyone get it working?

Yes, I see people hitting it from their N900s (including me).

If I try apt-get update with that catalog apt-get complains about an parse error (see above).

As I understand it dist and component must be set in a catalog.
...and the corresponding direcories must exist on the repository server.
Or you leave component/dist empty and put the repo in the root dir.

Could you post the URL of the binary packages?
I couldn't find them under
http://obra.freemoe.org
Some are under sources (?!) but not all.

http://obra.freemoe.org/freemoe-etch/

Again, did you delete the catalog and re-add it?

[hawaii]

Hot **** dood.

Thanks for posting this up!

[SWFu]

I've the same issues as asys3 here, throws an error when installling.

Edit: Typically i tried installing dsniff and driftnet, both of which are'nt there.

[jebba]

I've the same issues as asys3 here, throws an error when installling.

I was able to reproduce it now. (Note if you actually say what the exact error is, it helps.)

I just added a trailing "/" to the URL and it works as before.

(That said, I do have a pretty crappy directory layout for all this--it really wasn't meant to be a main repo, but just a first dumping ground of the builds.)

[jebba]

Etch was released at beginning of 2007 which makes it about 3 years old. Adding release freeze means that software has ~3.5 year now.

I know that for Maemo5 it is fresh new stuff (as there are pre-Etch components in rootfs) but I hope that at least Maemo6 will finally be rebased to something more fresh (Lenny for example).

Even Lenny seems pretty ancient...

I'd love to build more recent packages, but automating that is a bit tricky since the Maemo 5 SDK tools are from the stone age...

[jebba]

Edit: Typically i tried installing dsniff and driftnet, both of which are'nt there.

They didn't build due to missing dependencies. Build logs for the two are here:


http://obra.freemoe.org/freemoe-etch/d/driftnet/root.log


http://obra.freemoe.org/freemoe-etch/d/dsniff/root.log

[asys3]

I just added a trailing "/" to the URL and it works as before.

(That said, I do have a pretty crappy directory layout for all this--it really wasn't meant to be a main repo, but just a first dumping ground of the builds.)

Yep!
Now the line
deb http://obra.freemoe.org/ freemoe-etch/
is added to the repository list.

And that works both for prog manager and apt-get!

Thanks again for your work.
asys3

[mdengler]

jebba - could you share your /etc/apt/sources.list and any special steps (beyond "apt-get -b <pkg>") that you needed to get all these to build?

[jebba]

jebba - could you share your /etc/apt/sources.list and any special steps (beyond "apt-get -b <pkg>") that you needed to get all these to build?

There's a package in extras-testing called "freemoe" which has a few scripts for rebuilding. There are configs in the server/obra sub directory for sbdmock etc.

I also have a git archive which has more recent build configs/scripts and also has scripts for building on Amazon's EC2.

http://gitorious.org/freemoe

http://gitorious.org/freemoe/freemoe/blobs/master/bin/freemoe-build-node-setup
http://gitorious.org/freemoe/freemoe/blobs/master/bin/freemoe-rebuild-debs
http://gitorious.org/freemoe/freemoe/blobs/master/bin/freemoe-rebuild-etch
http://gitorious.org/freemoe/freemoe/blobs/master/bin/freemoe-sbdmock

http://gitorious.org/freemoe/freemoe/blobs/master/servers/obra/sbdmock/espejo-maemo-fremantle-armel-extras-devel.cfg

[jebba]

The Debian Etch rebuilt for Maemo 5 repo has been maemo-optified with the latest version 0.3 from git. This hopefully fixes problems related to plugins and such[1].

Let me know if you see any issues due to optification as this is a test run of the latest version before it is run on all new builds.

[1] https://bugs.maemo.org/show_bug.cgi?id=7707

[hstende]

Did you compile it some optimized flags like neon and those mentioned on this side
http://armin762.wordpress.com/2009/12/18/armv7-stages-available/

[jebba]

Did you compile it some optimized flags like neon and those mentioned on this side
http://armin762.wordpress.com/2009/12/18/armv7-stages-available/

No, but that would be very nice.

[mdengler]

There appears to be some problem with the git package...I had installed my own optified git .deb [1] and when I added your repo to my sources.list and ran "apt-get install git" I got the following problems during your post-install:

http://www.martindengler.com/~martin/tmp/git-problem.txt

Note also that dpkg now refuses to remove your git package :(.




1. http://www.martindengler.com/~martin/tmp/git_1.6.5.7-3_armel.deb

[mdengler]

There appears to be some problem with the git package...I had installed my own optified git .deb [1] and when I added your repo to my sources.list and ran "apt-get install git" I got the following problems during your post-install:

http://www.martindengler.com/~martin/tmp/git-problem.txt

Note also that dpkg now refuses to remove your git package :(.




1. http://www.martindengler.com/~martin/tmp/git_1.6.5.7-3_armel.deb

[jebba]

I am seeing the same problem with the new maemo-optify, so I am reverting the repo to the non-optified version until it gets fixed. I will also followup on the bug report:
https://bugs.maemo.org/show_bug.cgi?id=7707

[jebba]

There appears to be some problem with the git package...I had installed my own optified git .deb [1] and when I added your repo to my sources.list and ran "apt-get install git" I got the following problems during your post-install:

http://www.martindengler.com/~martin/tmp/git-problem.txt

Note also that dpkg now refuses to remove your git package :(.

1. http://www.martindengler.com/~martin/tmp/git_1.6.5.7-3_armel.deb

I ran into the same issue and put the info in the bug report. Here is how I got rid of the stubborn package I installed:

~ $ sudo dpkg --remove bwbar
(Reading database ... 31118 files and directories currently installed.)
Removing bwbar ...
rm: cannot remove '/usr/sbin/bwbar': No such file or directory
dpkg: error processing bwbar (--remove):
subprocess post-removal script returned error exit status 1
Errors were encountered while processing:
bwbar
~ $ sudo touch /usr/sbin/bwbar
~ $ sudo dpkg --remove bwbar
(Reading database ... 31118 files and directories currently installed.)
Removing bwbar ...

In other words, just `touch /usr/bin/git-foo` for each file missing and then you will please dpkg. Perhaps there is a dpkg option too...

[jebba]

I have re-optified the etch builds with the latest maemo-optify git mentioned here:
https://bugs.maemo.org/show_bug.cgi?id=7707#c9

[DrWilken]

* 6,451 .debs produced.

:eek:

Thanks Jebba... You're awesome... ;)

You deserve a link in my sig... :)

[Meelis]

I guess I have to say thanks :)

Although, I wanted to get the wpasupplicant from there, but noticed only later that it also failed to build.

Yet the joy from your effort might come in another day. ^.^

[jebba]

Although, I wanted to get the wpasupplicant from there, but noticed only later that it also failed to build.


I have built wpasupplicant and added it to my repo. If someone confirms it works, I'll upload it to extras-devel.

http://www.freemoe.org/users/jebba/jebba.install
http://www.freemoe.org/users/jebba/dists/unstable/main/binary-armel/

(Note, this is a different repo than the Debian Etch repo.)

[jebba]

I have reprocessed the repo (again) with the latest maemo-optify.

[mikec]

Jebba

I'm developing maesynth and need fluidsynth deb which seems to be listed in your repo, but when I do an apt-get install fluid synth (after installing your repo) it says it cant find it.

Any chance I can get you to upload this into extras, pretty please.

[jebba]

Jebba

I'm developing maesynth and need fluidsynth deb which seems to be listed in your repo, but when I do an apt-get install fluid synth (after installing your repo) it says it cant find it.

Any chance I can get you to upload this into extras, pretty please.

fluidsynth didn't build due to missing dependencies, sorry.

-Jeff

[mikec]

fluidsynth didn't build due to missing dependencies, sorry.

-Jeff

Ok Cheers Jeff, its a shame as we have it in diablo :confused:

[mdengler]

BTW - any chance of getting some of these packages into extras-devel? GNU Screen and git, for example?

I'm happy to help with that if you point me in the right direction.

[AlMehdi]

I have added the repo and no faults show up. Still it looks empty. I have searched for some programs but not been able to find them.

I have checked apt-get, apt-cache and HAM.. but nothing.

[j.s]

BTW - any chance of getting some of these packages into extras-devel? GNU Screen and git, for example?

I'm happy to help with that if you point me in the right direction.

To get screen, see my post #3 in thread http://talk.maemo.org/showthread.php?t=38428

There is also some general information about tools repositories.

[mdengler]

Thanks - ISTR that with tools enabled, apt-get upgrade did something I don't want, so I don't have it enabled by default.

[mdengler]

[QUOTE=j.s;656927]To get screen, see my post #3 in thread http://talk.maemo.org/showthread.php?t=38428

Does screen install cleanly for you?


# apt-get install screen
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following extra packages will be installed:
libncursesw5
The following NEW packages will be installed:
libncursesw5 screen
0 upgraded, 2 newly installed, 0 to remove and 14 not upgraded.
Need to get 936kB of archives.
After this operation, 1606kB of additional disk space will be used.
Do you want to continue [Y/n]? y
WARNING: The following packages cannot be authenticated!
libncursesw5 screen
Authentication warning overridden.
Get:1 http://repository.maemo.org fremantle/tools/free libncursesw5 5.7+20081213-1.maemo1+0m5 [341kB]
Get:2 http://repository.maemo.org fremantle/tools/free screen 4.0.3-0.3osso4+0m5 [595kB]
Fetched 936kB in 6s (155kB/s)
Selecting previously deselected package libncursesw5.
(Reading database ... 43753 files and directories currently installed.)
Unpacking libncursesw5 (from .../libncursesw5_5.7+20081213-1.maemo1+0m5_armel.deb) ...
Selecting previously deselected package screen.
Unpacking screen (from .../screen_4.0.3-0.3osso4+0m5_armel.deb) ...
Setting up libncursesw5 (5.7+20081213-1.maemo1+0m5) ...
ldconfig: /usr/lib/libosmgpsmap.so.0 is not a symbolic link

Setting up screen (4.0.3-0.3osso4+0m5) ...
/var/lib/dpkg/info/screen.postinst: line 23: /usr/sbin/add-shell: not found
install-info(/usr/share/info/screen.info): no file /usr/share/info/dir, retrieving backup file /var/backups/infodir.bak.

[j.s]

[QUOTE=j.s;656927]To get screen, see my post #3 in thread http://talk.maemo.org/showthread.php?t=38428

Does screen install cleanly for you?

(snip)

Setting up screen (4.0.3-0.3osso4+0m5) ...
/var/lib/dpkg/info/screen.postinst: line 23: /usr/sbin/add-shell: not found
install-info(/usr/share/info/screen.info): no file /usr/share/info/dir, retrieving backup file /var/backups/infodir.bak.
[/CODE]

It was back in December, but I think so. I would have mentioned it if it did not. I do not remember if libcurses had already been installed because of something else. I think not, because I would probably have tried putting the screen executable in usr/local/bin without installing it. I had done that with some other binaries, but it was nice to find a maemo package for it.

Maybe one of the maemo updates breaks installing screen and/or curses? Also, maybe I did not notice the postinstall error. Were left with a screen executable in your path or anywhere? Does it work?

You might also file a bug against the screen maemo package.

[j.s]

Thanks - ISTR that with tools enabled, apt-get upgrade did something I don't want, so I don't have it enabled by default.

I thought apt-get upgrade was a no-no in maemo.

[dazzakoh]

I have a similar problem to asys above: I have used the install file from Obra, but the catalogue shows up as empty in my Application Manager.

I have disabled all other catalogues. When I do an update, the log files shows a whole long list of :

apt-worker: Ignoring version from wrong domain base-files 4
apt-worker: /var/lib/apt/lists/obra.freemoe.org_freemoe-etch_packages

etc
etc


PR1.2 - shouldn't have an impact, right?

[qole]

wmctrl would be very nice to have in Maemo Extras. It is an integral part of the keyboard focus hack (http://talk.maemo.org/showthread.php?t=36952).

EDIT: I just put the wmctrl source files (http://obra.freemoe.org/freemoe-etch/w/wmctrl/) from Jebba's repo into the Extras Assistant (https://garage.maemo.org/extras-assistant/index.php) and it seemed to build OK. So that means wmctrl should show up in Extras-devel soon now.

[telecomgeek79]

I have a similar problem to asys above: I have used the install file from Obra, but the catalogue shows up as empty in my Application Manager.

I have disabled all other catalogues. When I do an update, the log files shows a whole long list of :

apt-worker: Ignoring version from wrong domain base-files 4
apt-worker: /var/lib/apt/lists/obra.freemoe.org_freemoe-etch_packages

etc
etc


PR1.2 - shouldn't have an impact, right?


same issue here...Jebba? something wrong?

[Captwheeto]

What happened to this repo? I'd like to check it out but it seems down

[jebba]

I have stopped doing Maemo development and that repo is no longer available.

I can give someone access to the files if they copy them to a new server they maintain.

[hawaii]

what's the compressed archive size? I'm sure I can find a server to plop it on for posterity sake.

[qole]

I could host it at qole.org as well... I supposedly have unlimited bandwidth and I haven't been hassled about any of my Easy Debian downloads, which can be north of 70 GB a month for Dreamhost...

[Captwheeto]

I would really like this a lot. Is there any guide out there which is pretty thorough in how to port applications from Debian to maemo? I've been wanting finch for so long you see.

[qole]

jebba: thanks for re-activating the repo. Any chance of tarring it all up for us and leaving it somewhere, so I can get a copy for my repo?

[Crogge]

Just PM me if you need a new host for the files

[MohammadAG]

jebba: thanks for re-activating the repo. Any chance of tarring it all up for us and leaving it somewhere, so I can get a copy for my repo?

Shouldn't wget -m or wget -r work?

[qole]

So far, no luck. I tried from dreamhost, and it first downloads all sorts of spurious index.html files and a bunch of multi-gigabyte facebook name lists. I tried again with
wget http://obra.freemoe.org -m -R index.html*,facebook* and that was working for a while (~20 minutes) and then I got:
Yikes! One of your processes (wget, pid 16102) was just killed because your processes are, as a whole, consuming too much memory. If you believe you've received this message in error, please contact Support.

I guess I could try with my own machine, but the bandwidth is a lot more limited...

The simplest method is to post a freemoe-etch.tar.bz2 file.

[qole]

Tried again. wget 1.11.4 (the version in use on my dreamhost server) doesn't seem to want to get the files at the end of each directory (files like the ones in this directory (http://obra.freemoe.org/binary-armel/a/a2ps-perl-ja/)). I don't know why... :confused:

EDIT: Same thing's happening on my home computer, running Lucid's wget 1.12! HUH?!

[Nokia 5700]

Have you specified -r so that it will download recursively?
Works for me if i want a copy of a website along with the files. :)

EDIT: It has started. Will see about the results. If i get some packages, i'd say it works.
But so far, no .deb files.
Might have something to do about recursion depth.
Ok... not recursion depth.

I cant figure this out, either. :confused: (Attempting from Ubuntu Maverick with wget 1.12)

[dazzakoh]

Did wget with -r as well yesterday.. Again, only blank folders created: unable to get to the files... Running Debian Testing

[Captwheeto]

Have you told it to ignore robots?

[jebba]

Well, you should be able to get wget to work, but even better is rsync along the lines of:

mkdir myfreemoedir

rsync \
-ulta \
-v --progress --stats \
rsync://obra.freemoe.org/obra/freemoe-etch-OPTIFIED/ \
myfreemoedir

There are a few repos there, some optified, some not. Nokia never fixed broken optification, so many optified apps are still fkted, this many months later...

https://bugs.maemo.org/show_bug.cgi?id=7707

The repos are between 7 and 10 gigs each.

[jebba]

I would really like this a lot. Is there any guide out there which is pretty thorough in how to port applications from Debian to maemo? I've been wanting finch for so long you see.

Maybe this would be of some use:
http://wiki.maemo.org/User:Jebba/Package_Building_HOWTO

[gsever]

Just out of curiosity,

Is there a similar build attempt of relatively new Debian squeeze packages for Maemo5?

[leetnoob]

I have 2 questions:

1. Is there any advantage to using a repo like this over installing easy debian and installing packages there?

2. If so , the repo seems down, did anyone manage to re-host it?

[radiochickenwax]

1. Is there any advantage to using a repo like this over installing easy debian and installing packages there?


The advantage is that the packages on such a repo do not have to run in an alternate (chroot = changed root) filesystem such as easy-debian, they can be run natively from the n900.


2. If so , the repo seems down, did anyone manage to re-host it?

I second this query. Could really use those packages right now.

[Bad_Habit]

seems to be unusable...

[2|user@n900|~]wget http://obra.freemoe.org/obra.install
--11:21:24-- http://obra.freemoe.org/obra.install
=> `obra.install'
Resolving obra.freemoe.org... 63.247.92.157
Connecting to obra.freemoe.org|63.247.92.157|:80... failed: Connection refused.

[insanelysexy]

Links are down !! Any mirrors ??