Active Topics

 


Reply
Thread Tools
qgil's Avatar
Posts: 3,105 | Thanked: 11,088 times | Joined on Jul 2007 @ Mountain View (CA, USA)
#1
Let me say BIG THANK YOU to Jeremiah, Niels and whoever else has been involved in the development of the maemo.org packages interface - http://communitizer.blogspot.com/200...-packages.html

Now... let's have a look to the queue of apps that have been pushed from extras-devel to extras-testing:

http://maemo.org/packages/repository...ng_free_armel/

Zero! OK, makes sense. How do we get started, though?

People testing Maemo 5 inside Nokia are configuring extras-devel and trying out apps available there. However, the % of apps with dependency problems or other basic issues is relatively high. Enough to feel lazy about filing bugs at that stage.

So what about starting the process of developers pushing the packages that they think are ready to extras-testing? This will be more human testers (Nokia developers with units, SDK users...) concentrated in less but more solid applications.
 

The Following 8 Users Say Thank You to qgil For This Useful Post:
andy80's Avatar
Posts: 131 | Thanked: 150 times | Joined on Jan 2007 @ Pistoia, Italy
#2
I've read that dependencies in maemo 5 are a very big headache... I think we'll have lot of problems if something doesn't change
 
thp's Avatar
Posts: 1,391 | Thanked: 4,272 times | Joined on Sep 2007 @ Vienna, Austria
#3
Originally Posted by qgil View Post
So what about starting the process of developers pushing the packages that they think are ready to extras-testing? This will be more human testers (Nokia developers with units, SDK users...) concentrated in less but more solid applications.
A final release announcement would give developers a reason to start polishing their apps for Fremantle.

Developing against a moving target like Fremantle that is hard to test in the current situation isn't fun:
  • No task switcher in SDK (developer can't test integration of their apps)
  • On-device software more recent than SDK contents (at least with beta1 this was the case for several weeks)
  • Slow test cycles: upload, ask testers, wait for reply, ...
  • On-device situations that are unreproducible in the SDK
  • On-device features that are not emulated by the SDK
  • Uncertain release date of final/frozen version

Having some kind of feature freeze or release announcement would help developers have a clear picture of what to expect in the end product and when to expect it. FLOSS developers write software in their free time.

Again, developers would have good reasons to get their apps running in Fremantle if they know the SDK contents are frozen (feature complete; only bugfixes) and they can expect a release in e.g. one month or whatever the timeframe is.
 

The Following 13 Users Say Thank You to thp For This Useful Post:
Posts: 398 | Thanked: 301 times | Joined on Sep 2007 @ Texas
#4
I resolved my dependency problem tonight, anyone with a real device and a Roku Soundbridge want to give Tabletbridge a try?

thanks,
Frank
 
Jaffa's Avatar
Posts: 2,535 | Thanked: 6,681 times | Joined on Mar 2008 @ UK
#5
Given the high developer relevance of this, I think maemo-developers should also be involved (if not the primary place of this discussion).

Otherwise, I'm echoing thp's thoughts entirely. The one bit of software I've published for Fremantle apparently has bugs, but I don't want more testing: I want to get the information necessary to fix those bugs first. Even once fixed, anyone using the accelerometers is going to have to have an awful lot of self-confidence to push something for wider testing.

Some of the "dependency problems" could also be being caused by the buggy implementation of the (not-quite-sure-if-it's-a-good-idea) third party package policy.
__________________
Andrew Flegg -- mailto:andrew@bleb.org | http://www.bleb.org
 

The Following 2 Users Say Thank You to Jaffa For This Useful Post:
qgil's Avatar
Posts: 3,105 | Thanked: 11,088 times | Joined on Jul 2007 @ Mountain View (CA, USA)
#6
I don't know whether this is a topic for maemo-developers, here or a sprint task. I was just trying to kick off the discussion.

With all the problems you point out...

I still think it's worth to open the maemo-testing door. First because we need to test and probably fine tune the own promotion from devel to testing. Better to do it now that things are relatively calm than when a final release is out and everybody is in a rush.

Actually it is good to note that we haven't agreed on the criteria and process to promote a package from -devel to -extras (or have we?). That would be a good start. There was this maemo-developers thread and there is a wiki page, but no conclusions AFAIR.

In principle the promotion is meant to be automatic: the maintainer of a package thinks it meets the -testing criteria and pushes a botton. Then the automatic process runs some automatic checks and either promotes it or keeps it in -devel. So we need to agree on the criteria, see what can be automated now and put the trust on the developers for the rest.

My initial proposal for -testing quality criteria was:

Requirements for extras-testing (should be testable automatically)
- Install and deinstall flawlessly.
- Don't bring conflicts in dependencies.
- Their info in the app manager is complete (icon, summary, URL to project, updates info).
- Have decent page in maemo.org/downloads.
- Have a place to report issues to the developers.
We should add "The developers thing it's ready for testing".

And that's it. The fine-tuning and polishing belongs more to the promotion from extras-testing to extras. I agree with you that it is difficult for most hobbyist developers to go through this task without a final SDK, a product announced and an idea about the sales start date.

Clearly the current situation doesn't help getting applications polished. We can't give any dates for further SDK releases, but we consider this Beta 2 quite stable. Fremantle is in pure bugfix mode targeting the final release. The plan is to have a pre-final SDK release that will become the final either without changes or through a minor update synchronised with the Maemo 5 final release.

About the origin of the package dependency problems... The fact is with 120 apps around it's difficult to keep track of the broken dependencies created by the Package Policy, the ones caused by dependencies on deprecated components, the Python related problems... You don't know whether the developer is aware or not, whether it's in the top priority or anyway he is working on other stuff first, whether he actually wants to push that app to end users using Extras or is just playing around.

If the promotion to extras-testing is open then we can focus on the feedback of the developers willing to push their packages. And we can focus the human testing on the apps making it there.
 

The Following 2 Users Say Thank You to qgil For This Useful Post:
Posts: 1,208 | Thanked: 1,028 times | Joined on Oct 2007
#7
Originally Posted by qgil View Post

My initial proposal for -testing quality criteria was:
- Have decent page in maemo.org/downloads.
This requirement doesn't make sense until there is Fremantle Testing category in downloads.

Applications which are in testing have to be clearly identified in downloads. Otherwise whole extras-testing -> extras stuff doesn't have any purpose because everyone will be using testing stuff unknowingly.
 
qgil's Avatar
Posts: 3,105 | Thanked: 11,088 times | Joined on Jul 2007 @ Mountain View (CA, USA)
#8
fwiw currently app entries in Downloads do have a label to state their quality:

Stable: http://maemo.org/downloads/product/O...personal-menu/

Beta: http://maemo.org/downloads/product/OS2008/aarddict/

Alpha: http://maemo.org/downloads/product/OS2008/gnumeric/

Should this be simply mapped to Extras, -testing and -devel?
 
jeremiah's Avatar
Posts: 170 | Thanked: 261 times | Joined on Feb 2009 @ Gothenburg, Sweden
#9
Originally Posted by qgil View Post
Let me say BIG THANK YOU to Jeremiah, Niels and whoever else has been involved in the development of the maemo.org packages interface - http://communitizer.blogspot.com/200...-packages.html
I am really impressed by Niel's hard work on this project. He has done a lot of complicated coding to make the QA process easier for developers and brought a smart way to promote packages. His dedication to this community should be evident to everyone.
 

The Following 7 Users Say Thank You to jeremiah For This Useful Post:
qgil's Avatar
Posts: 3,105 | Thanked: 11,088 times | Joined on Jul 2007 @ Mountain View (CA, USA)
#10
Let me elaborate a bit more:

- A developer is just playing with some packages in extras-devel: no Downloads page.

- A developer thinks the app is in a shape good enough to be promoted to -testing: Page created with Alpha label.

- An app makes it to extras-testing, ideally the page would be automatically updated to Beta within a week. Otherwise the change would be made manually.

- An apps makes it to Extras, ideally geta automatically updated to Stable quality. Otherwise the change is done manually.
 
Reply

Tags
extras-testing


 
Forum Jump


All times are GMT. The time now is 00:13.