After some testing, thinking it was maybe related to the browser, which didn't pan out. It seems the ALS is just doesn't perform well in non-ideal lighting conditions. I guess my house isn't well-lit enough...or dark enough.

Wish you could turn it off/adjust it. If some other N900 owners could mess around with the ALS and see how well it works it'd be appreciated.