Personally, I never saw the point of widgets. I tried liking them. Tried using them. Not in a "fine, sure ill try, oooh look im trying widgets oh what fun..." kind of way, but really made an effort.
Of course the HW isnt top of the line. Hell, its barely middle of the line as far as I can tell. Thats true. However the specs, as you say, must be seen in the light of how the OS makes use of it.
Not going to sit here and say that dualcore wouldnt be nice, cause... hell, who would. But same specs on something running Android 2.3.5 probably would be a hell of a lot worse of an experience than Maemo6.
Its not "judge the UI/SW not the HW" its more like you say in the end; judge the phone entire.