I think it is just u-boot not properly initialising the twl403 MMC pins. I'm also looking at the linux kernel sources on how mmc is inititialised (e.g. the nokia patches) and it seems linux is doing a lot more stuff than u-boot does (e.g. initialising clocks).
@pali, did you uplaod the fix for console scrolling somewhere? Thanks!