As I understand it, the only built-in app that can use portrait mode is the phone app. (And possibly the image browser app?)

I too would like to see as many apps as possible have both portrait and landscape modes, but that might take a while.