Sorry for necroing this thread, but I also discovered that PulseAudio is using about 33% of the CPU (at 250mhz), and this is very excessive I think.
Would be really nice to have a way to bypass the speaker protection thing, or get rid of Pulse Audio at all (I always had problems with it even on my netbook).