I have sometimes freezes and reboots while using swap on SD - IMHO it's something related to SD reliability and/or latency. When I need absolute stability I 'swapoff' the uSD partition, in all day usage I accept the risk and 'swapon' it again