I managed to get what I needed by moving the host scratchbox ssh out of the way and having scratchbox use the ssh from the armel sdk repos instead.