Yes, you should leave the "ssh-rsa " in place.
To be sure: you are using the id_rsa.pub public key of the user you are using for the scp?