@switch-hitter which version of android is your device running?
I do not know how easy this is to do with stock Android but on Cyanogen it is easy to not install any Google stuff, instead choosing F-Droid for a software repository and if you really need an APK or two from the amazon and google stores use http://android-apk-downloader.com