Depending on things like your location and program used (user agent) and video format, you get your video from different youtube/google data center/server. I occasionally have the same problem and when I look under the hood it is usually the very same server in NY and not one in europe as it should be. In that (relatively rare) case the only solution is to let it buffer or simply download it.