For clarifictation as to what is happening
Its not a "peering" issue at all. Its your ISP using their own Google Caching servers, to try and not send stuff outside their network, which means that their caching server needs to load the video(slowly), and then you need to load it from them. If its a popular video, issues usually don't persist. You can skip your ISPs caching server in a few simple steps. First you identify the offending caching server, then block your computer or router from accessing it. It usually results in a small delay, as YT handles the IP rejection, and then reroute your connection to one of their faster servers. Blame your ISP for intentionally throttling your online streaming media experience.