Exactly, look for ISP that has YouTube cache server. I am on 1Mbps line but I can buffer 1080p videos without even waiting for a second. If YouTube is your primary need, go for ISP with YouTube caching..
My ISP cache YouTube, Commonly downloaded torrents, Microsoft related stuff, Google Play...