Precisely. After all, they'd never be able to compete with the big boys when trying to cut deals for preferential access. Suddenly, the big sites would start loading faster, and all the ISP's customers would know is that one site seems faster and more responsive than the other. They'd likely conclude that the slower site must not be as well-run and therefore not deserving of their business.
