I'm one of those who just went the other way
I just switch from Comcast to CenturyLink/Qwest, and got an upgraded internet connection. I had 25/5(?) with Comcast, now have VDSL2 at 40/20.
When I had Qwest in the past, virtually all of my problems were related to house wiring as the source.
Does the average person need more than 40/20 at this point? Not in my view, but I suppose in a large household with lots of gaming and video streaming. But with myself and 3 boys mid-teens to early 20s, it's plenty.
But I understand 40/20 is the exception for Telcos. Up until the last month or so, 7M DSL was the limit for my house.