Sir, you are ABSOLUTELY RIGHT on the problem being the Middle Mile!
After talking to some small town Telcos, they blame the high prices of their Middle Mile suppliers for not going to fiber as quickly as many would like.
In my area, the finger was pointed to AT&T as the WORST offender. One small Telco finally just installed their own 70 mile fiber line, to get around the Death Star and their high costs!