Yeah this is something legit. They will disconnect you at the tap if you don't call them and get them to come out and fix the issue. FCC requires them to constantly monitor their plant for this leakage and fix it within a given period of time or they can be fined.