| Also....
During a scheduled maintenance (GCR 6287157) to upgrade a Washington DC router, a configuration issue caused the two routing engines on the router not to sync. Once the Technical Service Center notified the IP NOC of the customer impact, the NOC wiped out the configuration and loaded a current configuration to restore services. |
| ....I agree, perfect storm indeed. And a total FML / date with Crown Royal moment. 
As for that routing engine sync issue... I've worked with enough gear to know that that's
ALOT harder to zero in on... and if it was part of the fiber issue, it makes tracking it down
that much harder as all your other issues can mask the problem.
Moral of the story... I hope when they fixed the thing, the guys who fixed it were given
a 2week allexpenses trip to the Bahamas, minimum. Cuz I can say I wouldn't've wanted
any part of that cleanup job ... [facepalm]
Regards |
