republican-creole
site Search:


 
   
story category
Verizon Pumping Out Central Offices
Trying to Repair Things as Quickly as Power Allows
by Karl Bode Wednesday 31-Oct-2012 tags: business · telco · Verizon
While most wireless networks are struggling under load or due to offline towers, Verizon informs us that the company is also in the process of repairing the damage that was incurred to landline broadband facilities as well. Like most ISPs, Verizon is of course at the mercy of power companies who are warning many regions that the power outages could last well into next week. The company tells us their NYC headquarters at 140 West St. took on significant water the night of the storm, offering us the picture to the right.

Click for full size
The building housed some administrative offices, in addition to a central office that serves hundreds of thousands of voice and data circuits in Lower Manhattan.

"We still have some central offices in New York City that are flooded," Verizon's Bill Kula tells Broadband Reports.

"We'll continue to work safely and quickly to pump out the storm water; re-route traffic from non working central office to others; get backup generator power operating in our impacted central offices; and hope that the local power company can restore commercial power as quickly as possible."

Verizon has set up this website designed to help impacted customers.

view: topics flat text 
Post a:

seamore
Premium
join:2009-11-02

Disaster recovery fee...

coming to a bill near you.
CXM_Splicer
Looking at the bigger picture
Premium
join:2011-08-11
NYC
kudos:1
Reviews:
·Verizon FiOS

Re: Disaster recovery fee...

Well if they do that they should be thrown in jail... as soon as the president declares a disaster, FEMA money becomes available; Verizon sends them the bill. Trust me, if the government wasn't footing the bill, Verizon wouldn't have us working overtime. Right now it is just free money; there is very little to do until the trees and power lines are cleared away. And, if this is anything like Irene, we will be using the 'disaster code' on the time sheets long after the hurricane is cleaned up

OSUGoose

join:2007-12-27
Columbus, OH

Re: Disaster recovery fee...

Didn't stop AEP Ohio from passing on their costs to the ratepayers.
MaynardKrebs
Premium
join:2009-06-17
kudos:4
Wouldn't that be a "disaster recovery recovery fee"?
ITALIAN926

join:2003-08-16
kudos:1

Unbelievable.

Keep in mind thats the lobby. Scuba divers are currently taking photos of the lower floors.
zippoboy7

join:2006-06-18
USA

Re: Unbelievable.

More then likely the lower floors are a parking garage, that is how most of those older buildings are setup, some of the newer ones put the parking garage on the first few floors above the lobby.

nycdave
Premium,MVM
join:1999-11-16
Melville, NY
kudos:10

Re: Unbelievable.

No, 140 West St. has 6 sub-basements that house all the OSP cables in a large cable vault - in addition to other equipment. There is no parking garage in the basement.

Smith6612
Premium,MVM
join:2008-02-01
North Tonawanda, NY
kudos:22

Re: Unbelievable.

With all that water in there, I wonder how long it will take to pump it out and get all of the gear that was ruined from the water replaced. Hope some of those rooms were designed watertight to withstand some flooding.

KrK
Heavy Artillery For The Little Guy
Premium
join:2000-01-17
Tulsa, OK
And currently houses fish and a few eels.

NOCTech75
Premium
join:2009-06-29
Marietta, GA
Reviews:
·Comcast

Re: Unbelievable.

said by KrK:

And currently houses fish and a few eels.

My hovercraft is full of eels.

AVD
Respice, Adspice, Prospice
Premium
join:2003-02-06
Onion, NJ
kudos:1
said by KrK:

And currently houses fish and a few eels.

The Hudson River is uninhabitable on a good day.
--
* seek help if having trouble coping
--Standard disclaimers apply.--
rebus9

join:2002-03-26
Tampa Bay
Reviews:
·Verizon FiOS
·Bright House
said by nycdave:

No, 140 West St. has 6 sub-basements that house all the OSP cables in a large cable vault - in addition to other equipment. There is no parking garage in the basement.

Dave, were those cable vaults sealed or did everything take a salt water bath?

(For those not used to thinking in terms of storm surges, salt water is infinitely worse than fresh water. Many things soaked in fresh water can be dried out and used again-- even some electrical equipment if it was NOT energized when the water hit. But after salt water flooding, fuhgeddaboutit.

OSUGoose

join:2007-12-27
Columbus, OH

Re: Unbelievable.

Yea Natural Sea Water is mother natures way of saying "upgrade yo shit, as I just trashed it."

wdoa

join:2001-10-16
Spencer, MA

Uh, excuse to decommission more DSL and landlines

We all know Verizon wants to ditch their copper plant, might they in some cases use this an excuse to just decide not to fix the landline infrustructure?
ITALIAN926

join:2003-08-16
kudos:1

Re: Uh, excuse to decommission more DSL and landlines

Like it or not, they are still a regulated utility, they cant simply opt-out of the 96 telecom act. CLECS/wholesalers will have a slight issue with that.

alchav

join:2002-05-17
Palm Desert, CA
said by wdoa:

We all know Verizon wants to ditch their copper plant, might they in some cases use this an excuse to just decide not to fix the landline infrustructure?

Verizon is dedicated to it's Customers and will work around the clock to restore Service. They will do it in the most Cost Effective and Efficient way. If this means using existing Fiber or adding Fiber Feeds, to restore Service, this will be done. No one will be left without Service. As for the CLEC's and Wholesalers, Verizon will work with them to restore their Infrastructure.
majortom1029

join:2006-10-19
Lindenhurst, NY
kudos:1

Re: Uh, excuse to decommission more DSL and landlines

said by alchav:

said by wdoa:

We all know Verizon wants to ditch their copper plant, might they in some cases use this an excuse to just decide not to fix the landline infrustructure?

Verizon is dedicated to it's Customers and will work around the clock to restore Service. They will do it in the most Cost Effective and Efficient way. If this means using existing Fiber or adding Fiber Feeds, to restore Service, this will be done. No one will be left without Service. As for the CLEC's and Wholesalers, Verizon will work with them to restore their Infrastructure.

Verizon is NOT dedicated to their customers. I am a business customer with expensive service. We have a couple of analog lines for our alarms. Their tech pulled the wrong pair in the box. It took them 2 weeks to come back and fix it. That is not dedicated.
CXM_Splicer
Looking at the bigger picture
Premium
join:2011-08-11
NYC
kudos:1
Haha! That HAD to be sarcasm... even the company spokesman can't shovel BS like that

alchav

join:2002-05-17
Palm Desert, CA

Re: Uh, excuse to decommission more DSL and landlines

said by CXM_Splicer:

Haha! That HAD to be sarcasm... even the company spokesman can't shovel BS like that

Well I did Retire from PacBell as a Service Manager, and I worked with some high end Marketing Teams so I learned how to put together some good information. Still in time of Crisis we would pull together and the Customer came first. I know that the Telco Techs in New York are a lot tougher than the ones in California, but in times like these the best in them will come out.
LoopTooLong

join:2006-02-16
140 West st feeds the NYSE. I don't think they will just abandon it!
patt2k

join:2009-01-16

ehhh

yup my tower has been offline while other T Mobile , Att been working fine for other -_-

LazMan
Premium
join:2003-03-26
canada

Basements aren't storage in CO's

Worst hit is usually the DC power/battery rooms (kept in the basement for weight) and the cable vaults, where the underground cables (copper and fibre) enter the building...

It will be months before everything is completely back to normal...

SteveCon
IBEW 2222 Boston, MA
Premium
join:2004-09-02
Boston, MA

Re: Basements aren't storage in CO's

Many people fail to realize, this is not a case of simply needing time for "everything to dry out". Many coastal areas are dealing with tidal related flooding - that means salt water. Salt water is highly corrosive and much of which that was subjected to it - will need to be replaced.
MaynardKrebs
Premium
join:2009-06-17
kudos:4

Re: Basements aren't storage in CO's

said by SteveCon:

Many people fail to realize, this is not a case of simply needing time for "everything to dry out". Many coastal areas are dealing with tidal related flooding - that means salt water. Salt water is highly corrosive and much of which that was subjected to it - will need to be replaced.

There are millions of electrical connections inside a central office, and each one that is engulfed in salt water will need to be meticulously dried & cleaned. Even so, there will be much that simply needs replacing and one will have to expect random glitches in this equipment fr years until it's all replaced.

This stuff »boeshield.com/ works wonders at protecting connections from salt corrosion, but I doubt any of it (or similar products) are used in switching gear.
c4junk
Premium
join:2004-05-08
Orlando, FL

Basements aren't storage in CO's

The tip splices I did in Florida cable vaults were not watertight, the feeder cable had a plug that I made so that air pressure could be applied to the field side to help combat small leaks. This was back in the era of 2400-2700 pair pulp (paper )insulated copper before fiber, fiber don't care about water until it gets to the mux which in DC powered.
HeadSpinning
MNSi Internet

join:2005-05-29
Windsor, ON
kudos:5
said by LazMan:

Worst hit is usually the DC power/battery rooms (kept in the basement for weight) and the cable vaults, where the underground cables (copper and fibre) enter the building...

It will be months before everything is completely back to normal...

In most cases around here, Bell uses watertight splice closures to transition from the OSP cable to the stubs coming from the MDF for copper, but I've also seen some that are not watertight.

For fibre, I've seen both wall/cable rack mounted transition boxes as well as watertight splice closures.

Where we enter Bell buildings, we typically use a watertight closure to transition to riser cable - but lately we've simply been using OFNR Indoor/Outdoor cable and not transitioning in the vault at all. We just leave a slack loop in case we need to cut in to the cable at some future date.

I don't know what the practice in the states is, and it probably varies from ILEC to ILEC.
--
MNSi Internet - »www.mnsi.net

LazMan
Premium
join:2003-03-26
canada

Re: Basements aren't storage in CO's

I've done a fair bit of work in Sprint CO's in the mid-Atlantic region...

My experience is that even closures that were supposed to be watertight, usually aren't sealed right in the vaults; and that a lot of the transitions weren't in watertight closures anyways...

I haven't done much fibre in the US, and what I did, was OSP cable straight into the transition cabinet (wherever that was - vault, or more often within our own space) - no automatic OSP/riser transition in the vault; just a slack-loop...
MaynardKrebs
Premium
join:2009-06-17
kudos:4
said by HeadSpinning:

In most cases around here, Bell uses watertight splice closures to transition from the OSP cable to the stubs coming from the MDF for copper, but I've also seen some that are not watertight.

There's water resistant, water tight, and watertight to a rated depth. A four-to-six floor deep basement is going to be somewhere between 3-6 atmospheres of pressure if it's flooded.
HeadSpinning
MNSi Internet

join:2005-05-29
Windsor, ON
kudos:5

Re: Basements aren't storage in CO's

said by MaynardKrebs:

said by HeadSpinning:

In most cases around here, Bell uses watertight splice closures to transition from the OSP cable to the stubs coming from the MDF for copper, but I've also seen some that are not watertight.

There's water resistant, water tight, and watertight to a rated depth. A four-to-six floor deep basement is going to be somewhere between 3-6 atmospheres of pressure if it's flooded.

Good point. Most splice closures are designed to be watertight sitting at the bottom of below grade manhole chamber, not 5 sub basements down.
--
MNSi Internet - »www.mnsi.net
MaynardKrebs
Premium
join:2009-06-17
kudos:4
said by LazMan:

It will be months before everything is completely back to normal...

I wonder if the natives will give the $24 worth of beads & blankets back in exchange for the island.
patt2k

join:2009-01-16

:D

I really hope they will credit us who are impacted , as they expect payment on time and give you late fees when you late this better be credited.

bhan261

join:2001-02-12
New York, NY
Reviews:
·Verizon FiOS

West St is my CO

West St. is the CO that serves my apartment building. I remember post-9/11 they had to install temporary switches a couple blocks north and ran LOTS of cable in the streets to them. It took easily 6 months before they got back to anything near "normal". I haven't been home for a couple weeks but I know my building is without power and my FiOS is obviously down. I'm hoping to get back this weekend if power is restored but wonder if my FiOS will be up.

David
Now accepting new patients
Premium,VIP
join:2002-05-30
Granite City, IL
kudos:78

.

That's going to be a mess to clean up.
Madtown
Premium
join:2008-04-26
Madera, CA

Re: .

Sure will be.
tmc8080

join:2004-04-24
Brooklyn, NY

salt

saltwater eats copper... how does it do on Fiber?

See 16 replies to this post

KrK
Heavy Artillery For The Little Guy
Premium
join:2000-01-17
Tulsa, OK

I can see why they took on so much water...

... someone left the door open so the water could come in.

sk1939
Premium
join:2010-10-23
Washington, DC
kudos:9
Reviews:
·T-Mobile US

Smaller CO's

I wonder how the smaller CO's faired, given this was a relatively major CO. You also would have hope that Verizon had pumps and/or sandbagged the building before the hurricane hit. Then again, given that they evacuated NYU Hospital because the backup generators failed disaster planning does not seem high on the list of one of the most targeted/important cities in the world.
zipjay

join:2003-03-11
South Williamson, KY

anyone curious...

about what the outside of the building looks like.. I found the outside of the doors in the flood picture above on google street view. »maps.google.com/maps?q=140+West+···,,1,6.96

AVD
Respice, Adspice, Prospice
Premium
join:2003-02-06
Onion, NJ
kudos:1

Re: anyone curious...

I passed by it on Wed. The entrance was sandbagged, I didn't realize that a picture would be of interest.
--
* seek help if having trouble coping
--Standard disclaimers apply.--

DSL12steps

join:2001-12-24

same building from 9-11?

Correct me if I'm wrong, but that was the building that took damage from the WTC collapse. I remember Verizon having to run cables to the 5th floor or some crazy thing to restore service after 9-11. The cable vaults were broken open then too. I could be wrong....

DSL12steps

join:2001-12-24

Re: same building from 9-11?

Here ya go for recent pics. I'd hate to have to try and fix this mess. Don't get me wrong, the OT would be tremendous. But these guys have a monumental task ahead of them

»online.wsj.com/article/SB1000142···386.html

Monday, 20-May 10:32:06 Terms of Use & Privacy | feedback | contact | Hosting by nac.net - DSL,Hosting & Co-lo
over 13.5 years online © 1999-2013 dslreports.com.