| reply to CurGeorge8
Re: Fail Servers should be BACKED UP daily and weekly & monthly backups should be held offsite. |
|
 milnoc
join:2001-03-05
H3B
kudos:1 | What's the best way to back up thousands of terabytes (or petabytes) of data? A second system maybe? |
|
glinc
join:2009-04-07
New York, NY | exactly, they should have all hdd's set up with raid-1 |
|
|
|
 MattAll noise, no signal.Premium
join:2003-07-20
Jamestown, NC
kudos:12 | reply to milnoc
said by milnoc:What's the best way to back up thousands of terabytes (or petabytes) of data? A second system maybe? It's a SAN that failed, apparently one that was being upgraded for Microsoft by Hitachi. So the better question would be, why were live customers accessing a SAN that was being upgraded and why did the upgrade nullify the redundancy?
--
"What is conservatism? Is it not adherence to the old and tried, against the new and untried?" - Abraham Lincoln |
|
 tiger72SexaT duorPPremium
join:2001-03-28
Saint Louis, MO
kudos:1
 ·T-Mobile US
| reply to fAcEtIOUs
precisely.
From what I read, the loss of personal data was due to a system upgrade. For some reason, Microsoft/Danger did not do a data backup before making the big upgrade. In fact, they apparently hadn't done ANY data backups EVER?! They don't have any "old" backups to fall back on.
I'm sure heads will roll at Microsoft for this. And deservedly so. They'll have cost Microsoft and T-Mobile $millions in damages.
--
"What makes us omniscient? Have we a record of omniscience? ...If we can't persuade nations with comparable values of the merit of our cause, we'd better reexamine our reasoning."
-United States Secretary of Defense (1961-1968) Robert S. McNamara |
|
| said by tiger72:I'm sure heads will roll at Microsoft for this. And deservedly so. They'll have cost Microsoft and T-Mobile $millions in damages. At least T-Mobile can have Google to fall back on.  |
|
| reply to tiger72
said by tiger72:From what I read, the loss of personal data was due to a system upgrade. For some reason, Microsoft/Danger did not do a data backup before making the big upgrade. In fact, they apparently hadn't done ANY data backups EVER?! I guess "Change Management" to them means "Let's upgrade and start over from scratch". |
|
| reply to tiger72
said by tiger72:I'm sure heads will roll at Microsoft for this. And deservedly so. They'll have cost Microsoft and T-Mobile $millions in damages. I'm trying to figure out how exactly. The users are all under contract, so they are stuck with the service no matter what. And I guarantee you there is something in the TOS stating they aren't responsible for data loss. |
|
tiger72SexaT duorPPremium
join:2001-03-28
Saint Louis, MO
kudos:1 Reviews:
·T-Mobile US
| said by Camelot One:said by tiger72:I'm sure heads will roll at Microsoft for this. And deservedly so. They'll have cost Microsoft and T-Mobile $millions in damages. I'm trying to figure out how exactly. The users are all under contract, so they are stuck with the service no matter what. And I guarantee you there is something in the TOS stating they aren't responsible for data loss. TMO has already given customers a free month of service - that in itself is an extremely expensive move. Not to mention the likely class-action suit that will no doubt be brought forth...
--
"What makes us omniscient? Have we a record of omniscience? ...If we can't persuade nations with comparable values of the merit of our cause, we'd better reexamine our reasoning."
-United States Secretary of Defense (1961-1968) Robert S. McNamara |
|
 lolwhatYou're getting warmerPremium
join:2001-06-11
PonziWorld
 ·Callcentric
| reply to milnoc
Anything. Anything at all. Microsoft isn't nicknamed M$ for nothing; they have gobs of money, and they could've used it to do something for a backup.
--
The Greater Depression: Coming soon to a country near you!
F*** the Republicrats. |
|
patcat88
join:2002-04-05
Jamaica, NY
kudos:1 | reply to Matt
said by Matt:It's a SAN that failed, apparently one that was being upgraded for Microsoft by Hitachi. So the better question would be, why were live customers accessing a SAN that was being upgraded and why did the upgrade nullify the redundancy? Because the blond sales agent from Hitachi said they solution can do it, and the boss ordered the IT minions to do it, the blond sales agent promised it to him. |
|
| reply to glinc
said by glinc:exactly, they should have all hdd's set up with raid-1 I've seen a RAID 1 controller puke and take both drives out. Or even worse, corruption on 1 drive immediately gets replicated to the other.
And, yes, I've seen even RAID 5 arrays go tits-up.
Of course people need to realize that even with tape backups, a full system restore of lots and lots of TB pretty much never happens. Where I work we have many, many (90 maybe) TB of data. It has been calculated that a full database restore from tape would take almost a month. I forget if that takes into account the validation work or not. Needless to say we have a redundant system somewhere else.
However, I wonder where it was said it was a SAN - the articles I've saw said "server"....
Working in IT for as long as I have, I've seen it all. Most likely what happened this time was there was:
1) No $$ for that spare SAN.
2) The risk was supposed to be so low as to not cause an issue.
My bet is on #2 - I've seen way too much of those types of things cause issues. Including work on 1/2 of a fully redundant SAN take the whole thing down where the vendor is still scratching their heads years later. |
|
 r81984Fair and BalancedPremium
join:2001-11-14
Katy, TX
 ·AT&T U-Verse
 ·AT&T DSL Service
·row44
| reply to tiger72
said by tiger72:They'll have cost Microsoft and T-Mobile $millions in damages. Damages for what? Did they guarantee storage of data?
--
Democrats are not Socialists any more than Republicans are. |
|
tiger72SexaT duorPPremium
join:2001-03-28
Saint Louis, MO
kudos:1 Reviews:
·T-Mobile US
| said by r81984:said by tiger72:They'll have cost Microsoft and T-Mobile $millions in damages. Damages for what? Did they guarantee storage of data? It doesn't matter. If a class-action suit is brought forward, TMO and Microsoft would want to settle early and quickly to get it all out of the news. They try to build their images on "reliability", and the longer this is in the news, the more likely they'll lose future customers. A settlement (regardless of what the actual contract states) would get it out of the news - but at a price.
--
"What makes us omniscient? Have we a record of omniscience? ...If we can't persuade nations with comparable values of the merit of our cause, we'd better reexamine our reasoning."
-United States Secretary of Defense (1961-1968) Robert S. McNamara |
|
 ptrowskiGot Helix?Premium
join:2005-03-14
Putnam, CT
kudos:4
·VOIPo
| reply to r81984
said by r81984:said by tiger72:They'll have cost Microsoft and T-Mobile $millions in damages. Damages for what? Did they guarantee storage of data? Very good point.
--
"So, Lone Starr, now you see that evil will always triumph because good is dumb."
Have you been touched by his noodly appendage? »www.venganza.org |
|
dsless
join:2001-05-16
Pittsburgh, PA | reply to Matt
Ugh Hitachi!  |
|
 ReformCRTCSupport Your Independent ISP
join:2004-03-07
Canada | reply to milnoc
PETabytes? Sounds kinky... |
|
 powerhogStinkin' up the jointPremium
join:2000-12-14
Owasso, OK | reply to patcat88
LOL- so true!
I worked at a company where one of the vendor reps was a hot blonde woman. Needless to say, the datacenter quickly filled with her company's servers even though they were, by far, the most prone to failure of all the systems we had. |
|
 FBGuyyippee ki yayPremium
join:2005-03-19 | reply to glinc
even better would be to have several different sites all doing the same thing. and then have backups of those. |
|
FBGuyyippee ki yayPremium
join:2005-03-19 | reply to ReformCRTC
its petabytes. your thinking of pedobytes  |
|
