 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA | Economic SAN with 400 Tb per controller
Hi, any suggestions for an economical SAN that supports 400 Tb controller. Maybe something outside the usual suspects? -- CCNA, Comtrain Certified Tower Climber |
|
  nixen Rockin' the Boxen Premium join:2002-10-04 Alexandria, VA
·Cox HSI
·Speakeasy
| said by cmaenginsb :Hi, any suggestions for an economical SAN that supports 400 Tb controller. Maybe something outside the usual suspects? Not sure what you're asking, here, when you say "400 Tb controller".
Do you mean a 400TB array? If so, are we saying 400TB raw or 400TB effective. Even at 400TB raw on SATA, you're looking at 200-400 (figuring 14 drives per shelf, that's 15-30 drive shelves) drive arrays. I don't know of any arrays in that class that are "economical".
Or do you mean 4Gb FCAL (assuming some bizarre typo/misconversion)?
Or do you mean something completely different? -- The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt. -- Bertrand Russell |
|
 bilbusb
join:2003-04-10 Tucker, GA | reply to cmaenginsb economical and 400TB do not go together.
He must mean a 4gb FC controler. |
|
 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA
| reply to cmaenginsb Sorry I meant 400 Tb per controller and it would be raw. As to economical, I realize what the average array like this costs in terms of EMC, Hitachi and NetApp but I'm wondering if there are any other companies doing arrays of this size that support both SATA and FC drives?
Nexsan for example can do an array of this size but it's SATA and SAS, which doesn't meet the requirements. -- CCNA, Comtrain Certified Tower Climber |
|
 jester121 Premium join:2003-08-09 Lake Zurich, IL
·surpasshosting
·ViaTalk
| said by cmaenginsb :Nexsan for example can do an array of this size but it's SATA and SAS, which doesn't meet the requirements. What does meet the requirements without using SATA or SAS? |
|
  Jahntassa What, I can have feathers Premium join:2006-04-14 Conway, SC
| reply to cmaenginsb said by cmaenginsb :I'm wondering if there are any other companies doing arrays of this size that support both SATA and FC drives? FC drives? FC as in Fibre Channel?
I wasn't aware they were making drives with Fibre connectors built in!
In all seriousness, I think more insight into what you're trying to accomplish would be helpful. I haven't done anything with arrays this size but I would imagine a single controller that supports SATA -and- FC sources doesn't really exist, unless you're considering a 'SAN appliance' as a controller. |
|
 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA
| reply to jester121 said by jester121 :said by cmaenginsb :Nexsan for example can do an array of this size but it's SATA and SAS, which doesn't meet the requirements. What does meet the requirements without using SATA or SAS? That's why I'm asking the question. I'm trying see if there are any other alternative manufacturers out there making NAS systems that can handle 400 Tb raw capacity with a mix of SATA/FC drives .
Imagine asking about backbone/enterprise level routers before Juniper became as well know as it is. I'm looking for the Juniper equivalent in SAN storage. -- CCNA, Comtrain Certified Tower Climber |
|
 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA
| reply to Jahntassa said by Jahntassa :said by cmaenginsb :I'm wondering if there are any other companies doing arrays of this size that support both SATA and FC drives? FC drives? FC as in Fibre Channel? I wasn't aware they were making drives with Fibre connectors built in! In all seriousness, I think more insight into what you're trying to accomplish would be helpful. I haven't done anything with arrays this size but I would imagine a single controller that supports SATA -and- FC sources doesn't really exist, unless you're considering a 'SAN appliance' as a controller. Drives with FC connectors have been available since at least 2006 maybe earlier, here's a link to some of Seagate's »www.seagate.com/www/en-us/produc···h_15k.7/
A "SAN appliance" is what I am talking about. It typically consists of a control frame with one or more controllers and drive arrays that are tied to the control frame. The controller is then connected via FC switch to the servers. The drive arrays would need to support SATA and FC (not in the same array), so you could have array 1 with 12 600 Gb FC drives and arrays 2,3 and 4 with 1 Tb SATA drives allowing for relatively fast access to the FC data and using the SATA for slower "archived" storage.
Examples of this would be the Hitachi USP series or EMC Clarion CX3 series. Both of these have multiple different "controllers" that define the maximum number of storage arrays connected and type , for example the CX3 has a model 10, model 20 etc. -- CCNA, Comtrain Certified Tower Climber |
|
  nixen Rockin' the Boxen Premium join:2002-10-04 Alexandria, VA
·Cox HSI
·Speakeasy
| The intrinsic problem of arrays implementing internal FC is the requirement to implement internal FC networks (either the more common internal loops or the rarer switched-fabric designs). A lot of the not "usual suspects" are in the market because of price considerations of the "usual suspects". Internal FC networks, particularly of the highly redundant, high-speed switched-fabric designs you'll find in an HDS enterprise-class frame, don't generally fit with the "price considerations" model. It's even rarer to find arrays with internal FC and NAS-only data presentation (the NAS protocols typically become a bottleneck that obviates the reason for having internal FC).
I can't remember what 3par runs internally. But they'd be the one I'd check after EMC/HDS/NetApp. Pure performance and scalability standpoint, I might look at DataDirect. -- The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt. -- Bertrand Russell |
|
  Jahntassa What, I can have feathers Premium join:2006-04-14 Conway, SC
| reply to cmaenginsb Learn something new every day.. I had no idea they made internal drives with FC connections, but then our company is much too small to be dabbling in FC in the first place. |
|
 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA
| reply to nixen said by nixen :The intrinsic problem of arrays implementing internal FC is the requirement to implement internal FC networks (either the more common internal loops or the rarer switched-fabric designs). A lot of the not "usual suspects" are in the market because of price considerations of the "usual suspects". Internal FC networks, particularly of the highly redundant, high-speed switched-fabric designs you'll find in an HDS enterprise-class frame, don't generally fit with the "price considerations" model. It's even rarer to find arrays with internal FC and NAS-only data presentation (the NAS protocols typically become a bottleneck that obviates the reason for having internal FC). I can't remember what 3par runs internally. But they'd be the one I'd check after EMC/HDS/NetApp. Pure performance and scalability standpoint, I might look at DataDirect. Thanks, I had just started looking at 3par and I'll check DataDirect. We do video surveillance which really only needs a lot of storage for archival purposes so speed isn't an issue for us but occasionally we get a customer (usually government) that has a bigger pocketbook to put in some requirements for FC and large controller sizes etc. In that case I usually go with Hitachi and in a few cases EMC but I wanted to see if there were any newer players that would be more cost competitive because in those contracts cost is a factor. -- CCNA, Comtrain Certified Tower Climber |
|
 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA
| reply to Jahntassa said by Jahntassa :Learn something new every day.. I had no idea they made internal drives with FC connections, but then our company is much too small to be dabbling in FC in the first place. If it wasn't for some government bids all the storage we'd install would be SATA with a little SAS and I wouldn't have known they had FC drives either. -- CCNA, Comtrain Certified Tower Climber |
|
  nixen Rockin' the Boxen Premium join:2002-10-04 Alexandria, VA
·Cox HSI
·Speakeasy
| reply to cmaenginsb said by cmaenginsb :Thanks, I had just started looking at 3par and I'll check DataDirect. We do video surveillance which really only needs a lot of storage for archival purposes so speed isn't an issue for us but occasionally we get a customer (usually government) that has a bigger pocketbook to put in some requirements for FC and large controller sizes etc. In that case I usually go with Hitachi and in a few cases EMC but I wanted to see if there were any newer players that would be more cost competitive because in those contracts cost is a factor. For surveilance video, you *really* don't need FC-class storage. Well-designed SAS, or even SATA, storage will tend to be sufficient.
Solutions from Isilon and Nexsan would be more than sufficient and provide a lot of resiliency and at an attractive price point.
If you wanted to go with a big name on their low/mid-tier products, the EMC CLARiiONs, you mentioned previously, and the HDS AMS systems would probably do you well.
3par is mostly geared towards mixed-use, utility computing (the predecessor to the current "cloud computing" model and that Sun called, at one point, "grid computing").
Speaking of Sun, you might look at their Thumper storage servers.
Can't remember whether BlueArc is still out there, but they've been playing at the surveillance segment of the video storage space, too. -- The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt. -- Bertrand Russell |
|
 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA
| said by nixen :said by cmaenginsb :Thanks, I had just started looking at 3par and I'll check DataDirect. We do video surveillance which really only needs a lot of storage for archival purposes so speed isn't an issue for us but occasionally we get a customer (usually government) that has a bigger pocketbook to put in some requirements for FC and large controller sizes etc. In that case I usually go with Hitachi and in a few cases EMC but I wanted to see if there were any newer players that would be more cost competitive because in those contracts cost is a factor. For surveilance video, you *really* don't need FC-class storage. Well-designed SAS, or even SATA, storage will tend to be sufficient. Solutions from Isilon and Nexsan would be more than sufficient and provide a lot of resiliency and at an attractive price point. If you wanted to go with a big name on their low/mid-tier products, the EMC CLARiiONs, you mentioned previously, and the HDS AMS systems would probably do you well. 3par is mostly geared towards mixed-use, utility computing (the predecessor to the current "cloud computing" model and that Sun called, at one point, "grid computing"). Speaking of Sun, you might look at their Thumper storage servers. Can't remember whether BlueArc is still out there, but they've been playing at the surveillance segment of the video storage space, too. I understand that FC is way overkill, it's the customer that is specifying FC drives. Regretfully the customer wants FC to the servers as well and Thumper is only NAS and possibly iSCSI from what I remember. -- CCNA, Comtrain Certified Tower Climber |
|
  nixen Rockin' the Boxen Premium join:2002-10-04 Alexandria, VA
·Cox HSI
·Speakeasy
1 edit | said by cmaenginsb :I understand that FC is way overkill, it's the customer that is specifying FC drives. Regretfully the customer wants FC to the servers as well and Thumper is only NAS and possibly iSCSI from what I remember. Sadly, customers often want the wrong things. Best we can do is try to talk them down from the cliff.
The one thing that should weigh into your recommendations is scalability. Sure, your customer wants 400TB now - that's actually become a "small" configuration - but, how fast will their data grow? Most of the solutions from the non "usual suspects" top out at around 1 or 2PB.
Could be worse: could be asking you about solutions that include SSD. I was on a DoD project, earlier this year, where along with "what can we do to virtualize our storage" (they were already running EMC and NetApp arrays), they also asked whether they should go SSD (for, essentially, static content like SharePoint and home directories).
-- The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt. -- Bertrand Russell |
|
 cmaenginsb Premium,MVM join:2001-03-19 Palmdale, CA
| said by nixen :said by cmaenginsb :I understand that FC is way overkill, it's the customer that is specifying FC drives. Regretfully the customer wants FC to the servers as well and Thumper is only NAS and possibly iSCSI from what I remember. Sadly, customers often want the wrong things. Best we can do is try to talk them down from the cliff. The one thing that should weigh into your recommendations is scalability. Sure, your customer wants 400TB now - that's actually become a "small" configuration - but, how fast will their data grow? Most of the solutions from the non "usual suspects" top out at around 1 or 2PB. Could be worse: could be asking you about solutions that include SSD. I was on a DoD project, earlier this year, where along with "what can we do to virtualize our storage" (they were already running EMC and NetApp arrays), they also asked whether they should go SSD (for, essentially, static content like SharePoint and home directories). Yeah, if it wasn't an RFP response I'd spend a lot of time lobbying for a different way. The video will only need about 30 Tb and isn't likely to change much, the extra capacity and FC requirement is because they want to share the array for some basic IT needs. With currently supported drives/densities they won't be able to get much more than 400 Tb because they don't have room for additional cabinets. -- CCNA, Comtrain Certified Tower Climber |
|
  nixen Rockin' the Boxen Premium join:2002-10-04 Alexandria, VA
·Cox HSI
·Speakeasy
| said by cmaenginsb :Yeah, if it wasn't an RFP response I'd spend a lot of time lobbying for a different way. The video will only need about 30 Tb and isn't likely to change much, the extra capacity and FC requirement is because they want to share the array for some basic IT needs. With currently supported drives/densities they won't be able to get much more than 400 Tb because they don't have room for additional cabinets. Well, if they can accept SATA, they'll get better storage density. You can fit 14 half-height 1TB drives in about 4U of rack space. That's 140TB per standard rack - or less than four full racks for 400TB. They can get even greater density if they go for the 2TB SATA drives. Most of the FC-drive arrays are still only selling in the 450/500GB range meaning they'd need to set up 8 racks for that same 400TB. Less drives will also tend to mean a lot less in the way of power and cooling.
Speaking of power and cooling, one of the points in DataDirect is their use of auto-MAID. Basically, drives that aren't being actively used for data reads or writes are spun down.
Just some things you might point out to them - particularly given their likely performance needs. -- The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt. -- Bertrand Russell |
|
  dennismurphy Put me on hold? I'll put YOU on hold Premium join:2002-11-19 Parsippany, NJ | reply to cmaenginsb HP Extreme Data Storage 9100. PM me if you want details. |
|
  Simba7
join:2003-03-24 Billings, MT
·Bresnan Online
| reply to nixen said by nixen :Could be worse: could be asking you about solutions that include SSD. I was on a DoD project, earlier this year, where along with "what can we do to virtualize our storage" (they were already running EMC and NetApp arrays), they also asked whether they should go SSD (for, essentially, static content like SharePoint and home directories). Sometimes I just wish the DoD would actually talk to their own IT personnel.
Being in the Navy for 8 years, it's amazing that no one wanted questions about how to build out the NMCI network. It just gets irritating when you have thousands of IT personnel and never ask them how to build their new network. -- Bresnan 15M/1M|MyWS[P4HT@4.01GHz,2GB RAM,2x1TB HDDs,Win7]|WifeWS[P4@2.4GHz,1GB RAM,60GB HDD,Win7]|Router[2xP3@1GHz,640MB RAM,18GB HDD,Allied Telesyn AT-2560FX,Kingston KNE100TX,2xDigital DE504,Compaq NC3131,iPro/1000DP,Blitz BWI715,Gentoo Linux] |
|
  nixen Rockin' the Boxen Premium join:2002-10-04 Alexandria, VA
·Cox HSI
·Speakeasy
| said by Simba7 :Sometimes I just wish the DoD would actually talk to their own IT personnel. Sadly, most of their systems people just aren't that clueful. Or, even if they were, they've had it beaten out of them by the utter mediocrity that's encouraged. Everybody has their little thing they're responsible for and little interest to go beyond that. Anyone with any level of organizational control/direction, are too busy with turf wars to really consult with their technical people. In the end, it creates disjointed complexes of non-integrated parts.
said by Simba7 :Being in the Navy for 8 years, it's amazing that no one wanted questions about how to build out the NMCI network. It just gets irritating when you have thousands of IT personnel and never ask them how to build their new network. Yeah. When they were showing me the COIs and everything else that would have to be factored into the N-tier application deployment and cross-continental replication, it made me want to cry. -- The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt. -- Bertrand Russell |
|