Mac Pro RAID setup

I recently posted about choosing a new storage solution for my Mac Pro where I decided to invest in an SAS based RAID system from www.rentaraid.co.uk. Now that the kit has been installed I thought I’d post a quick update about the installation procedure, an issue I ran into and the results so far.

Firstly, here’s a rundown of the kit I ordered and how it’s all setup.  The PCIe card is the Areca AC-1882x 8 port SAS/SATA Raid adapter. This card features two external SAS connectors, each capable of controlling up to four SATA hard drives, hence the (8 port) description. Fitting the card into the Mac Pro is a relatively simple process, at least it is if you’re used to fiddling around with PCI cards. If you’ve grown up on iMacs then you might find this a little daunting but as long as your careful then fitting PCI cards is fairly straightforward.

One thing to take into consideration is that the SAS card is capable of utilising a x8 PCI slot. The slots in a 2010 Mac Pro are preconfigured so that the bottom two are x16 and the top two are x4. With my Nvidia Quadro 4000 GPU using the bottom slot the obvious choice for the new card was the next slot up. The card would still work if connected to a x4 slot but performance would be effected to some degree.

With older Mac Pro’s like the 2008 Model you can actually configure the slots in various ways using a utility that pops up when the Mac detects a PCI configuration change. I’m not sure whay the newer models don’t have that feature but anyway, it makes things simpler.

   

As you can see in the images above the card is locked into place by the bolt on locking place as well as a sliding bar which on the 2010 Mac Pro is locked and unlocked by pressing a small button on the fan assembly and sliding the assembly backwards and forwards. Next job is connecting a pair of miniSAS cables to the back of the card. The cables and connectors are large and very solid, they slide into the cards and fasten with a press button release mechanism. I numbered my cables and the Mac so that if I have to remove the cables at any point I could make sure to return them to the same position.

   

Now on to the drive enclosure. I went for an Enhance-Tech E-800MS 8 bay desktop enclosure, the same product is marketed in the US as the Proavio Editbox 8.  When I unpacked the enclosure I was surprised how small it was, probably due to the image at the top of this post. Mine came from Rentaraid pre-installed with eight Hitachi Deskstar 7K3000 3TB Drives. Wiring up was very simple, just plug in the two SAS connectors, attach a power lead, and it’s ready to go. The enclosure is just a dumb device that holds and connects up the drives really, there’s no configuration necessary for the enclosure itself. Once connected up I switched on the Enclosure followed by the Mac Pro.

 

Booting the Mac Pro results in two loud beeps from the Areca card, this is normal for a cold boot. The card has a speaker built on to it so that it can warn you about any problems that may crop up with the array.

I had decided to install Mountain Lion on my Mac Pro previous to ordering the RAID kit and so made sure that the appropriate drivers for the card were available. Areca had a press release on their website stating that drivers for their SAS cards were included with Mountain Lion so I shouldn’t need to install any drivers… fingers crossed! Interestingly the Mountain Lion drivers are not available on the included CD or on the Areca website at the time of writing this.

Once at the desktop I looked at the system profiler and the card was showing as an SAS device, so far so good! The next job was to set up a RAID set… that’s where things started to get a little more complicated.

With something like a Drobo or a Pegasus system there’s going to be a slick installer app that you can run and follow the on screen prompts and options until your unit is ready to roll, nothing like that here!. The first challenge is getting to the admin utility which runs as a web based system on the card itself, it’s really just a case of typing http://127.0.0.1:81 into safari which brings up the following page but even figuring that out means trawling through a very in depth manual.

 

 

From there you can navigate into many pages of setup and maintenance options (See the bottom of this post for examples). Neil gave me some settings to use with the ‘quick create’ option which I followed and my RAID set was soon being built. Without those instructions though I can see a lot of people being stumped, it’s not user friendly at all unless your a systems admin.

I want to mention that Neil from Rentaraid.co.uk actually offers to remote into his clients machines and set everything up for them. The day my unit was delivered Neil was overseas so I decided to tackle it unattended with some written instructions instead… no patience me!

It took 15 hours for the RAID 5 set to build. Once complete the common ‘This Disk needs to be initialised” appeared on my screen and then once set to ‘Mac OS Extended’ I had a shiny new drive icon ready to be used. The first thing I did was run some tests on the RAID set using AJA’s System Test utility and it became apparent that something wasn’t quite right with the read speeds.

 

As you can see the read speeds are very erratic resulting in the green block you can see and the overall read results being lower the the write speeds. Sorry about the low quality image, it was captured by Neil using screen sharing software.

The next day Neil was back in the country so he remoted in to the mac and we tried various configuration settings to no avail. Neil even sent me a replacement Areca card to try but the results were the same. I tried installing the setup on my older 2006 Mac Pro running Lion and again the results were the same.

Not wanting to use up more of my time troubleshooting Neil had the kit picked up and sent it to the manufacturer who experimented with it for a couple of days and then sent it back to me along with their custom settings. So here’s the result from the same test after they configured it as RAID 5.

 

 

(See the bottom of this post for the card settings provided by Areca)

As you can see the results are very different now, instead of the erratic wash of green read speeds there’s a much steadier green line above the write speeds and the average reads results are in line with the write results at around 850 MB/s. So lets put that into perspective.

I have 21TB available on an RAID 5 solution that is more than ten times faster than my Drobo S and more than twice as fast as a 12TB Pegasus R6 running on a Thunderbolt connection. Although the initial cost is higher than both the Drobo and Pegasus solutions, the cost per TB is lower.

For comparison purposes Chris Fenwick has recently posted some examples of drives speeds using the same AJA test app. Chris tested the Pegasus R6 using thunderbolt and achieved read and write speeds of around 350 MB/s using RAID 5.

And how about Black Magics Disk Speed Test? Full House!

The only down side to using the Areca SAS card is that it’s not quite as easy to set up as some other options. If your a little more technically minded though or buy from somewhere like Rentaraid.co.uk that are happy to help with setup then it’s not something you should have to mess with very often.

Thunderbolt is useful and easy to use on laptops and iMacs but the thing to remember is that it does not perform as well as a Mac Pro’s PCIe slots. Having Thunderbolt on a Mac Pro would still be useful for offloading footage etc, but in terms of RAID storage you’re much better off with PCIe slots and a Mac Pro.

The full kit from Rentaraid in the UK costs £2,295.00 + VAT
B&H sell a similar complete Proavio Editbox 8 kit for $5,152

 

Words of Advice

I want to finish with two bits of RAID advice. Firstly, the Areca card has 1GB of built in cache memory that temporarily stores data during read and write actions. If you happen to lose power during a write session there’s a good chance that data will be lost and the RAID set might be damaged. There’s two ways to stop this happening. Firstly you can install a battery module on the card that keeps that data safe for a few hours and then writes it to the drives once the system is restarted. The second solution, and the one I chose was to install a UPS (Uninterruptible Power Supply). I picked up a reconditioned APC 1500 SmartUPS on ebay for £140 that keeps my Mac Pro and the enclosure running for around 20 minutes, in the event of power loss, it then communicates with the Mac Pro via USB and makes it shut down gracefully. If you buy a UPS for a Mac it needs to have ‘pure sine wave’ power output, not a stepped sine wave.

The other thing that you must do is backup your data! A RAID is not a backup solution, it can survive a disk failure but it’s a very complex system that can still suffer from failures resulting in the loss of all the data it holds. The other danger with 21TB of data on one drive is a human one, if you accidentally delete something, it can be a big something!

Over the next week or so I’m going to post about my backup solution, you just need to have a plan to recover all of the data should you lose the RAID, or the entire location where it lives.

 

Card Settings

If you’re interested in the Areca 1882 settings that Enhance-Tech supplied then I’ve included screen grabs below. Please bare in mind that these are specific to the Hitachi 7K3000 drives installed and the Enhance-Tech / Proavio E-800MS enclosure. The same may not work for different configurations.

 

 

 

 

Be Sociable, Share!
    • Sean
    • September 5th, 2012 2:49pm

    Hi,
    I’m doing something very similar to your setup. I have the areca 1882ix-12 card and the sans digital tr8x enclosure. I was surprised to see that your raid enclosure shipped with consumer drives and not enterprise drives since they say you have to use enterprise drives because of the firmware settings. Have you had any problems with the drives dropping out or degrading the array? Just curious. I’m on the fence between enterprise and consumer drives. The price difference between consumer and enterprise drives is 2x.
    Thanks.

    • No Problems yet Sean, the drives came highly recommended by Rentaraid.

    • Sean
    • September 23rd, 2012 10:58pm

    Awesome. I bought consumer drives (seagates-3tb) and they were a real pain to initialize. They took forever (16 drives in 2 eight drive arrays). MRAID kept freezing up. Reboot computer and continue on…
    Since that has completed there have been no hiccups. So, I am also very happy. I am getting read/write scores from Disk Speed test of 1100/MB/s in raid 5.

    The sans disk tr8x enclosures were kinda loud so I have replaced the fans with noctua nf-s12b running at 900rpms.

    Thanks again for putting this on the web. It was nice finding this information when I was in the process of doing something very similar.

    • Alex
    • October 19th, 2012 8:43pm

    Thank you for sharing this info Paul!

    Please don’t laugh but I started my film company in 2008 (so 5 years next year) and started with Final Cut Studio 2 on the best iMac I could afford at the time. I am still editing on this machine with HD footage from DSLRs. These are the specs (here’s the bit where you shouldn’t laugh) iMac (Early 2008) OSX (mountain lion) 4GB DDR2 RAM (all it takes), 3.06GHz Core 2 Duo processor with 500GB internal HDD. I also invested in Drobo S for safety and this is where all my footage is stored and currently edited from (connected via FW800).

    So as you can see I am now realising how underspec’d my suite is and how much I need to invest further. Desperately wanting to make use of Thunderbolt technology but also wanted to enjoy CUDA accelerated graphics (as now cutting with CS6) along with introducing a tonne of new RAM and a way better processing set. So for me the Mac Pro has always been the way to go but the lack of thunderbolt stumps me especially when I can see the benefit of it when it comes to moving data (for back-ups et cetera).

    As it looks like Apple aren’t going to be releasing one anytime soon this provides me with an excellent work around!

    Thanks

    • You’re welcome Alex. Once you’ve tried something like an SAS card you realise that thunderbolt is actually more of a consumer solution anyway, although can of course be very handy for our needs as well so it’ll still be great to see it on whatever apple do with the next Mac Pro.

  1. I have just implemented a far more modest & much cheaper RAID array on each of our Mac Pros. I had a bunch of 1.5TB disks knocking around from another project so went looking for an enclosure. For just under £150 I found the the DataTale RC-M4DJ 4-bay eSATA hardware RAID device. Our Mac Pros are the early 2008 model with two spare SATA sockets on the motherboard so the RAID box is connected using a Sonnet cable that adds two eSATA sockets. The box has a nice software interface that can send an email if a disc fails & performance at >200MB/s R/W while pitifully low compared to your super array is not much slower than the 250MB/s that I get from an SSD in the regular HD sled. Interestingly performance is pretty much the same whether configured as 4-disk 6TB RAID-0, 4.4TB RAID-5 or 3TB RAID 0+1 so I am pretty sure that it is the 3Gbps SATAII interface that is the bottleneck.

    Now each Mac Pro has a 4.5TB RAID array with at least double the performance of the regular internal disks. If I had bought 3TB disks at about £100 each then it would be a grand total of about £450 for 9GB of RAID5 which I think is a bargain.

  2. Hey there,

    Just found your blog post and am running into a few issues I can’t seem to figure. I have a macpro tower with an internal 8TB raid built using the maxupgrade’s chasis. It’s been a great raid (raid 5). Since updating to Lion and now (tonight) Mountain Lion I cannot get to the web-based admin. The MRAID folder no longer opens up the web browser so I have no way of managing the RAID or doing diagnostics. Areca hasn’t been very helpful.

    Do you know how I can access the admin features of the RAID?

    All the best and many thanks in advance,

    Ed

  1. No trackbacks yet.