Game Development Community

Networked - Drive Farm

by Edward F. Maurina III · in Hardware Issues · 05/14/2005 (4:47 pm) · 2 replies

Hello. I made myself a promise, to upgrade my computing system at home, after completing EGTGE. Now, I'm not done yet, but completion is not that far away, so I'm starting to do research. There are many parts to the 'quest for better computing', and one of them is setting up a disk farm in a separate room in my house. I'd like to reduce the storage in my local machine and centralize data in a remote disk farm. To that end, I'm investigating various possibilities.

I'm writing this post in the hope that some of you have also looked into this and may have some good leads.

My needs are as follows:
1. 500GB - 1TB+ storage.
2. Individual disks do not need to be very high speed as this is a data dump. (Will probably use SATA-150).
3. Networked via Fast Ethernet, or 1Gb Ethernet (preferred).
4. No redundancy required. This data will be backed up instead.


I've investigated the following:
- Network appliances (light-weight connectors for USB drives and other). - Thus far, none of these has had the capacity or bandwidth I need, but cost seems OK.

- Professional servers - These would do the job, but the price is prohibitive.

I'm considering doing:
1. Build a box from off-the shelf parts, including a MOBO w/ 1Gb ethernet and onboard SATA-150 for up to four drives.
2. Drop four large SATA -150drives into the box.
3. Drop in 256-512 MB of memory and a slow CPU.
4. Run a linux disk server.
5. Hooks the whole thing up to a 1000 watt UPS and connect it to the home network in a back room.

What can I use? - Pretty much any thoughtful suggestions you can provide.


Thanks in advance to anyone who can assist me in this project. I'll probably list specs in a .plan when I get my whole system set up, for those of you who are considering doing something similar.

www.hallofworlds.com/how.ico Hall Of Worlds - For Gamers
EdM|EGTGE

#1
05/14/2005 (6:23 pm)
The Asus A8N-Sli mainboard will support up to 4 ATA-150 drives in Raid-5 for you.
Get some 300GB drives and you'll have a ~900GB raid5 array with that. That mobo also
has dual 1GB ethernet ports so it could also take on the role as a intnernet router/firewall for you.
It will use a Sempron XP 3100 (cheap enuff) and a couple of 256MB sticks (the board has dual channel if you wish to use it).

If you don't want redundancy with raid5 you could use raid 0 (for disk performance) and get the full 1200GB (1.2TB)

Hope this tip helps :)

Edit: The board acutally has two raid controllers. The other one doesn't have raid5 but it
has NCQ support found in the newer SATA drives for additional performance when more than one disk operation takes place at the same time.
#2
05/15/2005 (4:19 am)
You can probably recycle some old hardware with a new net card and drive card. You are right in that you dont need a scsi drive array for high performance, so you can get away with using the (semi) software raid that comes on a load of mobos and cheap sata raid cards or even just the emulated raid that you can do entirely in linux.

In theory, a Compaq EN PIII733 with 128mb ram, 3x 200gb IDE drives would provide a cheap and quiet solution, maybe throw in a new gigabit nic. In the UK, the cost would be approx