Game Development Community

dev|Pro Game Development Curriculum

ABigHole In the Web part Duex

by Sean Rice · 02/28/2015 (7:19 pm) · 6 comments

When I started with Torque we had several resources to us to upload files and the resources list here contained a link to many of these. A lot of these files have been lost to time, server corruption, lack of backups, lazy admins, server take downs and simply lack of interest by the original artist. Several individuals like myself have collected these resources throughout the years and began hosting them to provide them to the community. Back then, it was a Big hole in the web (torque.abigholeintheweb.com/public_system/) and then I mirrored the site at abighole.hngamers.com to pay homage to the original hoster of those files.

Recently, we had an issue with the website that we hosted at abighole.hngamers.com. The software is no longer maintained and while I am a PHP dev, I have too many of my current projects I am working on to fix a failing piece of software. Several of these projects just happen to coincide with the exact thing that I have always stated I would provide for this community, a file sharing and storage site. Due to our requirements to provide fast downloads to multiple sections of the world, the ability to utilize torrents, automated highly available web servers, database servers and storage for customer files, we had to create a new network and learn new technologies. As such, since ABighole resides in this network, it has received a major upgrade.

The upgrade consists of multiple levels. First and foremost the front end is handled by Pydio, a great collaborative site that allows users to share resources on a team or individual basis. This provides clients for both the desktop and mobile devices to be able to access these resources. You can synchronize individual trees or branches of the workspaces without having to download the entire tree.

Second, the backend is a multi tiered platform handled by HAProxy and Mirror brain to deliver a highly available web service that is quickly expandable to support any number of users world wide. Mirrorbrain handles the torrenting, hashes and redirection of files. HAProxy handles the redirection of the websites. Last is the DNS Failover which is monitoring all of the sites to verify full update. Each of these services remove servers that fail, prior to the customer ever seeing an issue. You can see what this network looks like below. In addition to this, is an offsite backup that occurs every 15 minutes for any files that change.
puu.sh/ggQ56/0bb7a5bdbc.png
Full sized network image: puu.sh/ggP5x/bd80ce16a3.png
Where it is (Abighole): files.hngamers.com/abighole/
Where it is (Cloud): cloud.hngamers.com/pydio/
What you pay: NOTHING! EVER! That's right, we have always and will always maintain free services to these sites. This is my effort to continue to provide these resources to the community, even if I am no longer "actively" participating in it. We do ;however, always accept donations to help our services. HNGamers consists of a small team and is fully funded out of our pockets from the proceeds of our day jobs. Please note, that even though I am offering this to the community, this is not for "commercial" use. This is for indie use and development, once you have progressed beyond the indie stage, we can talk about your commercial usages of our network delivery layers.
What You Get: Access to the community resource folders to upload new files into the resources. Personal storage for yourself and your projects. Access to our store front, to sell your games. No file speed limitations, no bandwidth limitations. Your files are delivered at the speed our network can deliver at.
Requirements: You must have a valid and active profile on the Torque site and the need to share files that won't ever be deleted.
How to get it: Send me an email to the email attached to my profile, make sure to link your profile. I will create your account and send it back to you. This offer is only available to the members here, in this community.
What it provides: Torrent/Magnet from multiple servers in multiple locations in the world, SHA1, SHA256, MD5 and BT Hashes, Meta Links, self healing auto redirecting always available file services.
What can you do with it: Well, we are using it to hash files, list files for distribution, deliver files to clients via torrents from multiple sites at incredibly high speeds and manage our updates to our end users through our client, which consumes the hashes and lists to verify the users have the correct files locally.

#1
03/02/2015 (8:15 am)
I have no idea what that means but it sounds great! Thanks Sean.
#2
03/02/2015 (3:37 pm)
This sounds all very complicated, but I think you want to tell us that you have archived all the Torque3D resources, right?
#3
03/02/2015 (3:39 pm)
Haha, yes, I have a large number of resources backed up and available at the site.
#4
03/08/2015 (12:17 pm)
Thanks! I really like that idea :O)
#5
04/30/2015 (8:25 am)
Thanks for the backed resources!
#6
09/14/2015 (2:55 am)
::hums superman theme::