open All Channels
seplocked EVE General Discussion
blankseplocked EVE-Files' harddrive went poof again
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: 1 [2]

Author Topic

Bish Ounen
Gallente
Best Path Inc.
Cult of War
Posted - 2007.12.28 16:37:00 - [31]
 

Originally by: Regat Kozovv


I should have been a little clearer, when I said SCSI is just an interface, I really mean that no one makes consumer-grade SCSI drives. =)

And yes, SCSI/SAS will outperform SATA any day. However, for Chirbba's budget, I do wonder if SATA would be more cost effective. Fiber Channel SANs and proper virtualization is great and would definitely be recommended. But who has the resources to do that?
I guess we need Chirbba to post his specs.

On a related note, I was reading this just the other day:
http://www.techreport.com/discussions.x/13849
Maybe we should buy him one! =)


Ahhh. Well yes. I think we can absolutely agree on that point, there really isn't any SCSI/SAS consumer-grade equipment out there. I do wonder though if Chribba hasn't simply outstripped the capabilities of most consumer-grade hardware. I mean, didn't he JUST replace this equipment about 2 months ago? That seems like an awfully short lifespan for any server, unless he just got a Lemon hard drive.

I suspect it may very well be time for him to just rent space in a proper datacenter. I'm sure there must be companies that specialize in high-availability/high-uptime web and data solutions that don't cost an arm and a leg to rent from?

I'd also like to see some stats on the type of traffic and throughput he gets on a daily basis. It would be easier to suggest solutions that way.

Also, that SUN system is kinda neat, but with all SATA drives I still don't think it would take the thrashing that EVE-Files must take. He's absolutely going to need a SAS RAID setup for his DB, or he's going to be swapping out drives every 2-3 months, if the last drives' survival time are any indication of his transaction levels.

-------------------------------------------------

Regat Kozovv
Caldari
Alcothology
Posted - 2007.12.28 16:51:00 - [32]
 

Edited by: Regat Kozovv on 28/12/2007 16:52:04
Originally by: Bish Ounen


Also, that SUN system is kinda neat, but with all SATA drives I still don't think it would take the thrashing that EVE-Files must take. He's absolutely going to need a SAS RAID setup for his DB, or he's going to be swapping out drives every 2-3 months, if the last drives' survival time are any indication of his transaction levels.

-------------------------------------------------


Good point. =)

Maybe use something like the Sun system as general file storage, and move the DB itself to a small, but high performance SAS solution like you described. Either way it'll take some cash.

flashfreaking
LFC
Executive Outcomes
Posted - 2007.12.28 17:42:00 - [33]
 

Well, at my job we'r currently using them Suns, and we're very happy about them, but as Chribba knows, the datatraffic on his server is way higher then ours, and the writing/reading is pretty intense, so SSD's seem to be the only way to save data, without having to replace broken drives every month.

Lysander Memnos
The Graduates
Brutally Clever Empire
Posted - 2007.12.28 18:55:00 - [34]
 

Replacing hard drives is the cheapest option, so that's the easiest course.

There are a couple things you could do to reduce/mitigate the database load (which might help some on drive lifespans):

  • Optimize your sites to reduce the number of database calls (easy to say, hard to do)

  • Split your databases among different drives

  • Round-robin DNS with database replication (boy this would be fun to implement...not)

  • Beg CCP for a RAMSAN loaner Twisted Evil


Chribba
Otherworld Enterprises
Otherworld Empire
Posted - 2007.12.28 19:02:00 - [35]
 

Well hdd is replaced so all fine there, but for some reason the nightly backup of the db isn't really restoring ok - which is why everything is still not working as intended, am trying both left and right to get the backup to restore properly.

Linerra Tedora
Amarr
Faulcon de Lazy
Posted - 2007.12.28 19:10:00 - [36]
 

hmm couldn't it be possible, to use a ram drive to load up the database from a set of raid drives.

So that accessing the database, is no trouble on the harddrive, and only uses the harddrive when writing data into the base.
I guess most of his hits come from people reading parts instead of adding new stuff to the database.

Chribba
Otherworld Enterprises
Otherworld Empire
Posted - 2007.12.28 22:07:00 - [37]
 

Holding my breath that it will hold a little while longer now (or at least until a new drive arrive). Things "should" be back and working, some files (about 5) was uploaded after the backup of the db was made - those files have been deleted and needs to be re-uploaded.

Sorry for the downtime pilots, let me know of anything not working.

Cergorach
Amarr
The Helix Foundation
Posted - 2007.12.28 22:30:00 - [38]
 

[curious]How big is this database?[/curious]

Chribba
Otherworld Enterprises
Otherworld Empire
Posted - 2007.12.28 22:36:00 - [39]
 

Originally by: Cergorach
[curious]How big is this database?[/curious]
Only some 1GiB so not big at all.

flashfreaking
LFC
Executive Outcomes
Posted - 2007.12.28 22:39:00 - [40]
 

You sir, deserve a medal, ingame, like the Tournament ones.
Hmm, would be good suggestion anyway, for all active community members doing something awesome for the community

Verite Rendition
Caldari
F.R.E.E. Explorer
EVE Animal Control
Posted - 2007.12.28 23:18:00 - [41]
 

Originally by: Chribba
Originally by: Cergorach
[curious]How big is this database?[/curious]
Only some 1GiB so not big at all.
Great, that's tiny. The RAMdrive idea is a good one given the size you're working with, you don't even need a hardware device to do it. I believe there are a couple of good Linux apps that create a RAMdrive out of the memory pool that would allow you to quickly go that route if you'd like.

Lazuran
Gallente
Aliastra
Posted - 2007.12.29 00:23:00 - [42]
 

Originally by: Chribba
Originally by: Cergorach
[curious]How big is this database?[/curious]
Only some 1GiB so not big at all.


With such a tiny DB you should have no performance issues at all with a decent RDBMS and a server with more RAM than that...


Flinx Evenstar
Sniggerdly
Pandemic Legion
Posted - 2007.12.29 01:07:00 - [43]
 

Good job getting it back online Chribba

You are a ****ing hero dude Very Happy CCP should throw you a little bandwidth and some storage space your way tbh Wink

I really can't imagine EVE without eve-files, keep up the good work xxx





Aleksi Maksimovich
Colossus Technologies
P R I M E
Posted - 2007.12.29 01:15:00 - [44]
 

o/

RL comp tech - have been for 5 years

ssd for servers would scare me

get 6x 80gb sata hdd's (aprox $50 cdn for round #'s)

raid 6 pci card (aprox $450 cdn)

replace drives as necessary - knowing consumer hardware i would keep at least 2 around spare at any time so you can drop 2, and have them go through the RMA process without any downtime.

expensive, yes

downtime, no

considering the number of people who use this service im betting that if you asked for donations to upgrade hardware you'd likely get it in spades m8

~Cheers

Yumis
Amarr
Element 115.
Raiden.
Posted - 2007.12.29 02:16:00 - [45]
 

Originally by: Mobius Dukat
They have no moving parts, very little heat build up...

Ask yourself "how often does a RAM stick fail in your server?" isn't often i'll bet :)



I work in a Data Center with HPC clusters, the DIMMs get really really hot (to hot to touch), I suppose its down to what you do with the server a general office server will idle alot of the day but if you pound it with calucations things break. We loose a stick of RAM every couple of months across a few racks.

Make sure if you buy a SAS drive that you have a SAS controller, they look very similar to SATA, and a SATA drive will work with a SAS controller but not the other way around.

Im not even going to touch the RAID levels as I dont know what situation Chribba has, but im presuming (and presumptions are evil and lead to mistakes) that its colocated? If so he may only have 1U servers so the number of drives available will be low due to the small profile of the server, and a separate NAS/SAN would be out of the question as they charge heavily on size & power usage.

Good luck Chribba, keep up the amazing work you do.

Yumis
Amarr
Element 115.
Raiden.
Posted - 2007.12.29 02:21:00 - [46]
 

Originally by: Aleksi Maksimovich

ssd for servers would scare me



Scary but its coming, spoke to a few guys at Seagate recently and rumour has it they are stopping making 10K rpm SCSI drives and focusing development on SSD & improving the 15K rpm SAS ones. Confused

Although if you have a SAN with 200+ spindles you can max out the 4GB fibre connection Smile so they still can perform very well. YARRRR!!


Pages: 1 [2]

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only