open All Channels
seplocked EVE Information Portal
blankseplocked New Dev Blog: Full Suite of Upgrades to the Tranquility DB - Yippie!
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: 1 2 3 [4] 5

Author Topic

Pneumon Blaster
Quondam Souls of the Universe corporation
THE R0NIN
Posted - 2011.03.25 05:48:00 - [91]
 

Lag did not change.

Fix the standings bug finally?

Monkey M3n
GK inc.
Pandemic Legion
Posted - 2011.03.25 05:57:00 - [92]
 

Edited by: Monkey M3n on 25/03/2011 05:57:14
Why didn't you get the Xeon w3690?


Dek'athor
Posted - 2011.03.25 07:01:00 - [93]
 

Edited by: Dek''athor on 25/03/2011 07:04:22
Hmmm, this may explain why the time from right-clik-> sell until THE TIME the dialog box with the average region item price INCREASED.

This is in a ~100 players mission hub, no modules lag, nothing wrong with anything, just market data interrogation takes about 5-15 seconds PER ITEM. I noticed this this in the last few days...

Did I understand well that the DB has new SSD technology? Solid State Drive? as in diskless HDD's? I seem to recall some products had issues with the initial read time, i.e. the time it takes from the initial read request until the data gets out there. Once the initial read is out of the way, the data would be read at a awesome speed making nice love with large file read performance, but absolutely murdering small file read performance.

Edit: inserted obligatory emoticon: Evil or Very Mad

Super Whopper
I can Has Cheeseburger
Posted - 2011.03.25 07:12:00 - [94]
 

Originally by: Sith LordXXX
Edited by: Sith LordXXX on 25/03/2011 05:35:33
Edited by: Sith LordXXX on 25/03/2011 05:30:49
Opteron 6174's would have been a much better upgrade as apose to 8 fake cores in the intel and intel costing twice as much going for $2400, the AMD's have 12 real cores giving far more processing power then a intel chip with only 8 real cores with a marketing gimmic of 8 fake cores.

16 threads don't equal twice the processing power. The performance boost 2 threads give is fake. Like smoke and mirrors you can't get power from something that isn't there. As apose to 12 real physical cores with 12 threads. Your getting real world performance for half the cost. Means you could have used 4 socket boards to get 48 real cores of power for the same price as a dual socket intel. Intel doesn't have quad socket boards on newegg, amd does, for 12 real core cpus. Thats more then 50% the power then a intel system. Intel is a joke. AMD beats intel in every way in the server area its physical fact. ugh

If anybody thinks 16 cores with 16 fake cores can beat even 24 real cores they get a Rolling Eyes for being derp, and 48 real cores impossible intel can even compete with, if you think so, you get a double... Rolling EyesRolling Eyes Also price per performance ratio amd wins by 50%. Thats madness. Laughing AMD is the real smart choice for real processing power. Wow intresting intel's 8 core cpu's run at 130w and amd's 12 core cpu's run at 115w. Not only does amd have more power, they use less power consumption with more cores. Very Happy


The moment you find out why people keep swallowing the Intel propaganda, rather than buy quality you let me know.

CCP, you're pretty daft for buying Intel. It's been known for a very long time that AMD are superior but you keep buying Xeon's. You getting kickbacks from Intel for not buying AMD or you just love wasting money?

Erichk Knaar
Caldari
Noir.
Noir. Mercenary Group
Posted - 2011.03.25 08:24:00 - [95]
 

ITT: People who don't get why Intel is leading AMD.

http://images.anandtech.com/graphs/amd12core_032610044429/22157.png

There's your precious AMD chip in a database test.

Other wise, as someone who understands what all of that is: Nice toys :)

Seconding the guy above who mentioned Greenplum. Stuff is sick (And cost effective).

Aldariandra
Gallente
MunsterMunch
The 0rphanage
Posted - 2011.03.25 08:44:00 - [96]
 

By the way. Those CPU graphs look rather familiar to me.
Quest Foglight Performance Analysis for SQL by any chance? :D

Xenofarion
Gallente
Swords Horses and Heavy Metal
Posted - 2011.03.25 09:03:00 - [97]
 

Quote:
9 x 300 GB SSD's drives RAID 5 attached via IBM V7000
36 x 600 GB SAS drives RAID 10 attached via IBM V7000


And all connected with an OnBoard-RAID-controller? Laughing Razz

No, seriously, keep it coming CCP!

CCP Yokai

Posted - 2011.03.25 09:15:00 - [98]
 

Originally by: Hawk TT
CCP, now you have to look at Intel Xeon X5698 Dual-Core 4.4GHz and X569X @ 4.66GHz...

I suppose those would be nice match for the SOL nodes...Twisted EvilTwisted EvilTwisted Evil


Spoiler Alert!!!

Watch my very short 2 min section of the Keynote today at 15:00...

All I can say right now... but there is way! more to come.

Charles Javeroux
Gallente
INTERSTELLAR CREDIT
Posted - 2011.03.25 09:19:00 - [99]
 

Wohoo \o/...after reading this d-blog, it feels like second X-mas Very Happy

CCP Yokai

Posted - 2011.03.25 09:20:00 - [100]
 

Edited by: CCP Yokai on 25/03/2011 09:21:06
General Response to "I thought the DB was not under load".

It wasn't back then... but it is now.

Changes I can think of off the top of my head that affect the DB.

  • Inventory 64

  • API

  • Evegate

  • Enhanced Backups

  • Cleanup jobs

  • Simple DB size growth


We are doing ALOT behind the scenes that needs more power from the DB and we were obviously starting to break it.



CCP Yokai

Posted - 2011.03.25 09:27:00 - [101]
 

Originally by: Korerin Mayul

you have four 8g ports per server, rolled into 2 trunks of 16g? - sweet!! what is managing the host level trunking? I havent seen this done in anger before

THIS

Additionally, be really careful with thin provisioning, I speek form bitter, bitter experience that using that stuff in prod will cause many tears and late night clickeyfests.

Only being used for non-production warehousing and such. Just more cool stuff we didn't have before. Daddy likes options you know?



Super Whopper
I can Has Cheeseburger
Posted - 2011.03.25 09:28:00 - [102]
 

Originally by: Erichk Knaar
ITT: People who don't get why Intel is leading AMD.

http://images.anandtech.com/graphs/amd12core_032610044429/22157.png

There's your precious AMD chip in a database test.

Other wise, as someone who understands what all of that is: Nice toys :)

Seconding the guy above who mentioned Greenplum. Stuff is sick (And cost effective).


A company that is buying thousands of CPU's only looks at one graph? I'm surprised you didn't post some gaming benchmark.

CCP Yokai

Posted - 2011.03.25 09:29:00 - [103]
 

Originally by: Svizac Marmotov
Is Tranquility going to become self-aware?



My best guess... 04-15-2011 (I'm having it do my taxes)

CCP Yokai

Posted - 2011.03.25 09:30:00 - [104]
 

Edited by: CCP Yokai on 25/03/2011 09:32:07
Originally by: ModeratedToSilence
Originally by: CCP Yokai
Originally by: Marconus Orion
I'm not very tech savy so for us laymen non-super geeks, please using a car reference, what is the comparison?

We going from a Fiesta to a Mustang?


We had a Ferrari 1985 288 GTO

We have a Ferrari 2011 599 GTO

Both great... both fast... the new one is just magic.

make sense?


Attempting to align computer technology development with automotive development is stupidity. Computer hardware tends to double in its basic attributes every 18-24 months. If we had the same development in motor vehicles we would not be playing internet spaceships - we would be in real life spaceships.


Note: I agree with you and this is why I used a 1985 to 2011 comparison for a 2008 to 2011 server change. Seems about right to me. But I get what you mean... hard to compare really... I just like the 599 GTO enough to make up any excuse to use it.

The Snowman
Gallente
Aliastra
Posted - 2011.03.25 09:32:00 - [105]
 

What happens to all the old equipment? Do you sell it to try recover some of the cost?

Super Whopper
I can Has Cheeseburger
Posted - 2011.03.25 09:36:00 - [106]
 

Originally by: CCP Yokai
Originally by: Hawk TT
CCP, now you have to look at Intel Xeon X5698 Dual-Core 4.4GHz and X569X @ 4.66GHz...

I suppose those would be nice match for the SOL nodes...Twisted EvilTwisted EvilTwisted Evil


Spoiler Alert!!!

Watch my very short 2 min section of the Keynote today at 15:00...

All I can say right now... but there is way! more to come.


You could also do your bit by not supporting a rogue apartheid regime.

Muul Udonii
Minmatar
THORN Syndicate
BricK sQuAD.
Posted - 2011.03.25 09:47:00 - [107]
 

Yes it's all very nice, but does it have a camera?

Rahnim
Posted - 2011.03.25 09:51:00 - [108]
 

And all this stuff is live now? when did you change this stuff? did it fix the large scale fleet lag?

CCP Yokai

Posted - 2011.03.25 09:53:00 - [109]
 

Originally by: Rahnim
And all this stuff is live now? when did you change this stuff? did it fix the large scale fleet lag?


Yes, 03-17-2011, NO

Cresalle
Posted - 2011.03.25 09:53:00 - [110]
 

Nice. Now don't light it on fire. Laughing

Dr Sheepbringer
Gallente
Halinallen veroparatiisi
Inglorious Carebears
Posted - 2011.03.25 10:24:00 - [111]
 

So the hamsters went from Rambo...probably the third one already to the bloodiest movie ever Rambo 4 then?

Just as a ballpart...how much does that stuff cost? I mean I'm not talking about just one part etc. In a whole, how much does a Rambo 4 degree hamster mayhem cost?

Fredd Mosibfu
Posted - 2011.03.25 10:30:00 - [112]
 

woah im learning to be a network manager and i think i took the right education.. these stats make me horny Twisted Evil

if only i could do my internship at ccp but its so far away Crying or Very sad

SwissChris1
Playboy Delivery Service
S E D I T I O N
Posted - 2011.03.25 10:32:00 - [113]
 

Wow I just sent those specs around the office and everyone is SUPER jelous Laughing

amazing stuff...

Viktor Rasmussen
Gallente
Eagle's Club
Posted - 2011.03.25 12:40:00 - [114]
 

simply awesome!

drinking12many
Minmatar
Nine Inch Ninja Corp
Posted - 2011.03.25 12:50:00 - [115]
 

Edited by: drinking12many on 25/03/2011 13:02:34
Edited by: drinking12many on 25/03/2011 13:00:54
Edited by: drinking12many on 25/03/2011 12:51:55
Originally by: Sith LordXXX
Edited by: Sith LordXXX on 25/03/2011 05:35:33
Edited by: Sith LordXXX on 25/03/2011 05:30:49
Opteron 6174's would have been a much better upgrade as apose to 8 fake cores in the intel and intel costing twice as much going for $2400, the AMD's have 12 real cores giving far more processing power then a intel chip with only 8 real cores with a marketing gimmic of 8 fake cores.

16 threads don't equal twice the processing power. The performance boost 2 threads give is fake. Like smoke and mirrors you can't get power from something that isn't there. As apose to 12 real physical cores with 12 threads. Your getting real world performance for half the cost. Means you could have used 4 socket boards to get 48 real cores of power for the same price as a dual socket intel. Intel doesn't have quad socket boards on newegg, amd does, for 12 real core cpus. Thats more then 50% the power then a intel system. Intel is a joke. AMD beats intel in every way in the server area its physical fact. ugh

If anybody thinks 16 cores with 16 fake cores can beat even 24 real cores they get a Rolling Eyes for being derp, and 48 real cores impossible intel can even compete with, if you think so, you get a double... Rolling EyesRolling Eyes Also price per performance ratio amd wins by 50%. Thats madness. Laughing AMD is the real smart choice for real processing power. Wow intresting intel's 8 core cpu's run at 130w and amd's 12 core cpu's run at 115w. Not only does amd have more power, they use less power consumption with more cores. Very Happy


Your right real cores (usually) > hyperthreading but thats not to say performance gains wont be seen. Also its can be very transaction database load dependent. We had done benchmarking on our esx servers with hyperthreading off and in the past you were usually better off leaving it off. Now days there is a definite improvement in the performance I think we saw somewhere around 30% or so. Now is that to say they should have thought about amd yes they probably did but since it appears they go with IBM hardware which I believe does offer AMD they may have been constrained or helped by some other cpu feature/ kind of database transactions they do that they went with the Intel which right now for most loads tends to be better. Even in my company we tend to go with Intel even though my preference is AMD from a cost performance standpoint. Though my piddly database server only has 8 cores no HT and 16GB of ram *cries* and just standard raid 10 SAN storage and only about 75GB in size we only get about 5000-7000 IOPS with the caching and all and during inventory updates my DB cries. Maybe next time I can talk them into more RAM and some flash san storage if they give me the money :(

Illwill Bill
Svea Crusaders
Posted - 2011.03.25 12:52:00 - [116]
 

I came.Embarassed

EliteSlave
Minmatar
Macabre Votum
Morsus Mihi
Posted - 2011.03.25 13:07:00 - [117]
 

Originally by: Sith LordXXX
Edited by: Sith LordXXX on 25/03/2011 05:35:33
Edited by: Sith LordXXX on 25/03/2011 05:30:49
Opteron 6174's would have been a much better upgrade as apose to 8 fake cores in the intel and intel costing twice as much going for $2400, the AMD's have 12 real cores giving far more processing power then a intel chip with only 8 real cores with a marketing gimmic of 8 fake cores.

16 threads don't equal twice the processing power. The performance boost 2 threads give is fake. Like smoke and mirrors you can't get power from something that isn't there. As apose to 12 real physical cores with 12 threads. Your getting real world performance for half the cost. Means you could have used 4 socket boards to get 48 real cores of power for the same price as a dual socket intel. Intel doesn't have quad socket boards on newegg, amd does, for 12 real core cpus. Thats more then 50% the power then a intel system. Intel is a joke. AMD beats intel in every way in the server area its physical fact. ugh

If anybody thinks 16 cores with 16 fake cores can beat even 24 real cores they get a Rolling Eyes for being derp, and 48 real cores impossible intel can even compete with, if you think so, you get a double... Rolling EyesRolling Eyes Also price per performance ratio amd wins by 50%. Thats madness. Laughing AMD is the real smart choice for real processing power. Wow intresting intel's 8 core cpu's run at 130w and amd's 12 core cpu's run at 115w. Not only does amd have more power, they use less power consumption with more cores. Very Happy



Actually having a HT is very beneficial, as you state that it is a "Fake core" yes, but its only a "FAKE core" as the CPU actually has an extra register per core thus giving a second lane of data to be held for processing, The CPU itself is not to blame for this trick as it is merely the way current x86-64 operating systems are written.

Also AMD does not have the horsepower that INTEL has when it comes to server grade chipsets. Nothing to do with kickbacks. the job i work for isnt as big as CCP when it comes to enterprise level but considering we have 100 physical virtual host's which are currently all AMD, while AMD was nice when it was not number crunching we slowly started to grow in the past year which really showed AMD's weakness when it comes to doing the crunching it just doesnt have the horsepower that is needed. CPU clock cycles have been pegged at near 70% the past year and have not come down at all. While we brought in 10 INTEL boxes of the same clock rates migrated a few servers onto the boxes, the cycles have dropped down to mere 25-30% which means I can load more VM's on it.

Ban Doga
Posted - 2011.03.25 13:53:00 - [118]
 

Originally by: Tinkanium
Originally by: Ban Doga
It is also true that there is always a limiting factor and addressing one will usually make something else a limiting factor.

Yeah man. In fact based on what you yourself said you're already wrong. There's always a limiting factor. If you fix that, and it is no longer the limiting factor, then by the logic that there's always a limiting factor something else must become the limiting factor.


1) there can be several limiting factors at the same time ("a" does not imply "exactly one")
2) addressing something does not imply fixing it ("better" does not imply "best")

Also, "usually" is a superset of "always" so what I said was not wrong at all.
You might call it inaccurate but it isn't even that:
Just assume you have 2 limiting factors at the same time (eg you can't run from New York to London in 2 hours because humans can't run that fast AND there's a huge ocean between those two), if you eliminate 1 of those limits (let's say you find a way to run over water) you'd still have one limiting factor (you just can't run that fast).
But that's not a new limiting factor.
You just "fixed" the other one.

Originally by: Tinkanium
Even in the dev blogs there's always someone. Seriously. Incredibly long post containing nothing but quotes and seemingly intelligent logic that basically amounts to nothing. Please do save us all some time and just read along k?

It's not my fault you decide to read something and think "that is wrong" just because you don't understand the simple difference between "a" and "the" while trying to argue about logic.

And if you think that's an "incredibly long post" I'm actually surprised you managed to read the devblog.
Just stick to reading the shorter posting if you the long ones bother you k?

Callea Melin
Amarr
MevilD
Posted - 2011.03.25 14:22:00 - [119]
 

Edited by: Callea Melin on 25/03/2011 14:33:24
Edited by: Callea Melin on 25/03/2011 14:32:23
Edited by: Callea Melin on 25/03/2011 14:25:17
Hi there,

well I've been following all of CCP's blogs so far and sometimes got some ideas even for our business.
We've been running for almost 2 years now on 8 Quad Core AMD Opteron 8359 2.3 GHZ processors for our main database, and when we went live with it, had about 20% CPU peak.
Well, we underestimated IO and User growth quite a bit at that time, so now we are struggling for at least 6 month with a usual 90% cpu and constant IO bottlenecks.
New storage is on its way, but even with this the CPU's are well overloaded nowadays.
The rest is a similar system, Windows 2008 R2 Enterprise 64, Enterprise SQL Server 2008 R2 CU2 64, 256 GB Ram and so on. Using this (hardware) for a good 2 years now.

Our main Database is about 2 TB large now with a more or less constant growth of ~1.1 GB/day.

Im also really keen on getting this new HP P9500 storage with a rather small load of 19x8 15k rpm 2.5" SAS disks up and running for prod here.

Can't post graphs here unfortunatly, just sharing some technical stuff since I like to :)

Cheers

ps: For all that want to have such stuff, yes it is indeed very nice to work with it... but getting used to such stuff tends to be expensive for private stuff, since you want bigger and better stuff for yourself too :P

pps: Being a DBA, sometimes I'd really like to chat a bit with some CCP DBA's :P

Valeroth Kyarmentari
Posted - 2011.03.25 15:45:00 - [120]
 

Very sexy graphs.


Pages: 1 2 3 [4] 5

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only