open All Channels
seplocked EVE Technology Lab
blankseplocked Tyrannis Static DataDump release [UPDATED x2]
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: [1] 2 3 4

Author Topic

CCP Zirnitra

Posted - 2010.05.26 21:13:00 - [1]
 

Edited by: CCP Zirnitra on 02/06/2010 14:19:59
As EVE Online: Tyrannis has now been deployed, it is time to release the new StaticDataDump (SDD). This time around we will not be releasing all the Planetery Interaction schematic information, we will be releasing this information as we come closer to the final release of Planetary Interaction.

UPDATE: We now have a new Image Dump available for you as well, you can grab it here

But without further ado, I bring you the EVE Online: Tyrannis SDD, now with PI data

Enjoy!

Update 2010-06-02: Image dump has now been released.

Update 2010-06-01: We have now released the PI schematics dump as promised. The link above have been updated to reflect the changes, so please go ahead and re-download the SDD. The ImageDump should be coming your way shortly as well
Update 2: I jumped the gun a bit, if you have downloaded the updated PI dump, please re-download it using the link above, as I know should have all the correct information for you :)

Arous Drephius
Posted - 2010.05.26 21:32:00 - [2]
 

Yay, datadump!

On a related note, can you give us any info about the new image service that launched with Tyrannis?

Jercy Fravowitz
School of Applied Knowledge
Posted - 2010.05.26 21:34:00 - [3]
 

usual barrage of conversions:

mysql singlefile (you are most likely looking for this one)
this one should also load just fine in php-webloader-scripts, if it whines about something with timestamps at the end, ignore it.
you want innodb? bzcat tyr10-mysql5-v1.sql.bz2 | sed -e 's/ENGINE=MyISAM/ENGINE=InnoDB/g' | mysql

sqlite singlefile
can be used for Eve Asset Manager

less popular:

MSsql script dump (useful for those who cba to upgrade to sql server 2008)

mysql "one file per table" dumps

there may or may not be other flavors i forgot about if you look here.

as usual, please whine if there are any issues or you need custom dumps (partial sqlite, csv, ...) or something...

hints on how to use the split materials data may be found in the dom100 thread.


Jercy Fravowitz
School of Applied Knowledge
Posted - 2010.05.26 21:40:00 - [4]
 

now, the sad part is ... we didnt get any PI related tables.
as in, the schematics data is missing.

here is an approximation based on sisi data, the final tables will
probably have different names and some column type changes, the
structure of the data should stay the same though.
also, the values _probably_ will be still different.

but this is enough to get people hacking on tools.

should load just fine in mysql, only minor changes needed for
other db flavors. really basic sql.

dbz.scmSchematics
dbz.scmSchematicsTypeMap
dbz.scmSchematicsPinMap

you will see how it fits together.


Mmon
Posted - 2010.05.26 21:56:00 - [5]
 

Many thanks.

Any chance of a Postgres dump?

Thanks

Brock Nelson
Posted - 2010.05.26 22:49:00 - [6]
 

Can anybody export excel version of the material requirement for all blueprints?

Stick Cult
Posted - 2010.05.26 23:15:00 - [7]
 

Edited by: Stick Cult on 26/05/2010 23:34:31
It could be my computer, or your datadump, but for some reason when I load the mysql dump, it stops at mapcelestialstatistics. This leaves out all the rest of the map tables, and all of the ram*, sta* and trn* tables. I say it could be my computer because when I load the script in mysql query browser, I can't scroll beyond about line 652,311 which is part of the invtypes table dump. For now I can just download the individual tables, but... yea

edit: also noticed that mapcelestialstatistics is incomplete, I only had about 80,000 of the 470,000 that should be there.

Anders1
Volatile Instability
Posted - 2010.05.27 00:09:00 - [8]
 

Originally by: Jercy Fravowitz
usual barrage of conversions:

mysql singlefile (you are most likely looking for this one)
this one should also load just fine in php-webloader-scripts, if it whines about something with timestamps at the end, ignore it.
you want innodb? bzcat tyr10-mysql5-v1.sql.bz2 | sed -e 's/ENGINE=MyISAM/ENGINE=InnoDB/g' | mysql

sqlite singlefile
can be used for Eve Asset Manager

less popular:

MSsql script dump (useful for those who cba to upgrade to sql server 2008)

mysql "one file per table" dumps

there may or may not be other flavors i forgot about if you look here.

as usual, please whine if there are any issues or you need custom dumps (partial sqlite, csv, ...) or something...

hints on how to use the split materials data may be found in the dom100 thread.



slightly offtopic but when do we get to see you in #eve-dev again? :x

TorTorden
Amarr
Posted - 2010.05.27 02:43:00 - [9]
 

Edited by: TorTorden on 27/05/2010 02:46:40
Edited by: TorTorden on 27/05/2010 02:44:13
Shweet!, And much thanks to Jercy for making a Mysql port, (I wouldn't know how myself)

Just figured I share this little nugget on how to get the db up and running on a regular WAMP install for those who's interested in playing with this. I unzip the archive provided by Jercy go into the wamp mysql folder
should be something like x:\wamp\bin\mysql\mysql5.1.36\data\ and make a new folder i.e tyrranis_dump (this will also be your database name) and store the unzippet sql file in there.
then find the mysql executable, it should be in \wamp\bin\mysql\mysql5.1.36\bin\ and run this in command line

Quote:
mysql.exe -u root tyrranis_dump <..\data\tyrranis_dump\tyr10-mysql5-v1.sql


This takes a while a while so let it run, you can set a verbose tag (mysql.exe -v -u....etc) if you'd like to see it happen, but keeping an eye on the amount of files in the data directory you made. will let you see 'something happens'
figured I put this here since I spent while googling trying to figure this out last time around.

Update: running a test with the verbose tag seems to slow the whole process down considerably, a guess would be almost tripling the time it took letting it do so silently.

Vilgan Mazran
Aperture Harmonics
K162
Posted - 2010.05.27 02:57:00 - [10]
 

Anyone have basic stats on how many of each type of planet?

Catari Taga
Centre Of Attention
Middle of Nowhere
Posted - 2010.05.27 09:04:00 - [11]
 

Originally by: Vilgan Mazran
Anyone have basic stats on how many of each type of planet?


Pretty off-topic for this thread but since I looked it up myself anyway:

Planet Distribution Dominion
Planet (Gas)		23754
Planet (Ice) 11251
Planet (Storm) 8170
Planet (Barren) 8113
Planet (Temperate) 7284
Planet (Lava) 6473
Planet (Oceanic) 1256
Planet (Plasma) 943
Planet (Shattered) 9


Planet Distribution in Tyrannis
Planet (Gas)		20261
Planet (Barren) 19715
Planet (Temperate) 7200
Planet (Lava) 6609
Planet (Storm) 5569
Planet (Ice) 3323
Planet (Oceanic) 3036
Planet (Plasma) 1530
Planet (Shattered) 10

Yuefei Linn
Posted - 2010.05.27 11:07:00 - [12]
 

Originally by: Mmon
Many thanks.

Any chance of a Postgres dump?

Thanks


+1 from me for this.

IntegerOverflow
Posted - 2010.05.27 12:56:00 - [13]
 

Edited by: IntegerOverflow on 27/05/2010 14:19:37
That's funny, some names changed obviously.

I just ran a few unit tests and an assertion failure was reported when I was expecting 'Super Conducters' but actually the database returned 'Superconducters'

EDIT: easy answer: Super Conductors is the schematic used to PI prod Superconductors dooh

Lukas Rox
Torchwood Archive
Posted - 2010.05.27 13:34:00 - [14]
 

First off, many thanks to CCP Zirnitra for the dump, and to Jercy for very fast conversion.

Secondly, I have an idea: wouldn't it be easier both for CCP and for us if there was a page with static data dump on the EVE website? Link API and SDD and call it - for example - Eve Development Kit. All info necessary to write your own tool or make your own eve-related website in one place.

The only problem I see is Jercy wouldn't be able to put his very much useful conversions there.

What do you think?

Ix Forres
Caldari
Righteous Chaps
Posted - 2010.05.27 13:39:00 - [15]
 

Originally by: Lukas Rox
First off, many thanks to CCP Zirnitra for the dump, and to Jercy for very fast conversion.

Secondly, I have an idea: wouldn't it be easier both for CCP and for us if there was a page with static data dump on the EVE website? Link API and SDD and call it - for example - Eve Development Kit. All info necessary to write your own tool or make your own eve-related website in one place.

The only problem I see is Jercy wouldn't be able to put his very much useful conversions there.

What do you think?

I think you hit the nail on the head with the fact that the conversions wouldn't be listed. Unofficial pages are pretty much the only way to do this since CCP doesn't want to endorse stuff it's not made or checked. Without them, there's not much point. There is a page with the official dump on it- albeit out of date.

I have a postgres conversion based on the MySQL dump in the works and will link it here when it's done.


CCP Zirnitra

Posted - 2010.05.27 14:14:00 - [16]
 

Originally by: Lukas Rox
First off, many thanks to CCP Zirnitra for the dump, and to Jercy for very fast conversion.

Secondly, I have an idea: wouldn't it be easier both for CCP and for us if there was a page with static data dump on the EVE website? Link API and SDD and call it - for example - Eve Development Kit. All info necessary to write your own tool or make your own eve-related website in one place.

This is indeed a very good idea, which is also why this page already exists. However, due to the timing of the release of the SDD and ImageDumps, it is not always possible to have our web team update this page right away, and to make the data available for 3rd party developers, we usually choose to drop a message here on the forums with a link, while the toolkits page is being updated Smile

Perhaps Ix will be kind enough to update his "EVE 3rd-Party Developer Information" thread which has been stickied, since most people doesn't seem to find it in the menu system (It can be found under Community -> Toolkit)

- CCP Zirnitra

Ix Forres
Caldari
Righteous Chaps
Posted - 2010.05.27 15:04:00 - [17]
 

Edited by: Ix Forres on 27/05/2010 15:04:48
Originally by: CCP Zirnitra
Originally by: Lukas Rox
First off, many thanks to CCP Zirnitra for the dump, and to Jercy for very fast conversion.

Secondly, I have an idea: wouldn't it be easier both for CCP and for us if there was a page with static data dump on the EVE website? Link API and SDD and call it - for example - Eve Development Kit. All info necessary to write your own tool or make your own eve-related website in one place.

This is indeed a very good idea, which is also why this page already exists. However, due to the timing of the release of the SDD and ImageDumps, it is not always possible to have our web team update this page right away, and to make the data available for 3rd party developers, we usually choose to drop a message here on the forums with a link, while the toolkits page is being updated Smile

Perhaps Ix will be kind enough to update his "EVE 3rd-Party Developer Information" thread which has been stickied, since most people doesn't seem to find it in the menu system (It can be found under Community -> Toolkit)

- CCP Zirnitra


Would be more than happy to were it not locked for inactivity, meaning I can't edit that thread any more... Razz

Cheers for the timely release in any case (a couple of days in advance wouldn't hurt but it's hardly the end of the world to wait a little bit).

Jercy Fravowitz
School of Applied Knowledge
Posted - 2010.05.27 16:02:00 - [18]
 

Originally by: Mmon
Any chance of a Postgres dump?

Any chance of the postgres userbase making up its mind whether the identifiers should be quoted or not?

because, while i actualy do have both quoted and unquoted tyr10 conversions that will load into postgres, after the last months the postgres users can all go die in a fire as far as i am concerned.

Catari Taga
Centre Of Attention
Middle of Nowhere
Posted - 2010.05.27 19:11:00 - [19]
 

Edited by: Catari Taga on 27/05/2010 19:13:22
Originally by: IntegerOverflow
I just ran a few unit tests and an assertion failure was reported when I was expecting 'Super Conducters' but actually the database returned 'Superconducters'

EDIT: easy answer: Super Conductors is the schematic used to PI prod Superconductors dooh

There's a few more like that, was bug reported on SiSi already. Thought the schematics data wasn't in this release, anyway, just wait for the final data.

Arkady Sadik
Minmatar
Electus Matari
Posted - 2010.05.27 19:28:00 - [20]
 

Originally by: Jercy Fravowitz
Originally by: Mmon
Any chance of a Postgres dump?

Any chance of the postgres userbase making up its mind whether the identifiers should be quoted or not?


Unquoted. If you do not quote them, people can write invTypes and invtypes whichever they prefer. Only "invTypes" will break. If you quote them, people have to write "invTypes", neither invTypes nor invtypes will work.

Quote:
after the last months the postgres users can all go die in a fire as far as i am concerned.


Crying or Very sad

We miss you on #eve-dev btw! Even us poor postgres users!

Zendoren
Aktaeon Industries
The Black Armada
Posted - 2010.05.27 22:09:00 - [21]
 

Originally by: CCP Zirnitra

This is indeed a very good idea, which is also why this page already exists. However, due to the timing of the release of the SDD and ImageDumps, it is not always possible to have our web team update this page right away, and to make the data available for 3rd party developers, we usually choose to drop a message here on the forums with a link, while the toolkits page is being updated Smile

- CCP Zirnitra


This is evident by viewing This, This, and This Laughing

D Program
Amarr
Ambient Fleet
Posted - 2010.05.28 14:26:00 - [22]
 

Edited by: D Program on 28/05/2010 14:26:20
None of those conversions links work. Rolling Eyes

Jercy Fravowitz
School of Applied Knowledge
Posted - 2010.05.28 14:51:00 - [23]
 

Originally by: D Program
None of those conversions links work. Rolling Eyes
they all work.
if you need help debugging problems with your internet connection you might have to get a tiny little more specific regarding the nature of your problem than "doesn't work".

D Program
Amarr
Ambient Fleet
Posted - 2010.05.28 14:54:00 - [24]
 

Edited by: D Program on 28/05/2010 14:54:21
Originally by: Jercy Fravowitz
Originally by: D Program
None of those conversions links work. Rolling Eyes
they all work.
if you need help debugging problems with your internet connection you might have to get a tiny little more specific regarding the nature of your problem than "doesn't work".


500 - Internal Error

The server was unable to process your request.

Support personel has been notified, no further action is needed.

Back

Jercy Fravowitz
School of Applied Knowledge
Posted - 2010.05.28 14:59:00 - [25]
 

Originally by: D Program

500 - Internal Error
The server was unable to process your request.
Support personel has been notified, no further action is needed.

ah. thats a ccp-side bug with the forum, not related to the data dump.

you can find the dump conversions here: http://eve.no-ip.de/tyr10/

but you will have to figure out from the filenames what is what. he-he.

Paraligo
Posted - 2010.05.28 17:00:00 - [26]
 

Originally by: Jercy Fravowitz
there may or may not be other flavors i forgot about if you look here.

as usual, please whine if there are any issues or you need custom dumps (partial sqlite, csv, ...) or something...


What happened to the "xml one file per table dumps"?
-OR-
How do I convert the MySQL dumps to the XML ones?

Jercy Fravowitz
School of Applied Knowledge
Posted - 2010.05.28 18:23:00 - [27]
 

Originally by: Paraligo

What happened to the "xml one file per table dumps"?
-OR-
How do I convert the MySQL dumps to the XML ones?
the xml dumps are _huge_ and in general not used that much, so they are on the list of conversions i dont do unless someone asks for them. (i keep all the dumps back to the 2006 version online, so yes, space _is_ an issue by now. X)

if you have a penguin with mysql, its trivial to do them yourself though. just restore the mysql dump, and fill in the name of the db you restored it into and whatever options you need to pass to the mysql client to connect to the right db here:
Quote:
VERS=-v1
PREF=tyr10

DBNAME=mssql
MYSQLOPT="-u mssql -S /tmp/musql.sock"

echo "show tables;" | mysql $MYSQLOPT $DBNAME | (read;cat) > TMP-${PREF}-tables$VERS
mkdir ${PREF}-mysql5-xml$VERS
for a in `cat TMP-${PREF}-tables$VERS`; do
mysqldump -X $MYSQLOPT $DBNAME $a > ${PREF}-mysql5-xml$VERS/${PREF}-$a-mysql5$VERS.xml
done


my whole conversion dance including the csv and xml and whatnot versions is avail btw: DBHOWTO
and if that references a script bla.pl that can be found as http://zofu.no-ip.de/bla.pl


Zendoren
Aktaeon Industries
The Black Armada
Posted - 2010.05.28 20:21:00 - [28]
 

Edited by: Zendoren on 28/05/2010 20:22:33
I would like to point out that the attributes for the new skill books (Particularly the Interplanetary Consolidation and Command Center Upgrades ) are messed up.

In the required skill attribute has 0 in their fields which point to #System.

Please refer to the EDK Forums post:

http://eve-id.net/forum/viewtopic.php?p=32083&f=504#p32083

Mella Elcus
Posted - 2010.05.29 17:33:00 - [29]
 

I've been looking everywhere but I can't seem to find any table in the database dump containing the PI schematics, anyone know where to find them?

Jercy Fravowitz
School of Applied Knowledge
Posted - 2010.05.29 18:10:00 - [30]
 

Originally by: Mella Elcus
I've been looking everywhere but I can't seem to find any table in the database dump containing the PI schematics, anyone know where to find them?
your answer is right here in this thread: 4th post


Pages: [1] 2 3 4

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only