open All Channels
seplocked EVE Information Portal
blankseplocked EVE Data Export, REVELATIONS Edition and Dev Blog
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: first : previous : ... 2 3 4 5 [6] 7 8 9 10 ... : last (14)

Author Topic

khazid
Privateers
Privateer Alliance
Posted - 2007.01.09 09:25:00 - [151]
 

hi,

i'm searching for detailed ship informations in the dump and can't find. i need the info on how many high, med, low slots a ship has. in which table can i find that? think i looked into each sql file but really can't find anything on it, hope somebody can help me...


greetz

Vessper
Indicium Technologies
Hephaestus Forge Alliance
Posted - 2007.01.09 14:24:00 - [152]
 

Originally by: khazid
hi,

i'm searching for detailed ship informations in the dump and can't find. i need the info on how many high, med, low slots a ship has. in which table can i find that? think i looked into each sql file but really can't find anything on it, hope somebody can help me...


greetz

Check the dgmTypeAttributes table. Anything with an attributeID of 12, 13, 14 or 1137 indicate low, med, high and rig slot respectively. Obviously you will need to cross reference the typeID from those records to the invTypes table to get the ship names.

Hope that helps Very Happy

khazid
Privateers
Privateer Alliance
Posted - 2007.01.09 16:08:00 - [153]
 

thank you very much! helps a lot.

Phyra
Caldari
NEXT Incorporated
Posted - 2007.01.09 18:42:00 - [154]
 

...would help a lot more if I hadn't have to make up some table defs myself...

Sorry to say, but I expect a better job from a company that I pay decent money.

The RMR exports had the same issues: missing table definitions, missing or illdefined variables. I filed bug-reports about it, with details as to how to improve the situation - to no avail.

Now again: missing table-defs etc. Although ppl took the time to point it out in this thread: no update.

Just as a further service to you (should be the other way round?) I provide the following:

Easy way to test if everything is right with a data-export is to install SQL Server Express on any off-the-shelve machine (it's free downloadable from microsoft). Then RUN the SQL-scripts and build a database. Count if tables in DB and number of SQL scripts to insert data into tables is consistent. If so run the other scripts too and see if it works w/o errors. Easy as that. Done within an hour or two.

I'm looking forward to the improved version :)

hth

best regards

Phyra

Eewec Ourbyni
Caldari
Posted - 2007.01.09 18:44:00 - [155]
 

As a slight aside to this,... typeid = 16845.... hehe... I lol'd.

Dunedon
Trans Nebula Inc.
Posted - 2007.01.09 22:00:00 - [156]
 

Is it just me or is the data dump missing "pieces" of data?

I'm trying to build a table of all the recycling values ... sounds simple you'd think.

The Eve-Online database even contains the information I need for the 'Large Standard Container' (typeID: 3296)

However I cannot find in the data dump the component values, even though they are listed on the site (so apparently it can find them).

Does anyone know where I would find this information? I've looked in the blueprints, TL2 and attributes tables ... don't know where else I should really be looking :)

Thanks in advance for any assistance - even if it's just to tell me that yes that information is missing :)

- Dunedon

Phyra
Caldari
NEXT Incorporated
Posted - 2007.01.10 11:38:00 - [157]
 

Edited by: Phyra on 10/01/2007 12:10:01
Sorry to be on the same rant again, but this is costing my time:

I worked a little more with that export.

T20: Get things fixed ASAP. It is really unacceptable with all the bugs. You got very good responses in this thread and in bug reports before. Now heed them. Especially annoying are these five bugs:

1. In the 40 MB "dbo_eveNames.sql" all table references are to dbo_eveNames instead of dbo.eveNames.(There's another smaller file with the same problem, find it too while you are at it). Fix it!

2. All tables containing true/false values have mismatching values/variables. Either change the values from true/false to numerical (recommended) or change the variable def.

3. In the table defs all those IDENTITY statements are completely out of place for our purposes here. Fix it!

4. All those COMMIT statements are out of place. Get them out.

5. Big files, i.e. above 2 or 3 MB need a few "GO" statements in between all those INSERTs. Every 10k - 20k rows is nice for example.

@Dunedon: I'll try and find out as soon as I have all tables set up...

Ty

Phyra

Edited to include two more annoying bugs.

Vessper
Indicium Technologies
Hephaestus Forge Alliance
Posted - 2007.01.10 18:17:00 - [158]
 

Originally by: Dunedon
Is it just me or is the data dump missing "pieces" of data?

I'm trying to build a table of all the recycling values ... sounds simple you'd think.

The Eve-Online database even contains the information I need for the 'Large Standard Container' (typeID: 3296)

However I cannot find in the data dump the component values, even though they are listed on the site (so apparently it can find them).

Does anyone know where I would find this information? I've looked in the blueprints, TL2 and attributes tables ... don't know where else I should really be looking :)

Thanks in advance for any assistance - even if it's just to tell me that yes that information is missing :)

- Dunedon


I have to agree with you here - I can't find any material information for any of the cans, secure or standard. If it was anywhere, it would have been in the TL2 file.

Chruker
Posted - 2007.01.10 18:22:00 - [159]
 

Originally by: Phyra
Edited by: Phyra on 10/01/2007 12:10:01
Sorry to be on the same rant again, but this is costing my time:

I worked a little more with that export.

T20: Get things fixed ASAP. It is really unacceptable with all the bugs. You got very good responses in this thread and in bug reports before. Now heed them. Especially annoying are these five bugs:

1. In the 40 MB "dbo_eveNames.sql" all table references are to dbo_eveNames instead of dbo.eveNames.(There's another smaller file with the same problem, find it too while you are at it). Fix it!

2. All tables containing true/false values have mismatching values/variables. Either change the values from true/false to numerical (recommended) or change the variable def.

3. In the table defs all those IDENTITY statements are completely out of place for our purposes here. Fix it!

4. All those COMMIT statements are out of place. Get them out.

5. Big files, i.e. above 2 or 3 MB need a few "GO" statements in between all those INSERTs. Every 10k - 20k rows is nice for example.

@Dunedon: I'll try and find out as soon as I have all tables set up...

Ty

Phyra

Edited to include two more annoying bugs.


I ran into all of those except number 5. And they were very easy to solve with a simple search and replace. Took maybe 10 mins.

Eewec Ourbyni
Caldari
Posted - 2007.01.10 19:42:00 - [160]
 

Quick q to anyone who knows the datadump backwards, forwards and inside out. Anyone found where they (CCP) hid the repackaged volume of ships/items? Not sure about items, but the ships repackaged volume seems nowhere to be found.

Salvador King
Posted - 2007.01.10 23:13:00 - [161]
 

Hi,

Was wondering in which table was located informations about skills required per item.
I.e. skills required to be able to use Nosferatu.

On the other hand. Let me know if someone is interested to get an Oracle dump of what t20 published.

cya

Rynlam
Gallente
Posted - 2007.01.11 01:24:00 - [162]
 

If anybody has a complete version of this stuff with the bugs ironed out, I'd love a copy... and XML is really cool if at all possible since the webhost where I plan on using this limits me to 100MB databases :( XML should easily fit into my 100GB htdocs

Vessper
Indicium Technologies
Hephaestus Forge Alliance
Posted - 2007.01.11 14:05:00 - [163]
 

Originally by: Salvador King
Hi,

Was wondering in which table was located informations about skills required per item.
I.e. skills required to be able to use Nosferatu.


Skill requirements for all items/ships/other skills are in the dgmTypeAttributes file.

Eewec Ourbyni
Caldari
Posted - 2007.01.11 14:38:00 - [164]
 

BTW, if you have a machine that can run eve and are looking at ways to get this info, and then want a way to export it to your own choice of file type (like xml for example) then go to the following sites:

Apache Web server - to get yourself an apache server on your own system
PHP code - to get php to run on your apache web server
mySQL database server/client - to store the info you access through the php on your apache web server.
Eclipse development environment - to get a rather snazzy development environment for developing your php/java

All that works together quite nicely... although it does take some fiddling to get it all working together.

I also have MS VC# Express, MS C++ Express and SQL server Express 2005 running along side that and I only have an off the shelf pc atm due to my last one dieing rather spectacularily... runs EVE quite well too...

Yeah, anywho, that lot took me a while to configure but I'm getting there... now just need to work out why my php script seems to work, then bugs out at outputting one of the files half way through.

Robert Wilson
Posted - 2007.01.11 17:33:00 - [165]
 

Originally by: Chruker
Originally by: Phyra
Edited by: Phyra on 10/01/2007 12:10:01
Sorry to be on the same rant again, but this is costing my time:

I worked a little more with that export.

T20: Get things fixed ASAP. It is really unacceptable with all the bugs. You got very good responses in this thread and in bug reports before. Now heed them. Especially annoying are these five bugs:

1. In the 40 MB "dbo_eveNames.sql" all table references are to dbo_eveNames instead of dbo.eveNames.(There's another smaller file with the same problem, find it too while you are at it). Fix it!

2. All tables containing true/false values have mismatching values/variables. Either change the values from true/false to numerical (recommended) or change the variable def.

3. In the table defs all those IDENTITY statements are completely out of place for our purposes here. Fix it!

4. All those COMMIT statements are out of place. Get them out.

5. Big files, i.e. above 2 or 3 MB need a few "GO" statements in between all those INSERTs. Every 10k - 20k rows is nice for example.

@Dunedon: I'll try and find out as soon as I have all tables set up...

Ty

Phyra

Edited to include two more annoying bugs.


I ran into all of those except number 5. And they were very easy to solve with a simple search and replace. Took maybe 10 mins.


10mins? I must be doing something wrong then, because so far it's taken me over 30mins to search and replace dbo_eveNames.sql and I'm not even half way done. Am I just dumb for trying to use a text editor for this, If so what program should I be using (and is it really going to take only 10 minutes) ?

Dunedon
Trans Nebula Inc.
Posted - 2007.01.11 17:44:00 - [166]
 

I bought and used this:

http://www.funduc.com/search_replace.htm

it's by far one of the cheapest and best text replacers I have ever used :) ... it made the required updates to the entire directory in about 15-20 minutes on my machine.

I recommend it completely! - Dunedon

Rynlam
Gallente
Posted - 2007.01.11 18:49:00 - [167]
 

Edited by: Rynlam on 11/01/2007 18:47:13
In case anybody cares, UltraEdit (UE32) is a very nice text editor for source files (including SQL) and it's search/replace function goes pretty darn fast on large files.

When I try to put dbo__TABLES.sql into a MySQL db, I get the error:

#1064 - You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near 'IDENTITY(1, 1),
operationName nvarchar(100) NOT N

In dbo__TABLES.sql this is at the top:

CREATE TABLE dbo.staOperations
(
activityID tinyint NOT NULL,
operationID tinyint NOT NULL IDENTITY(1, 1),
operationName nvarchar(100) NOT NULL DEFAULT '',

and so on. I'm not sure what to change to fix this, as I haven't done much stuff with SQL other than running a few forums and a killboard.

Robert Wilson
Posted - 2007.01.11 19:10:00 - [168]
 

Thanks for the help, but i finally got it (dbo_eveNames.sql) done.

Check earlier in this thread (page 4?), someone has posted a correct/modified table setup file. The short answer would be just remove all the 'IDENTITY' properties, but there is a little more than needs to be done to the file to get it to work in mySQL.

Rynlam
Gallente
Posted - 2007.01.11 19:43:00 - [169]
 

Edited by: Rynlam on 11/01/2007 20:04:42
Edited by: Rynlam on 11/01/2007 19:51:35
Okay, I download the "fixed" one on page 4. I downloaded the MSSQL-MySQL conversion tool and converted it. Now the error is:

SQL query:

--
-- invCategories
--
CREATE TABLE invCategories(

categoryID tinyint NOT NULL ,
categoryName nvarchar( 100 ) NOT NULL DEFAULT '',
`description` nvarchar( 3000 ) NOT NULL DEFAULT '',
graphicID smallint NULL ,
--
CONSTRAINT pk_invCategories PRIMARY KEY CLUSTERED( categoryID )
)

#1064 - You have an error in your SQL syntax. Check the manual that corresponds to your MySQL server version for the right syntax to use near
'nvarchar(100) NOT NULL DEFAULT '',
`description` nvarchar

Has anybody at all successfully gotten this imported into a MySQL 4 db?

EDIT: By changing nvarchar to varchar (there is no datatype nvarchar in MySQL, where the hell did that come from? Shouldn't the MSSQL-MySQL tool have done that?) and afterwards changing varchar(3000) (or anything over 255 since maximum is 255 apparently) to blob, I can successfully create the tables. However, I don't if this will break the data. Yes/no/maybe so? Hopefully also deleting all the stuff regarding maps, stations, rams, and corps won't break anything.

Colonel Jinx
TARDZ
Gods of Night and Day
Posted - 2007.01.12 03:43:00 - [170]
 

It's a month and a half later, and unless i'm blind which i could very well be... WHERE are the icons???

Dektor
Gallente
Nebula Rasa Holdings
Nebula Rasa
Posted - 2007.01.12 15:36:00 - [171]
 

Ok I've managed to import everything into MySQL 5.0.27 using the MySQL Query Browser 1.2

I downloaded the fixed download and the tool to convert it to MySQL acceptable format. Both where posted by Mecci earlier in this topic.

I still ran into three problems:

1) The field careerID and specialityID must be UNSIGNED to allow for numbers above the 127.

These two fields occur in these tables:
chrcareers
chrcareerskills
chrcareerspecialities
chrcareerspecialityskills
chrschools


2) The table invTypeReactions needs to include the field input in its key or a couple of records can't be imported due to double keys.

Both of the above problems can be prevented by using my edited version of the converted tables creation file which can be downloaded here.

3) The table ramAssemblyLines uses a for MySQL incompatible datetime format (The American Date notation borks things up yet again).
I've solved this myself by replacing ALL dates with '1900-01-01 00:00:00' since I suspect this information isn't really that important. All dates were in the past anyways.

I used EditPad Pro for this using its Find and Replace function. Finding the Regular Expression (u need to enable the option to the right of the search window) '(.)+\/(.)+\/(.)+' (including the 's) and replacing it with '1900-01-01 00:00:00'.

I hope this makes it easier for other MySQL users out there to get the stuff in a usable database. Make sure you create the dbo database before starting the 'script files' (thats how MySQL Query Browser calls those nifty .sql files Smile).

Sooooooo... hmmz... now what to do with all this nifty database...

* Dektor dives into php code.

Zatch
Gallente
Death of Virtue
MeatSausage EXPRESS
Posted - 2007.01.12 16:22:00 - [172]
 

Edited by: Zatch on 12/01/2007 16:21:30
There seem to be some missing items in the item/bptypes, specifically the Multispectral Frequency Probe and its associated blueprint. Also, is an icon release still planned?

I'm afraid I can't trust the data export now that it seems to be incomplete.

Robert Wilson
Posted - 2007.01.12 18:30:00 - [173]
 

Edited by: Robert Wilson on 12/01/2007 18:29:17
Edited by: Robert Wilson on 12/01/2007 18:29:05
Just to let anyone with my find and replace problem know. MySQL (5.0) actually comes with a small replace program! Worked great on dbo_invTypes (everything else was done by the time i found it). Although I don't think it supports regex. Check the documentation for syntax.

Also with the careerID (atleast, didn't notice the specialityID error) I just accepted the errors since those where all jove entries and they are unplayable, although I guess for completeness unsigned is a better solution.


Oh also, Multispectral Frequency Probes were added after revelations was deployed which is probably why they aren't in the dump.

Zatch
Gallente
Death of Virtue
MeatSausage EXPRESS
Posted - 2007.01.12 22:17:00 - [174]
 

I figured that was the case, would still be nice to have the base material requirements available though so I don't have to deal with rounding errors.

Ezlo Murkin
Posted - 2007.01.12 22:38:00 - [175]
 

Edited by: Ezlo Murkin on 12/01/2007 22:36:14
To retrieve the asteroid types/ore available in a system do you just use the true security of the system.

Mercoxit security < -0.75
Arkanor security < -0.55
Bistot security < -0.45
etc

I was just wondering if this is always based on security of the system, or is it random for the very rare asteroid types? (I go to 0.0 very rarely). I didn't see anything in the mapDenormalize table (or any other table) to indicate what type of asteroids are in each belt.

Thanks!

Salvador King
Posted - 2007.01.13 16:16:00 - [176]
 

Hi

For the people interested to get it in Oracle database. Here are the dumps files and usefull link to download it:
1. Download Oracle Express 10g
2. Install the above and create a new schema.
3. Download the following dump file dump
4. open a command window and type imp, provide informations asked.
5. Now, build you queries with a tool like Toad Freeware

cya

Chruker
Posted - 2007.01.13 19:28:00 - [177]
 

Originally by: Zatch
Edited by: Zatch on 12/01/2007 16:21:30
There seem to be some missing items in the item/bptypes, specifically the Multispectral Frequency Probe and its associated blueprint. Also, is an icon release still planned?

I'm afraid I can't trust the data export now that it seems to be incomplete.


It is in there. Look at typeID = 26910 the database seems outdated, since it is called 'Frequency Probe Blueprint'

Raquel Smith
Caldari
Freedom-Technologies
Sev3rance
Posted - 2007.01.13 22:58:00 - [178]
 

Edited by: Raquel Smith on 13/01/2007 22:59:33
It seems some corporations aren't in the dump:
id=150072611, for starters. Reference in staStations:

INSERT INTO staStations
(stationID,security,dockingCostPerVolume,maxShipVolumeDockable,officeRentalCost,
operationID,stationTypeID,corporationID,solarSystemID,constellationID,regionID,
stationName,x,y,z,reprocessingEfficiency,reprocessingStationsTake,
reprocessingHangarFlag)
VALUES(60014922,500,0,50000000,0,47,12295,150072611,30004059,20000593,10000051,
'9-4RP2 IV - Moon 2 - Cloning Outpost',878666588160,175879741440,
-1675383644160,0.5,0.025,4);

(This query has been formatted for your screen.)


Edit:
With some bash-fu here's a list of corporation IDs that aren't in the corporation table:

1000173 doesn't exist in crpNPCCorporations
144684705 doesn't exist in crpNPCCorporations
144693213 doesn't exist in crpNPCCorporations
144719292 doesn't exist in crpNPCCorporations
150001295 doesn't exist in crpNPCCorporations
150020944 doesn't exist in crpNPCCorporations
150072611 doesn't exist in crpNPCCorporations
150087495 doesn't exist in crpNPCCorporations
150094093 doesn't exist in crpNPCCorporations
150134971 doesn't exist in crpNPCCorporations
150151670 doesn't exist in crpNPCCorporations
150158528 doesn't exist in crpNPCCorporations
150217957 doesn't exist in crpNPCCorporations

These are all referenced in staStations.

Colonel Jinx
TARDZ
Gods of Night and Day
Posted - 2007.01.14 04:22:00 - [179]
 

This is frustrating, icons promised a day after a release, I really want to update my killboard for the new ships!
Can we get the icons please!

Nuska
Amarr
Agony Unleashed
Agony Empire
Posted - 2007.01.15 08:05:00 - [180]
 

Edited by: Nuska on 15/01/2007 08:02:40
If someone could post a step-by-step detailed "how to import this data into mssql 2005 express edition", I would be thankful (and send some isk your way too). Thanks in advance!

Edit: I have downloaded the files listed in the devblog post at http://myeve.eve-online.com/devblog.asp?a=blog&bid=406


Pages: first : previous : ... 2 3 4 5 [6] 7 8 9 10 ... : last (14)

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only