| Author |
Topic |
Dragonaire
Caldari
Corax.
PURgE Alliance |
Posted - 2010.12.18 04:53:00 - [ 91]
I might also suggest if you know more about MySQL databases than programming trying Yapeal which does the whole API raw XML to some simple DB tables stuff for you. You might find it a little esaier to understand in that case but it's still not an end user application just a different approach to getting the data into what most people consider an easier form to work with. |
Catari Taga
Centre Of Attention
Middle of Nowhere |
Posted - 2010.12.18 05:37:00 - [ 92]
 Originally by: Dragonaire
I might also suggest if you know more about MySQL databases than programming trying Yapeal which does the whole API raw XML to some simple DB tables stuff for you. You might find it a little esaier to understand in that case but it's still not an end user application just a different approach to getting the data into what most people consider an easier form to work with.
Reverence is unrelated to the EVE API. |
Dragonaire
Caldari
Corax.
PURgE Alliance |
Posted - 2010.12.18 15:24:00 - [ 93]
Sorry I forgot it's for the cache stuff  Not for the first time I've done that just the first time I did not catch myself before posting  |
Manathera |
Posted - 2010.12.18 21:12:00 - [ 94]
Edited by: Manathera on 18/12/2010 21:13:13I just discovered reverence and love it, thank you entity. So I thought I'd contribute to this by providing a bit of code I wrote. based on a sample posted by Cyaxares II on the first page. His code just gets the high, low and average price history. My sample gets the entire order and outputs it to a file that's as identical to the market export files as possable. MarketReaderPlease let me know of any errors as this is the first python code I've ever written. |
Theodor Bliesheimer
Integrated Astromechanics Corp.
Zeta Conglomerate |
Posted - 2010.12.19 12:04:00 - [ 95]
Originally by: Jay Wareth
Originally by: Gemini Rock
What happens next? Have I missed a really simple instruction somewhere. Seriously, I could be being really thick here but how do I use this?
As Two Step said, this isn't an end user tool. It is a tool designed to help developers access EVE's internal data. If you don't know what to do from here you don't have the skills for this tool to be useful to you.
Is there anyone planning to release a Reverence-based end-user compatible tool usable to extract market history data, or has such a tool already been released (with the exception of EveMetrics)? |
Ix Forres
Caldari
Righteous Chaps
|
Posted - 2010.12.20 01:07:00 - [ 96]
|
Blazing Fire
Interstellar Operations Incorporated
|
Posted - 2010.12.30 22:32:00 - [ 97]
Edited by: Blazing Fire on 30/12/2010 22:57:08
Edited by: Blazing Fire on 30/12/2010 22:48:48
Hi,
From the readme it is not clear to me if this tool read only the static data or it can be used to read the market orders and market history. Can someone confirm.
I am a newbie .Net codder and I want to read market data in my app. and I have no idea if this Pythin library can be used on .Net app and how.
Is there a place where I can read about the actual structure of the EVE .cache files? Again I am interested in the market data.
TIA,
Blaze
|
Entity
X-Factor Industries
Synthetic Existence |
Posted - 2011.01.19 18:53:00 - [ 98]
Originally by: Blazing Fire
From the readme it is not clear to me if this tool read only the static data or it can be used to read the market orders and market history. Can someone confirm.
I am a newbie .Net codder and I want to read market data in my app. and I have no idea if this Pythin library can be used on .Net app and how.
Is there a place where I can read about the actual structure of the EVE .cache files? Again I am interested in the market data.
It can read anything in the cache. which includes market orders/history as that stuff appears in the cache when you look it up ingame. Reverence is not compatible with IronPython afaik (so much for .NET) No documentation for specific cache objects exists. |
Entity
X-Factor Industries
Synthetic Existence |
Posted - 2011.01.19 18:58:00 - [ 99]
Notice to Reverence users:
It seems that with this patch, one or more of the static data tables died.
config.BulkData.ramtypematerials is one of the casualties, as the bill of materials seems to be created serverside by request now, judging by the new GetMaterialsForTypeWithActivity method I see in my cache.
This means cfg.prime() will fail (funnily enough on the very last table it loads), but apps using transparent loading that do not use the ramtypematerials table will continue to function as normal.
I'll update the library to not load ramtypematerials in cfg.prime() soon™
|
Takeshi Ryuu
Black Octopus
Blind Octopus |
Posted - 2011.01.20 15:05:00 - [ 100]
What am i doing wrong? Quote:
>>> cmc = cachemgr.LoadCacheFolder("CachedMethodCalls")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "D:\tools\python-2.7.1\lib\site-packages\reverence\cache.py", line 231, in LoadCacheFolder
what, obj = blue.marshal.Load(open(filename,"rb").read())
AttributeError: 'module' object has no attribute 'CFilterRowset'
cachemgr is initialized the same way as in examples posted on previous pages. |
Catari Taga
Centre Of Attention
Middle of Nowhere |
Posted - 2011.01.20 15:17:00 - [ 101]
Originally by: Entity
Notice to Reverence users:
It seems that with this patch, one or more of the static data tables died.
config.BulkData.ramtypematerials is one of the casualties,
Hmm, I haven't looked into new cache structure at all yet but my cache to datadump converter still pulls that table just fine using (an old version of) your library. |
Two step
Aperture Harmonics
K162 |
Posted - 2011.01.20 16:57:00 - [ 102]
Originally by: Entity
Notice to Reverence users:
It seems that with this patch, one or more of the static data tables died.
config.BulkData.ramtypematerials is one of the casualties, as the bill of materials seems to be created serverside by request now, judging by the new GetMaterialsForTypeWithActivity method I see in my cache.
This means cfg.prime() will fail (funnily enough on the very last table it loads), but apps using transparent loading that do not use the ramtypematerials table will continue to function as normal.
I'll update the library to not load ramtypematerials in cfg.prime() soon™
I'm pretty sure it just got renamed to invtypematerials or something similar. I was looking at diffs between tq (pre-patch) and sisi with the final patch and that is what I saw. |
Entity
X-Factor Industries
Synthetic Existence |
Posted - 2011.01.20 18:35:00 - [ 103]
Originally by: Two step
I'm pretty sure it just got renamed to invtypematerials or something similar. I was looking at diffs between tq (pre-patch) and sisi with the final patch and that is what I saw.
Ah, I must've read invtypereactions, I'm blind. Thanks :P A table name change still requires a reverence update though :-/ |
Catari Taga
Centre Of Attention
Middle of Nowhere |
Posted - 2011.01.20 21:33:00 - [ 104]
Originally by: Two step
I'm pretty sure it just got renamed to invtypematerials or something similar. I was looking at diffs between tq (pre-patch) and sisi with the final patch and that is what I saw.
Oh yes that's it. My code always renamed it anyway so I didn't notice. :) |
6ie |
Posted - 2011.01.20 23:07:00 - [ 105]
Originally by: Takeshi Ryuu
What am i doing wrong?
Quote:
>>> cmc = cachemgr.LoadCacheFolder("CachedMethodCalls")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "D:\tools\python-2.7.1\lib\site-packages\reverence\cache.py", line 231, in LoadCacheFolder
what, obj = blue.marshal.Load(open(filename,"rb").read())
AttributeError: 'module' object has no attribute 'CFilterRowset'
cachemgr is initialized the same way as in examples posted on previous pages.
hmmm i am getting this error too now. It worked prior to the Tuesdays patch. I have multiple sub-dirs under \MachoNet\87.237.38.200\ No idea if that is relevant. |
Covert Kitty
Amarr
SRS Industries
SRS. |
Posted - 2011.01.30 07:27:00 - [ 106]
I get that error as well, any idea whats causing it? |
Entity
X-Factor Industries
Synthetic Existence |
Posted - 2011.01.30 07:56:00 - [ 107]
CCP's moving the handling of certain types of data structures from Python into C++ for performance.
So, CFilterRowset is the C++ implementation of the python FilterRowset, and I have yet to write a class
for it. I haven't looked at the structure yet, will do Soon™
|
Da Trader |
Posted - 2011.01.30 15:44:00 - [ 108]
Sorry to revive topic with stupid Q, but does it still work after new patch? |
Covert Kitty
Amarr
SRS Industries
SRS. |
Posted - 2011.01.31 11:13:00 - [ 109]
parts of it do, the market cache doesnt seem to however due to the error above |
6ie |
Posted - 2011.01.31 21:06:00 - [ 110]
Let us all send Entity 100mil to complete that code.
I will be 2nd, go.
|
Theodor Bliesheimer
Integrated Astromechanics Corp.
Zeta Conglomerate |
Posted - 2011.02.01 05:32:00 - [ 111]
One of my corp members fixed his Reverence errors after the latest patch by deleting his cache folder (C:\Users\XXX\AppData\Local\CCP\EVE\c_eve-online_tranquility\cache\). Not sure if that will work for everyone but it's at least worth a try. |
Verite Rendition
Caldari
F.R.E.E. Explorer
EVE Animal Control |
Posted - 2011.02.02 02:16:00 - [ 112]
Now that I have some free time, I have a chance to look in to this.
Can anyone tell me if Reverence can extract mapsoloarsystems and other such data from EVE? I'm looking at what it would take to do a periodic version of the Influence map for Serenity (EVE-China); since they don't have an API I'd need to extract sovereignty information, stations, and an alliance list from the client. Is this possible with Reverence? |
Catari Taga
Centre Of Attention
Middle of Nowhere |
Posted - 2011.02.02 03:10:00 - [ 113]
Originally by: Verite Rendition
Now that I have some free time, I have a chance to look in to this.
Can anyone tell me if Reverence can extract mapsoloarsystems and other such data from EVE? I'm looking at what it would take to do a periodic version of the Influence map for Serenity (EVE-China); since they don't have an API I'd need to extract sovereignty information, stations, and an alliance list from the client. Is this possible with Reverence?
You can pull everything that you can see in the client, but to get the data you will need to request it via the client first, after that the information will be cached and can be accessed via Reverence. This will be easy for some data (Sov data, development indices, list of alliances themselves, but for things like alliance members you'll need to show info on each of them (the ingame browser and some javascript can help here). I'm not sure whether you can get a conquerable stations list in game so that data might not be available (short of doing a show info on every conquerable solar system and then on the listed stations). |
Verite Rendition
Caldari
F.R.E.E. Explorer
EVE Animal Control |
Posted - 2011.02.02 03:21:00 - [ 114]
Edited by: Verite Rendition on 02/02/2011 03:24:10 Originally by: Catari Taga
Originally by: Verite Rendition
Now that I have some free time, I have a chance to look in to this.
Can anyone tell me if Reverence can extract mapsoloarsystems and other such data from EVE? I'm looking at what it would take to do a periodic version of the Influence map for Serenity (EVE-China); since they don't have an API I'd need to extract sovereignty information, stations, and an alliance list from the client. Is this possible with Reverence?
You can pull everything that you can see in the client, but to get the data you will need to request it via the client first, after that the information will be cached and can be accessed via Reverence.
This will be easy for some data (Sov data, development indices, list of alliances themselves, but for things like alliance members you'll need to show info on each of them (the ingame browser and some javascript can help here). I'm not sure whether you can get a conquerable stations list in game so that data might not be available (short of doing a show info on every conquerable solar system and then on the listed stations).
Thanks for the quick reply Catari. Just digging through the code and using Entity's datadump example, it looks like I can get most of the information I need. Once the client has pulled up the in-game sov map and in-game station map, the cached data becomes available as MethodCall.server.stationSvc.GetAllianceSystems and MethodCall.server.map.GetStationCount respectively. Both of which are a bit weird, but it's enough data to work with. The remaining issue seems to be that I can't find a list of the alliances (even after having the client open up the alliance ranking list). I don't need to know the individual corps for now, but I can't even get a complete list of alliances and their names. Looking through the cache resources on EVE-Dev, I'm not even sure there's a proper list in the cache, is there? And while I'm on a note about weird things, looking at MethodCall.server.devIndexManager.GetAllDevelopmentIndices, it's interesting to note that it uses the raw point value instead of the calculated level. Has anyone ever figured out how many points correlate to which level? |
Catari Taga
Centre Of Attention
Middle of Nowhere |
Posted - 2011.02.02 03:40:00 - [ 115]
See MethodCall.server.allianceRegistry.GetRankedAlliances for the alliance list.
As to point to level conversion on system upgrades, have never looked into that and can't help there, but you'll figure it out quickly just by comparing how it's displayed in game. |
Verite Rendition
Caldari
F.R.E.E. Explorer
EVE Animal Control |
Posted - 2011.02.02 05:25:00 - [ 116]
Originally by: Catari Taga
See MethodCall.server.allianceRegistry.GetRankedAlliances for the alliance list.
What's the trick to getting that to come out of the cache? Even after the client has accessed it, the datadump script isn't handing it over. |
Catari Taga
Centre Of Attention
Middle of Nowhere |
Posted - 2011.02.02 12:11:00 - [ 117]
Originally by: Verite Rendition
Originally by: Catari Taga
See MethodCall.server.allianceRegistry.GetRankedAlliances for the alliance list.
What's the trick to getting that to come out of the cache? Even after the client has accessed it, the datadump script isn't handing it over.
I had to look at Entity's example script for that (the things I do  ). If you comment out lines 94 and 96 of that and it will dump it as MethodCall.server.allianceRegistry.GetRankedAlliances.0.sql. |
Axemaster |
Posted - 2011.02.02 23:53:00 - [ 118]
Hi, I was wondering when this might be working for mac OS-X 10.6? I tried to get the basic cache reading to work but had absolutely no luck, and the python libraries weren't installing correctly.
I have been searching fruitlessly for quite some time... there doesn't seem to be any useful info anywhere regarding how I could decrypt this stuff. Very frustrating.
As far as I can tell, the caches are encrypted using a python function called "marshal", but I have no understanding of it. It seems to be a black box, with no published documentation that I can find.
I was hoping that someone might be able to post the decrypting code in a sort of "general format" (the full code, with no "modules" or language-specific functions) so I could translate it easily into another programming language... I don't need any fancy stuff, just the basic code that converts the cache files into text. |
Kitty Kupcake |
Posted - 2011.02.03 02:54:00 - [ 119]
Edited by: Kitty Kupcake on 03/02/2011 04:38:59 Originally by: Theodor Bliesheimer
One of my corp members fixed his Reverence errors after the latest patch by deleting his cache folder (C:\Users\XXX\AppData\Local\CCP\EVE\c_eve-online_tranquility\cache\). Not sure if that will work for everyone but it's at least worth a try.
To be more specific, you need to remove the folders under the directory cache\MachoNet\###\ Where ### is some folder with a number as a name. Example 12.345.67.890 And of course before you do that, please make a backup. --- So to reiterate, I was having issues with the following line of code: cmc = cachemgr.LoadCacheFolder("CachedMethodCalls") To fix it, I removed the folders under the directory: C:\Users\XXX\AppData\Local\CCP\EVE\c_eve-online_tranquility\cache\MachoNet\###\ --- UPDATE: Cleared the cache\MachoNet\###\ folders and everything worked for awhile. I flew around a bit without touching the market, and it stopped working again. |
Entity
X-Factor Industries
Synthetic Existence |
Posted - 2011.02.03 05:49:00 - [ 120]
If anyone wants to give me one of the files that fails to decode on the CFilterRowset... I don't seem to have any of them in my cache. |
All Channels
EVE Technology Lab
