open All Channels
seplocked EVE Technology Lab
blankseplocked Eve-MarketData.com - replacement for eve-metrics
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: first : previous : ... 2 3 4 5 6 [7] 8 9 10 : last (10)

Author Topic

r0selan
Kasar Infinae
Posted - 2011.03.18 01:18:00 - [181]
 

I hope the site and tools are still updated. I discovered the world of eve apis today. eve-marketdata is impressive.

I would love to see a new info in item_orders_buy.xml and item_orders_sell.xml. That is range. (station, system, region, x jumps). The aim is of course to check if the order is available from your current location.


Vanus Prime
Posted - 2011.03.21 07:14:00 - [182]
 

hi, i have some problem with the api data.

i have inport the data in goggle docs with

=ImportXML("http://eve-marketdata.com/api/item_prices_jita.xml&type_ids="&JOIN(",",$B3:$B22) ; "/eve/price")

he imports the prices but the prices are the same every day and week ;-(

isen't the service work at the moment ?

Kallahar
Posted - 2011.03.21 23:55:00 - [183]
 

d'oh, my mistake, all the prices should be updating correctly at downtime now.

Kallahar

DarkGentleman Sith
Posted - 2011.03.22 06:51:00 - [184]
 

thx a lot

UfoTRADER
Relentless Technologies
Quod Erat Demonstrandum
Posted - 2011.03.23 15:54:00 - [185]
 

Any chance of adding a leaderboard or a region request for market suggestions? I think both would significantly increase the number of submissions. I have four chars going 23/7 in four regions, but that's only because I trade between the four and I make double use of the data.


Bumse
North Star Networks
The Kadeshi
Posted - 2011.03.24 07:54:00 - [186]
 

Edited by: Bumse on 24/03/2011 08:23:30
Originally by: VIXIT CORP
Hi,

I would like to use the uploader but it can't find my eve folders
I use the following command to strart eve, so no logging and caching
is done in the c:\documents and settings\user\etc... folder

M:\games\EVE_CLIENT1\bin\ExeFile.exe /end /LUA:OFF

With the client of eve-metrics I could tell the client where to look
How can I manage to do the same with this client?

Hope this can be solved soon (tm) so I can contribute here also.

Kind regards
VIXIT CORP


QFT.
Uploader doesnt work if cache isnt found in the default folder/s.
Please enable manual selection of cache directory and/or do a more thorough search.

However, I like the possibility of using two uploaders at once, but this renders kinda useless in my case since the uploader cant find anything to upload ;P

Edit: new issue after making a test install in default location. Even when setting down the scan delay to 20, only every forth or fifth item that's available gets uploaded.

Should I perhaps email you with issues instead of posting them here? ^_^

Insufferable
Posted - 2011.03.27 14:53:00 - [187]
 

I am running eve in a virtual box and cannot get the data uploader to work. I get an error saying that the uploader is not configured correctly, try to reinstall. Doing so results in teh same error message. There is no error during installation.

Is it not possible to run the scanner/uploader within a virtual box?

Jitorius
Posted - 2011.03.28 08:19:00 - [188]
 

Edited by: Jitorius on 28/03/2011 08:32:05
While the uploader is working (on looong AFK market checking sessions, the uploader tends to 'choke', though, not uploading, but rather stating "Queue is xxx items"), I'm wondering why the "History" of items is always at least 2 days behind. I can see how you need the data uploaded in the first place, but if I upload hisory data for an item and check a few minutes later, I never get yesterday's stats, but just starting from the day before yesterday at best.

The data should be "fixed" if it's, well, past data, so why have another day of delay in that one?

Jitorius
Posted - 2011.03.28 09:17:00 - [189]
 

Okay, getting increased frequencies of data not being uploaded - verbose mode gives me the following insights (multiple times):

FileChanged: 3 29e1.cache
(0) Queueing file (5, u'C:\\Users\\Myname\\AppData\\Local\\CCP\\EVE\\e_spiele_eve_tranquility\\cache\\MachoNet\\87.237.38.200\\259\\CachedMethodCalls\\29e1.cache')
OnNewFile: C:\Users\Myname\AppData\Local\CCP\EVE\e_spiele_eve_tranquility\cache\MachoNet\87.237.38.200\259\CachedMethodCalls\29e1.cache
skipping unknown key ('config', 'GetMapObjects', 30004127, 0, 0, 0, 1, 0)
No data parsed

With different numbers after that 'GetMapObjects' thingy.

HighlanderUK
Interstellar Business Machines Corp.
Posted - 2011.03.28 18:31:00 - [190]
 

Originally by: Insufferable
I am running eve in a virtual box and cannot get the data uploader to work. I get an error saying that the uploader is not configured correctly, try to reinstall. Doing so results in teh same error message. There is no error during installation.

Is it not possible to run the scanner/uploader within a virtual box?


inside your VM, have you tried running it from the CCP folder to see if it picks up the Machonet folder from your profile?

on the other note of the uploads not working, I have had no issues with my Win 7 system, uploading has been fine the last week or so with over 2,000 uploads from Citadel region.

Joost Caldari
Caldari
Joost Inventor Labs
Posted - 2011.03.29 09:11:00 - [191]
 

Lately, this feature hasn't been working for me anymore either. Is anybody working on resolving this? Because it's a crucial tool for my trading alt. I loved it when it worked. But now it fails with an 500 error all the time. Previously it worked maybe once every 10 attempts.

Originally by: Joost Caldari
First of all, great effort!

But I've started the use the "Sell my Hangar" functionality, but the suggested price seems double the market price. Anybody else have that problem. SOmehow the suggested price doesn't seem right.

Project 69
Posted - 2011.03.29 13:13:00 - [192]
 

hello Kallahar,

awesome work so far, but I have one little question.

would it be possible to see the sell and buy prices in your /api/item_price_jita and /api/item_prices APIs?

would help at least me a lot :)

thanks

Joost Caldari
Caldari
Joost Inventor Labs
Posted - 2011.03.29 17:41:00 - [193]
 

As a matter a fact, any request from the database is not working. I cannot use the in-game "sell hangar", but even out-game simple requests of an item doesn't respond with a price. Uploading is still working though!


Originally by: Joost Caldari
Lately, this feature hasn't been working for me anymore either. Is anybody working on resolving this? Because it's a crucial tool for my trading alt. I loved it when it worked. But now it fails with an 500 error all the time. Previously it worked maybe once every 10 attempts.

Originally by: Joost Caldari
First of all, great effort!

But I've started the use the "Sell my Hangar" functionality, but the suggested price seems double the market price. Anybody else have that problem. SOmehow the suggested price doesn't seem right.


Muscaat
EVE Markets
Posted - 2011.03.29 18:49:00 - [194]
 

Originally by: Joost Caldari
As a matter a fact, any request from the database is not working. I cannot use the in-game "sell hangar", but even out-game simple requests of an item doesn't respond with a price. Uploading is still working though!


Uploading is also running slowly and periodically failing Sad

Kallahar
Posted - 2011.03.30 20:22:00 - [195]
 

Thanks everyone!
1) database issues should be fixed. I had to rewrite a query which was locking a bunch of tables. That should be completely solved now.
2) the uploader... unfortunately my Python skills are low, so I've been struggling to figure out how to have multiple paths, manual path selection, better error handling, etc. If anyone wants to download the code and give me a better version, please do!
3) uploader skipping files: not all cache files are market cache items, so even if the queue is 50 files, sometimes only a few of those are market, so skipping them is normal.

fun fact: the total volume everything selling in Jita 4-4 is currently at 634,013,195,968.627m^3 (643 million cubic kilometers), which is about 1/3 the volume of all the oceans on the earth, and about 2.7% of the volume of the moon.

Kallahar

Bel Amar
Amarr
Sudden Buggery
Situation: Normal
Posted - 2011.03.31 10:06:00 - [196]
 

I had an issue with the uploader. I attempted to clear my ingame cache, and the game would not restart after the fact. Even a restart didn't solve the problem. I turns out that the uploader is locking a cache directory and thus the game client can't delete it, causing it to chuck an error and quit.

Jitorius
Posted - 2011.04.01 08:50:00 - [197]
 

Originally by: Kallahar
3) uploader skipping files: not all cache files are market cache items, so even if the queue is 50 files, sometimes only a few of those are market, so skipping them is normal.

Nah, I mean, I often let a client idle, just using the "upload suggestions", and coming back, I see that the uploader doesn't upload any longer, but rakes up e.g. 500 items in the queue. Checking a new item just adds 1 to the numbers...

I also sometimes happen to have the uploader active, checking items of interest for me, but the data doesn't get picked nor uploaded by the uploader.exe, even though I'm clicking those items in game to get them actually submitted.

Insufferable
Posted - 2011.04.01 09:38:00 - [198]
 

I have now got the scanner working on my work pc as a workaround. I remote into the work pc at night and get it to do a tour of empire space and set the scanner to scan. It does around 10-12 hours a day like that at the moment. Is there a prize for top contributor? XD

I have noticed that the market scan list contains a lot of items which are sold at a flat rate in NPC stations (most skill books etc). I figure that since these items are sold at flat rate than they ought to be removed from the regular scan list (updates wil never change the price).

Crimson Firebird
Posted - 2011.04.02 01:14:00 - [199]
 

Through following the directions on the developer page for google docs, I am unable to get it working :(

Can a guide be posted for how to pull data for google docs and narrow it down by region, separate it for buy/sell and so on...

Another useful element will be if you can pull data based on item name only (reference the name to a typeID and pull the data from there). It would help keep the spreadsheet a little cleaner :)

Thanks for the hard work on this. The potential of this tool is incredible.

Ogi


Crimson Firebird
Posted - 2011.04.02 09:10:00 - [200]
 

Ok, I've messed with it and got it working in google docs however there is one issue that I don't see a resolution for.

If I want to pull the minimum sell order for an item in a specific station, this is what I need to do enter in this:

=MIN(ImportXML("http://eve-marketdata.com/api/item_orders_sell.xml?&station_ids=60003760&type_id=25605"; "/eve/order/price"))

The problem here is that I need a separate ImportXML function for every item, there is no way I can do multiple items this way (that I know of).

Any insight would be greatly appreciated :D



SO Rider
Posted - 2011.04.10 10:29:00 - [201]
 

First of all, great website!

I'm not sure if it's by design, but I can only see data older than 3 days:
http://eve-marketdata.com/api/item_history.xml?type_ids=34®ion_ids=10000002&days=5
only shows current-5 and current-4

Ty for the great website!


Jitorius
Posted - 2011.04.12 17:13:00 - [202]
 

As for the history function, it will only present "current" history if it has been uploaded recently (I regularly update for my items of interest myself, bit tedious).

However, it will never show data that is more recent than two days ago - e.g. today (12/04) the latest you will see is data from 10/04. I guess it might be due to the data from yesterday sometimes being a bit buggy? Still, I'd prefer some data over no data, or just double checking... but that's me.

anotherpricecheckpls
Posted - 2011.04.13 20:05:00 - [203]
 

Edited by: anotherpricecheckpls on 13/04/2011 20:20:32
Kallahar - is there a reason you're not including the type_id back in the return for the Item Orders (item_orders_buy/sell) set of APIs?

They accept a list of type_ids and are useful as they can be specific to a system unlike other APIs, but there is no way to match up the request to the return if doing more than one type_id (and I didn't want to blatter your server with multiple requests when one would do).

Or am I being blind and missing something?

Edit: thinking about it, the ideal change to the APIs would just be allowing regionID and solarsystemID in the normal item_price API and doing the average buy on your side (*flutters eyelids*)

Idle Bow
Gallente
Genesis Claymores
Posted - 2011.04.14 00:44:00 - [204]
 

Edited by: Idle Bow on 14/04/2011 00:47:54
Hello boss, thanks for reviving this project. For me as for uploader currently (and very possible user of accumulated data later) it could be very useful to see more information about update status of current region. Currently we see i.e. "83% of Domain has been updated in the last 48 hours". It could be really good to see similar percentage for 24hrs, maybe 12hrs... I usually sit in region while get 100% there, but 48hrs old data isn't as good as 24, 12 or even more fresh.

I would also suggest (if your servers will keep it up and there are no other restrictions) to let increase the speed to 2, but keep 3 as default value. That could increase uploading speed and give a chance to update more regions for those few who do that. At a moment it is quite clear that project lacks of uploaders.

And the last thing. This project is useless without the most required data. So it needs some sort of heuristics to push forward and update more often those types, which are queried more often. I think I could even help you to write it if you need that kind of help.

anotherpricecheckpls
Posted - 2011.04.14 03:37:00 - [205]
 

Originally by: Idle Bow
it could be very useful to see more information about update status of current region. Currently we see i.e. "83% of Domain has been updated in the last 48 hours". It could be really good to see similar percentage for 24hrs, maybe 12hrs... I usually sit in region while get 100% there, but 48hrs old data isn't as good as 24, 12 or even more fresh.
You've got last hour, 24hrs, 7 days and 30 days here: http://eve-marketdata.com/reports.php?step=UploadPriceStats

Idle Bow
Gallente
Genesis Claymores
Posted - 2011.04.14 20:07:00 - [206]
 

Originally by: anotherpricecheckpls
You've got last hour, 24hrs, 7 days and 30 days here: http://eve-marketdata.com/reports.php?step=UploadPriceStats


Yeah I know that. But it is usability issue. To access those numbers we need to switch to that report and in some cases it can be problematic. It could be much more useful if those numbers were in place where they are needed.

UnidentifiedTango
Posted - 2011.04.15 10:53:00 - [207]
 

Originally by: Idle Bow
Yeah I know that. But it is usability issue. To access those numbers we need to switch to that report and in some cases it can be problematic. It could be much more useful if those numbers were in place where they are needed.
Oh - you mean on the IGB while uploading? Trouble is that needs to be kept fairly low overhead as the amount of page updates when you're running a browse upload of 3k items or so would put too much stress on the server, for little gain for the average Joe (who's normally uploading afk anyway).

Idle Bow
Gallente
Genesis Claymores
Posted - 2011.04.16 01:01:00 - [208]
 

Edited by: Idle Bow on 16/04/2011 01:39:35
Originally by: UnidentifiedTango
Oh - you mean on the IGB while uploading? Trouble is that needs to be kept fairly low overhead as the amount of page updates when you're running a browse upload of 3k items or so would put too much stress on the server, for little gain for the average Joe (who's normally uploading afk anyway).


Yes, I talk about IGB. While I didn't check javascript code of upload page, I have a strong feeling that it updates that indicator only on page refresh and page refreshes are being done once per 100 item types. It loads 100 items and then the rest is done by javascript without refreshing. In addition to that, IGB upload screen already has percentage indicator, so SQL server is already dealing with task to analyze uploaded data for each refresh. As far as I know (if indexing is set properly) from SQL point of view there should be no difference what to count, percentage for 24 hours or 48. If we wanted to have several percentage indicators that could have difference but this can be dealt with too. Now what we get, instead of having useful indication in upload screen, when we reach 100% within 48h range we are forced to go to more "expensive" report and refresh it constantly to see are we ready to jump to the next region. Some uploaders will go to that report, some not.

Basically this project indicates now that it is happy to have 2 days old price data. But while for price history that can be ok, for orders so old data is useless. Without useful data, there will be no users of it, without users no uploaders, without uploaders this project is dead. My suggestion is at current phase to limit ourselves/yourselves to API and push to excellence data collection, after it is done work on data analysis tools (like eve-metrics had and eve-central has) can be started. The only current my game in eve is "upload as much as you can" to help for this project to move forward (eve-metrics is dead de facto, eve-central is almost dead). So basically I do not do that afk. If I go somewhere I check each region I visit and if it is not 100% stop there to fix that. Capability to see real status of desired data upload condition could save time and efforts, set more proper goals for uploaders.

Siiee
Recycled Heroes
Posted - 2011.04.16 17:55:00 - [209]
 

I think even just the base method to choose which items get updated could be made a lot more efficient as well. Once I was running the IGB updater in a region with 48% completion, and in the first batch or two of updates I saw it was pulling things like learning skills (no longer seeded) and T2 BPOs (extremely unlikely to be on the market, even if there were one in game with no research on it left). Other things like T1 BPOs (NPC seeded, much less important to track than other higher volume goods) and off racial BPOs (like Caldari freighter in Metropolis, same as previous point but even lower trade volume)

If you trim out all the invalid market entries and put in some simple prioritization, say 3 or 4 tiers of goods, you could get much more effective stats from fewer uploaders. Something like trit you may want to flag for an update every 12 hours, pre-empting something like freighter BPOs or Capital skillbooks that could be updated every 48hs or more.

Idle Bow
Gallente
Genesis Claymores
Posted - 2011.04.22 11:09:00 - [210]
 

Edited by: Idle Bow on 22/04/2011 11:11:32
Hello boss. I am playing with your DB and had found something what could attract your attention. As I understand, items_buying and items_selling tables keep information about the latest recorded version of an order and there should be only one record per order. In fact I had found that there is 3675 record overhead in selling table and 1282 records in buying. These numbers are total amounts of records for orders which have more than one record. And except id value the rest of records for the same order are identical.

Here are SQL statements which I used to check data consistency:

SELECT b . *
FROM items_buying AS b, (
SELECT a.order_id
FROM (
SELECT count( order_id ) AS o, order_id
FROM items_buying
GROUP BY order_id
) AS a
WHERE a.o >1
) AS a
WHERE b.order_id = a.order_id
ORDER BY b.order_id;

SELECT b . *
FROM items_selling AS b, (
SELECT a.order_id
FROM (
SELECT count( order_id ) AS o, order_id
FROM items_selling
GROUP BY order_id
) AS a
WHERE a.o >1
) AS a
WHERE b.order_id = a.order_id
ORDER BY b.order_id;


Pages: first : previous : ... 2 3 4 5 6 [7] 8 9 10 : last (10)

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only