open All Channels
seplocked Market Discussions
blankseplocked EVE-Central.com Cross Region Market Browser, Cache Reading
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: first : previous : ... 6 7 8 9 10 11 [12] 13 14 : last (14)

Author Topic

Tyrion WarMage
Knights of the Silver Dawn
The Fourth District
Posted - 2008.11.27 11:17:00 - [331]
 

I'm also planning to write a tool, using the database.
My question is simply: What is the "best" way to get the current trade informations for all items in a specific region(s), updated in the last x hours ?

My ideas:
- Querying quicklook for every item. But: It will return more than the most current informations -> Overhead
- Using the mail-push system. But: I want to write a standalone programm (because of heavy calculations), so every user would be requiered to register his own mail-push account -> Overhead

.. also a list of the valid typeIds would be nice

Jaarlax
Ratty Corp PLC
Posted - 2008.11.27 17:42:00 - [332]
 

Originally by: Williamat Centaurus
Edited by: Williamat Centaurus on 01/10/2008 00:06:03
Hi there, great program and site. Is there a certain category of items you would like uploaded on a regular (daily or weekly) basis? Maybe the ores for instance? If there is, I would certainly be happy to do so. I will be uploading the entire market once a month in the Everyshore region.

A guide on your website about items to upload more frequently or on a schedule would be good for those that are interested in contributing in this way.


Personaly, whenever i look at any market item, i upload it, on the assumption, that if i wanted to know someone else will.
Also, i use it to advertise, whenever i put up anything for buy/sale i export it :)


Carinosa Peligrosa
Posted - 2008.11.30 17:01:00 - [333]
 

Originally by: Tyrion WarMage
.. also a list of the valid typeIds would be nice

Look at the invTypes table for a list of valid items. You can filter from there (is it published, does it have a market group, etc)



I'm still having difficulty with the data, in that I'm still unsure about how much time to download. If I take the whole 720 hours worth, it has orders that have been completed. On the other hand, if I take only 24 hours worth of data, I miss the orders that were placed, say, 26 hours ago but haven't expired? It seems that we're not getting snapshots, but actual reported data.

Tyria WarMage
Posted - 2008.11.30 17:23:00 - [334]
 

Originally by: Carinosa Peligrosa

I'm still having difficulty with the data, in that I'm still unsure about how much time to download. If I take the whole 720 hours worth, it has orders that have been completed. On the other hand, if I take only 24 hours worth of data, I miss the orders that were placed, say, 26 hours ago but haven't expired? It seems that we're not getting snapshots, but actual reported data.


I think the best way is to cache the current data locally, and request all data in the time after the last caching. You can now calculate your snapshot by only saving/updating the most current reports by station+item. This way u will get all reports from the last person who has update a specific item, but you will not get multiple reports per station+item (just like ingame)

Nareg Maxence
Gallente
Posted - 2008.11.30 20:36:00 - [335]
 

This is a very cool tool.

From an integrator standpoint I have one suggestion. I tried the mail push service. I must admit I don't have any data on this, but I assume that there is a lot of redundancy for some items, in that they get updated a lot. For some people getting every single update of every item may be overkill. Would it make sence to create another feed that is a digest of changes for the last hour or so? That is it only sends a market export out if it was updated during the last hour, and if there was several updates, only the last one is sent.

Tyrion WarMage
Knights of the Silver Dawn
The Fourth District
Posted - 2008.12.03 22:52:00 - [336]
 

I've filtered the typeId List by published, marketGroupID and size, but i've still ~3k-5k item Id's (depending on the size limit). Is there a way to filter them more ?
I want to get all items, possibly available on the market, below a size limit.

Carinosa Peligrosa
Posted - 2008.12.08 13:03:00 - [337]
 

Originally by: Tyrion WarMage
I've filtered the typeId List by published, marketGroupID and size, but i've still ~3k-5k item Id's (depending on the size limit). Is there a way to filter them more ?
I want to get all items, possibly available on the market, below a size limit.

You can filter by the object's volume, which is in the same InvTypes table. It's the volume in m3. Or am I misunderstanding what you want to filter against?

Mr Ratty
Ratty Corp PLC
Confederation of Independent Corporations
Posted - 2008.12.10 17:24:00 - [338]
 

Sites down :(

Dantes Revenge
Caldari
Posted - 2008.12.12 10:16:00 - [339]
 

I'm getting a proxy error on the site. The home page is fine but the market page and users page is unobtainable.

Also, it would be nice to be able to set up a scheduled scan of the files at a preset time s uploading can be automated. I can use scheduler to run the uploader program but can't make it scan. Maybe this could be included in a future update. It would save having to remember to do it manually and I keep forgetting to hit the scan button when I've finished playing.

TitusFlamininus
Ars ex Discordia
GoonSwarm
Posted - 2008.12.12 17:25:00 - [340]
 

Still down :(

Jaarlax
Ratty Corp PLC
Posted - 2008.12.12 17:34:00 - [341]
 

Sites up, uploader and api is down :(


Jaarlax
Ratty Corp PLC
Posted - 2008.12.15 19:06:00 - [342]
 

Edited by: Jaarlax on 15/12/2008 19:18:23
now i'm only getting partial api results.

there's been no blog updates in a while, and no sign of kal in this thread, i hope EC hasn't been dropped


Edit: after playing around, looks like there is now a limit of no more than 20 items per api request

Kaladr
Amarr
Posted - 2008.12.15 20:25:00 - [343]
 

Edited by: Kaladr on 15/12/2008 20:25:56
Edited by: Kaladr on 15/12/2008 20:25:38
Sorry about that, had a rocky week and not enough EC babysitting time.

The 20 item limit is a temporary measure until I can work out a few performance issues relating to the use of 100s of type IDs in a single request (which is what borked the single backend server this week, oops).


Jaarlax
Ratty Corp PLC
Posted - 2008.12.17 16:52:00 - [344]
 

I personally prefer the 20 item limit, makes trouble shooting easier as i only need to check 20 numbers in a row instead of what turned out to be 53 Very Happy

oh BTW its down again :(

Kaladr
Amarr
Posted - 2008.12.18 05:12:00 - [345]
 

And up :-/

Blah. I'll figure it out soon enough. Stupid new backend features :)

Ambo
I've Got Nothing
Posted - 2008.12.18 09:44:00 - [346]
 

I hope the requests from EMMA are not causing this, I noticed that eve-central's problems started not long after I released 1.0 Embarassed. They are marked with a custom user-agent header as you recommend so if you're getting unreasonable numbers of them then let me know and I'll look into ways of reducing the load.

Currently requests are always for a single item and are made as data is required. results are retained and another request will only be made after 24 hours.

Karina Redstar
Posted - 2008.12.18 14:59:00 - [347]
 

Also the "Invention profit calculator" does multi-items requests in the API. Noticed that it fails to update the prices few days ago I seems like this 20 items limit is the problem. Maybe you can get in touch with the developer and sort it out.

Kaladr
Amarr
Posted - 2008.12.20 23:34:00 - [348]
 

Originally by: Ambo
I hope the requests from EMMA are not causing this, I noticed that eve-central's problems started not long after I released 1.0 Embarassed. They are marked with a custom user-agent header as you recommend so if you're getting unreasonable numbers of them then let me know and I'll look into ways of reducing the load.

Currently requests are always for a single item and are made as data is required. results are retained and another request will only be made after 24 hours.


Don't believe so. The 20 item was a red herring however, not the underlying cause. Yay for concurrency bugs in native code. I've put in workarounds in deployment which should prevent it from croaking at inconvenient times.


Solar Ray
Vanishing Point
Posted - 2008.12.26 04:09:00 - [349]
 

Any tips on when the limit will be removed? The invention calculator is desperate for new data :)

Lothris Andastar
Posted - 2009.01.02 05:21:00 - [350]
 

Just a friendly bump to ask when (or if) the limit will be removed?

Ni Kannor
Posted - 2009.01.12 03:58:00 - [351]
 

Can Eve central, or any other tool for that matter, allow me to monitor intra-day price fluctuations?

What I'd like to do is track the prices of NPC corporations through out the day. My understanding is that as players buy and sell commodities to an NPC station, the next buy price will decline and the next sell price will rise - until prices are reset during the daily maintenance.

Schive
Forge War Industries
Posted - 2009.01.18 10:45:00 - [352]
 

Could someone make a "How to use the XML extraction option" ??

I really understand nada of the given information on EvE-Central :S

I would like to retrieve the following:
Prizing data on different sorts of goods.
Regional area only.

Update frequenzy: every 1-2 hours.

The above info is needed in a website using the E107 CMS system.

Best thing, would be s code snippets, containing every single bit of code needed to make things work.

Muscaat
EVE Markets
Posted - 2009.01.18 17:25:00 - [353]
 

Originally by: Ni Kannor
Can Eve central, or any other tool for that matter, allow me to monitor intra-day price fluctuations?

What I'd like to do is track the prices of NPC corporations through out the day. My understanding is that as players buy and sell commodities to an NPC station, the next buy price will decline and the next sell price will rise - until prices are reset during the daily maintenance.


I've been working on this site, which I think does what you ask, using price data from EVE-Central. For example, Quafe - with history over the past 1, 5, 14, 30 and 90 days using the average global price reported by EVE-Central, for every item on the market. It's still a work-in-progress but I'm hoping to be able to launch a proper beta test some time this week.

Muscaat
EVE Markets
Posted - 2009.01.18 17:32:00 - [354]
 

Originally by: Schive
Could someone make a "How to use the XML extraction option" ??

I really understand nada of the given information on EvE-Central :S

I would like to retrieve the following:
Prizing data on different sorts of goods.
Regional area only.

Update frequenzy: every 1-2 hours.

The above info is needed in a website using the E107 CMS system.

Best thing, would be s code snippets, containing every single bit of code needed to make things work.


The trouble is, "work" in this context is not well-defined Wink

In terms of getting data from the API, you'll need to know the typeIDs of the items you're interested in. You can find these out by (say) browsing EVE-Central and looking at the URL, or by examining the EVE static data dump. You'll also need to know the region IDs of the regions you're interested in (again, data dump is your friend).

You then query the API for the data by sending a request to one of the URLs on the developer page - these take the form http://eve-central.com/api/quicklook?typeid=YOUR_TYPE_ID&typeid=ANOTHER_TYPE_ID®ionlimit=YOUR_REGION and will return an XML document.

How you load that document into your CMS in whatever language it's written in, and what you do with that raw data, is up to you Smile

Hope that helps

Schive
Forge War Industries
Posted - 2009.01.18 18:24:00 - [355]
 

Quote:
The trouble is, "work" in this context is not well-defined Wink

Work, as in show the latest data given from EvE-Central, in a defined area. (more on the area later on)

Quote:
In terms of getting data from the API, you'll need to know the typeIDs of the items you're interested in. You can find these out by (say) browsing EVE-Central and looking at the URL, or by examining the EVE static data dump. You'll also need to know the region IDs of the regions you're interested in (again, data dump is your friend).

How to get the ID's is a thing i think i can figure out, mostly thanks to your winks there :)

Quote:
You then query the API for the data by sending a request to one of the URLs on the developer page - these take the form http://eve-central.com/api/quicklook?typeid=YOUR_TYPE_ID&typeid=ANOTHER_TYPE_ID®ionlimit=YOUR_REGION and will return an XML document.

How you load that document into your CMS in whatever language it's written in, and what you do with that raw data, is up to you :)


Now we begin :S
First of all, my skills in programming are pretty much non-present. This is the reason i use a CMS. Just got a few buttons to press, a little HTML, and there we go, a website is born.

I use the CMS called E107, wich is a free, open source CMS system, where you are allowed to alter anything you like, (at your own risk of site functionality of course...).
So, i build a page up, using simple HTML.
Now, using HTML as "bridge" between my site and EvE-Central, doesent ruin my website. (not up yet).
So, using your info, i want to get the following from EvE-Central:

  • Image of the item.
    Name of the item.
    Prize of the item.
    and a specifik region. (Let's say The Forge)


Now, using HTML, how will i get the above info pulled from EvE-Central, and into my site ?
All i do to build a page in E107, is to use any code and CSS needed betbeen the 2 body-tags.

Ye, i know, im asking for an almost premade code :S But i seriousy have no clue about XML, API or the likes of those, so a need help really really bad. i really dont know how to put it otherwise :S
Sorry for being a nubbie here :(

Muscaat
EVE Markets
Posted - 2009.01.18 23:34:00 - [356]
 

Schive, EVE-mail sent Smile

Marcus D'Eriellius
Gallente
Rage and Terror
Against ALL Authorities
Posted - 2009.01.19 11:06:00 - [357]
 

I notice the EON awards are out and for some unfathomable reason EVE-Central.com does not appear in the best application/service category which makes the awards a laughing stock.

Don't worry Kaladr, we appreciate what you do.

Lone Davinel
Caldari
Caldari Provisions
Posted - 2009.01.27 14:08:00 - [358]
 

I was wondering how exactly the market buy/sell "movement" is calculated. Is it based on a 24 hour period? or is it based on the "hours old" value that you determine. Also considering some items are probably only updated a few times a day, how accurate is the movement value? This could be a very important piece of information on deciding wether or not to set up a buy order for a particular item, as the movement history in-game only determines the total movement of the buy + sell orders.

Brock Nelson
Posted - 2009.02.12 01:59:00 - [359]
 

Is there a list of productID and regionID that I can look up?

Ambo
I've Got Nothing
Posted - 2009.02.12 08:49:00 - [360]
 



Pages: first : previous : ... 6 7 8 9 10 11 [12] 13 14 : last (14)

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only