open All Channels
seplocked EVE Technology Lab
blankseplocked EVE Marketeer (beta) - (Market) Data Aggregation & Display
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: 1 2 [3] 4

Author Topic

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.12 18:12:00 - [61]
 

Turhan Bey, you are correct. I had the credits for new uploads at a limited value at first, since I expected to get uploads from the easy regions a lot at first (leading to massive amounts of credits for fairly easy work, which is a bit opposed to the purpose), I will be changing this to be as you say soon (maximum credits for never before uploaded items), since I figure most easy uploads have been done by now.
The time factor on uploads is not so high as to make it very profitable to wait a long time before uploading new data, but repeatedly spamming the upload of a certain item won't work either. Then again, if you upload an item very often and the changes are huge (tritanium has a tendency to have many changed orders, even in just half an hour) it might actually pay off more than going out to remote regions and uploading new and/or less often updated prices.

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.12 22:10:00 - [62]
 

Edited by: Callean Drevus on 12/08/2011 22:10:37
On a different note, feedback has been upgraded! You can now comment and I can mark items as complete without breaking the whole system.

I've also made progress on implementing inferred orders due to a complete rewrite of the system used for importing orders (all different sources were using different ways to import data up until now, so I essentially had the same code thrice). If that part is finished, I'll be able to start on building features in earnest :)

Turhan Bey
EVE University
Ivy League
Posted - 2011.08.14 17:05:00 - [63]
 

Version 2.5.1 seems to have fixed the E-MD upload checkbox issue, thank you. :)

Could you also make a download available that is not wrapped in an MSI package? Just a ZIP like the old 2.5 download, basically. Or has the format changed such that an install is needed?

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.14 17:43:00 - [64]
 

Edited by: Callean Drevus on 14/08/2011 17:47:12
Originally by: Turhan Bey
Version 2.5.1 seems to have fixed the E-MD upload checkbox issue, thank you. :)

Could you also make a download available that is not wrapped in an MSI package? Just a ZIP like the old 2.5 download, basically. Or has the format changed such that an install is needed?


Good :) and no, nothing has changed significantly that makes the MSI necessary, it's just that the installer is able to make the program autostart, which you might regard as both good or bad (I personally like it). I'll happily provide a zip download as well.

Will soon put up a download page where you can get the msi or zip version of the uploader as well as historical downloads, just in case I mess up sometime.

Everyone might also notice that I've modified the credit calculation algorithm, leading to a better distribution of overal credit for uploads. I'm sorry for our previous record holder, but it seems this changed the distribution of credits significantly Wink

More features coming in a new release tonight!

Domi Etymology
Posted - 2011.08.15 02:25:00 - [65]
 

I'm finding an interesting situation with the uploading client. If I'm running to eve clients dumping data, it goes fine. However if I add a third client, the uploader seems to freeze up after a few seconds. It sort of looks like it can't handle the speed that items are entering into eve's cache, or something.

Anyone else noticed anything similar, or am I the only nut who tries market dumping data with 3 or more clients at once :P

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.15 09:58:00 - [66]
 

Originally by: Domi Etymology
I'm finding an interesting situation with the uploading client. If I'm running to eve clients dumping data, it goes fine. However if I add a third client, the uploader seems to freeze up after a few seconds. It sort of looks like it can't handle the speed that items are entering into eve's cache, or something.

Anyone else noticed anything similar, or am I the only nut who tries market dumping data with 3 or more clients at once :P


I must confess my testing was limited at two clients, though I fail to see how three clients shouldn't work. I'll work on finding out though ;)

Turhan Bey
EVE University
Ivy League
Posted - 2011.08.15 15:15:00 - [67]
 

Same, I've never run more than two clients simultaneously, and usually only run one. Unfortunately, I don't think that I'll be able to help test this one because I don't believe that my system could handle more. Embarassed

Domi Etymology
Posted - 2011.08.16 03:14:00 - [68]
 

Hasn't stopped you from uploading a ton of info though :) Do you leave two clients going almost constantly anytime you're not actively using your account?

Dragonaire
Caldari
Corax.
PURgE Alliance
Posted - 2011.08.16 06:01:00 - [69]
 

I was reading back through the thread after something a friend said about you having some problems with slow queries and thought I'd see if you'd looked into MariaDB and TokuDB instead of MySQL? Maria is a drop in replacement for MySQL and is faster and has less bugs. Toku is another DB engine like InnoDB or MyISAM which you can add on as a plugin and use. It uses a different index structure that makes it a lot faster with more indexes which is where the slow down usually is because you either have a lot and inserts become real slow or don't have them and pay with slow selects. I've tested Yapeal using them and even with very small datasets the queries were measurably faster.

Anyway if you're interested in talking about it some more contact me via my E-mail from Google code and I'll go into a little more details with you.

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.16 08:41:00 - [70]
 

Edited by: Callean Drevus on 16/08/2011 12:30:43
Edited by: Callean Drevus on 16/08/2011 12:20:59
Originally by: Dragonaire
I was reading back through the thread after something a friend said about you having some problems with slow queries and thought I'd see if you'd looked into MariaDB and TokuDB instead of MySQL? Maria is a drop in replacement for MySQL and is faster and has less bugs. Toku is another DB engine like InnoDB or MyISAM which you can add on as a plugin and use. It uses a different index structure that makes it a lot faster with more indexes which is where the slow down usually is because you either have a lot and inserts become real slow or don't have them and pay with slow selects. I've tested Yapeal using them and even with very small datasets the queries were measurably faster.

Anyway if you're interested in talking about it some more contact me via my E-mail from Google code and I'll go into a little more details with you.


I happened to come across MariaDB before, in connection with the thread on this forum in regards to route processing, but I haven't given it much attention yet. I hadn't heard about Toku though, which might be interesting, even if it's only for the inserts, which is something that's happening all the time.

EVE Marketeer is running on my company production server though, and I'm not so hot on experimenting with new technologies when I can break several of my 'real' websites. I'll find out some more about them, and I'll contact you later.

UPDATE: It also turns out I couldn't resist the possibility of more storage engines, even if I'm never going to use them. The install was pretty simple too, so well, I now have MariaDB as well as the TokuDB engine.

UPDATE2: I have failed to find your email on google code :P

Dragonaire
Caldari
Corax.
PURgE Alliance
Posted - 2011.08.16 14:22:00 - [71]
 

Good to hear you are giving them a try. Try the Yapeal project owner at Gmail and you'll find me Wink

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.16 22:23:00 - [72]
 

Ah, yes, I must be an idiot :P

For those industrialists here. I've added a feature that allows you to calculate how much resources building a certain amount of items will cost you in both time and resources. It also shows you how much profit you will make selling to current market prices. It's awesome! Give it a try. Just go to the page of a random item (that can be built) and look at the bottom of the manufacturing & research tab :)

Johnathan Roark
Caldari
The Graduates
Morsus Mihi
Posted - 2011.08.16 22:53:00 - [73]
 

Originally by: Callean Drevus
Ah, yes, I must be an idiot :P

For those industrialists here. I've added a feature that allows you to calculate how much resources building a certain amount of items will cost you in both time and resources. It also shows you how much profit you will make selling to current market prices. It's awesome! Give it a try. Just go to the page of a random item (that can be built) and look at the bottom of the manufacturing & research tab :)


very neat tool, but im getting an error:

Warning: Missing argument 5 for mod_item::minerals(), called in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/item.php on line 228 and defined in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/item.php on line 201

Warning: Missing argument 5 for mod_item::minerals(), called in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/item.php on line 228 and defined in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/item.php on line 201


http://www.evemarketeer.com/item/itemprice/Absolution

Domi Etymology
Posted - 2011.08.17 06:46:00 - [74]
 

This bug seems to be with anything not t1. Tested it out looking for a few t2 ships, and t3's.

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.17 09:39:00 - [75]
 

Edited by: Callean Drevus on 17/08/2011 13:48:47
Whoops, forgot to add a new argument for my recursive functions, thats why you were seeing so MANY errors.

It should be fixed now.

EDIT: Ahrg, morons uploading false data to EVE Central are messing up my alghorithms Rolling Eyes now I've got a neat little project for the next few days. Finding a way to identify false uploads... Neutral

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.17 22:41:00 - [76]
 

Edited by: Callean Drevus on 17/08/2011 22:42:21
Oh, I've been distracted from my previous goal by creating a nice page for tracking your wallet transactions. It creates a summary for transactions over the last x days, and allows you to filter your transaction list by type, station, and client (the last two of which are probably useless, but the first one might prove pretty useful).

It obviously requires you to enter you full API key and select some characters, but otherwise it should be pretty epic :)

http://www.evemarketeer.com/trade/transactions

Domi Etymology
Posted - 2011.08.18 01:52:00 - [77]
 

Originally by: Callean Drevus
EDIT: Ahrg, morons uploading false data to EVE Central are messing up my alghorithms Rolling Eyes now I've got a neat little project for the next few days. Finding a way to identify false uploads... Neutral


Would it be feasible to have a checkbox to allow whether the user wanted to include eve-central and/or eve-marketdata info in their results?

Or is this just a terribad-will-break-everything-and-cause-the-apocalypse sort of idea?

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.18 08:19:00 - [78]
 

Edited by: Callean Drevus on 18/08/2011 18:38:49
Originally by: Domi Etymology
Originally by: Callean Drevus
EDIT: Ahrg, morons uploading false data to EVE Central are messing up my alghorithms Rolling Eyes now I've got a neat little project for the next few days. Finding a way to identify false uploads... Neutral


Would it be feasible to have a checkbox to allow whether the user wanted to include eve-central and/or eve-marketdata info in their results?

Or is this just a terribad-will-break-everything-and-cause-the-apocalypse sort of idea?


It is not a terrible option, but due to the way the website is build, completely impossible Wink all data is mixed and matched on upload, even though the information on who uploaded it is available, there is no way to retrieve the state of the orders from a different service (well, there is, but it's not something you should want to use for that) Smile

Besides, I just cannot let myself be defeated by phonies. That is also the only reason my uploader is not open source, it prevents people from looking at the source (hopefully) and finding out the data format and endpoint for my uploads.

UPDATE: To prevent further degeneration of the data, I've made you all gods. If the website thinks the orders have been tampered with, and someone uploads with my own uploader, it'll revert history to the point where the last upload by an EVE Marketeer occurred, and make changes/calculate inferred orders etc. from there. Hopefully fixing most of the possible idiocy that could have occurred :)

Turhan Bey
EVE University
Ivy League
Posted - 2011.08.18 23:38:00 - [79]
 

Originally by: Domi Etymology
Hasn't stopped you from uploading a ton of info though :) Do you leave two clients going almost constantly anytime you're not actively using your account?

Yeppers, I have a second system that is even lower-end (it will definitely choke and die if made to run dual clients), but it is a basic server system that is running 24/7. So whenever I am not online with one account or the other, then I try to use that system to log it in and just run a constant market scan, and when convenient from within a random (uncommon) region.

Salam Horani
Posted - 2011.08.20 08:48:00 - [80]
 

hi callean,

great site you have there, thank you.

i have an issue, though. i don't seem to be able to add my API keys or add characters to my account. i get all sorts of error. posting bellow the errors i get when i try to add api key or characters:

Fatal error: Uncaught exception 'LogicException' with message 'Api call requires user credentials' in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/eveonline.php:187 Stack trace: #0 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/eveonline.php(211): AleEVEOnline->addCredentials(Array, 2) #1 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/util/context.php(60): AleEVEOnline->_retrieveXml(Array, Array) #2 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/player.php(102): AleUtilContext->__call('Characters', Array) #3 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/player.php(102): AleUtilContext->Characters() #4 [internal function]: mod_player->api(Object(Request)) #5 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/main.php(46): call_user_func_array(Array, Array) #6 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/index.php(11): include('/home/admin/dom...') #7 {ma in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/eveonline.php on line 187

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.20 10:03:00 - [81]
 

Originally by: Salam Horani
hi callean,

great site you have there, thank you.

i have an issue, though. i don't seem to be able to add my API keys or add characters to my account. i get all sorts of error. posting bellow the errors i get when i try to add api key or characters:

Fatal error: Uncaught exception 'LogicException' with message 'Api call requires user credentials' in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/eveonline.php:187 Stack trace: #0 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/eveonline.php(211): AleEVEOnline->addCredentials(Array, 2) #1 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/util/context.php(60): AleEVEOnline->_retrieveXml(Array, Array) #2 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/player.php(102): AleUtilContext->__call('Characters', Array) #3 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/player.php(102): AleUtilContext->Characters() #4 [internal function]: mod_player->api(Object(Request)) #5 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/main.php(46): call_user_func_array(Array, Array) #6 /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/index.php(11): include('/home/admin/dom...') #7 {ma in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/core/lib/ale/eveonline.php on line 187


Hey Salam, are you by any chance using your account name as the account id? I'll take a look at this behaviour, I know my API additions are a little volatile, but I've refrained from changing it as of yet, since CCP will release the new API keys at the end of august anyway and I'll have to rewrite it completely then anyway.

Salam Horani
Posted - 2011.08.20 10:08:00 - [82]
 

Originally by: Callean Drevus
Originally by: Salam Horani
hi callean,
Hey Salam, are you by any chance using your account name as the account id? I'll take a look at this behaviour, I know my API additions are a little volatile, but I've refrained from changing it as of yet, since CCP will release the new API keys at the end of august anyway and I'll have to rewrite it completely then anyway.


no i'm not. first time i clicked on the api info link, i got a page where i could insert my api key. when i submitted the data, i got that error, and i've been getting it ever since. hope that helps.

cheers,

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.20 10:10:00 - [83]
 

Ok, I'll take a look at it :)

What is your account name? It seems you are not registered under Salem?

Salam Horani
Posted - 2011.08.20 10:31:00 - [84]
 

my account name is "mirage3d"

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.20 11:07:00 - [85]
 

Salam, I have made a few adjustments to the way in which API keys were entered. It should work fine now. Seems for one reason or another your api key was inserted with a user id of 0 Wink

Salam Horani
Posted - 2011.08.20 13:01:00 - [86]
 

Edited by: Salam Horani on 20/08/2011 13:29:02
hi Callean,

thanks for your fast reply and action. the page works fine now, but i think i know what went wrong. i probably input the "user id" that i used to register with your site instead of my "account number" on EVE. the same mistake happened twice and now it won't let me input the right data even though. i input my correct account number. now i get a confirmation about my preference in green followed by the error in red:

"Your character preferences have been saved. Data will be updated periodically for the selected characters."

"New API credentials invalid, this combination of key and user id does not exist."

hope that helps, and thanks again.

edit: just noticed a warning on top of the page:

"Warning: Invalid argument supplied for foreach() in /home/admin/domains/coronum.nl/public_html/dev/evemarketeer.com/mod/player.php on line 71"

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.20 14:04:00 - [87]
 

Ok, I think it should be completely fixed now. I accidentally broke the whole registration process because of a typo.

Salam Horani
Posted - 2011.08.20 14:20:00 - [88]
 

Edited by: Salam Horani on 20/08/2011 14:27:20
Originally by: Callean Drevus
Ok, I think it should be completely fixed now. I accidentally broke the whole registration process because of a typo.


yup, it works now. thanks a lot. i still get "You have not added any characters yet. Try adding some?" at the "My Market" page even though i checked both characters that i play. when i click on the link "adding some" it takes me back to the "Accounts/API Details" page.

edit: it now magically lists both my characters, unless the magic was performed by you hehehehe.

Callean Drevus
Caldari
Icosahedron Crafts and Shipping
Silent Infinity
Posted - 2011.08.20 14:45:00 - [89]
 

Edited by: Callean Drevus on 20/08/2011 14:53:06
Nope, the magic is performed by yapeal. It takes a little while for it to update the character sheets and information, which are necessary to show you any useful data. I believe the creator of yapeal is now working on a possibility to instantly query certain types of data, removing the delay you just noticed.

In the meantime, I have added a warning to the API section hat notifies users of the fact that it might take a bit before seeing the characters Wink thanks for pointing it out to me.

Karbowiak
Sniggerdly
Posted - 2011.08.20 18:20:00 - [90]
 

It saddens me greatly you list Griefwatch, but not EVSCO or EVE-KILL.. Saddens me very greatly! Crying or Very sad


Pages: 1 2 [3] 4

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only