open All Channels
seplocked Market Discussions
blankseplocked The Next EMMA thread. - 1.5.1.0 now available. Massive update.
 
This thread is older than 90 days and has been locked due to inactivity.


 
Pages: first : previous : ... 2 3 4 5 [6] 7 8 9 10 ... : last (30)

Author Topic

Queen Krystal
Posted - 2010.01.06 03:31:00 - [151]
 

Originally by: Queen Krystal

I shouldnt be reading this forums at 3am... you can easily miss stuff while reading.

Noticed the Lost Hamster values for his JournalGenerations table
Quote:
ID Start Date End Date Offset LargersID
0 2000-01-01 00:00:00.000 2007-09-01 00:00:00.000 0 1000000000
1 2007-12-01 00:00:00.000 2008-11-27 09:53:00.000 1085796677 1887206022
2 2008-11-29 01:00:00.000 2009-09-16 08:29:24.000 2591720933 1642241558


And replaced the last row on mine, it worked! it just trew out the most recent journal entries for today 05/01/2010, not all the data but at least its something, i just hope to see all the data comming on next sync.

Thanks for your awesome app Ambo! i would like to see if its posible to port it to use sqlite or postgre for a less-resource-eater database rather than MSSQL


For some reason the journal entries before Jan 5th arent comming even after several updates to the API

APIError.xml show this

Quote:
<?xml version="1.0" encoding="UTF-16" standalone="yes"?>
<eveapi version="2">
<currentTime>2010-01-06 03:16:47</currentTime>
<error code="103">Already returned one week of data: retry after 2010-01-06 04:16:40.</error>
<cachedUntil>2010-01-06 04:16:40</cachedUntil>
</eveapi>


Bangbroo
Posted - 2010.01.06 06:47:00 - [152]
 

Originally by: Valyrian Tyr
I'm having a bit of trouble getting emma to work. Right now all I get upon opening the program is an immediate 'EMMA has stopped working' window which says

'a problem caused the program to stopworking correctly. Windows will clost the program and notify you if a solution is available'

A little info:
Windows Vista 64 sp2
I have installed SQL with SQLEXPR.EXE file. It seemed to install properly after the second attempt.
I ran the setup.exe file first and that seemed to install properly as well.
I've restarted windows multiple times to get the sql to kick on.

Any help? I'll keep at the threads and see if I can figure it out but I'll take any sugestions you may have.

Thanks!




Hey did you try to run it as administrator? Worked perfectly fine for me. Didnt work on W7 either and know works like a charm

only wondering if you can connect your EMMA to a spreadsheet?
So it automatically updates any orders you have open etc how many numbers you have left.

Ambo
I've Got Nothing
Posted - 2010.01.06 07:53:00 - [153]
 

Originally by: Queen Krystal

For some reason the journal entries before Jan 5th arent comming even after several updates to the API



Usually, the API can only get data from so far back.
Specifically, a maximum of 1000 journal entries or 1 week if you have more than 1000 journal entries.

However, in this case, you're clearly not getting the full week.
The error just indicates that the API already think you've retrieved your maximum amount of data so you have to wait an hour until the next update.


I'm a bit baffled tbh.
You can check for files called 'Character Journal Entries*.xml' in the 'Logging' folder, sort them by date and check the most recent ones. Do those files contain entries from before Jan 5th? If they do then it's a problem with EMMA, if they don't then it's a problem with the eve API.

Ambo
I've Got Nothing
Posted - 2010.01.06 08:01:00 - [154]
 

Originally by: Bangbroo
Originally by: Valyrian Tyr
I'm having a bit of trouble getting emma to work. Right now all I get upon opening the program is an immediate 'EMMA has stopped working' window which says

'a problem caused the program to stopworking correctly. Windows will clost the program and notify you if a solution is available'



Hey did you try to run it as administrator? Worked perfectly fine for me. Didnt work on W7 either and know works like a charm

only wondering if you can connect your EMMA to a spreadsheet?
So it automatically updates any orders you have open etc how many numbers you have left.


Yep, Right click -> Run as administrator should fix that problem.

You can't sync EMMA with a spreadsheet at all but you can 'Export to CSV' from most of the data windows and the reports (right click -> export to CSV).
This CSV can then be loaded into virtually any spreadsheet app.

Queen Krystal
Posted - 2010.01.06 08:08:00 - [155]
 

Edited by: Queen Krystal on 06/01/2010 08:09:46
Edited by: Queen Krystal on 06/01/2010 08:08:55
Originally by: Ambo
Originally by: Queen Krystal

For some reason the journal entries before Jan 5th arent comming even after several updates to the API



Usually, the API can only get data from so far back.
Specifically, a maximum of 1000 journal entries or 1 week if you have more than 1000 journal entries.

However, in this case, you're clearly not getting the full week.
The error just indicates that the API already think you've retrieved your maximum amount of data so you have to wait an hour until the next update.


I'm a bit baffled tbh.
You can check for files called 'Character Journal Entries*.xml' in the 'Logging' folder, sort them by date and check the most recent ones. Do those files contain entries from before Jan 5th? If they do then it's a problem with EMMA, if they don't then it's a problem with the eve API.


Checked out the API Call History folder and the journal entries file is created twice each time:

Quote:
Character journal entries characterID=******* beforeRefID=2091367011 633983590467214000.xml
--------------------------------------------------
<?xml version="1.0" encoding="UTF-16" standalone="yes"?>
<eveapi version="2">
<currentTime>2010-01-06 07:17:06</currentTime>
<error code="103">Already returned one week of data: retry after 2010-01-06 08:17:02.</error>
<cachedUntil>2010-01-06 08:17:02</cachedUntil>
</eveapi>



Second one
Quote:
Character journal entries characterID=******* beforeRefID=0 633983590455234000.xml
-----------------------
Has data from 2009-12-29 to 2010-01-06


It looks like EMMA its cahing journal data data twice.

Is there any way to remove all the journal data and just make EMMA catch a fresh one?

Ambo
I've Got Nothing
Posted - 2010.01.06 11:28:00 - [156]
 

To start from fresh you should just have to not request an update for at least one hour.

Queen Krystal
Posted - 2010.01.06 21:37:00 - [157]
 

Not working, still cant receive journal data from before 05/01/2010 3:55am

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.06 22:50:00 - [158]
 

Originally by: Queen Krystal
Not working, still cant receive journal data from before 05/01/2010 3:55am

Not sure if this will help, but I know that it's stored what was your last transaction in the db. Could be that during the import the program is ignoring all older entries.

If you open the EMMADatabase \ dbo.APICharacters table
then there are some Columns called:
HighestCharTransID
HighestCharJournalID

Try to set those values to 0.


Edit: however it could be if you set it to zero, then during the import it will generate duplicated entries, or crash the program.

So if you just have started to use the program, then the easiest would be to drop that two table.
in the SQL management console right click on EMMADatabase -> new query
and you execute the following command:

Use EMMADatabase
truncate table Transactions;
truncate table Journal;


This will wipe your Transaction and Journal table!!!

Then you set up the HighestCharTransID, HighestCharJournalID to 0 and you try to download the data into the database.

I suggest you wait for a confirmation from Ambo, that this can be a solution.

Ambo
I've Got Nothing
Posted - 2010.01.06 23:00:00 - [159]
 

It's been a long time since I've looked at the code but I think you're correct, that should solve the issue.

I WANT TO EMPASISE THAT THIS WILL WIPE ALL JOURNAL AND TRANSACTION DATA CURRENTLY IN YOUR EMMA DATABASE


Queen Krystal
Posted - 2010.01.07 02:23:00 - [160]
 

Finally fixed, thanks Lost Hamster and Ambo for your help!

Valyrian Tyr
Posted - 2010.01.07 22:51:00 - [161]
 

Edited by: Valyrian Tyr on 07/01/2010 22:52:28
First off thanks for the quick reply in helping me get this program going. Running it as administrator did the trick and it looks like a really slick program. I went through the tutorial and am wondering if I can get some tips and tricks of how you use this program to aid in region to region trading and station trading. Is there a website for emma that I can check out? Fron what I can gather it seems most benificial to player corperations and not the lone trader. Hopefully I'm wrong :) because I like the layout of the program but I'm having problems figuring out how to use it to aid my gaming.

Thanks!

Spudzz
Posted - 2010.01.07 23:05:00 - [162]
 

Edited by: Spudzz on 07/01/2010 23:05:49
Hi all,

Apologies if I missed a solution to my prob, I've been looking but haven't seen one yet.

After installing the latest version of EMMA, I let it go and do an update. During the update process it has 3 steps, the last one relating to the .mdf file.

When it tries to do the last step "EveData_log.ldf component (3 of 3) Copying....."

I get an error stating:

Problem copying file 'EveData.mdf'
The process cannot copy the file C:Program Files\EMMA\Data\EveData.mdf' because it is being used by another process.

Given it's EMMA updating itself, what other process is accessing the database file?

*edit* forgot to add, once the update has finished EMMA will no longer run and bombs out with a standard MS error when loading. I can however use it fine if I don't bother with the update.

Looking forward to playing with this, so any help appreciated.

Regards
Spudz

Ambo
I've Got Nothing
Posted - 2010.01.08 08:34:00 - [163]
 

Originally by: Spudzz
<updating problem>


Some of the older versions of EMMA could lock their own database files when trying to update. This has been fixed for a long time but you may just have an older version.

I recommend the following:


This should preserver the database automatically but if it does not, simply copy the files you backed up into the new data folder.

Ambo
I've Got Nothing
Posted - 2010.01.08 08:47:00 - [164]
 

Originally by: Valyrian Tyr
Edited by: Valyrian Tyr on 07/01/2010 22:52:28
First off thanks for the quick reply in helping me get this program going. Running it as administrator did the trick and it looks like a really slick program. I went through the tutorial and am wondering if I can get some tips and tricks of how you use this program to aid in region to region trading and station trading. Is there a website for emma that I can check out? Fron what I can gather it seems most benificial to player corperations and not the lone trader. Hopefully I'm wrong :) because I like the layout of the program but I'm having problems figuring out how to use it to aid my gaming.

Thanks!


I'm afraid there is nothing beyond the tutorial really.

Personally, I used it as a lone trader with one account and one character. The multi-char/corp stuff was just addded because other people wanted it.

I used the following method:

  • Place region-wide buy orders in The Citadel and Lonetrek
  • Use the auto-contractor in EMMA to setup public courier contracts for haulers to take goods to Jita.
  • Sell stuff in Jita
  • Profit! Very Happy


I later expanded my activities to include a refine step before selling if it was worth it. This was the main reason for adding the 'reprocessor' feature in EMMA. Doing this with very high-volume items made me a LOT of extra cash.

I used the reporting features, particularly the item report to constantly refine the list of items I was trading.

It requires a fair bit of market research to setup but then just an hour or so per day to keep it ticking over. You do end up with a lot of crap scattered around though. Sometimes I'd go and collect it myself but to this day, I've still got about 200 mil worth of modules sat in arse-end-of-nowhere stations.

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.09 21:06:00 - [165]
 

I think we have a problem..
In the Journal the refID is greater than 2 147 483 647 - which is the max value of int32.

So It's not possible to import any Journal entry at the moment.
I think the problem is with the import algorithm. I think it would be possible to change the type from int 32 to unsigned long then it would work for a while.

ps: I guess CCP use the 64bit version of the SQL server, so the ref id can get pretty big.
So if that will be bigger than 4,294,967,295, then we will be screwed. Unless we port the program to 64 bit.

Ambo
I've Got Nothing
Posted - 2010.01.09 23:35:00 - [166]
 

Originally by: Lost Hamster
I think we have a problem..
In the Journal the refID is greater than 2 147 483 647 - which is the max value of int32.

So It's not possible to import any Journal entry at the moment.
I think the problem is with the import algorithm. I think it would be possible to change the type from int 32 to unsigned long then it would work for a while.

ps: I guess CCP use the 64bit version of the SQL server, so the ref id can get pretty big.
So if that will be bigger than 4,294,967,295, then we will be screwed. Unless we port the program to 64 bit.



The journal ID in EMMA should be greater than 2^32. This is because EMMA was always designed to use a 64 bit integer for ref ID instead of Eve's 32bit.

However, I guess it's possible that with the upgrade to SQL 2008, CCP finally got around to increasing the ref ID in Eve's database to 64bit as well. In that case, there could be some areas where EMMA is expecting 32bit and is getting 64bit, hence the problems.

I'll try and remember to take a look at it tomorrow.

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.09 23:51:00 - [167]
 

Originally by: Ambo

However, I guess it's possible that with the upgrade to SQL 2008, CCP finally got around to increasing the ref ID in Eve's database to 64bit as well. In that case, there could be some areas where EMMA is expecting 32bit and is getting 64bit, hence the problems.


Here is the error message, I hope it helps:
2010.01.09. 21:35:23 Error - EveMarketMonitorApp.Common.EMMAException - Error when adding journal data from api
Inner Exception: Value was either too large or too small for an Int32.
Stack Trace: at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
at EveMarketMonitorApp.AbstractionClasses.APICharacter.RetrieveJournal(CharOrCorp corc, XmlDocument fileXML, Int16 defaultWalletID)

Vested Interest
Posted - 2010.01.10 00:52:00 - [168]
 

Oh dear, I think I've killed her finally:

EXCEPTION REPORT
=====================================================================================
1/9/2010 5:49:20 PM Error - EveMarketMonitorApp.Common.EMMAException - Error when adding journal data from api
Inner Exception: Value was either too large or too small for an Int32.
Stack Trace: at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
at EveMarketMonitorApp.AbstractionClasses.APICharacter.RetrieveJournal(CharOrCorp corc, XmlDocument fileXML, Int16 defaultWalletID)


EXCEPTION REPORT
=====================================================================================
1/9/2010 4:52:35 PM Critical - EveMarketMonitorApp.Common.EMMADataException - The journal entries you are adding appear to be for a generation after the latest one in the EMMA database.
You will be unable to import journal entries from the EveAPI until the EMMA database is updated with newer journal generation data.


I was running a very large report, took EMMA at least 10 minutes to finish, when it appears to have jammed on an API update. Confused

Kaldira
Posted - 2010.01.10 10:39:00 - [169]
 

Edited by: Kaldira on 10/01/2010 10:40:15



Getting the int32 error as well Sad

Ambo
I've Got Nothing
Posted - 2010.01.10 11:25:00 - [170]
 

Yes, everyone with recent journal entries will be getting it. Looking into it now...

Ambo
I've Got Nothing
Posted - 2010.01.10 12:06:00 - [171]
 

This should not be a big deal to fix. However, I currently only have c# express on my PC so am unable to build a release version of the program.

I will need to make some further changes and will release a fix tomorrow.

Ambo
I've Got Nothing
Posted - 2010.01.11 10:12:00 - [172]
 

Beta version 1.3.1.5 now available.

This will fix the issue with the journal not updating correctly.

I'll put it on general release once we have a few confirmed users with no problems.

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.11 10:31:00 - [173]
 

Doest look's good. :(

2010.01.11. 11:22:55 Critical - EveMarketMonitorApp.Common.EMMADataException - Problem changing type of APICharaters' columns to bigint.
Inner Exception: The object 'DF_APICharacters_HighestCharTransID' is dependent on column 'HighestCharTransID'.
ALTER TABLE ALTER COLUMN HighestCharTransID failed because one or more objects access this column.
Stack Trace: at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlCommand.RunExecuteNonQueryTds(String methodName, Boolean async)
at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(DbAsyncResult result, String methodName, Boolean sendToPipe)
at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()
at EveMarketMonitorApp.DatabaseClasses.Updater.Update()

And when I try to do an updte, then the program crash:
2010.01.11. 11:23:32 Critical - EveMarketMonitorApp.Common.EMMADataException - Error storing eve character data in the EMMA database.
Inner Exception: Error converting data type bigint to int.
Stack Trace: at System.Data.Common.DbDataAdapter.UpdatedRowStatusErrors(RowUpdatedEventArgs rowUpdatedEvent, BatchCommandInfo[] batchCommands, Int32 commandCount)
at System.Data.Common.DbDataAdapter.UpdatedRowStatus(RowUpdatedEventArgs rowUpdatedEvent, BatchCommandInfo[] batchCommands, Int32 commandCount)
at System.Data.Common.DbDataAdapter.Update(DataRow[] dataRows, DataTableMapping tableMapping)
at System.Data.Common.DbDataAdapter.Update(DataRow[] dataRows)
at EveMarketMonitorApp.DatabaseClasses.EMMADataSetTableAdapters.APICharactersTableAdapter.Update(DataRow dataRow)
at EveMarketMonitorApp.DatabaseClasses.APICharacters.Store(APICharacter apiChar)

Ambo
I've Got Nothing
Posted - 2010.01.11 10:45:00 - [174]
 

I can't reproduce your problem and I don't have an 'DF_APICharacters_HighestCharTransID' object in my database. Perhaps it's something to do with you being on SQL 2008 (I seem to remember you are but I may be wrong?)

I'll see if I can convert to 2008 and reproduce it.

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.11 10:47:00 - [175]
 

Edited by: Lost Hamster on 11/01/2010 11:12:37
Originally by: Ambo
I can't reproduce your problem and I don't have an 'DF_APICharacters_HighestCharTransID' object in my database. Perhaps it's something to do with you being on SQL 2008 (I seem to remember you are but I may be wrong?)

I'll see if I can convert to 2008 and reproduce it.


I traced the problem:
The isssue is with the dbo.APICharUpdate stored procedure.
There the HighestCharJournalID and HighestCorpJournalID are int.

And int the dbo.APICharInsert stored procedure.



Edit: Could be something else.. I still can not convert it.
Still looking into. :)

Edit2:
DF_APICharacters_HighestCharTransID you can find under:
Table\dbo.APICharactes\Constraints

I hope this helps.

Ambo
I've Got Nothing
Posted - 2010.01.11 11:14:00 - [176]
 

Edited by: Ambo on 11/01/2010 11:14:39
Originally by: Lost Hamster
Edited by: Lost Hamster on 11/01/2010 10:52:01
Edited by: Lost Hamster on 11/01/2010 10:48:25
Originally by: Ambo
I can't reproduce your problem and I don't have an 'DF_APICharacters_HighestCharTransID' object in my database. Perhaps it's something to do with you being on SQL 2008 (I seem to remember you are but I may be wrong?)

I'll see if I can convert to 2008 and reproduce it.


I traced the problem:
The isssue is with the dbo.APICharUpdate stored procedure.
There the HighestCharJournalID and HighestCorpJournalID are int.

And int the dbo.APICharInsert stored procedure.



Edit: Could be something else.. I still can not convert it.
Still looking into. :)


The update changes the four 'highestxxx' fields on 'APICharacter' from int to bigint. It then updates the APICharInsert and APICharUpdate stored procedures.

However, if the first part fails then it will never get to the stored procedures and will just keep trying each time you start EMMA.

Quote:

Edit2:
DF_APICharacters_HighestCharTransID you can find under:
Table\dbo.APICharactes\Constraints


Thought it might be. That does not appear in my database though. There are no constraints on the table as far as I can see.

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.11 11:39:00 - [177]
 

Edited by: Lost Hamster on 11/01/2010 11:39:30
I dropped the Constrains, now it look's better. The stored procedures where updated as well.

If anyone experience similar issues, then run the following command in sql management console.

Select EMMAdatabase, right click new query:

use [Emmadatabase]
alter table dbo.APICharacters
drop Constraint DF_APICharacters_HighestCharJournalID
alter table dbo.APICharacters
drop Constraint DF_APICharacters_HighestCharTransID
alter table dbo.APICharacters
drop Constraint DF_APICharacters_HighestCorpJournalID
alter table dbo.APICharacters
drop Constraint DF_APICharacters_HighestCorpTransID
alter table dbo.APICharacters
drop Constraint DF_APICharacters_LastCorpJournalUpdate
alter table dbo.APICharacters
drop Constraint DF_APICharacters_LastCorpTransUpdate
alter table dbo.APICharacters
drop Constraint DF_APICharacters_LastCharJournalUpdate

Then press the parse (blue pipe) then the Execute button.

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.11 12:02:00 - [178]
 

Originally by: Vested Interest

Posted on 27/12/2009 07:21:00
Assets report is toast:


I have done some more investigation, and that is toast because it tries to use the reprocessor part of the program - which is broken with the new database.

Ambo
I've Got Nothing
Posted - 2010.01.11 16:17:00 - [179]
 

Beta 1.3.2.0 released

This includes Lost Hamster's updated eve database file with the Dominion data and a slight tweak to get the reprocessor (and assets report) working.

Please let me know if you have any issues with it, if not, I'll put it on general release tomorrow.

Lost Hamster
Hamster Holding Corp
Posted - 2010.01.11 16:50:00 - [180]
 

Edited by: Lost Hamster on 11/01/2010 17:04:36

Originally by: Ambo
Beta 1.3.2.0 released

This includes Lost Hamster's updated eve database file with the Dominion data and a slight tweak to get the reprocessor (and assets report) working.

Please let me know if you have any issues with it, if not, I'll put it on general release tomorrow.

Look's good! No issues so far. Thanks Ambo, You are GREAT!

Edit: If you are already digged in to the source code Very Happy
I'm not sure if this has been adressed or not Embarassed :
http://www.eveonline.com/ingameboard.asp?a=topic&threadID=1180576&page=4#112

You said it's easy to fix. Smile


Pages: first : previous : ... 2 3 4 5 [6] 7 8 9 10 ... : last (30)

This thread is older than 90 days and has been locked due to inactivity.


 


The new forums are live

Please adjust your bookmarks to https://forums.eveonline.com

These forums are archived and read-only