Fixed last generation missing error (I think, please verify)

[Brian the Fist]

I believe I have fixed a bug on the server. What would happen is you upload a bunch of results and at some point get cut off for some reason. On that last generation you uploaded, gen. X, only part of it gets through so the server partially handles it. When you upload again later, the server sees gen. X again and says 'Ive seen this before' so discards it. However, your growing protein folding movie is at gen. X-1 only since X didnt get fully processed last time. Then you upload gen X+1 and although the data is not duplicate, it cannot find Gen. X, only Gen. X-1. Hence you get a 'previous generation missing' error. Next comes Gen X+2 and since X+1 couldnt be added anywhere, neither can X+2, and so on up to gen 250 from this point.

I believe a number of people have experienced this problem though it was difficult to nail down from the descriptions until someone mailed me a dataset I could reproduce the problem from (thanks!).

Note if you are currently experiencing this error, it will still not work - you must use the -purgeuploadlist feature to wipe out everything to the end of gen 250 or delete filelist.txt. However, from now on this 'bug' should not occur. Please keep an eye out if you have been having this problem and let us know if it indeed appears to be fixed (but remember, if its already messed up in our current data set, that doesn't count).

Hope this makes everyone's life easier :elephant:

[tpdooley]

good riddance to another intermittent bugs.. :machgun: :mouserun: :sniper:

[IronBits]

Good one Howard :smoking:

[Fozzie]

for us on dial-up this was a constant worry.

[Brian the Fist]

Again, I *think* its fixed - do let me know

[cygnussphere]

Would this be what your refering to having fixed?:dunno:


========================[ Aug 29, 2003 12:13 PM ]========================
NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [010.003] {taskapi.c, line 1218} [ReadServerResponse] Timeout waiting for response, got 724 chars.
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [777.000] {ncbi_socket.c, line 1173} [SOCK::s_Connect] Failed SOCK_gethostbyname(www.distributedfolding.org)
ERROR: [777.000] {ncbi_connutil.c, line 801} Socket connect to [url]www.distributedfolding.org:80 failed: Unknown
ERROR: [777.000] {ncbi_socket.c, line 1173} [SOCK::s_Connect] Failed SOCK_gethostbyname(www.distributedfolding.org)
ERROR: [777.000] {ncbi_connutil.c, line 801} Socket connect to [url]www.distributedfolding.org:80 failed: Unknown
ERROR: [777.000] {ncbi_socket.c, line 1173} [SOCK::s_Connect] Failed SOCK_gethostbyname(www.distributedfolding.org)
ERROR: [777.000] {ncbi_connutil.c, line 801} Socket connect to [url]www.distributedfolding.org:80 failed: Unknown
ERROR: [777.000] {ncbi_http_connector.c, line 101} [HTTP] Too many failed attempts, giving up
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER
ERROR: [010.003] {taskapi.c, line 1218} [ReadServerResponse] Timeout waiting for response, got 14600 chars.
ERROR: [777.000] {ncbi_http_connector.c, line 244} [HTTP] Error writing body at offset 8192
ERROR: [010.003] {taskapi.c, line 1218} [ReadServerResponse] Timeout waiting for response, got 14600 chars.

========================[ Aug 29, 2003 6:08 PM ]========================
ERROR: [010.003] {taskapi.c, line 1218} [ReadServerResponse] Timeout waiting for response, got 14600 chars.
ERROR: [000.000] {foldtrajlite2.c, line 4440} Cannot find structure from previous generation .\xxxxxxxx_x_xxxxxxxx_protein_167_0000036_min.val; find it manually or delete filelist.txt to continue
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: Previous generation missing
ERROR: [001.001] {trajtools.c, line 3512} Unable to open trajectory distribution file xxxxxxxx_protein_196.trj
FATAL ERROR: [002.003] {foldtrajlite2.c, line 5307} Unable to read trajectory distribution xxxxxxxx_protein_196, please create a new one

[Keller]

Well, i think this is the kind of a prev gen missing error, that is caused by a server slowdown ...
try to start the client with the argument -purgeuploadlist 1 (make a backup before) and start it than again ... normally this should help ...
@howard: cant you purge the uploadlist automatically or tell the client if there is one generation too much or one missing (if theres one generation too much (for example: already received but not deleted by the client) it would be great if the client deletes that one automatically.

[Chaser]

hi howard!

i had one folder that crashed with the prev. gen. missing error.
you now, that i tried to upload it once...
shall i upload again or do you have now everything you need?

i dont mind!

bye
Chaser

[cygnussphere]

Originally posted by Keller
Well, i think this is the kind of a prev gen missing error, that is caused by a server slowdown ...
try to start the client with the argument -purgeuploadlist 1 (make a backup before) and start it than again ... normally this should help ...
@howard: cant you purge the uploadlist automatically or tell the client if there is one generation too much or one missing (if theres one generation too much (for example: already received but not deleted by the client) it would be great if the client deletes that one automatically.

This looks to me like this upload was "cut off" as he makes referance to in the first post of this thread. Does it make a differance if its one set being "cut off" in the middle of the upload or 100 sets? It still results in the missing previouse generation error which is what we are dealing with. :dunno:
I did run purgeupload 1 before I posted and it did make the client run again but the client had set idle for 8 hours thats the real beef here.::trash:
I do like your idea of the client running the -purgeuploadlist 1 automatically under these circumstances. At least the client would be giving a chance to start again in stead of sitting dead in the water until it is discovered. :scratch:

:tempted:

:cheers:

[Brian the Fist]

As for the auto-running purge uploadlist, I am hesitant to allow the client to automatically delete things, for obvious reasons.

The missing last generation error I am referring to in this post is in fact the message from the server (error #910). The error above is a bug in the client, because a file on disk is missing. This does not indicate that anything is missing on the server.

Apparently this client bug still exists however. So Cyguns, if possible please post a ZIP of the errored directory somewhere I could grab it, or e-mail filelist.txt, foldit.bat and a directory listing (i.e. output if 'dir') to [email protected] Thanks

[IronBits]

error #910 wouldn't happen to exit with a specfic errorlevel now would it? ;)
/me runs off ducking

[Chaser]

shall i upload the file again or not???? :Pokes: :Pokes:

[HaloJones]

Just got this:


========================[ Aug 31, 2003 6:47 PM ]========================
ERROR: [000.000] {foldtrajlite2.c, line 4539} Warning during upload: STATUS 910 MISSING PREVIOUS OR ILLEGAL GENERATION


========================[ Aug 31, 2003 6:49 PM ]========================
ERROR: [000.000] {foldtrajlite2.c, line 2101} Sun Aug 31 18:49:16 2003
Unable to check server status
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: STATUS 902 UNRECOGNIZED FILE TYPE

========================[ Aug 31, 2003 6:50 PM ]========================
FATAL ERROR: [000.000] {foldtrajlite2.c, line 1462} Upload list has been tampered with, please delete filelist.txt and try again


Trying to upload, there was a quick message about I/O error, insufficient space, then I got the above.

Now the filelist.txt is empty and I have 243 generations with no way to upload. Anybody?

[cygnussphere]

Originally posted by Brian the Fist
As for the auto-running purge uploadlist, I am hesitant to allow the client to automatically delete things, for obvious reasons.

The missing last generation error I am referring to in this post is in fact the message from the server (error #910). The error above is a bug in the client, because a file on disk is missing. This does not indicate that anything is missing on the server.

Apparently this client bug still exists however. So Cyguns, if possible please post a ZIP of the errored directory somewhere I could grab it, or e-mail filelist.txt, foldit.bat and a directory listing (i.e. output if 'dir') to [email protected] Thanks

The next time I incounter this I will zip and send. I had long since run purgeupload list and sent it back to folding.:thumbs:

:tempted:

:cheers:

[Brian the Fist]

Originally posted by HaloJones
Just got this:



Trying to upload, there was a quick message about I/O error, insufficient space, then I got the above.

Now the filelist.txt is empty and I have 243 generations with no way to upload. Anybody?

If your disk got full and filelist is size zero (check for filelist.txt.tmp too, this one can be renamed), then your datasets are essentially lost, yes.

[Brian the Fist]

Originally posted by HaloJones
Just got this:


========================[ Aug 31, 2003 6:47 PM ]========================
ERROR: [000.000] {foldtrajlite2.c, line 4539} Warning during upload: STATUS 910 MISSING PREVIOUS OR ILLEGAL GENERATION


========================[ Aug 31, 2003 6:49 PM ]========================
ERROR: [000.000] {foldtrajlite2.c, line 2101} Sun Aug 31 18:49:16 2003
Unable to check server status
ERROR: [000.000] {foldtrajlite2.c, line 4616} Error during upload: STATUS 902 UNRECOGNIZED FILE TYPE

========================[ Aug 31, 2003 6:50 PM ]========================
FATAL ERROR: [000.000] {foldtrajlite2.c, line 1462} Upload list has been tampered with, please delete filelist.txt and try again


Trying to upload, there was a quick message about I/O error, insufficient space, then I got the above.

Now the filelist.txt is empty and I have 243 generations with no way to upload. Anybody?

Please see the very first post of the thread for a description of the problem which I have alledgedly fixed.

[Admiral]

ERROR: [000.000] {foldtrajlite2.c, line 4476} Cannot find structure from previous generation .\mf2crzys_0_mf2crzys_protein_1_0000040_min.val; find it manually or delete filelist.txt to continue
ERROR: [000.000] {foldtrajlite2.c, line 4654} Error during upload: Previous generation missing

========================[ Sep 12, 2003 12:24 PM ]========================
ERROR: [000.000] {foldtrajlite2.c, line 4476} Cannot find structure from previous generation .\mf2crzys_0_mf2crzys_protein_1_0000040_min.val; find it manually or delete filelist.txt to continue
ERROR: [000.000] {foldtrajlite2.c, line 4654} Error during upload: Previous generation missing

========================[ Sep 12, 2003 12:26 PM ]========================
ERROR: [000.000] {foldtrajlite2.c, line 4476} Cannot find structure from previous generation .\mf2crzys_0_mf2crzys_protein_1_0000040_min.val; find it manually or delete filelist.txt to continue
ERROR: [000.000] {foldtrajlite2.c, line 4654} Error during upload: Previous generation missing

========================[ Sep 12, 2003 12:26 PM ]========================
ERROR: [000.000] {foldtrajlite2.c, line 4476} Cannot find structure from previous generation .\mf2crzys_0_mf2crzys_protein_1_0000040_min.val; find it manually or delete filelist.txt to continue
ERROR: [000.000] {foldtrajlite2.c, line 4654} Error during upload: Previous generation missing

deleting filelist.txt or using -purgelist 1 didn't do the job :(

[Paratima]

1. If you delete filelist.txt, it's over (unless you saved a copy). You can clean the all the fold*.bz2 files and the yourhandle*.* files and start over from zero.

2. Before you go to the extreme of (1), try using the -purgelist 1 several times. Maybe even many times. If your work-files really got borked, you may be able to save half of them this way. Better than losing them all? ;)

[Admiral]

done it 20 times, still shows
Checking for newer version...
Uploading fileset 1/81 from last run to server...
Previous generation missing

[Pascal]

I also had this problem several times. Up to now I do not have any problems, because I'm using the Kerio Personal Firewall for permitting and denying internet access.

The normal way for me to exit the client iis deleting the .lock-file and waiting, until the cmd.exe window shuts down.

you should not run any other DC client on higher priority - and if you use any antivirus software, you might have to way a bit longer.

@Howard Feldman:

Perhaps it is a shutdown problem of the client, if you shutdown via pressing 'q'. Try sleep() - found in time.h - or say, that stopping via deleting the .lock-file is the better way.

[tpdooley]

when I used it, I ended up having to type in "foldtrajlite.exe -purgeuploadlist x" (where x can be any number from 1 to 250)

if he's getting previous generation missing errors now, it's time to get rid of all the stored files "foldtrajlite.exe -purgeuploadlist 9999" is said to do that.. and then nuke filelist.txt


You don't get points for uploading tons of post-missing generations - so it's best to nuke 'em and start over from 0 - otherwise you waste the time getting to gen 250.

(If you have enough stored generations that they cross the gen 250 boundary and start over.. let it finish uploading the missing generations.. and you'll start getting points for the next Generation 0 onwards.. :)

[Brian the Fist]

Actually, it is best that you SAVE your entire directory, and put it somewhere we can get it (we'll try to get anonymous FTP access open somewhere once we get security issues ironed out). Then we can analyze the problem and hopefully fix the problem if it still exists. Anyone receiving this or other errors with the latest protein and client, please contact us at [email protected] with info, and help us help you. Thanks

[sheriar]

Hi Howard,

I was doing just fine on uploading from all three PCs. But suddenly from yesterday two of them won't up load and give the "last gen missing" error. How do I fix it? Will I get credit for the same when you switch over to a new protein t'mrow??

:help: :trash: