Advanced search

Message boards : Number crunching : Ghost Tasks

Author Message
Nick Name
Send message
Joined: 3 Sep 13
Posts: 53
Credit: 1,533,531,731
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 53646 - Posted: 13 Feb 2020 | 23:57:06 UTC

Over the last week I've had a few tasks that the server showed were in progress on one or more of my hosts, but that I never got. Right now I should have two "In Progress" according to the server, but I don't have them. This is pretty annoying as it means that host won't get more work until those tasks time out in five days, and of course work generation is slowed while those tasks are stuck in limbo until they can be resent. Is anyone else seeing this?
____________
Team USA forum | Team USA page
Join us and #crunchforcures. We are now also folding:join team ID 236370!

Keith Myers
Send message
Joined: 13 Dec 17
Posts: 1284
Credit: 4,923,706,959
RAC: 6,445,960
Level
Arg
Scientific publications
watwatwatwatwat
Message 53647 - Posted: 14 Feb 2020 | 0:14:27 UTC - in response to Message 53646.

No I haven't seen any sign of ghost work here. Every task the scheduler says I have been sent I have crunched and returned.

Nick Name
Send message
Joined: 3 Sep 13
Posts: 53
Credit: 1,533,531,731
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 53648 - Posted: 14 Feb 2020 | 19:57:21 UTC - in response to Message 53647.

Thanks for the reply. Apparently no one else is seeing this so it must be specific to me. I don't have an explanation for the previous ones, but I did have an internet outage of unknown length around the time of these latest ghosts so that must have caused it although I don't know why.

I will say that I've had a lot of trouble uploading the little work that I have been getting, I've been seeing stalled uploads and "file handler locked" messages when trying to return work. I don't see why the two problems should be related but maybe there's an underlying cause.
____________
Team USA forum | Team USA page
Join us and #crunchforcures. We are now also folding:join team ID 236370!

Pop Piasa
Avatar
Send message
Joined: 8 Aug 19
Posts: 252
Credit: 458,054,251
RAC: 0
Level
Gln
Scientific publications
watwat
Message 53934 - Posted: 17 Mar 2020 | 15:57:00 UTC - in response to Message 53646.

I show 4 ghost tasks since grosso zombied out on Friday the 13th. They showed up on the 14th or 15th of March. I also have a task stuck in validation since the 14th.

Nick Name
Send message
Joined: 3 Sep 13
Posts: 53
Credit: 1,533,531,731
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwat
Message 53939 - Posted: 18 Mar 2020 | 7:27:06 UTC

I've had a few more as well, not accounted for by local internet or network problems.
____________
Team USA forum | Team USA page
Join us and #crunchforcures. We are now also folding:join team ID 236370!

Pop Piasa
Avatar
Send message
Joined: 8 Aug 19
Posts: 252
Credit: 458,054,251
RAC: 0
Level
Gln
Scientific publications
watwat
Message 53941 - Posted: 18 Mar 2020 | 16:24:21 UTC

My guess is that grosso is doing it somehow, marking tasks as sent even though they timed out somewhere in the sending process or cache. They showed up for me during a time when there was a heavy backlog after a longish outage.
I recently added a second GPU to both my machines and both have non-identical GPU combinations. I wonder if that could be a factor.

Post to thread

Message boards : Number crunching : Ghost Tasks

//