Message boards : Number crunching : New NOELIA Longruns
| Author | Message |
|---|---|
|
HA-SOFT, s.r.o. Send message Joined: 3 Oct 11 Posts: 100 Credit: 5,879,292,399 RAC: 0 Level  Scientific publications      | |
|
All new NOELIA longrun tasks errored out on my pc's immediately after start. | |
ID: 26446 | Rating: 0 | rate:
 /   Reply
Quote
| |
|
JugNut Send message Joined: 27 Nov 11 Posts: 11 Credit: 1,021,749,297 RAC: 0 Level  Scientific publications  | |
All new NOELIA longrun tasks errored out on my pc's immediately after start. Me too, exactly the same. All NOELIA's fail so far. Both CUDA31 & CUDA42 NOELIA'a All other WU's CUDA42 work fine. GTX580, win7 x64 | |
| ID: 26449 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Bedrich Hajek Send message Joined: 28 Mar 09 Posts: 485 Credit: 11,133,622,824 RAC: 15,518,739 Level  Scientific publications | |
|
What is wrong with these units? They have all crashed. | |
| ID: 26451 | Rating: 0 | rate:
/ Reply
Quote
| |
|
flashawk Send message Joined: 18 Jun 12 Posts: 297 Credit: 3,572,627,986 RAC: 0 Level  Scientific publications | |
|
Same here, I've had 3 error out, 2 on a GTX 670 and 1 on a GTX 560 with another queued right now. | |
| ID: 26452 | Rating: 0 | rate:
/ Reply
Quote
| |
|
So for, 3 out of 3 failed on a GTX 275, Windows XP Pro 32, cuda31 tasks | |
| ID: 26454 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Carlos Augusto Engel Send message Joined: 5 Jun 09 Posts: 38 Credit: 2,880,758,878 RAC: 0 Level  Scientific publications | |
|
Error in all NOELIA's tasks on GTX 580 and GTX 570. | |
| ID: 26456 | Rating: 0 | rate:
/ Reply
Quote
| |
 [PUGLIA] kidkidkid3 Send message Joined: 23 Feb 11 Posts: 98 Credit: 1,285,571,653 RAC: 2,051,418 Level Scientific publications | |
|
Hi Noelia, | |
| ID: 26461 | Rating: 0 | rate:
/ Reply
Quote
| |
|
MarkJ  Volunteer moderator Volunteer tester Send message Joined: 24 Dec 08 Posts: 738 Credit: 200,909,904 RAC: 0 Level  Scientific publications  | |
|
Just had a look at my tasks. Looks like all the sh2_fragment long work units are failing for everybody, not just me. Obviously a bad batch of work units seeing as everybody are failing them. | |
| ID: 26465 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Bedrich Hajek Send message Joined: 28 Mar 09 Posts: 485 Credit: 11,133,622,824 RAC: 15,518,739 Level Scientific publications | |
|
These NOELIA_sh2fragment units are all crashing with the same error message: | |
| ID: 26468 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Bedrich Hajek Send message Joined: 28 Mar 09 Posts: 485 Credit: 11,133,622,824 RAC: 15,518,739 Level Scientific publications | |
|
Just completed the first NOELIA_sh2fragment unit successfully. See link below: | |
| ID: 26492 | Rating: 0 | rate:
/ Reply
Quote
| |
SMTB1963  Send message Joined: 27 Jun 10 Posts: 38 Credit: 524,420,921 RAC: 0 Level  Scientific publications | |
Whatever you did to fix the bug, worked. Me too!  | |
| ID: 26494 | Rating: 0 | rate:
/ Reply
Quote
| |
Stoneageman  Send message Joined: 25 May 09 Posts: 224 Credit: 34,057,374,498 RAC: 186 Level Scientific publications | |
|
Just had a failure after 7hrs of a NOELIA run9 replica21 task on a reliable (up to now) card. The card is now working ok on a PAOLA task. | |
| ID: 26495 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Bedrich Hajek Send message Joined: 28 Mar 09 Posts: 485 Credit: 11,133,622,824 RAC: 15,518,739 Level Scientific publications | |
Just completed the first NOELIA_sh2fragment unit successfully. See link below: Two more of these units completed successfully. See links below: http://www.gpugrid.net/workunit.php?wuid=3601862 http://www.gpugrid.net/workunit.php?wuid=3601963 Though one took about 16 hours to complete, while the other two took about 9 to 10 hours. | |
| ID: 26496 | Rating: 0 | rate:
/ Reply
Quote
| |
|
HA-SOFT, s.r.o. Send message Joined: 3 Oct 11 Posts: 100 Credit: 5,879,292,399 RAC: 0 Level Scientific publications | |
Just had a failure after 7hrs of a NOELIA run9 replica21 task on a reliable (up to now) card. The card is now working ok on a PAOLA task. Exactly the same on my GTX580 under Linux. | |
| ID: 26498 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Stoneageman Send message Joined: 25 May 09 Posts: 224 Credit: 34,057,374,498 RAC: 186 Level Scientific publications | |
|
and I've another failed after 7 hrs, as it did before me. Considering aborting all NOELLA tasks now :-( | |
| ID: 26500 | Rating: 0 | rate:
/ Reply
Quote
| |
Considering aborting all NOELLA tasks now :-( Me, too...I thought maybe I was okay after this one finished successfully: run10_replica21-NOELIA_sh2fragment_fixed-0-4-RND7749_0 But then the one I had queued up next crashed after 14-hours plus: run9_replica1-NOELIA_sh2fragment_fixed-0-4-RND6355_1 Both had the "MDIO: cannot open file 'restart.coor'" message in the stderr output. ____________ | |
| ID: 26502 | Rating: 0 | rate:
/ Reply
Quote
| |
Retvari Zoltan Send message Joined: 20 Jan 09 Posts: 2343 Credit: 16,249,865,968 RAC: 4,089,892 Level Scientific publications | |
Both had the "MDIO: cannot open file 'restart.coor'" message in the stderr output. This is a false error message. It appears in every task, even in the successful ones. BTW these "fixed" NOELIA tasks are running fine on all of my hosts. Perhaps you should lower your GPU clock (calibrate your overclocking settings to the more demanding CUDA 4.2 tasks, because these extra long tasks are even more demanding). | |
| ID: 26504 | Rating: 0 | rate:
/ Reply
Quote
| |
Perhaps you should lower your GPU clock (calibrate your overclocking settings to the more demanding CUDA 4.2 tasks, because these extra long tasks are even more demanding). Even if I'm running at stock speeds? Other than two NOELIA's, I've had few, if any, comp errors with this card that weren't attributable to "bad" tasks. ____________ | |
| ID: 26508 | Rating: 0 | rate:
/ Reply
Quote
| |
|
MarkJ Volunteer moderator Volunteer tester Send message Joined: 24 Dec 08 Posts: 738 Credit: 200,909,904 RAC: 0 Level Scientific publications | |
|
So far all the sh2fragment_fixed have been working on my two GTX670's. Make sure the work units have "fixed" in their name, otherwise they are probably the bad ones we already know about. | |
| ID: 26509 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Retvari Zoltan Send message Joined: 20 Jan 09 Posts: 2343 Credit: 16,249,865,968 RAC: 4,089,892 Level Scientific publications | |
Perhaps you should lower your GPU clock (calibrate your overclocking settings to the more demanding CUDA 4.2 tasks, because these extra long tasks are even more demanding). Yes. But if you are running your cards at stock speeds, I'd rather try to increase the GPU core voltage by 25mV (if your GPU temperatures allows to do so). | |
| ID: 26511 | Rating: 0 | rate:
/ Reply
Quote
| |
|
Retvari Zoltan Send message Joined: 20 Jan 09 Posts: 2343 Credit: 16,249,865,968 RAC: 4,089,892 Level Scientific publications | |
BTW these "fixed" NOELIA tasks are running fine on all of my hosts. One of these workunits was stuck on my GTX590 for 7 hours. The progress indicator did not increased since my previous post. A system restart helped. Bye-bye 24 hours bonus.... | |
| ID: 26512 | Rating: 0 | rate:
/ Reply
Quote
| |
dskagcommunity Send message Joined: 28 Apr 11 Posts: 456 Credit: 817,865,789 RAC: 0 Level  Scientific publications | |
|
Soon my first fixed NOELIA Unit is finished on cuda31. Unfortunaly it is the first WU on my 285GTX that need more then 24hours (25hours ;)) to compute :( Bye-bye 24 hours bonus.... But it seems to work here.. (this one, we will see on the next ones ^^) | |
| ID: 26513 | Rating: 0 | rate:
/ Reply
Quote
| |
|
And another one bites the dust after almost 7 hours: | |
| ID: 26520 | Rating: 0 | rate:
/ Reply
Quote
| |
|
dskagcommunity Send message Joined: 28 Apr 11 Posts: 456 Credit: 817,865,789 RAC: 0 Level Scientific publications | |
|
Hm my second one worked too. | |
| ID: 26521 | Rating: 0 | rate:
/ Reply
Quote
| |
|
MarkJ Volunteer moderator Volunteer tester Send message Joined: 24 Dec 08 Posts: 738 Credit: 200,909,904 RAC: 0 Level Scientific publications | |
Soon my first fixed NOELIA Unit is finished on cuda31. Unfortunaly it is the first WU on my 285GTX that need more then 24hours (25hours ;)) to compute :( Bye-bye 24 hours bonus.... But it seems to work here.. (this one, we will see on the next ones ^^) Dskagcommunity you might want to update to 301.42 drivers. They still should work on your GTX285. That way you can get the speed advantages of the cuda 4.2 app. ____________ BOINC blog | |
| ID: 26522 | Rating: 0 | rate:
/ Reply
Quote
| |
|
dskagcommunity Send message Joined: 28 Apr 11 Posts: 456 Credit: 817,865,789 RAC: 0 Level Scientific publications | |
|
I downgrade them because 42 runs much slower on 285gtx. Up to 15000secs! Included some wus that erroring because i dont want to change anything of the stockclocked cardsettings. So i prevere to compute one sort of wus in over 24hours but the rest computes for sure and secure in good times. | |
| ID: 26523 | Rating: 0 | rate:
/ Reply
Quote
| |
|
MarkJ Volunteer moderator Volunteer tester Send message Joined: 24 Dec 08 Posts: 738 Credit: 200,909,904 RAC: 0 Level Scientific publications | |
I downgrade them because 42 runs much slower on 285gtx. Up to 15000secs! Included some wus that erroring because i dont want to change anything of the stockclocked cardsettings. So i prevere to compute one sort of wus in over 24hours but the rest computes for sure and secure in good times. I wonder if you were getting the downclock bug, which only appears if the cards are running hot (but not overheating). Its supposedly fixed in the 304 (beta) drivers but I have heard of issues with running other project apps (Seti) with 304 drivers. What sort of temps is your GTX285 running at under load? ____________ BOINC blog | |
| ID: 26527 | Rating: 0 | rate:
/ Reply
Quote
| |
|
dskagcommunity Send message Joined: 28 Apr 11 Posts: 456 Credit: 817,865,789 RAC: 0 Level Scientific publications | |
|
79-80 degrees in a room with AC with manual set fan speed cos normal it would run with 90-92 that i found little to much for 24h operation. dont installin beta things. When there is a downclocking problem, then i hope 304 is soon available for stable release ^^ someone told me to raise gpu voltage a minimum to kill the errorthing but i dont want to touch these settings because i have only bad experience with such things. Ether it runs like it is from the factory or not ;) thats the ground why i dont buy any OC Cards. | |
| ID: 26528 | Rating: 0 | rate:
/ Reply
Quote
| |
|
MarkJ Volunteer moderator Volunteer tester Send message Joined: 24 Dec 08 Posts: 738 Credit: 200,909,904 RAC: 0 Level Scientific publications | |
79-80 degrees in a room with AC with manual set fan speed cos normal it would run with 90-92 that i found little to much for 24h operation. dont installin beta things. When there is a downclocking problem, then i hope 304 is soon available for stable release ^^ someone told me to raise gpu voltage a minimum to kill the errorthing but i dont want to touch these settings because i have only bad experience with such things. Ether it runs like it is from the factory or not ;) thats the ground why i dont buy any OC Cards. Yep that would be enough to trip the overheating bug. Well anyway at least you know why 301.42 doesn't work well for your config. Hopefully they'll sort out the issues with 304 and get a good one out the door soon. ____________ BOINC blog | |
| ID: 26532 | Rating: 0 | rate:
/ Reply
Quote
| |
|
My system is currently processing WU 3601638 which appears to now be at 41 hours elapsed and 61% completed. This appears likely to be 2 or 2.5 times longer than most units that my system has worked recently. Does this appear to be a WU that I should allow to run to completion, or is it indicating a problem. Seems that most WU of this type of had problems with immediate failures. Don't know if this is also a problem of a cuda31 process on my machine (which seems like it has been handling cuda42 work properly). | |
| ID: 26534 | Rating: 0 | rate:
/ Reply
Quote
| |
|
skgiven Volunteer moderator Volunteer tester  Send message Joined: 23 Apr 09 Posts: 3968 Credit: 1,995,359,260 RAC: 0 Level  Scientific publications | |
|
Presumably you mean this task: | |
| ID: 26548 | Rating: 0 | rate:
/ Reply
Quote
| |
Message boards : Number crunching : New NOELIA Longruns
