Advanced search

Message boards : Graphics cards (GPUs) : Update on issue with priority changes in app 6.14

Author Message
Qazwaplol
Send message
Joined: 1 May 11
Posts: 5
Credit: 11,472,593
RAC: 0
Level
Pro
Scientific publications
watwatwatwatwatwat
Message 21553 - Posted: 29 Jun 2011 | 12:49:36 UTC

Hi there,

Since the thread on 6.14 is closed I post it here.
"http://www.gpugrid.net/forum_thread.php?id=2545"

Could you give me an update on the issue's with the new higher priority with the 6.14 tasks?

In a case of great timing I switched to Einstein@home at the time the new tasks came out, so did not notice it back then. Just switched back to GPUGRID to find an extremely sluggish response from all running applications.

Currently dropped all GPUGRID tasks and switched back again to Einstein.


You made a mistake with the above normal priority, thats ok no problem. Been there, done that ;).

But when can we expect new tasks with a correct priority (idle or below normal) that does not prevent any user run application from functioning?

Thanks,

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 386
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21556 - Posted: 29 Jun 2011 | 14:32:27 UTC - in response to Message 21553.

You can solve this problem with a 3rd party priority changer tool. See this message.

Qazwaplol
Send message
Joined: 1 May 11
Posts: 5
Credit: 11,472,593
RAC: 0
Level
Pro
Scientific publications
watwatwatwatwatwat
Message 21558 - Posted: 29 Jun 2011 | 15:20:03 UTC
Last modified: 29 Jun 2011 | 15:44:43 UTC

I know I can manually set the priority back to something lower, and yes there are tools that you can use to automate it. But that is not a solution to the problem, merely a workaround.

A workaround a participant/volunteer or whatever you wish to name the people running GPUGRID should not have to use.


Using the above normal priority goes against the main principal of all distributed computing projects, the usage of idle/unused computing power. This is fine if you have dedicated machines solely running GPUGRID but not for regular situations.


Sure the setting will ensure a higher performance, simply by making sure GPUGRID takes priority over all other applications except a few OS processes. Then make it a recommendation for those users with a dedicated machine not running anything else to set this by hand or 3rd party tool in the FAQ: Best configurations for GPUGRID. The way it is now is just wrong

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21559 - Posted: 29 Jun 2011 | 16:17:30 UTC - in response to Message 21558.
Last modified: 29 Jun 2011 | 16:21:56 UTC

I agree with Qazwaplol. Setting the priority higher than idle or below normal is wrong. It defys the basic BOINC philosophy of using spare CPU cycles and it's a blatant hijacking of resources. People who install BOINC do so on the assumption that only spare cycles will be used because that's how BOINC is advertised at the BOINC website and everywhere else. For GPUgrid to do otherwise is a fraud and abuse of the trust of volunteers.

As Qazwaplol said, those who want the task to run with higher priority can do so via third party software. Volunteers running dedicated crunchers don't need to do anything since the task(s) will get nearly all the CPU time anyway.

The more I learn about this project the less I like it. There is also the problem with WUs being resent before the 5 day deadline passes.

To those of you who say GPUgrid is not the right project for me I say no, GPUgrid is not right for BOINC.

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 2343
Credit: 16,201,255,749
RAC: 386
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21560 - Posted: 29 Jun 2011 | 18:02:20 UTC - in response to Message 21559.

While I do agree with both of you to some extent, I have to note that there was a beta testing phase with above normal priority, and no such problems were reported. That's why it went to production phase, then complaints showed up. To fix this, in the future the priority class will be set differently on the GPU attached to the display. BTW it should have been done by now.

Profile skgiven
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21561 - Posted: 29 Jun 2011 | 18:30:08 UTC - in response to Message 21559.

The tasks should run well at Normal priority, without causing lag. I'm sure the team will get round to fixing this when they get the chance. In the long run we want to have the choice to set priority to Above Normal via Boinc. Ideally this would be card specific, as the lag is only due to the monitor usage; having it high on a second card would not result in lag.

I will not be adding the afore mentioned 3rd party tool to the Recommended settings; this is a temporary work around only. There has been plenty of discussion about its use in the past as an alternative to the recommended settings. Long term, we want to control this through Boinc.

It is necessary for GPU tasks to run at some level above low. In the past Below Normal was used but this slowed many GPUGrid tasks down; mostly because CPU tasks were using too many CPU resources (despite being low priority). This is generally worse on HT systems with mid-ranged cards, and probably worse on Vista and W7 than on XP or Linux.

There is also the problem with WUs being resent before the 5 day deadline passes.

This was changed from 2days to 3days to please the masses, including you. In my opinion this is sufficient, and extends the useful life of many cards.

There is an arguement to say that GPUGrid would be better off with it's own manager, but for different reasons (Settings mostly); the same CPU tasks could still interfeer with the GPU tasks if they were controlled by different managers. As I explained in previous posts the project is now in high production mode rather than development mode.

Qazwaplol
Send message
Joined: 1 May 11
Posts: 5
Credit: 11,472,593
RAC: 0
Level
Pro
Scientific publications
watwatwatwatwatwat
Message 21562 - Posted: 29 Jun 2011 | 22:00:17 UTC - in response to Message 21560.

While I do agree with both of you to some extent, I have to note that there was a beta testing phase with above normal priority, and no such problems were reported. That's why it went to production phase, then complaints showed up. To fix this, in the future the priority class will be set differently on the GPU attached to the display. BTW it should have been done by now.


Actually, I did check all those posts you mentioned which is why I started this thread.

It took 2 days to change the high priority (that didn't work for 2 out of 4 testers) to above_normal (with only 1 reply), since then 2 weeks have gone by with no update. Apart from a confirmation on the 16th that the setting will be changed.

Altough it would be nice I'm not requesting it to be fixed right away. But merely a timeframe in which to expect it.

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21566 - Posted: 30 Jun 2011 | 21:12:55 UTC - in response to Message 21561.
Last modified: 30 Jun 2011 | 21:16:23 UTC

It is necessary for GPU tasks to run at some level above low.


The necessity of working within the basic BOINC philosophy takes precedence over the concerns of this project. That philosophy is to run science apps at lower priority. Higher priority apps should never even make it into beta test to see if the unwitting, dirty unwashed masses will catch on to the fact that GPUgrid is making their computer sluggish. OF COURSE they're gonna find out eventually, if not in beta test.

The way to get the apps running at higher priority is to ask the volunteers to do so via 3rd party software, upcoming features in BOINC or whatever. And if you have to wait for those features to be coded into BOINC then so be it, that's just the way things work and sometimes life sucks. The way it's being done now is cheap, underhanded trickery fit only for rogue projects. Respect the fact that you are a GUEST on your volunteers' computer not the lord and master.

There is also the problem with WUs being resent before the 5 day deadline passes.


This was changed from 2days to 3days to please the masses, including you.


Huh? Read my posts in that thread. I didn't ask for 3 days. I clearly said I don't care what the deadline is, the main concern is that there should be only one deadline. Currently there are 2 deadlines: one where the task is resent (3 days now) and another where the cruncher no longer receives credit (5 days).

There is an arguement to say that GPUGrid would be better off with it's own manager, but for different reasons (Settings mostly); the same CPU tasks could still interfeer with the GPU tasks if they were controlled by different managers.


And GPUgrid wants to benefit from the work already put into BOINC. That means GPUgrid needs to play by the rules already established. Be part of the community or be a rogue and get tossed.

As I explained in previous posts the project is now in high production mode rather than development mode.


I don't care how many times you explain it or what excuses you make, excuses like we're in high production, you best not break the rules else someone will blab it all over the BOINC community and the project will see it's production not so high and mighty. It's happened before and it can happen again. Also, most projects are continually doing development even when in production. I doubt this project can be any different.

zombie67 [MM]
Avatar
Send message
Joined: 16 Jul 07
Posts: 207
Credit: 1,729,151,456
RAC: 4,463,943
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21567 - Posted: 1 Jul 2011 | 0:55:19 UTC

I seem to recall that I read on the mailing list that this priority issue would be fixed when GDF comes back. Is this true? When does he come back?

And yeah, the re-issue and due dates should always be the same. It's not fair to tell someone that they have 5 days (for example) to return a task, and then re-issue it earlier. It sets them up to not get awarded credit. Not to mention a waste of time and energy.
____________
Reno, NV
Team: SETI.USA

Betting Slip
Send message
Joined: 5 Jan 09
Posts: 670
Credit: 2,498,095,550
RAC: 0
Level
Phe
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21568 - Posted: 1 Jul 2011 | 6:42:30 UTC - in response to Message 21566.
Last modified: 1 Jul 2011 | 7:05:54 UTC

I would have given your post a plus Dagorath but they have disabled that capability.

You are of course correct with all the points you make about playing by the rules of BOINC.

I personally, am getting fed up of changing priority on the 6.14 app and a lot of people will be put off by it affecting the performance of their computer so it will all end in loss of active members and any increase in performance will be more than negated.

The main point i would like to make is that I find the 6.14 app significantly faster even with priority set to below normal thus making such a change unnecessary.

I understand that most computers are bady configured and working below their potential, however, these systems usually belong to people who know nothing of process priorities or computers and more to the point, don't want to know. It is wrong to mess with priorities to obtain more resource from these already sub-optimal machines.

I also think the proposed fix is wrong, that is to only lower the priority of WU's running on device-0. I think this will also come back and bite GPUG in the ass.

This is already a small project in BOINC terms and that should tell the developers something. The people running this project long term have knowledge of their systems, many with multiple graphics cards. These people will actively get the best performace out of their machines either because they know how or will find out how by visiting fora and asking questions.

The devolopers of this project need to make what they want clear.

1) What is the lowest card (and driver version) allowed, notice I say allowed not recommended.
2) One clear deadline.
3) HT, on/off, because most people use HT to get more throughput on cpu projects or simply because it was on by default and don't realise the pro's and con's of HT. A 4 core processor running 8 projects will obviously become "cache and bus bound" and slow down the machine.

When people know what you expect they'll either join or not.

Please remember this is an elite project requiring investment in the higher end cards and systems, not a £399 machine bought from PC World with integrated graphics and cheap components which, do not always have PCI-E expansion slots to upgrade graphics even if they wanted to.

I could go on but you can see where this is going.

Know your users/potential users and their machines.

EDIT TO ADD

It is pitiful that I, with such a small contribution can be ranked 67th highest user. This should also tell you something. Get your act together GPUG.

If this post sounds overly aggresive to some I'm sorry but like Dagorath (I think) I hate wooly thinking and compromise which leads to misunderstanding and disappointment.
____________
Radio Caroline, the world's most famous offshore pirate radio station.
Great music since April 1964. Support Radio Caroline Team -
Radio Caroline

Profile skgiven
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21569 - Posted: 1 Jul 2011 | 10:14:28 UTC - in response to Message 21567.
Last modified: 1 Jul 2011 | 12:50:39 UTC

And yeah, the re-issue and due dates should always be the same. It's not fair to tell someone that they have 5 days (for example) to return a task, and then re-issue it earlier. It sets them up to not get awarded credit. Not to mention a waste of time and energy.

zombie67 [MM], the reissue time was recently moved to 3days, its not variable. You do get credit after 3days and up to 5days.

1) What is the lowest card (and driver version) allowed, notice I say allowed not recommended.
2) One clear deadline.
3) HT, on/off, because most people use HT to get more throughput on cpu projects or simply because it was on by default and don't realise the pro's and con's of HT. A 4 core processor running 8 projects will obviously become "cache and bus bound" and slow down the machine.

1) There is no minimum card. While the GPU spec is obviously a factor, how long the system is on for is more significant. The operating system is also important as is the rest of the system (CPU especially). Some people can also overclock by 20% and there are many non-reference GPU's, so do you try to factor that in as well? There are also different tasks and from time to time the applications change. Even drivers can change the performance (even when they work well). What about the people that don't configure their system according to recommended settings. How do you even begin to account for them. Some older cards might still work for some people but not others. Should you exclude all of these or where do you draw the line? I think there are too many variables to state exactly what GPU would definitely be the minimum card. So all we can do is make recommendations.
In my opinion (and everyone is entitled to have one), if you cannot finish and return one of the smaller tasks inside 3.25days then it would be a waste of time using that GPU here with whatever settings and other hardware you have. Others might think it should be 24h, 48h or even 5days.

Even before the present apps were released I posted the minimum drivers. You can find them in the FAQ - Minimum GPU Driver Requirements page and some of my posts. GDF also posted these when releasing the new apps.

2)The deadline is and has been 5days for years. Resend times are now 3days (really about 3.25days by the time they go through the system and get sent). This is now closer to the deadline. So perhaps you are arguing for the deadline to be changed to 3.25days. On the face of it, I would agree, but I don't know all the facts, it has not been tested, and its not my shout. Anyway that's a discussion for another thread, and it has been raised numerous times in the past.

3)You can do more CPU work with HT on, and using HT impacts less when you free up one thread rather than a full core. If you feel that just leaving one Thread free still leaves the system somewhat unresponsive from time to time (due to the CPU tasks being run), free up another thread; you would still be doing more work using 6 from 8 threads than using 3 from 4 cores.

Profile GDF
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 14 Mar 07
Posts: 1957
Credit: 629,356
RAC: 0
Level
Gly
Scientific publications
watwatwatwatwat
Message 21571 - Posted: 2 Jul 2011 | 9:10:27 UTC - in response to Message 21569.

I will be fixing this first thing next Monday.

gdf

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1112
Credit: 6,162,416,256
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 21597 - Posted: 4 Jul 2011 | 23:50:07 UTC
Last modified: 4 Jul 2011 | 23:50:57 UTC

Many projects run GPU tasks at higher priority. Since the apps use very little CPU this allows complete GPU utilization and still uses almost no CPU time. Boosting priority on some GPU apps allows them to run at 99% GPU while still using negligible CPU and still allowing a responsive system. Of course as always YMMV depending on what other apps are running and on the skill of the GPU app programmer.

Qazwaplol
Send message
Joined: 1 May 11
Posts: 5
Credit: 11,472,593
RAC: 0
Level
Pro
Scientific publications
watwatwatwatwatwat
Message 21612 - Posted: 5 Jul 2011 | 17:09:42 UTC

Thanks GDF

ben
Send message
Joined: 27 Oct 08
Posts: 19
Credit: 22,658,253
RAC: 0
Level
Pro
Scientific publications
watwatwatwatwatwatwatwat
Message 21671 - Posted: 11 Jul 2011 | 20:58:00 UTC - in response to Message 21612.

well i didnt read all the posts but to say gpugrid isnt right for boinc, i think you should consider that it works for schizophrenia and so what is boinc to the 24 million schizophrenic people in the world except gpugrid.

Post to thread

Message boards : Graphics cards (GPUs) : Update on issue with priority changes in app 6.14

//