Advanced search

Message boards : Multicore CPUs : QC tests for windows

Author Message
Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 732
Credit: 4,285,282
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 49817 - Posted: 8 Jul 2018 | 15:11:46 UTC
Last modified: 8 Jul 2018 | 16:29:29 UTC

I'm preparing some infrastructure for the Windows 64bit CPU app. There are some beta WUs out. They don't to actual calculations (for that we have to wait for the nontrivial psi4 port), but they do test the distribution system, dependencies, and so on.

Some are already coming back successful. The setup, if it works, will be completely native, not require VMs, nor the "linux subsystem". It will expand both the type of tasks we can distribute, and the available machines, of course.

In particular, I'd like to know
- whether it behaves well with "normal" unprivileged installations
- if there is an annoying "Anaconda" icon installed in the start menu

Thanks!

Zalster
Avatar
Send message
Joined: 26 Feb 14
Posts: 57
Credit: 2,019,207,362
RAC: 4,615,481
Level
Phe
Scientific publications
watwatwat
Message 49818 - Posted: 9 Jul 2018 | 0:40:04 UTC - in response to Message 49817.

Can't seem to DL anything for my windows machine.

Must have been a quick short run.

Profile Retvari Zoltan
Avatar
Send message
Joined: 20 Jan 09
Posts: 1942
Credit: 12,280,400,519
RAC: 2,868,528
Level
Trp
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49819 - Posted: 9 Jul 2018 | 6:34:41 UTC - in response to Message 49818.

Zalster wrote:
Must have been a quick short run.

Toni wrote:
They don't to actual calculations (for that we have to wait for the nontrivial psi4 port), but they do test the distribution system, dependencies, and so on.

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 732
Credit: 4,285,282
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 49821 - Posted: 9 Jul 2018 | 8:43:48 UTC - in response to Message 49819.

There weren't many (approx 300), all of them in the "beta" queue. I need to fix simultaneous starts there too.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 96
Credit: 252,222
RAC: 512
Level

Scientific publications
wat
Message 49844 - Posted: 11 Jul 2018 | 9:32:17 UTC - in response to Message 49821.

Waiting for more windows consistent queue....

Dzordzik
Send message
Joined: 5 Feb 17
Posts: 2
Credit: 268,772,571
RAC: 507,795
Level
Asn
Scientific publications
wat
Message 49935 - Posted: 17 Jul 2018 | 19:14:55 UTC

Hi, something new? My 88 thread server is hungry for some native Win work. If want to help with testing, can let me know.

Profile [AF] fansyl
Send message
Joined: 26 Sep 13
Posts: 7
Credit: 753,043,612
RAC: 846,041
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwat
Message 49952 - Posted: 19 Jul 2018 | 8:37:12 UTC

I think the team is busy with Windows GPU application issues, see here for more details: https://www.gpugrid.net/forum_thread.php?id=4802

Richard Haselgrove
Send message
Joined: 11 Jul 09
Posts: 883
Credit: 1,726,038,170
RAC: 1,104,572
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 49953 - Posted: 19 Jul 2018 | 10:16:54 UTC - in response to Message 49952.

https://www.gpugrid.net/forum_thread.php?id=4802

Also, several members of staff are on vacation at the moment, so progress will be slow until they return.

[VENETO] boboviz
Send message
Joined: 10 Sep 10
Posts: 96
Credit: 252,222
RAC: 512
Level

Scientific publications
wat
Message 50146 - Posted: 30 Jul 2018 | 7:59:42 UTC - in response to Message 49953.

https://www.gpugrid.net/forum_thread.php?id=4802

Also, several members of staff are on vacation at the moment, so progress will be slow until they return.


Now gpu windows app seems to be resolved.
Waiting for September for windows cpu app...

Toby Broom
Send message
Joined: 11 Dec 08
Posts: 13
Credit: 134,452,043
RAC: 681,365
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 50436 - Posted: 8 Sep 2018 | 11:17:25 UTC

Is there any windows CPU WU's, I set everything to be enable but I get no tasks.

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 732
Credit: 4,285,282
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 50437 - Posted: 8 Sep 2018 | 11:36:12 UTC - in response to Message 50436.

Coming soon (on the QC_beta app initially).

Toby Broom
Send message
Joined: 11 Dec 08
Posts: 13
Credit: 134,452,043
RAC: 681,365
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 50445 - Posted: 8 Sep 2018 | 14:37:34 UTC

I got a few beta but they failed, looks like it was installing Python and minconda while trying to run another WU at the same time.

hopefully next round is good.

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 732
Credit: 4,285,282
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 50446 - Posted: 8 Sep 2018 | 14:45:46 UTC - in response to Message 50445.

Installing python (miniconda actually) is normal. It should be contained in their own boinc directories. Also multiple installations should wait for each other. There is something else I'm investigating.

Did you get any "visible" changes in the system?

Thanks

Toby Broom
Send message
Joined: 11 Dec 08
Posts: 13
Credit: 134,452,043
RAC: 681,365
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 50450 - Posted: 8 Sep 2018 | 22:19:24 UTC

I see the anaconda option in the start menu, but non of the task actually worked.

if I click it it does not work as path is wrong it has

C:\%windir%\System32\cmd.exe "/K" C:\ProgramData\BOINC\projects\www.gpugrid.net\miniconda\Scripts\activate.bat C:\ProgramData\BOINC\projects\www.gpugrid.net\miniconda

but %windir% = C:\windows so it actually resolves to c:\c\windows.

I see that it trys to update conda version but it didn't work as the reported version is still 4.5.4

I see these 2 errors:

Traceback (most recent call last):
File "C:\ProgramData\BOINC\slots\3\qmml3\lib\site-packages\psi4\__init__.py", line 55, in <module>
from . import core
ImportError: DLL load failed: The specified module could not be found.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "run.py", line 13, in <module>
import psi4
File "C:\ProgramData\BOINC\slots\3\qmml3\lib\site-packages\psi4\__init__.py", line 60, in <module>
raise ImportError("{0}".format(err))

I can see the deepdiff, jsonpickle, psi4 in the pkgs folder.

this was most common causes of error. one was

C:\ProgramData\BOINC\projects\www.gpugrid.net\miniconda\Scripts\conda install -m -y -p C:\ProgramData\BOINC\slots\1\qmml3 --override-channels -c gpugridbeta -c defaults --file requirements.txt
) 9>C:\ProgramData\BOINC\projects\www.gpugrid.net\miniconda.lock
The process cannot access the file because it is being used by another process.
17:08:33 (8180): install_miniconda.bat exited; CPU time 0.046875
17:08:33 (8180): app exit status: 0x1
17:08:33 (8180): called boinc_finish(195)

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 732
Credit: 4,285,282
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 50489 - Posted: 13 Sep 2018 | 8:36:38 UTC - in response to Message 50450.
Last modified: 13 Sep 2018 | 8:42:35 UTC

The QC Beta app now seems to be working (group name TST4). To do: workaround the creation of the annoying shortcut.

Toby Broom
Send message
Joined: 11 Dec 08
Posts: 13
Credit: 134,452,043
RAC: 681,365
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 50495 - Posted: 13 Sep 2018 | 17:45:30 UTC

Seems like they are working now. I see 100% cpu load, running 4x4cores.


Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 732
Credit: 4,285,282
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 50496 - Posted: 13 Sep 2018 | 18:05:44 UTC - in response to Message 50495.
Last modified: 13 Sep 2018 | 18:11:38 UTC

Great. Did you see "black windows" like command prompts?

Toby Broom
Send message
Joined: 11 Dec 08
Posts: 13
Credit: 134,452,043
RAC: 681,365
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 50497 - Posted: 13 Sep 2018 | 18:40:29 UTC

Didn't notice any :)

Profile [AF] fansyl
Send message
Joined: 26 Sep 13
Posts: 7
Credit: 753,043,612
RAC: 846,041
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwat
Message 50506 - Posted: 14 Sep 2018 | 11:22:18 UTC

3 UT validated on i7-3770 W10 host ! :-)

Toni
Volunteer moderator
Project administrator
Project developer
Project scientist
Send message
Joined: 9 Dec 08
Posts: 732
Credit: 4,285,282
RAC: 0
Level
Ala
Scientific publications
watwatwatwat
Message 50507 - Posted: 14 Sep 2018 | 12:24:27 UTC - in response to Message 50506.

Can someone give an eye on the cpu% of windows tasks? In particular, if you run only one task, does it limit itself to 4 threads?

Profile [AF] fansyl
Send message
Joined: 26 Sep 13
Posts: 7
Credit: 753,043,612
RAC: 846,041
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwat
Message 50509 - Posted: 14 Sep 2018 | 17:18:13 UTC
Last modified: 14 Sep 2018 | 17:19:27 UTC

After few minutes, CPU load is OK: see the picture !

captainjack
Send message
Joined: 9 May 13
Posts: 138
Credit: 951,578,780
RAC: 248,214
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 50512 - Posted: 14 Sep 2018 | 20:12:11 UTC

Just out of curiosity, my Linux PC has been receiving Quantum Chemistry, beta test v3.32 (mt). PC number 258077. Is that supposed to happen? I was under the impression that the beta test tasks were for windows only.

Jim1348
Send message
Joined: 28 Jul 12
Posts: 614
Credit: 1,199,451,727
RAC: 134,958
Level
Met
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 50513 - Posted: 14 Sep 2018 | 20:36:14 UTC - in response to Message 50512.

Just out of curiosity, my Linux PC has been receiving Quantum Chemistry, beta test v3.32 (mt). PC number 258077. Is that supposed to happen? I was under the impression that the beta test tasks were for windows only.

Same for me, but they ran OK, so they must be for Linux.

Toby Broom
Send message
Joined: 11 Dec 08
Posts: 13
Credit: 134,452,043
RAC: 681,365
Level
Cys
Scientific publications
watwatwatwatwatwatwatwatwatwatwat
Message 50535 - Posted: 17 Sep 2018 | 19:45:10 UTC

Is there any drivers in the package? I had some stability issues with my computer, which I never saw before. I had one bug check that indicated python as culprit, I doubt it but just checking.

Post to thread

Message boards : Multicore CPUs : QC tests for windows