Advanced search

Message boards : Number crunching : Linux live USB

Author Message
Profile MJH
Project administrator
Project developer
Project scientist
Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 35298 - Posted: 23 Feb 2014 | 23:29:39 UTC
Last modified: 24 Feb 2014 | 8:00:01 UTC

Hi gang,

Since many of you have expressed an interest in trying Linux, but don't know where to start, I've made a bootable live disk image for you to have a play with. To use it:

* First, catch your USB stick. It needs to be at least 8GB in size
* Next, download and unzip the live image from http://download.acellera.com/gpugrid/GPUGRID-Live.zip It is 1.7GB in size, 6GB uncompressed
* Check the md5sum of the download: 032c5685fb9834246cd101419b4e9b33 GPUGRID-Live.zip
* Put the disk image onto the USB stick. Use RAWrite to do this http://www.chrysocome.net/rawwrite . Recommendations for alternative tools greatly received.
* Reboot your PC. At the BIOS boot menu, select the USB drive

After a wee wait, you'll be dumped into an Ubuntu desktop session. The BOINC Mangler is installed, as are the Nvidia drivers. All you need to do is log in with your GPUGRID account and get crunching.

The image is a true live install - any changes that you make will be persistent. If you need sudo access, the password is 'gpugrid'.

Please report any problems with it in this thread.

Have fun!

Matt [/url]

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1112
Credit: 6,162,416,256
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35308 - Posted: 24 Feb 2014 | 7:08:03 UTC

Any chance you could add a version with both NVidia and AMD drivers?

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35310 - Posted: 24 Feb 2014 | 7:22:17 UTC - in response to Message 35298.
Last modified: 24 Feb 2014 | 7:29:57 UTC

I'm having trouble and I think maybe I got a corrupted download or something. I would just d/l it again but it took over 90 minutes to get the first copy so I don't want to tie up your obviously limited bandwidth for nothing. Do you have a SHA256 sum for the file so I can verify it please?

Also, how did you create the disk image? Is it just an existing Linux installation scraped off a disk and packed into a .img file? Do you have a link to some docs or a tutorial?

Never mind about the docs/tutorial on Linux .img files, I found it. Good ol' Google. A SHA256 or MD5 sum would be nice though so everyone can verify their download. Yes, it should not unzip if it's corrupted but mine seems to have, can't think of any other explanation for the weirdness I'm seeing.
____________
BOINC <<--- credit whores, pedants, alien hunters

Profile MJH
Project administrator
Project developer
Project scientist
Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 35312 - Posted: 24 Feb 2014 | 7:57:37 UTC - in response to Message 35308.


Any chance you could add a version with both NVidia and AMD drivers?


No, sorry. It's a monumental pain in the arse to make the Nvidia and AMD drivers co-exist in the same image. The only way to do it is to have the display configured for the AMD card, which would obviously not be much good for those majority with only Nvidia cards.

Matt

Profile MJH
Project administrator
Project developer
Project scientist
Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 35313 - Posted: 24 Feb 2014 | 8:00:31 UTC - in response to Message 35310.


Do you have a SHA256 sum for the file so I can verify it please?


md5sum GPUGRID-Live.zip
032c5685fb9834246cd101419b4e9b33 GPUGRID-Live.zip

Matt

Profile skgiven
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 23 Apr 09
Posts: 3968
Credit: 1,995,359,260
RAC: 0
Level
His
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35317 - Posted: 24 Feb 2014 | 10:18:03 UTC - in response to Message 35313.
Last modified: 24 Feb 2014 | 10:19:15 UTC

Haven't tried it yet, but what about Cool-bits and cc_config? Could it include a script to look for GPU's and add them to cool-bits (for fan control through NV Xserver), and could the cc_config file be automatically built? Most people struggle with both.
Thanks,
____________
FAQ's

HOW TO:
- Opt out of Beta Tests
- Ask for Help

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1112
Credit: 6,162,416,256
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35321 - Posted: 24 Feb 2014 | 14:41:08 UTC - in response to Message 35312.


Any chance you could add a version with both NVidia and AMD drivers?

No, sorry. It's a monumental pain in the arse to make the Nvidia and AMD drivers co-exist in the same image. The only way to do it is to have the display configured for the AMD card, which would obviously not be much good for those majority with only Nvidia cards.

Matt

That's the way it's done in Windows. The AMD card should be primary and run the monitor and whatever GPU project and the NVidia runs GPUGrid. Works great and no dummy plug needed. I estimate there are more people running this configuration than you think.

If I knew more about Linux I'd do it myself, but are any of the Linux gurus out there up to taking this image and adding AMD support with the AMD GPU as the primary and NVidia as the secondary?

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35325 - Posted: 24 Feb 2014 | 18:04:11 UTC - in response to Message 35321.


Any chance you could add a version with both NVidia and AMD drivers?

No, sorry. It's a monumental pain in the arse to make the Nvidia and AMD drivers co-exist in the same image. The only way to do it is to have the display configured for the AMD card, which would obviously not be much good for those majority with only Nvidia cards.

Matt

That's the way it's done in Windows. The AMD card should be primary and run the monitor and whatever GPU project and the NVidia runs GPUGrid. Works great and no dummy plug needed. I estimate there are more people running this configuration than you think.


I think Matt knows it and is just trolling you a little.

If I knew more about Linux I'd do it myself, but are any of the Linux gurus out there up to taking this image and adding AMD support with the AMD GPU as the primary and NVidia as the secondary?


I checked with the gurus and so far none are willing so I guess it's up to Matt, me and any other wannabe who wants to join the effort.

I would like to see the final product have on-user-demand script upgrade and rollback functionality. I am sure I can code that but there is a security issue that I don't know how to resolve in a way that would make users feel secure. The problem stems from the fact that to with mess vid drivers or any system level stuff the script has to run as root. Running as root the script could do ANYTHING to the system. Do you and/or the user base trust me to not include malicious code in the script? Not sure I would. Is it sufficient for you to know that I'm fully aware I would be apprehended by the authorities in short order if I did something illegal like hack your bank account and steal your dough? And how do we handle security on issues that involve lesser illegal acts authorities don't have time to bother with?

I have all sorts of script fragments I could contribute and intend to write more. Perhaps I could submit them to Matt, he could clear them for security threats then incorporate them into an image. He would have to learn Python, of course but I think he's likely up to that challenge ;-)

Also, I've downloaded the LiLi software I suspect Matt might have used to create his Linux image file. It looks easy enough to use and I'll probably have an image ready for peeps to try in a few days. I would want it to be installable to HDD though, not just a pen drive. I'm not sure yet if that's possible with LiLi or does one need to convert the .img to .iso?

I've cross-posted much of this in the "What's so hard about Linux" thread. And I don't have an AMD card to work with but could get one soon enough.

____________
BOINC <<--- credit whores, pedants, alien hunters

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35326 - Posted: 24 Feb 2014 | 20:42:52 UTC

What was I thinking? LiLi doesn't create .img files, it's a Windows app that creates a bootable Linux USB stick from an ISO. Apparently you just select the flavor and version of Linux you want from a dropdown list, plugin a USB stick and LiLi takes care of the rest, like UNetBootIn does on Linux except LiLi runs on Windows. That is an awesome goof proof way for anybody to testdrive Linux, doesn't get any easier, but it doesn't install BOINC on the USB stick.

The LiLi site says test versions might be able to create a bootable Linux stick from a .img file but that functionality is still in test phase. If it works then it's an alternative to the app Matt recommended.

This page from the FAQ at the LiLi site explains what a Linux .img file is and why it's difficult to create a bootable Linux USB stick from it. Maybe that's why your .img doesn't want to work for me, Matt?

I did notice somewhere that it's possible to convert a Linux .img into an ISO. If that works then it I could provide a Ubuntu ISO with BOINC, NVIDIA drivers and my (yet to be written) Thing 2 script on an ISO from which LiLi could then create a bootable stick.

Back to Googling.

____________
BOINC <<--- credit whores, pedants, alien hunters

Profile Carlesa25
Avatar
Send message
Joined: 13 Nov 10
Posts: 328
Credit: 72,619,453
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35327 - Posted: 24 Feb 2014 | 22:30:58 UTC - in response to Message 35326.
Last modified: 24 Feb 2014 | 22:34:41 UTC

Hi, No if the issue but to create an ISO in Linux (Ubuntu) (actually a LiveCD or USB) starting from a fully configured installation to measure (Boinc, Nvidia + Coolbits etc ...) is a very suitable tool "Systemback ". http://sourceforge.net/projects/systemback/

Basically used to create backups, OS images that can be transformed into an installable ISO, bridges have a look as it is useful.

Profile MJH
Project administrator
Project developer
Project scientist
Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 35329 - Posted: 24 Feb 2014 | 23:33:42 UTC - in response to Message 35321.

That's the way it's done in Windows.

Linux, alas, is rather less accommodating. If I make an image with AMD support, it simply won't work in systems with only Nvidia cards.
If enough people use this version I'll think about an Nvidia+AMD version, but won't do it just for fun (been there, done that, and it's not fun)

Matt

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35330 - Posted: 25 Feb 2014 | 0:01:50 UTC - in response to Message 35327.

Hi, No if the issue but to create an ISO in Linux (Ubuntu) (actually a LiveCD or USB) starting from a fully configured installation to measure (Boinc, Nvidia + Coolbits etc ...) is a very suitable tool "Systemback ". http://sourceforge.net/projects/systemback/

Basically used to create backups, OS images that can be transformed into an installable ISO, bridges have a look as it is useful.


Thanks, Carlesa :-)

I installed it and it's creating an ISO image of my Ubuntu 12.04.3 system as I type. If this works then Crunchuntu (BOINCuntu?) will become a reality faster than I ever imagined.
____________
BOINC <<--- credit whores, pedants, alien hunters

GoodFodder
Send message
Joined: 4 Oct 12
Posts: 53
Credit: 333,467,496
RAC: 0
Level
Asp
Scientific publications
watwatwatwatwatwatwatwatwatwat
Message 35333 - Posted: 25 Feb 2014 | 9:41:17 UTC

Hi, does the image make use of a persistent ram disk for the project folders?
From that I mean if the host is rebooted are the ramdisk contents saved to the usb stick so BOINC can carry on from where it left off?

Thanks

Profile MJH
Project administrator
Project developer
Project scientist
Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 35334 - Posted: 25 Feb 2014 | 12:14:43 UTC - in response to Message 35333.

Yes, the image is persistent. It's just like running from any hard disk install.

Matt

mikey
Send message
Joined: 2 Jan 09
Posts: 297
Credit: 6,230,685,115
RAC: 29,319,456
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35337 - Posted: 25 Feb 2014 | 13:18:06 UTC - in response to Message 35325.


Any chance you could add a version with both NVidia and AMD drivers?



I checked with the gurus and so far none are willing so I guess it's up to Matt, me and any other wannabe who wants to join the effort.

I would like to see the final product have on-user-demand script upgrade and rollback functionality. I am sure I can code that but there is a security issue that I don't know how to resolve in a way that would make users feel secure. The problem stems from the fact that to with mess vid drivers or any system level stuff the script has to run as root. Running as root the script could do ANYTHING to the system. Do you and/or the user base trust me to not include malicious code in the script? Not sure I would. Is it sufficient for you to know that I'm fully aware I would be apprehended by the authorities in short order if I did something illegal like hack your bank account and steal your dough? And how do we handle security on issues that involve lesser illegal acts authorities don't have time to bother with?


You are building us an OS, you ALREADY have Root access so those of us that have no clue can make this work. IF we go on this ride with you we MUST trust you or hop off and suffer the road burns because of it. I think the key is to do what you need to do, maybe giving a short yes/no message about the dangers, and then when we say yes run it and then exit yourself from the Root status, returning our pc back to us. I think the key is to TELL US when you are doing things that could be harmful and let us then choose to proceed or not. If we do then it is us taking the risks not you. Hackers don't usually ask for permission, they take it.

Put your script on a forum so it can be vetted by those that understand what you are doing, then let us choose whether to run it or not. We ARE asking for your help, we MUST trust you at least to the point of letting you into our pc's. Not everyone needs or wants to run gpu cards in their machines, but those that do can't do it themselves or this whole thing would be moot. Linux is public use, if you are hacking my bank account it will soon be apparent to many others and you will blacklisted as will any further attempts by you to do much of anything. Your generous offer comes with the risk on my part of letting you do what you need to do so I can do what I want to do.

Profile Carlesa25
Avatar
Send message
Joined: 13 Nov 10
Posts: 328
Credit: 72,619,453
RAC: 0
Level
Thr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35338 - Posted: 25 Feb 2014 | 14:36:13 UTC - in response to Message 35337.
Last modified: 25 Feb 2014 | 14:41:15 UTC

Hi Mikey, I think things are pulling out of the place.

I understand , sorry if I'm wrong , that the partner is trying to design a Dagorath OS version based on Ubuntu 12.04 stable version , which has the prior installation of BOINC Nvidia driver , and special configurations as Coolbits, cc_config.xml etc. .. etc ... ie provide an installable ISO with everything needed to assemble and operate without more .

You supply preinstalled all we know GPUGRID users that need to run BOINC without problems or complications especially for someone who does not know Linux but wants to enjoy his greatest performance ( in GPUGRID or other projects )

The way you would not need everything installed compulsorily access as " root" to the SO thing parce worry , you can configure BOINC etc ... normal except for some , Ubuntu updates , drivers etc ...

Note: The Spanish - English translator sometimes plays tricks me , sorry if I 'm wrong .

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1112
Credit: 6,162,416,256
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35339 - Posted: 25 Feb 2014 | 15:01:47 UTC - in response to Message 35337.

Settle down Mikey. From what I've seen over quite a few years I'd say that you can trust Dagorath not to hack your system (at least I do). Pretty much what he's saying applies to any of the hundreds? of distros out there. If you want to worry, think of all the info MS and Apple are gathering about you when you run their OSes.

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35340 - Posted: 25 Feb 2014 | 16:51:37 UTC - in response to Message 35339.

I think Mikey is simply giving me a vote of confidence. I don't think he's upset or worried or anything like that. Thanks, Mikey.

I think we've stolen MJH's thread with comments about my efforts, mostly my fault. Let's limit comments about my work to the What is so hard about Linux? thread.

____________
BOINC <<--- credit whores, pedants, alien hunters

mikey
Send message
Joined: 2 Jan 09
Posts: 297
Credit: 6,230,685,115
RAC: 29,319,456
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35346 - Posted: 25 Feb 2014 | 19:07:36 UTC - in response to Message 35339.

Settle down Mikey. From what I've seen over quite a few years I'd say that you can trust Dagorath not to hack your system (at least I do). Pretty much what he's saying applies to any of the hundreds? of distros out there. If you want to worry, think of all the info MS and Apple are gathering about you when you run their OSes.


You misunderstood me, I was trying to say that I absolutely trust Dagorath with this project and my pc's. That being said will I move ALL of my pc's to this project, no I won't. I have 15 pc's running and have lots of irons in the fire at several different projects. Would I love to stop using some of the older version of Windows and get away from some of Windows 'validation' issues, yes I would, could I ever see myself switching to Linux whole hog, nope not likely. I am 61 years old and have been crunching since 1999 and have owned my own pc's since 1978 and 'programmed' them on and off since I was in high school. I remember next to nothing about programming though and NEVER did any type of programming beyond what interested me, which was pretty basic stuff.

Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1112
Credit: 6,162,416,256
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35412 - Posted: 1 Mar 2014 | 5:15:53 UTC - in response to Message 35346.

You misunderstood me, I was trying to say that I absolutely trust Dagorath with this project and my pc's.

I sit corrected ;-)

Dagorath
Send message
Joined: 16 Mar 11
Posts: 509
Credit: 179,005,236
RAC: 0
Level
Ile
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35413 - Posted: 1 Mar 2014 | 8:34:24 UTC - in response to Message 35412.

Good dog! Now shake a paw ;-)


____________
BOINC <<--- credit whores, pedants, alien hunters

mikey
Send message
Joined: 2 Jan 09
Posts: 297
Credit: 6,230,685,115
RAC: 29,319,456
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35420 - Posted: 1 Mar 2014 | 12:55:24 UTC - in response to Message 35413.

Good dog! Now shake a paw ;-)


Profile Beyond
Avatar
Send message
Joined: 23 Nov 08
Posts: 1112
Credit: 6,162,416,256
RAC: 0
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35432 - Posted: 1 Mar 2014 | 19:30:56 UTC - in response to Message 35413.

Good dog! Now shake a paw ;-)

Woof! Do I get a treat?

mikey
Send message
Joined: 2 Jan 09
Posts: 297
Credit: 6,230,685,115
RAC: 29,319,456
Level
Tyr
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 35447 - Posted: 2 Mar 2014 | 12:43:19 UTC - in response to Message 35432.
Last modified: 2 Mar 2014 | 12:44:06 UTC

Good dog! Now shake a paw ;-)


Woof! Do I get a treat?


No I think you are on a diet due to too many treats lately, sorry. You can go have a nice roll around backscratch in the yard though.

Matt
Avatar
Send message
Joined: 11 Jan 13
Posts: 216
Credit: 846,538,252
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 40293 - Posted: 1 Mar 2015 | 13:52:25 UTC

I see this thread is a bit old now, but I'm wondering if Matt's image file is still available somewhere. The link in the original post is dead.

Profile MJH
Project administrator
Project developer
Project scientist
Send message
Joined: 12 Nov 07
Posts: 696
Credit: 27,266,655
RAC: 0
Level
Val
Scientific publications
watwat
Message 40294 - Posted: 1 Mar 2015 | 14:26:11 UTC - in response to Message 40293.

I see this thread is a bit old now, but I'm wondering if Matt's image file is still available somewhere. The link in the original post is dead.


It's live again now.

Matt
Avatar
Send message
Joined: 11 Jan 13
Posts: 216
Credit: 846,538,252
RAC: 0
Level
Glu
Scientific publications
watwatwatwatwatwatwatwatwatwatwatwatwatwatwat
Message 40295 - Posted: 1 Mar 2015 | 17:35:45 UTC - in response to Message 40294.

Thanks!

Post to thread

Message boards : Number crunching : Linux live USB

//