HP Cloud Services SMP client setup

Change Page: 12345 > | Showing page 1 of 5, messages 1 to 30 of 150
Author Message
david12857

  • Total Posts : 768
  • Joined: 2/15/2009
  • Status: offline
  • Ribbons: 32
  • Folding: 66,987,817
HP Cloud Services SMP client setup Wednesday, January 18, 2012 8:41 PM (permalink)
These instructions will help setup and manage Folding@home SMP clients on HP Cloud Servers from a Windows 7 system. View Getting Started with HP Cloud Services for more information about HP Cloud Services and signup here.

This assumes you already have access to HP Cloud Services private beta and have created servers. I used Ubuntu 10.10 (64-bit) on two standard.2xlarge and one standard.xlarge servers. I created another thread to setup and monitor the SMP clients with HFM.NET.
 
Create a new folder called PuTTY on your Windows 7 system. Save all files to this location.

Download PuTTY and PuTTYgen.
http://the.earth.li/~sgta...y/latest/x86/putty.exe
http://the.earth.li/~sgta...atest/x86/puttygen.exe

Go to https://manage.hpcloud.com/compute/ select Manage Servers and follow the Creating a Key Pair instructions. I named the Key Pairs (.pem file) after the compute cluster location because only one key is needed for each compute cluster location (US West 2 - AZ2 and US West 2 - AZ1 or az-1.region-a.geo-1 and az-2.region-a.geo-1).  
 
Open PuTTYgen and select Conversions and Import Key. Select the Key Pair (.pem file) you created and then select Save private key. Ignore the warning.
I saved the files as USWest2-AZ2.ppk and USWest2-AZ1.ppk because only one key is needed for each compute cluster location.
Close PuTTYgen.

Copy your server's Public IP address.

Open PuTTY.
Paste your server's Public IP address into the Host Name (or IP address) field.

Expand SSH under Connection and select Auth.
Select Browse under Private key field for authentication and select your private key USWest2-AZ2.ppk or USWest2-AZ1.ppk

Select Session, enter the server's Public IP  address under Saved Sessions and select Save.

Select Open and yes on the Security Alert.
Logon as root
 
Update the OS and installed the SMP client with the following commands.

apt-get update
apt-get upgrade -y

mkdir -p /folding
cd /folding
wget www.stanford.edu/group/pandegroup/folding/release/FAH6.34-Linux64.tgz
tar xzf FAH6.34-Linux64.tgz
chmod +x fah6
Start the SMP client with the following command. Replace the # with 4 or 8 depending on the number of vCPU you're using. Ensure you enter your username, team # 111065 and your passkey.
screen ./fah6 -smp # 
screen allows us to enter new commands and close PuTTy while keeping the SMP client running.

After the SMP client is running hold the Crtl key down and press A then D to detach the screen. Always detach the screen before you close PuTTy.

Enter screen -r if you need to return to the SMP client.
 
Right-click on the PuTTy window and select Close to end the session. If you Saved your Sessions you will be able to simply double-click on the Saved Session name when you open PuTTy. Remember to logon as root and enter screen -r to return to the SMP client if needed.
 
I added the additional information for those that are not familiar with Linux and the CLI.
Use the following commands to navigate to the folding directory and start the SMP client.

  cd /folding
screen ./fah6 -smp #
  Ctrl+C will shutdown the SMP client.

The reboot command will restart the system. Type reboot, press Enter and wait a couple minutes for the system to restart. Right-click on the Putty window and select Restart Session. If you receive “Network error: Connection timed out” then you didn’t wait long enough.

 
The top command will show you running tasks. It's like the Task Manager in Windows. Press Ctrl+C to exit.
cat /proc/cpuinfo will display your CPU information. 
<message edited by david12857 on Wednesday, February 15, 2012 9:53 PM>
  
   
 
 Main system | HTPC | Folding&Crunching@EVGA
 
#1
    tonycw

    • Total Posts : 29
    • Joined: 12/4/2011
    • Location: Seattle
    • Status: offline
    • Folding: 7,212,977
    Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 2:08 AM (permalink)
    Thanks for the instructions! Just realized that HPCS is free during it's beta run...might give this a try. 
     
    #2
      Sleinous

      • Total Posts : 7032
      • Joined: 6/12/2010
      • Location: Paris, France
      • Status: online
      • Ribbons: 31
      • Folding: 46,050,766
      Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 2:42 AM (permalink)
      What CPU potential do they give you during the beta?
       

      two standard.2xlarge and one standard.xlarge servers

      <message edited by Sleinous on Thursday, January 19, 2012 2:43 AM>
      My Affiliate Code: GL1IAAFWJF
       
      #3
        david12857

        • Total Posts : 768
        • Joined: 2/15/2009
        • Status: offline
        • Ribbons: 32
        • Folding: 66,987,817
        Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 4:46 AM (permalink)
        cat /proc/cpuinfo reports 2.5Ghz CPUs . 2xlarge has 8 cores and xlarge has 4 cores..
         

        Attachment(s)Attachments are not available: Download requirements not met
          
           
         
         Main system | HTPC | Folding&Crunching@EVGA
         
        #4
          zimmie01

          • Total Posts : 593
          • Joined: 1/22/2010
          • Location: Antwerp, Belgium
          • Status: offline
          • Ribbons: 2
          • Folding: 6,151,585
          Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 6:04 AM (permalink)
          Signed up for the beta even though your explanation is chinese to me. I'll figure it out 
          EDIT: 
          HP sent me this:


          Thanks for your interest in the HP Cloud Services private beta and for completing the sign-up. The response to our private beta has been great, and we’ve already reached the initial target number of participants. We will certainly keep you informed as beta access becomes available.

           
             
           
          <message edited by zimmie01 on Thursday, January 19, 2012 6:08 AM>

          [eVGA classified 3 (E770) ]    [i7 920 D0 @ 4.2GHz 1.275Vcore]    [eVGA GTX 580 SLI 950/1900/2150 @ 1.125mV]  

          [Corsair AX1200]   [corsair DDR3 1866 C9]   [Corsair H50]   [Corsair obsidian 800D]



          Fold on!

           
          #5
            Sleinous

            • Total Posts : 7032
            • Joined: 6/12/2010
            • Location: Paris, France
            • Status: online
            • Ribbons: 31
            • Folding: 46,050,766
            Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 6:08 AM (permalink)
            Wow, so you have 20 cores in total, I assume that's what they give you and you can share teh 20 cores out however you like? Not sure but in any case that must be netting you some serious PPD. Also I signed up but they say private beta slots attained so I assume they won't accept any new applications.
            My Affiliate Code: GL1IAAFWJF
             
            #6
              zimmie01

              • Total Posts : 593
              • Joined: 1/22/2010
              • Location: Antwerp, Belgium
              • Status: offline
              • Ribbons: 2
              • Folding: 6,151,585
              Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 6:17 AM (permalink)
              Sleinous


              Wow, so you have 20 cores in total, I assume that's what they give you and you can share teh 20 cores out however you like? Not sure but in any case that must be netting you some serious PPD. Also I signed up but they say private beta slots attained so I assume they won't accept any new applications.


              Stop browsing the forums at work! 
              Sincerely,
              Your lady baws

              [eVGA classified 3 (E770) ]    [i7 920 D0 @ 4.2GHz 1.275Vcore]    [eVGA GTX 580 SLI 950/1900/2150 @ 1.125mV]  

              [Corsair AX1200]   [corsair DDR3 1866 C9]   [Corsair H50]   [Corsair obsidian 800D]



              Fold on!

               
              #7
                david12857

                • Total Posts : 768
                • Joined: 2/15/2009
                • Status: offline
                • Ribbons: 32
                • Folding: 66,987,817
                Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 6:43 AM (permalink)
                I added some pretty pictures to help.
                Sleinous
                  Wow, so you have 20 cores in total, I assume that's what they give you and you can share teh 20 cores out however you like? Not sure but in any case that must be netting you some serious PPD. Also I signed up but they say private beta slots attained so I assume they won't accept any new applications.
                The hardware profiles are already configured and we select from the drop-down list. Hopefully we're allowed to make custom profiles in the future. Like when they start charging. It will be interesting to see the PPD performance. I signed up whenever HPCS started folding and received the invite yesterday.
                  
                   
                 
                 Main system | HTPC | Folding&Crunching@EVGA
                 
                #8
                  ana3mic

                  • Total Posts : 694
                  • Joined: 4/16/2010
                  • Location: Bulgaria, EU
                  • Status: offline
                  • Ribbons: 1
                  • Folding: 13,357,238
                  Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 7:35 AM (permalink)
                  Nice guide there david, I applied for testing. Let's see if I get to try this baby . Have you managed to get a PPD estimate from the 3 servers you're provided with?

                   
                  #9
                    david12857

                    • Total Posts : 768
                    • Joined: 2/15/2009
                    • Status: offline
                    • Ribbons: 32
                    • Folding: 66,987,817
                    Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 7:51 AM (permalink)
                    My PPD was 9K. I'm anxiously awaiting the results.
                    http://folding.extremeove...ry.php?s=&u=524047
                      
                       
                     
                     Main system | HTPC | Folding&Crunching@EVGA
                     
                    #10
                      Sleinous

                      • Total Posts : 7032
                      • Joined: 6/12/2010
                      • Location: Paris, France
                      • Status: online
                      • Ribbons: 31
                      • Folding: 46,050,766
                      Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 8:07 AM (permalink)
                      david12857


                      I added some pretty pictures to help.
                      Sleinous
                        Wow, so you have 20 cores in total, I assume that's what they give you and you can share teh 20 cores out however you like? Not sure but in any case that must be netting you some serious PPD. Also I signed up but they say private beta slots attained so I assume they won't accept any new applications.
                      The hardware profiles are already configured and we select from the drop-down list. Hopefully we're allowed to make custom profiles in the future. Like when they start charging. It will be interesting to see the PPD performance. I signed up whenever HPCS started folding and received the invite yesterday.

                      Ah yes, however I mean how many of those 8 cores and 4 core profiles are you allowed to make?
                       
                      Have you been able to measure how much PPD you're making from those 3 profiles?
                       
                      EDIT: Woops just saw your reply, 9K for all 3 combined? That seems a tad low :(
                      My Affiliate Code: GL1IAAFWJF
                       
                      #11
                        david12857

                        • Total Posts : 768
                        • Joined: 2/15/2009
                        • Status: offline
                        • Ribbons: 32
                        • Folding: 66,987,817
                        Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 8:12 AM (permalink)
                        I could only make 2x 8 core profiles and a 4 core profile before but I figured out how to make 3 more. Now I have a total of 6 (4 x 8core and 2 x 4core). My PPD was 9K from a GPU client b4. I'm waiting to see what happens over the next couple of days. I'm already up to 25,399 today (01.19, 9am update).
                        <message edited by david12857 on Thursday, January 19, 2012 8:24 AM>
                          
                           
                         
                         Main system | HTPC | Folding&Crunching@EVGA
                         
                        #12
                          Sleinous

                          • Total Posts : 7032
                          • Joined: 6/12/2010
                          • Location: Paris, France
                          • Status: online
                          • Ribbons: 31
                          • Folding: 46,050,766
                          Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 10:29 AM (permalink)
                          Ok hang on a sec :P Coz i'm very confused. 9K from a GPU? I thought HP Cloud was just CPU's? Also 25K points but have you been folding anywhere else other than on the cloud?
                           
                          EDIT: Ohhh do you mean 9K before you started the cloud?
                          My Affiliate Code: GL1IAAFWJF
                           
                          #13
                            david12857

                            • Total Posts : 768
                            • Joined: 2/15/2009
                            • Status: offline
                            • Ribbons: 32
                            • Folding: 66,987,817
                            Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 1:22 PM (permalink)
                            The GPU client is running on a spare PC at my house. I'm typing on it now. Look at my stats an you will see there's almost a straight line at 9K. I already have 45,781 today (01.19.12 3pm update).
                             

                            Attachment(s)Attachments are not available: Download requirements not met
                              
                               
                             
                             Main system | HTPC | Folding&Crunching@EVGA
                             
                            #14
                              Sleinous

                              • Total Posts : 7032
                              • Joined: 6/12/2010
                              • Location: Paris, France
                              • Status: online
                              • Ribbons: 31
                              • Folding: 46,050,766
                              Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 1:31 PM (permalink)
                              I assume you doubled the number of CPUs by using AZ1 as well as AZ2, although the email I received mentioned something about only using AZ2, not sure though.
                              <message edited by Sleinous on Thursday, January 19, 2012 2:32 PM>
                              My Affiliate Code: GL1IAAFWJF
                               
                              #15
                                david12857

                                • Total Posts : 768
                                • Joined: 2/15/2009
                                • Status: offline
                                • Ribbons: 32
                                • Folding: 66,987,817
                                Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 4:24 PM (permalink)
                                Correct. I contacted support and I think they're going to restrict access to AZ1. I think old accounts were restricted at some point in the past but new accounts were still given access.
                                 
                                Things have been going good so far. Hopefully the final product allows us to create custom hardware profiles and of course for reasonable prices. I like having 8 cores but don't need 32GB of RAM or a 960GB HD.
                                  
                                   
                                 
                                 Main system | HTPC | Folding&Crunching@EVGA
                                 
                                #16
                                  700_up

                                  • Total Posts : 3364
                                  • Joined: 5/11/2009
                                  • Location: Silicon Valley California
                                  • Status: offline
                                  • Ribbons: 1
                                  • Folding: 28,399,017
                                  Re:SMP client setup with HP Cloud Services Thursday, January 19, 2012 9:25 PM (permalink)
                                  This definately sounds interesting, paying people to do the dirty work haha. Takes some of the fun out of folding imo but it could definately be used to give you a boost during Chimp Challenge and stuff. 



                                   
                                  #17
                                    david12857

                                    • Total Posts : 768
                                    • Joined: 2/15/2009
                                    • Status: offline
                                    • Ribbons: 32
                                    • Folding: 66,987,817
                                    Re:SMP client setup with HP Cloud Services Friday, January 20, 2012 1:54 AM (permalink)
                                    It might not be as fun for some people but it could make CPU folding more fun for me. Less noise, heat, electricity and hardware issues. I have been using Ubuntu 10.10 so not much changes there but I'm learning new things in the process. The final price & performance will be the determining factors.
                                      
                                       
                                     
                                     Main system | HTPC | Folding&Crunching@EVGA
                                     
                                    #18
                                      illutian

                                      • Total Posts : 120
                                      • Joined: 8/5/2010
                                      • Location: USA
                                      • Status: offline
                                      • Folding: 1,338,030
                                      Re:SMP client setup with HP Cloud Services Saturday, January 21, 2012 3:29 PM (permalink)
                                      Ugh, I gave up trying to get PuTTY to work; so I just installed Ubuntu as a VM 

                                       http://fah-web.stanford.edu/cgi-bin/main.py?qtype=userpage&username=Illutian&teamnum=111065
                                       
                                      http://folding.extremeoverclocking.com/user_summary.php?s=&u=549964
                                       
                                      I like the results. Wish I had gotten in earlier. :(

                                      Hopefully, EVGA will start a new Folding Round for this year. 
                                      "Our greatest glory is not in never falling but in rising everytime we fall." - Confucius
                                             

                                       
                                      #19
                                        david12857

                                        • Total Posts : 768
                                        • Joined: 2/15/2009
                                        • Status: offline
                                        • Ribbons: 32
                                        • Folding: 66,987,817
                                        Re:SMP client setup with HP Cloud Services Saturday, January 21, 2012 5:00 PM (permalink)
                                        What didn't work with PuTTy? The instructions should be pretty straightforward and the setup shouldn't take long. Maybe I need to clarify something or add more screenshots. Ubuntu is great but I didn't want to setup a VM just to SSH on my primary system. I like the results too. I really hope the final product is cost-effective.
                                        <message edited by david12857 on Saturday, January 21, 2012 5:02 PM>
                                          
                                           
                                         
                                         Main system | HTPC | Folding&Crunching@EVGA
                                         
                                        #20
                                          700_up

                                          • Total Posts : 3364
                                          • Joined: 5/11/2009
                                          • Location: Silicon Valley California
                                          • Status: offline
                                          • Ribbons: 1
                                          • Folding: 28,399,017
                                          Re:SMP client setup with HP Cloud Services Sunday, January 22, 2012 12:53 PM (permalink)
                                          What kind of PPD are you getting?



                                           
                                          #21
                                            david12857

                                            • Total Posts : 768
                                            • Joined: 2/15/2009
                                            • Status: offline
                                            • Ribbons: 32
                                            • Folding: 66,987,817
                                            Re:SMP client setup with HP Cloud Services Sunday, January 22, 2012 4:23 PM (permalink)
                                            55-65K from 3 servers or Running Instance as HPCS likes to call them.
                                              
                                               
                                             
                                             Main system | HTPC | Folding&Crunching@EVGA
                                             
                                            #22
                                              zimmie01

                                              • Total Posts : 593
                                              • Joined: 1/22/2010
                                              • Location: Antwerp, Belgium
                                              • Status: offline
                                              • Ribbons: 2
                                              • Folding: 6,151,585
                                              Re:SMP client setup with HP Cloud Services Sunday, January 22, 2012 4:50 PM (permalink)
                                              I'm still waiting for my beta invite 
                                              One of their community managers promised me a code 2-3 days ago and still nothing..
                                              I wonder what the cost will be in the final version 

                                              [eVGA classified 3 (E770) ]    [i7 920 D0 @ 4.2GHz 1.275Vcore]    [eVGA GTX 580 SLI 950/1900/2150 @ 1.125mV]  

                                              [Corsair AX1200]   [corsair DDR3 1866 C9]   [Corsair H50]   [Corsair obsidian 800D]



                                              Fold on!

                                               
                                              #23
                                                Sleinous

                                                • Total Posts : 7032
                                                • Joined: 6/12/2010
                                                • Location: Paris, France
                                                • Status: online
                                                • Ribbons: 31
                                                • Folding: 46,050,766
                                                Re:SMP client setup with HP Cloud Services Monday, January 23, 2012 12:03 AM (permalink)
                                                Hopefully affordable with custom profiles.
                                                My Affiliate Code: GL1IAAFWJF
                                                 
                                                #24
                                                  Opolis

                                                  • Total Posts : 960
                                                  • Joined: 3/25/2010
                                                  • Status: offline
                                                  • Ribbons: 4
                                                  • Folding: 19,170,047
                                                  Re:SMP client setup with HP Cloud Services Monday, January 23, 2012 11:06 AM (permalink)
                                                  Nice guide.  Anyone else have this running that can post avg PPD?  I haven't been able to get in yet but am seriously considering this if the price is right.  I had 4 gpu's going in my small room and the heat is bad even in the winter.  Sleinous your rigs could probably heat a small community!
                                                                

                                                          

                                                   
                                                  #25
                                                    zimmie01

                                                    • Total Posts : 593
                                                    • Joined: 1/22/2010
                                                    • Location: Antwerp, Belgium
                                                    • Status: offline
                                                    • Ribbons: 2
                                                    • Folding: 6,151,585
                                                    Re:SMP client setup with HP Cloud Services Monday, January 23, 2012 1:18 PM (permalink)
                                                    Just got everything configured - thank you Sleinous for the help!
                                                    PPD wise, 1 8 core gets around 28K PPD, another one 24K and a 4 core one I don't know yet..

                                                    [eVGA classified 3 (E770) ]    [i7 920 D0 @ 4.2GHz 1.275Vcore]    [eVGA GTX 580 SLI 950/1900/2150 @ 1.125mV]  

                                                    [Corsair AX1200]   [corsair DDR3 1866 C9]   [Corsair H50]   [Corsair obsidian 800D]



                                                    Fold on!

                                                     
                                                    #26
                                                      theGryphon

                                                      • Total Posts : 3930
                                                      • Joined: 3/4/2009
                                                      • Status: offline
                                                      • Ribbons: 13
                                                      • Folding: 42,205,605
                                                      Re:SMP client setup with HP Cloud Services Monday, January 23, 2012 3:59 PM (permalink)
                                                      I just got an invite from HP on my initial application and fired up the same three systems as in OP. Thanks for the guide!
                                                       
                                                      I should be getting 55-65K PPD through this. Hope it lasts long! :D
                                                      *** Something better than yours ***
                                                       
                                                      #27
                                                        ana3mic

                                                        • Total Posts : 694
                                                        • Joined: 4/16/2010
                                                        • Location: Bulgaria, EU
                                                        • Status: offline
                                                        • Ribbons: 1
                                                        • Folding: 13,357,238
                                                        Re:SMP client setup with HP Cloud Services Monday, January 23, 2012 8:59 PM (permalink)
                                                        Just got my invite, too . I'll try to do whatever I can from here (I'm at work currently), but if my restricted account doesn't allow me to I'll finish it when I get home in 8 hours. Now time for some fun . Thanks again david12857 for the guide .

                                                         
                                                        #28
                                                          Sleinous

                                                          • Total Posts : 7032
                                                          • Joined: 6/12/2010
                                                          • Location: Paris, France
                                                          • Status: online
                                                          • Ribbons: 31
                                                          • Folding: 46,050,766
                                                          Re:SMP client setup with HP Cloud Services Tuesday, January 24, 2012 12:31 AM (permalink)
                                                          Yeah i'm getting around 25K per 8 core and 9-10K PPD on the core. If you pick up the big SMP you get qround 28K PPD on teh 8 core and 10K on the 4 core.
                                                           
                                                          Hopefully they will create a 16 core profile because then a bigadv can be launched on there.
                                                          My Affiliate Code: GL1IAAFWJF
                                                           
                                                          #29
                                                            theGryphon

                                                            • Total Posts : 3930
                                                            • Joined: 3/4/2009
                                                            • Status: offline
                                                            • Ribbons: 13
                                                            • Folding: 42,205,605
                                                            Re:SMP client setup with HP Cloud Services Tuesday, January 24, 2012 1:58 PM (permalink)
                                                            Yeah, it's making a big difference between WU's. My 8-cores are getting around 16-17K now each, and the 4-core is getting close to 10K. So total is like 42K. If lucky, the 8-cores would pick up a big WU and get 27-28K each.
                                                             
                                                            At the end, the performance of the three machines I configured is 42-65K. Not bad at all! 
                                                             
                                                            Thanks for the guide again, I'd have no idea how to start with this otherwise! 
                                                             
                                                            *** Something better than yours ***
                                                             
                                                            #30
                                                              Change Page: 12345 > | Showing page 1 of 5, messages 1 to 30 of 150

                                                              Jump to:

                                                              Current active users

                                                              There are 0 members and 1 guests.

                                                              Icon Legend and Permission

                                                              • New Messages
                                                              • No New Messages
                                                              • Hot Topic w/ New Messages
                                                              • Hot Topic w/o New Messages
                                                              • Locked w/ New Messages
                                                              • Locked w/o New Messages
                                                              • Read Message
                                                              • Post New Thread
                                                              • Reply to message
                                                              • Post New Poll
                                                              • Submit Vote
                                                              • Post reward post
                                                              • Delete my own posts
                                                              • Delete my own threads
                                                              • Rate post

                                                              2000-2013 ASPPlayground.NET Forum Version 3.8