For a machine learning task at school I wrote my own MLP network. The data set is quite big, and training takes forever. I was alerted to the option of running my script on the Google Cloud Compute Engine. I tried to set this up, but did not succeed (yet).
The steps I undertook where:
- Create an account
- Create a VM
- Open the VM via the browser
Can anyone help me with importing and running my python script into the Google Cloud. Or does anyone have clear a tutorial on how to solve this? I tried finding these myself, but had no success so far.
I finally figured this out so I'll post the same answer on my own post that worked for me here. Using Debian Stretch on my VM. I'm assuming you already uploaded your file(s) to the VM and that you are in the same directory of your script.
Make your script an executable
chmod +x myscript.py
Run the nohup
command to execute the script in the background. The &
option ensures that the process stays alive after exiting. I've added the shebang line to my python script so there's no need to call python
here
nohup /path/to/script/myscript.py &
Logout from the shell if you want
logout
Done! Now your script is up and running. You can login back and make sure that your process is still alive by checking the output of this command:
ps -e | grep myscript.py
If anything went wrong, you can check out the nohup.out
file to see the output of your script:
cat nohup.out
Just navigate to the directory where the script is placed.
python thenameofscript.py
You can use Google cloud platform tutorials itself and is very simple to follow. Links are given below
Setting up python
https://cloud.google.com/python/setup
Getting started
https://cloud.google.com/python/getting-started/hello-world
Please note that you don't have any free tier to run Python 3.x, Standard environment with free tier only supports Python 2.x.
Edit: As per the latest update Python 3.x is also available for standard environment