SageMaker and TensorFlow 2.0

2020-08-12 16:32发布

What is the best way to run TensorFlow 2.0 with AWS Sagemeker?

As of today (Aug 7th, 2019) AWS does not provide TensorFlow 2.0 SageMaker containers, so my understanding is that I need to build my own.

What is the best Base image to use? Example Dockerfile?

3条回答
一纸荒年 Trace。
2楼-- · 2020-08-12 16:38

EDIT: Amazon SageMaker does now support TF 2.0 and higher.


Original answer

Here is an example Dockerfile that uses the underlying SageMaker Containers library (this is what is used in the official pre-built Docker images):

FROM tensorflow/tensorflow:2.0.0b1

RUN pip install sagemaker-containers

# Copies the training code inside the container
COPY train.py /opt/ml/code/train.py

# Defines train.py as script entrypoint
ENV SAGEMAKER_PROGRAM train.py

For more information on this approach, see https://docs.aws.amazon.com/sagemaker/latest/dg/build-container-to-train-script-get-started.html

查看更多
何必那么认真
3楼-- · 2020-08-12 16:53

Update on 10 nov 2019:

There is now a way to use Tensorflow 2 in SageMaker, event though there is no shortcut to start TF 2 directly from SageMaker console.

  1. Start a conda Python3 Kernel

  2. Make some updates (one in each code cell):

!pip install --upgrade pip         # pip 19.0 or higher is required for TF 2
!pip install --upgrade setuptools  # Otherwise you'll get annoying warnings about bad installs
  1. Install Tensorflow 2
!pip install --user --upgrade tensorflow

Given the doc, this will install in $HOME.

Nota:

If you are using a GPU based instance of SageMaker, replace tensorflow by tensorflow-gpu.

You now can use TF 2 in your instance. This only needs to be done once, as long as the instance remains up.

To test, just run in the next cell:

import tensorflow as tf
print(tf.__version__)

You should see 2.0.0 or higher.

查看更多
你好瞎i
4楼-- · 2020-08-12 16:57

As of now, the best image that you can use to build Tensorflow 2.0 is 2.0.0b1, which is the latest version of Tensorflow 2.0(image) that is available now.Please find the link here. You also have an image 2.0.0b1-py3, which comes with Python3 (3.5 for Ubuntu 16-based images; 3.6 for Ubuntu 18-based images).

If you feel this answer is useful, kindly accept this answer and/or up vote it. Thanks.

查看更多
登录 后发表回答