Can we access gsutil from Google Cloud Dataflow? i

2019-07-29 17:47发布

I'm new with google cloud dataflow and I need to copy files in GCS (Google Cloud Storage) from one bucket to another and rename. Answer with example would highly appreciated.

1条回答
虎瘦雄心在
2楼-- · 2019-07-29 18:31

Technically yes you can do this, but it would be better if you used Dataflow to just pick up the files and move them over to the new bucket instead of as a wrapper around gustil.

The class you need should be beam.io.gcsio.GcsIO() and that should be able to pick up and put down files where you need it too.

查看更多
登录 后发表回答