Please note: Although these Information about the usage of S3 are correct, the S3-gateway@AWI is still under construction and not available for users, yet. However, if you have use cases you may contact Pavan Kumar Siligam . He collects use cases.
Clients
There are verity of S3 clients to choose from and here are few that covers both command line based interaction to S3 bucket and also python scripting based interaction.
The clients that are covered here are:
- aws
- s3cmd
- s3fs
- boto3
Configuration for each of these tools is a bit different in terms of credentials naming conventions.
First setup the software stack using conda
software stack
conda create -y -n s3 python=3.12 conda activate s3 pip install aws-shell pip install s3cmd conda install -y -c condo-forge s3fs boto3 pyyaml