How to access bucket using s3fs?
Another way to access the bucket is to mount it to the file system. This is a convenient solution, however, in the case of a large number of objects in a bucket, its efficiency, e.g. listing all objects, can be significantly extended, because it is based on the file system.
To use this tool, first execute bellow commands:
sudo apt update sudo apt upgrade sudo apt install s3fs
You'll receive the credentials from WEkEO Support after asking for access and secret key.
sudo echo "<access_key>:<secret_key>" > ~/.passwd-s3fs sudo chmod 600 ~/.passwd-s3fs
Then, in the
/etc/fuse.conf file, remove the" # "from the "user_allow_other" line.
sudo vim /etc/fuse.conf
Then create a folder where the buket will be mounted.
sudo mkdir /mountpoint sudo chmod 777 /mountpoint
Finally, mount the bucket.
s3fs <bucket_name> <mountpoint> -o passwd_file=~/.passwd-s3fs -o url=<dpi_url> -o use_path_request_style -o umask=0002 -o allow_other
Data such as the name of the bucket and the address where the bucket is located can be checked in the details about a given bucket.
- <bucket_name> - you can get the bucket name from the "Bucket Name" field,
- <dpi_url> - you can get the address where the bucket is located from the "Endpoint URL" field.
Below is an example command:
s3fs firstbucket /mountpoint -o passwd_file=~/.passwd-s3fs -o url=https://mercator.dpi.wekeo.eu:8080 -o use_path_request_style -o umask=0002 -o allow_other