How to access EODATA using S3 protocol on EO-Lab
This article covers different methods which you can use to gain access to the EODATA repository on a virtual machine on EO-Lab.
What Are We Going To Cover
Obtaining S3 credentials
Accessing EODATA using s3fs, boto3, s3cmd, goofys and rclone
Prerequisites
No. 1 Hosting
You need a EO-Lab hosting account with Horizon interface https://cloud.fra1-1.cloudferro.com/auth/login/?next=/.
No. 2 Linux or Windows virtual machine with access to the dlr-access-net network
You need a Linux or Windows virtual machine on EO-Lab cloud. It should have access to the dlr-access-net network found in your cloud environment.
If you want to use a Linux image available on EO-Lab cloud by default, the following articles might help:
Windows virtual machines are also available on EO-Lab.
If you, instead, want to use an image created by you, first you need to upload such an image by using the Horizon dashboard:
You can also use the OpenStack CLI client for that:
After that, you can use that image to create a virtual machine.
Step 1: Obtain S3 credentials
Obtain the S3 credentials which will be used for accessing the EODATA repository by following this article:
/eodata/How-to-get-credentials-used-for-accessing-EODATA-on-a-cloud-VM-on-EO-Lab
Step 2: Access the EODATA repository
Below are different methods of obtaining the EODATA repository. You can choose the ones that are most compatible with your needs.
Other methods not mentioned here might also work. However, if you use them, we might not be able to provide you with technical support.
Method 1: s3fs (Linux)
On virtual machines created using Ubuntu or CentOS default images, access to the EODATA repository using s3fs should be successfully configured during first boot if appropriate prerequisites are met.
If you are using a Linux virtual machine created using a custom image, you might be able to use this method as well.
Check /eodata/How-to-mount-eodata-using-S3FS-in-Linux-on-EO-Lab to learn more.
Method 2: boto3 (Python)
If you want to access the EODATA repository using Python, you can use boto3 for that purpose.
The following articles contain more information:
/eodata/How-to-access-or-list-EODATA-using-boto3-on-EO-Lab
Method 3: s3cmd (Linux)
s3cmd can be used if you, say, don’t want to mount the EODATA repository as a file system.
Learn more here:
/eodata/How-to-access-EODATA-and-Object-Storage-using-s3cmd-on-Linux-on-EO-Lab
/eodata/How-to-access-EODATA-and-Object-Storage-using-s3cmd-on-Linux-on-EO-Lab
Method 4: goofys (Linux)
Like s3fs, goofys can be used to mount EODATA as a file system. If you prefer goofys, follow this article:
How to mount eodata as a filesystem using Goofys in Linux on EO-Lab
Method 5: rclone (Windows)
On virtual machines running Windows, access to the EODATA repository using Rclone should be automatically configured during first boot if appropriate prerequisites are met.
If this process is not successful, you can also configure it yourself.
Read this article to learn more:
/eodata/How-to-mount-eodata-on-Windows-virtual-machine-on-EO-Lab-hosting