New servers and S3 endpoints

  • Monday, 23rd December, 2024
  • 00:00am

We are pleased to announce the implementation of several enhancements and bug fixes in Quotaless, in accordance with our commitment to deliver a more stable and resilient service.
We invite you to take the time to test our new upload methods and S3 endpoints, and we can't wait to get your feedback.

Quotaless offers two modes for uploading: direct and indirect.
It also has two types of endpoints (upload hosts): dynamic and static.

While dynamic (multi-server) endpoints lack multipart upload functionality, they offer enhanced resilience by enabling uploads to multiple servers concurrently.
On the other hand, static (single-server) endpoints can offer better connectivity and faster uploads. It supports both multipart and single part uploads.

Synchronous upload refers to uploading directly to the server. Although it is more prone to errors during the upload process, this is the default upload method.

Asynchronous upload consists of uploading to a proxy server, which then uploads the files to the destination server. This upload method can display file modification time errors, which are often false positives, and it can also take some time for files to appear in the cloud.

When the endpoint is dynamic (multi server), the following flags must be set:
use_multipart_uploads = false
no_head = true

In the case of a static endpoint (single server), these flags can be set:
use_multipart_uploads = true
no_head = false

Rclone config templates


Direct (Syncronous) Upload with Dynamic Endpoint

[quotaless]
type = s3
provider = Minio
env_auth = false
access_key_id = YOUR_PERSONAL_TOKEN
secret_access_key = gatewaysecret
endpoint = https://io.quotaless.cloud:8000
acl = bucket-owner-full-control
list_chunk = 10000000
upload_cutoff = 100M
chunk_size = 50M
encoding = Slash,InvalidUtf8,Dot,Percent,Ctl
use_multipart_uploads = false
no_head = true

Direct (Syncronous) Upload with Static Endpoint

[quotaless]
type = s3
provider = Minio
env_auth = false
access_key_id = YOUR_PERSONAL_TOKEN
secret_access_key = gatewaysecret
endpoint = ENTER_THE_ENDPOINT_URL_HERE
acl = bucket-owner-full-control
list_chunk = 10000000
upload_cutoff = 100M
chunk_size = 50M
encoding = Slash,InvalidUtf8,Dot,Percent,Ctl
use_multipart_uploads = true
no_head = false

Select one of the URLs listed below, depending on your location:

https://nl.quotaless.cloud:8000 (Europe or Africa)
https://us.quotaless.cloud:8000 (South/North America)
https://sg.quotaless.cloud:8000 (Asia or Oceania)

Note: /data/personal-files is your root directory

The following example illustrates the process of copying a file named "song.mp3" to the "music" folder:
rclone copy -P /music/song.mp3 quotaless:/data/personal-files/music


Indirect (Asyncronous) Upload with Dynamic Endpoint

[proxy]
type = s3
provider = Rclone
access_key_id = YOUR_PERSONAL_TOKEN
secret_access_key = gatewaysecret
endpoint = https://rclone.io:2096
acl = bucket-owner-full-control
encoding = Slash,InvalidUtf8,Dot,Percent,Ctl
use_multipart_uploads = false
no_head = true

Indirect (Asyncronous) Upload with Static Endpoint

[proxy]
type = s3
provider = Rclone
access_key_id = YOUR_PERSONAL_TOKEN
secret_access_key = gatewaysecret
endpoint = ENTER_THE_ENDPOINT_URL_HERE
acl = bucket-owner-full-control
encoding = Slash,InvalidUtf8,Dot,Percent,Ctl
use_multipart_uploads = true
no_head = false

Select one of the URLs listed below, depending on your location:

https://nl.rclone.io:2096 (Europe or Africa)
https://us.rclone.io:2096 (South/North America)
https://sg.rclone.io:2096 (Asia or Oceania)

When performing indirect/asyncronous uploads, the "/data" portion of any URL should be excluded.
Therefore, your personal folder can be accessed at [name of the remote]:/personal-files.

The following example illustrates the process of copying videos from the "movies" folder:
rclone copy -P /home/myself/movies proxy:/personal-files/movies

 

« Back

Powered by WHMCompleteSolution