From dadc02b8039f6bca9943261bcfba9fe2842aeab1 Mon Sep 17 00:00:00 2001 From: Chris Lu Date: Sat, 4 Sep 2021 19:12:31 -0700 Subject: [PATCH] Created Gateway to Remote Object Storage (markdown) --- Gateway-to-Remote-Object-Storage.md | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+) create mode 100644 Gateway-to-Remote-Object-Storage.md diff --git a/Gateway-to-Remote-Object-Storage.md b/Gateway-to-Remote-Object-Storage.md new file mode 100644 index 0000000..d30a80c --- /dev/null +++ b/Gateway-to-Remote-Object-Storage.md @@ -0,0 +1,27 @@ +# Context + +The [[Mount Remote Storage]] feature can mount one remote storage folder to one local folder. +``` +> remote.mount -dir=/xxx -remote=cloud1/bucket +``` + +However, usually you may have multiple buckets in one cloud storage. How to synchronize them automatically? + +# Design + +The `weed filer.remote.sync` added a few of features: +* Upload all changes under `/buckets` to remote storage. +* If any buckets are created or deleted, the remote storage will also create or delete the corresponding buckets. +* The new buckets will be automatically mounted. + +To do so, the `weed filer.remote.sync` process needs to know the default remote storage to create the new bucket. + +# Usage +## Mount all existing remote buckets to local +TBD + +## Upload local changes in `/buckets` +``` +$ weed filer.remote.sync -createBucketAt=cloud1 +synchronize /buckets, default new bucket creation in cloud1 ... +```