From 4c2621c525efce8f4c7915d0536944b557231dbf Mon Sep 17 00:00:00 2001 From: Adam Lamar Date: Fri, 11 Feb 2022 15:43:42 -0700 Subject: [PATCH] Updated S3 API FAQ (markdown) --- S3-API-FAQ.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/S3-API-FAQ.md b/S3-API-FAQ.md index 765581b..05f0d2b 100644 --- a/S3-API-FAQ.md +++ b/S3-API-FAQ.md @@ -40,9 +40,9 @@ Having separate LevelDB instance, or separate SQL tables, will help to isolate t ## Filer Metadata Store Growth -Due to the semantics of the S3 API, empty directories (aka prefixes) aren't shown. However, an entry is still stored in the filer metadata store. When access patterns create many unique directories and then remove all the objects inside those directories, the filer metadata store can grow unbounded with orphaned directories. These directories are visible in the filer metadata store itself, but not using the S3 API. +Due to the semantics of the S3 API, empty directories (aka prefixes) aren't shown. However, an entry is still stored in the filer metadata store. When workload access patterns create many unique directories and then remove all the objects inside those directories, the filer metadata store can grow unbounded with orphaned directories. These directories are visible in the filer metadata store itself, but not using the S3 API. -If the filer argument `-allowEmptyFolder=false` is set, the orphaned directories are cleaned up during list requests for non top-level directories. Simply list an existing, non bucket-level directory. +If the filer argument `-allowEmptyFolder=false` is set, the orphaned directories are cleaned up during list requests for non bucket-level directories. Normally this works well, but if the workload never performs a list operation, the orphaned directories may never be cleaned up. To force cleanup, simply list an existing, non bucket-level directory. Example using rclone: @@ -50,4 +50,4 @@ Example using rclone: rclone lsf seaweedfs:my-bucket/dir ``` -If the directory `dir` exists in `my-bucket`, the orphaned metadata will be cleaned up. Note that `rclone ls` does not trigger cleanup, but `rclone lsf` will. \ No newline at end of file +If the directory `dir` exists in `my-bucket`, the orphaned metadata will be cleaned up. Note that due to slight API usage differences, `rclone ls` does not trigger cleanup, but `rclone lsf` will. \ No newline at end of file