Updated Filer as a Key Large Value Store (markdown)

Chris Lu 2020-12-27 15:37:12 -08:00
parent 75f9147e5e
commit 0acadca1d7

@ -5,10 +5,8 @@ Usually key-value stores are limited by the storage capacity. With SeaweedFS, yo
## How to do it?
There are two tricks:
* Configure to store small values in filer store. E.g., `weed filer -cacheToFilerLimit=1024` will store values less than 1KB to filer itself.
* Configure for [[Super Large Directories]]
This way, values less than 1KB is basically the same as the underlying key-value store, while the larger values are physically stored on volume servers, reducing the storage load.
* Configure to store small values in filer store. E.g., `weed filer -cacheToFilerLimit=1024` will store values less than 1KB to filer store itself. Accessing these entries are basically no difference than accessing the underlying key-value stores directly.
* Configure for [[Super Large Directories]]. It will avoid the additional work to maintain the file list in the large folder.
With the larger values offloaded, the underlying key-value store will also perform better with less bytes to move around.