Updated Filer as a Key Large Value Store (markdown)

Chris Lu 2020-12-29 03:13:54 -08:00
parent 904c0c7d6f
commit dc35e4d53a

@ -4,7 +4,7 @@ Usually key-value stores are limited by the storage capacity. As the data size g
Instead, we can move the large value data outside of KV stores, and only store the reference in KV stores.
With SeaweedFS, a large value can be stored as a chunk on volume servers and can be referenced by a chunk id, which is 20 bytes. In addition, the smaller values can be stored directly in KV stores, saving one network hop. So you can get an efficient KV store with almost unlimited size, while still have the same access speed for small values and reasonable speed for larger values.
With SeaweedFS, a large value can be stored as a chunk on volume servers and can be referenced by a chunk id, which is 16 bytes. In addition, the smaller values can be stored directly in KV stores, saving one network hop. So you can get an efficient KV store with almost unlimited size, while still have the same access speed for small values and reasonable speed for larger values.
## How to do it?