Updated Filer as a Key Large Value Store (markdown)

Chris Lu 2020-12-29 03:10:08 -08:00
parent fc1f5e68aa
commit 904c0c7d6f

@ -4,7 +4,7 @@ Usually key-value stores are limited by the storage capacity. As the data size g
Instead, we can move the large value data outside of KV stores, and only store the reference in KV stores.
With SeaweedFS, a large value can be stored as a chunk on volume servers and can be referenced by a chunk id, which is a small string. In addition, the smaller values can be stored directly in KV stores, saving one network hop. So you can get an efficient KV store with almost unlimited size, while still have the same access speed for small values and reasonable speed for larger values.
With SeaweedFS, a large value can be stored as a chunk on volume servers and can be referenced by a chunk id, which is 20 bytes. In addition, the smaller values can be stored directly in KV stores, saving one network hop. So you can get an efficient KV store with almost unlimited size, while still have the same access speed for small values and reasonable speed for larger values.
## How to do it?