From c2eebf7c444b41c1a2908626f6a13e6c532ca5fc Mon Sep 17 00:00:00 2001 From: Chris Lu Date: Sun, 27 Dec 2020 15:21:05 -0800 Subject: [PATCH] Updated Filer as a Key Large Value Store (markdown) --- Filer-as-a-Key-Large-Value-Store.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/Filer-as-a-Key-Large-Value-Store.md b/Filer-as-a-Key-Large-Value-Store.md index 551bde7..9df2026 100644 --- a/Filer-as-a-Key-Large-Value-Store.md +++ b/Filer-as-a-Key-Large-Value-Store.md @@ -1,5 +1,15 @@ # Key-Large-Value Store +Usually key-value stores are limited by the storage capacity. With SeaweedFS, you can get key value store with almost unlimited size, while still maintaining reasonable speed. + +## How to do it? + +There are two tricks: +* Configure to store small values in filer store. E.g., `weed filer -cacheToFilerLimit=1024` will store values less than 1KB to filer itself. +* Configure In [[Super Large Directories]] + +This way, values less than 1KB is basically the same as the underlying key-value store, while the larger values are physically stored on volume servers. + # Benchmark with YCSB as a Key-Value store [Yahoo! Cloud Serving Benchmark(YCSB)](https://github.com/brianfrankcooper/YCSB) is a framework for evaluating the performance of different “key-value” and “cloud” serving stores.