Updated Filer Stores (markdown)

Chris Lu 2020-03-09 01:04:12 -07:00
parent f2d4f4758a
commit bcfabdb94a

@ -4,18 +4,18 @@ The Filer Store persists all file metadata and directory information.
| Filer Store Name | Lookup | number of entries in a folder | Scalability | Directory Renaming | TTL | Note |
| ---------------- | -- | -- | -- | -- | -- | -- |
| memory | O(1) | limited by memory | Local, Fast | | | for testing only, no persistent storage |
| leveldb | O(logN)| unlimited | Local, Very Fast | | | Default, fairly scalable |
| leveldb2 | O(logN)| unlimited | Local, Very Fast, faster than leveldb | | | Similar to leveldb, part of the lookup key is 128bit MD5 instead of the long full file path |
| memory | O(1) | limited by memory | Local, Fast | | Yes| for testing only, no persistent storage |
| leveldb | O(logN)| unlimited | Local, Very Fast | | Yes| Default, fairly scalable |
| leveldb2 | O(logN)| unlimited | Local, Very Fast, faster than leveldb | | Yes| Similar to leveldb, part of the lookup key is 128bit MD5 instead of the long full file path |
| Redis | O(1) | limited | Local or Distributed, Fastest ||Yes| one directory's sub file names are stored in one key~value entry |
| Cassandra | O(logN)| unlimited | Local or Distributed, Very Fast||Yes| |
| MySql | O(logN)| unlimited | Local or Distributed, Fast |Atomic| | Easy to manage |
| Postgres | O(logN)| unlimited | Local or Distributed, Fast |Atomic| | Easy to manage |
| MemSql | O(logN)| unlimited | Distributed, Fast |Atomic| | Scalable |
| TiDB | O(logN)| unlimited | Distributed, Fast |Atomic| | Scalable |
| CockroachDB | O(logN)| unlimited | Distributed, Fast |Atomic| | Scalable |
| Etcd | O(logN)| ~10GB | Distributed, 10,000 writes/sec || | No SPOF. High Availability.|
| TiKV | O(logN)| unlimited | Local or Distributed, Fast |Atomic| | Easy to manage |
| MySql | O(logN)| unlimited | Local or Distributed, Fast |Atomic| Yes| Easy to manage |
| Postgres | O(logN)| unlimited | Local or Distributed, Fast |Atomic| Yes| Easy to manage |
| MemSql | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable |
| TiDB | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable |
| CockroachDB | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable |
| Etcd | O(logN)| ~10GB | Distributed, 10,000 writes/sec || Yes| No SPOF. High Availability.|
| TiKV | O(logN)| unlimited | Local or Distributed, Fast |Atomic| Yes| Easy to manage |
#### Switching between different Stores
It is easy to switch between different filer stores.