Updated Filer Stores (markdown)

Chris Lu 2021-01-05 13:23:29 -08:00
parent d2f3f415b3
commit 399fa6c0d6

@ -6,10 +6,11 @@ The Filer Store persists all file metadata and directory information.
| ---------------- | -- | -- | -- | -- | -- | -- | | ---------------- | -- | -- | -- | -- | -- | -- |
| memory | O(1) | limited by memory | Local, Fast | | Yes| for testing only, no persistent storage | | memory | O(1) | limited by memory | Local, Fast | | Yes| for testing only, no persistent storage |
| leveldb | O(logN)| unlimited | Local, Very Fast | | Yes| Default, fairly scalable | | leveldb | O(logN)| unlimited | Local, Very Fast | | Yes| Default, fairly scalable |
| RocksDB | O(logN)| unlimited | Local, Very Fast | | Native| Default, fairly scalable |
| leveldb2 | O(logN)| unlimited | Local, Very Fast, faster than leveldb | | Yes| Similar to leveldb, part of the lookup key is 128bit MD5 instead of the long full file path | | leveldb2 | O(logN)| unlimited | Local, Very Fast, faster than leveldb | | Yes| Similar to leveldb, part of the lookup key is 128bit MD5 instead of the long full file path |
| Mongodb | O(logN)| unlimited | Local or Distributed, Fast | | Yes| Easy to manage | | Mongodb | O(logN)| unlimited | Local or Distributed, Fast | | Yes| Easy to manage |
| Redis | O(1) | limited | Local or Distributed, Fastest ||Yes| one directory's sub file names are stored in one key~value entry | | Redis | O(1) | limited | Local or Distributed, Fastest ||Native| one directory's sub file names are stored in one key~value entry |
| Cassandra | O(logN)| unlimited | Local or Distributed, Very Fast||Yes| | | Cassandra | O(logN)| unlimited | Local or Distributed, Very Fast||Native| |
| MySql | O(logN)| unlimited | Local or Distributed, Fast |Atomic| Yes| Easy to manage | | MySql | O(logN)| unlimited | Local or Distributed, Fast |Atomic| Yes| Easy to manage |
| Postgres | O(logN)| unlimited | Local or Distributed, Fast |Atomic| Yes| Easy to manage | | Postgres | O(logN)| unlimited | Local or Distributed, Fast |Atomic| Yes| Easy to manage |
| MemSql | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable | | MemSql | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable |
@ -17,7 +18,7 @@ The Filer Store persists all file metadata and directory information.
| CockroachDB | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable | | CockroachDB | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable |
| Etcd | O(logN)| ~10GB | Distributed, 10,000 writes/sec || Yes| No SPOF. High Availability.| | Etcd | O(logN)| ~10GB | Distributed, 10,000 writes/sec || Yes| No SPOF. High Availability.|
| ElasticSearch | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable, Searchable | | ElasticSearch | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable, Searchable |
| HBase | O(logN)| unlimited | Distributed, Fast |Atomic| Yes| Scalable | | HBase | O(logN)| unlimited | Distributed, Fast | | Native| Scalable |
#### Switching between different Stores #### Switching between different Stores
It is easy to switch between different filer stores. It is easy to switch between different filer stores.