gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity

Updated Cloud Cache Architecture (markdown)

Chris Lu 2021-08-16 01:23:25 -07:00
parent ea23b8812e
commit 0e27e628eb
1 changed files with 6 additions and 6 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
Cloud-Cache-Architecture.md

@ -1,8 +1,8 @@
# SeaweedFS Remote Storage Cache
# SeaweedFS Cloud Cache
With this feature, SeaweedFS can cache data that is on cloud. It can cache metadata and file content. Given SeaweedFS unlimited scalability, the cache size is actually unlimited. Any local changes can be write back to the cloud asynchronously.
With this feature, SeaweedFS can cache data that is on cloud. It can cache both metadata and file content. Given SeaweedFS unlimited scalability, the cache size is actually unlimited. Any local changes can be write back to the cloud asynchronously.
![SeaweedFS Remote Storage](https://raw.githubusercontent.com/chrislusf/seaweedfs/master/note/SeaweedFS_RemoteMount.png)
![SeaweedFS Cloud Cache](https://raw.githubusercontent.com/chrislusf/seaweedfs/master/note/SeaweedFS_RemoteMount.png)
```
[HDFS|Mount|HTTP|S3|WebDAV] <== Filer(metadata cache) <== Volume Servers (data cache) <== Cloud
@ -10,7 +10,7 @@ With this feature, SeaweedFS can cache data that is on cloud. It can cache metad
[HDFS|Mount|HTTP|S3|WebDAV] ==> Filer(metadata cache) ==> Volume Servers (data cache) ==> `weed filer.remote.sync` ==> Cloud
```
There are no format changes to the files on the cloud. The mounted files will be just normal files on the cloud storage, and can be consumed by the cloud ecosystem.
There are no format changes to the files on the cloud. The mounted files will be mapped to normal files on the cloud storage, and can be consumed by the cloud ecosystem.
## Mount Remote Storage
@ -38,9 +38,9 @@ The local cache will get updated (except deletions). It is a light weight proces
By default, the file content is [[cached|Cache Remote Storage]] to local volume servers on the first read.
Sometimes you may want to fetch all file content for a set of files. But trying to warm up the cache by open and read all files is not fun.
Here you can run command `remote.cache -dir=/path/to/xxx/cacheNeeded` in `weed shell`, which will cache all files under the specified directory.
Here you can run command `remote.cache -dir=/path/to/xxx/cacheNeeded` in `weed shell`, which will cache all files under the specified directory. You can also cache by file name, size, age, etc.
Purge local cache, you can run `remote.uncache -dir=/path/to/xxx/cacheNeeded` in `weed shell`.
To purge local cache, you can run `remote.uncache -dir=/path/to/xxx/cacheNeeded` in `weed shell`.
## Write Back Cache