Updated Large File Handling (markdown)

Chris Lu 2018-06-07 21:22:32 -07:00
parent d458357d32
commit 44cb9cd602

@ -48,4 +48,9 @@ The steps to append a large file:
1. update the updated manifest file with mime type "application/json", and add url parameter "cm=true".
## Notes
There are no particular limit in terms of chunk file size. Each chunk size does not need to be the same, even in the same file. The rule of thumb is to just being able to keep the whole chunk file in memory, and not to have too many small chunk files.
There are no particular limit in terms of chunk file size. Each chunk size does not need to be the same, even in the same file. The rule of thumb is to just being able to keep the whole chunk file in memory, and not to have too many small chunk files.
## weed filer and weed mount
The filer server and the FUSE implementation that uses filer server are automatically chunking large files into smaller chunks.
The list of chunks are stored in filer storage, and managed by filer or weed mount client.