Updated Hadoop Compatible File System (markdown)

Chris Lu 2020-09-16 17:23:43 -07:00
parent 902b890865
commit 33141d295b

@ -73,7 +73,7 @@ Both reads and writes are working fine.
1. `fs.seaweedfs.impl`: This property defines the Seaweed HCFS implementation classes that are contained in the SeaweedFS HDFS client JAR. It is required.
1. `fs.defaultFS`: This property defines the default file system URI to use. It is optional if a path always has prefix `seaweedfs://localhost:8888`.
1. `fs.AbstractFileSystem.seaweedfs.impl`: Add the SeaweedFS implementation of Hadoop AbstractFileSystem to delegates to the existing SeaweedFS FileSystem and is only necessary for use with Hadoop 3.x.
1. `io.file.buffer.size`: Optionally change the HDFS default 4K buffer size to a larger number, e.g. 4194304.
1. `fs.seaweed.buffer.size`: Optionally change the default buffer size 4194304 to a larger number. It will be the default chunk size.
```
<configuration>
@ -90,7 +90,7 @@ Both reads and writes are working fine.
<value>seaweed.hdfs.SeaweedAbstractFileSystem</value>
</property>
<property>
<name>io.file.buffer.size</name>
<name>fs.seaweed.buffer.size</name>
<value>4194304</value>
</property>
</configuration>