Updated Hadoop Compatible File System (markdown)

Chris Lu 2020-09-28 20:48:20 -07:00
parent d2b4d86d36
commit 8d9e04d14d

@ -50,6 +50,9 @@ You would need to start a weed filer first, build the seaweedfs-hadoop2-client-x
or seaweedfs-hadoop3-client-xxx.jar, and do the following:
```
# optionally adjust hadoop memory allocation
$ export HADOOP_CLIENT_OPTS="-Xmx4g"
$ cd ${HADOOP_HOME}
# create etc/hadoop/mapred-site.xml, just to satisfy hdfs dfs. skip this if the file already exists.
$ echo "<configuration></configuration>" > etc/hadoop/mapred-site.xml
@ -111,8 +114,6 @@ $ cp ./seaweedfs-hadoop3-client-x.x.x.jar share/hadoop/common/lib/
Now you can do this:
```
$ cd ${HADOOP_HOME}
// optionally adjust hadoop memory allocation
$ export HADOOP_CLIENT_OPTS="-Xmx4g"
$ bin/hdfs dfs -ls /
# if you did not set fs.defaultFS in etc/hadoop/core-site.xml