gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity

Updated Hadoop Compatible File System (markdown)

Chris Lu 2020-09-28 20:48:20 -07:00
parent d2b4d86d36
commit 8d9e04d14d
1 changed files with 3 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
Hadoop-Compatible-File-System.md

@ -50,6 +50,9 @@ You would need to start a weed filer first, build the seaweedfs-hadoop2-client-x
or seaweedfs-hadoop3-client-xxx.jar, and do the following: or seaweedfs-hadoop3-client-xxx.jar, and do the following:
``` ```
# optionally adjust hadoop memory allocation
$ export HADOOP_CLIENT_OPTS="-Xmx4g"
$ cd ${HADOOP_HOME} $ cd ${HADOOP_HOME}
# create etc/hadoop/mapred-site.xml, just to satisfy hdfs dfs. skip this if the file already exists. # create etc/hadoop/mapred-site.xml, just to satisfy hdfs dfs. skip this if the file already exists.
$ echo "<configuration></configuration>" > etc/hadoop/mapred-site.xml $ echo "<configuration></configuration>" > etc/hadoop/mapred-site.xml
@ -111,8 +114,6 @@ $ cp ./seaweedfs-hadoop3-client-x.x.x.jar share/hadoop/common/lib/
Now you can do this: Now you can do this:
``` ```
$ cd ${HADOOP_HOME} $ cd ${HADOOP_HOME}
// optionally adjust hadoop memory allocation
$ export HADOOP_CLIENT_OPTS="-Xmx4g"
$ bin/hdfs dfs -ls / $ bin/hdfs dfs -ls /
# if you did not set fs.defaultFS in etc/hadoop/core-site.xml # if you did not set fs.defaultFS in etc/hadoop/core-site.xml