gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity

Updated run Spark on SeaweedFS (markdown)

Chris Lu 2020-09-28 21:12:48 -07:00
parent 8d9e04d14d
commit caf9033926
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
run-Spark-on-SeaweedFS.md

@ -15,8 +15,8 @@ Copy the seaweedfs-hadoop2-client-x.x.x.jar to all executor machines.
Add the following to spark/conf/spark-defaults.conf on every node running Spark
```
spark.driver.extraClassPath /path/to/seaweedfs-hadoop2-client-x.x.x.jar
spark.executor.extraClassPath /path/to/seaweedfs-hadoop2-client-x.x.x.jar
spark.driver.extraClassPath=/path/to/seaweedfs-hadoop2-client-1.4.8.jar
spark.executor.extraClassPath=/path/to/seaweedfs-hadoop2-client-1.4.8.jar
```
And modify the configuration at runntime: