gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity

Updated Run Presto on SeaweedFS (markdown)

boshen-dev 2020-12-02 19:44:14 +08:00
parent 71a6c0b712
commit fbe969922c
1 changed files with 37 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

38
Run-Presto-on-SeaweedFS.md

@ -51,5 +51,41 @@ Follow instructions for installation of Presto:
### Configure Presto to support SeaweedFS
1. Copy the seaweedfs-hadoop2-client-1.5.6.jar to Presto directory,for example:
```
cp seaweedfs-hadoop2-client-1.5.6.jar /opt/presto-server-344/plugin/hive-hadoop2
cp seaweedfs-hadoop2-client-1.5.6.jar /opt/presto-server-347/plugin/hive-hadoop2/
```
2. Modify core-site.xml
modify /opt/presto-server-347/etc/catalog/core-site.xml to support SeaweedFS, 30888 is the filer port
```
<configuration>
<property>
<name>fs.defaultFS</name>
<value>seaweedfs://10.0.100.51:30888</value>
</property>
<property>
<name>fs.seaweedfs.impl</name>
<value>seaweed.hdfs.SeaweedFileSystem</value>
</property>
<property>
<name>fs.AbstractFileSystem.seaweedfs.impl</name>
<value>seaweed.hdfs.SeaweedAbstractFileSystem</value>
</property>
<property>
<name>fs.seaweed.buffer.size</name>
<value>4194304</value>
</property>
</configuration>
```
3. Modify hive.properties
hive.metastore.uri is the service address of the previously deployed Hive Metastore
hive.config.resources points to the core-site.xml above
```
connector.name=hive-hadoop2
hive.metastore.uri=thrift://10.0.100.51:39768
hive.allow-drop-table=true
hive.max-partitions-per-scan=1000000
hive.compression-codec=NONE
hive.config.resources=/opt/presto-server-347/etc/catalog/core-site.xml
```