gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity

Updated Run Presto on SeaweedFS (markdown)

boshen-dev 2020-12-03 09:13:12 +08:00
parent f5b004781b
commit a363ea7db7
1 changed files with 25 additions and 6 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

23
Run-Presto-on-SeaweedFS.md

@ -34,6 +34,7 @@ modify core-site.xml to support SeaweedFS, 30888 is the filer port
``` ```
3. Modify hive-site.xml 3. Modify hive-site.xml
modify hive-site.xml to support SeaweedFS, need to manually create the /presto/warehouse directory in Filer modify hive-site.xml to support SeaweedFS, need to manually create the /presto/warehouse directory in Filer
metastore.thrift.port is the access port exposed by the Hive Metadata service itself
``` ```
<property> <property>
<name>metastore.warehouse.dir</name> <name>metastore.warehouse.dir</name>
@ -83,17 +84,35 @@ hive.metastore.uri is the service address of the previously deployed Hive Metast
hive.config.resources points to the core-site.xml above hive.config.resources points to the core-site.xml above
``` ```
connector.name=hive-hadoop2 connector.name=hive-hadoop2
hive.metastore.uri=thrift://10.0.100.51:39768 hive.metastore.uri=thrift://10.0.100.51:9850
hive.allow-drop-table=true hive.allow-drop-table=true
hive.max-partitions-per-scan=1000000 hive.max-partitions-per-scan=1000000
hive.compression-codec=NONE hive.compression-codec=NONE
hive.config.resources=/opt/presto-server-347/etc/catalog/core-site.xml hive.config.resources=/opt/presto-server-347/etc/catalog/core-site.xml
``` ```
4. Modify config.properties
The default port of presto is 8080
If you want to modify the default port of the Presto service, you can modify /opt/presto-server-347/etc/config.properties
Need to modify the ports of http-server.http.port and discovery.uri
```
coordinator=true
node-scheduler.include-coordinator=true
http-server.http.port=8080
query.max-memory=200GB
query.max-memory-per-node=8GB
query.max-total-memory-per-node=10GB
query.max-stage-count=200
task.writer-count=4
discovery-server.enabled=true
discovery.uri=http://10.0.100.51:8080
```
# Using Examples # Using Examples
1. Connect to Presto and create a table boshen 1. Connect to Presto and create a table boshen
--server is the ip and port of the Presto service
``` ```
[root@cluster9 ~]# ./presto --server 10.0.100.51:42174 --catalog hive --schema default [root@cluster9 ~]# ./presto --server 10.0.100.51:8080--catalog hive --schema default
presto:default> create table boshen(name varchar); presto:default> create table boshen(name varchar);
CREATE TABLE CREATE TABLE
presto:default> presto:default>