gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity

Updated S3 API Benchmark (markdown)

Chris Lu 2020-11-21 15:04:22 -08:00
parent 941e31e127
commit 26d9b07ce0
1 changed files with 47 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

47
S3-API-Benchmark.md

@ -1,3 +1,50 @@
# Test with Warp
https://github.com/minio/warp
Warp is a more complete test suite. It needs identity access management. So you would need to configure authentication info with `weed s3 -conf=...` or `weed filer -s3 -s3.conf=...`. See https://github.com/chrislusf/seaweedfs/wiki/Amazon-S3-API#authentication
Here is the results from my local laptop written to an external SSD via USB 3.1:
```
$ warp mixed --host localhost:8333 --access-key some_access_key1 --secret-key some_secret_key1 --duration=1m --obj.size 1024B --concurrent 4
warp: Benchmark data written to "warp-mixed-2020-11-21[145531]-iPQO.csv.zst"
Mixed operations.
Operation: DELETE, 10%, Concurrency: 4, Duration: 59s.
* Throughput: 419.91 obj/s
Operation: GET, 45%, Concurrency: 4, Duration: 59s.
* Throughput: 1.85 MiB/s, 1889.68 obj/s
Operation: PUT, 15%, Concurrency: 4, Duration: 59s.
* Throughput: 0.62 MiB/s, 629.96 obj/s
Operation: STAT, 30%, Concurrency: 4, Duration: 59s.
* Throughput: 1259.79 obj/s
Cluster Total: 2.46 MiB/s, 4199.28 obj/s
warp: Cleanup Done.
$ warp mixed --host localhost:8333 --access-key some_access_key1 --secret-key some_secret_key1 --duration=1m --obj.size 102400B --concurrent 4
warp: Benchmark data written to "warp-mixed-2020-11-21[145817]-YvKD.csv.zst"
Mixed operations.
Operation: DELETE, 10%, Concurrency: 4, Duration: 59s.
* Throughput: 309.05 obj/s
Operation: GET, 45%, Concurrency: 4, Duration: 1m0s.
* Throughput: 135.82 MiB/s, 1390.75 obj/s
Operation: PUT, 15%, Concurrency: 4, Duration: 59s.
* Throughput: 45.28 MiB/s, 463.71 obj/s
Operation: STAT, 30%, Concurrency: 4, Duration: 59s.
* Throughput: 927.00 obj/s
Cluster Total: 181.10 MiB/s, 3090.45 obj/s
warp: Cleanup Done.
```
# Test with Hotsauce S3 Benchmark
Found this https://github.com/markhpc/hsbench tool which seems easy to use.