Commit graph

8139 commits

Author SHA1 Message Date
石昌林 3dd60529c5 some code optimizations 2022-06-17 19:07:39 +08:00
石昌林 37df209195 add some unit tests and some code optimizes 2022-06-17 17:11:18 +08:00
Chris Lu d28f8bb88f
Merge pull request #3192 from guol-fnst/weed_update
remove "weed" from UsageLine, or weed will not show usage of weed update
2022-06-16 22:58:29 -07:00
guol-fnst c7c20881f5 remove "weed" from UsageLine, or weed will not show usage of weed update 2022-06-17 12:47:04 +08:00
chrislu 625fd16a2e reduce upfront memory usage for low density volume 2022-06-16 15:39:29 -07:00
Chris Lu 5f8d6b5f13
Merge pull request #3184 from guol-fnst/weed_update
Weed update
2022-06-16 10:02:45 -07:00
guol-fnst cd078471c4 fix path bug on windows
fix usage
2022-06-16 17:24:56 +08:00
chrislu aaa9938353 Revert "adjust conditions"
This reverts commit e024586ff1.
2022-06-16 01:26:36 -07:00
guol-fnst 995e221e97 remove -output, add -dir,-name for more flexibility 2022-06-16 16:07:32 +08:00
chrislu e024586ff1 adjust conditions 2022-06-15 23:19:39 -07:00
Chris Lu 82f3bcc65e
Merge pull request #3081 from paochiang/volume_upload_limit_fix
exclude replication from the concurrentUploadLimitMB
2022-06-15 23:16:44 -07:00
Chris Lu 40055211bd
Merge pull request #3190 from famosss/master
add bucket label to s3 prometheus metrics
2022-06-15 23:15:41 -07:00
liubaojiang df0ce31a2e add condition when inFlightUploadDataLimitCond signal 2022-06-16 14:07:11 +08:00
zzq09494 6449114e5e format 2022-06-16 13:52:36 +08:00
zzq09494 0a613876ca add bucket label to the grafana dashboard 2022-06-16 13:50:16 +08:00
zzq09494 62f74f5e3c add bucket label to s3 prometheus metrics 2022-06-16 13:21:25 +08:00
guol-fnst 4bc8792643 support specific version of weed 2022-06-16 11:40:23 +08:00
guol-fnst 1dbb925d29 remove unused function
remove log when weed is up to date

add check whether weed is full version
2022-06-16 11:40:20 +08:00
liubaojiang 3076ac101e move vs.concurrentUploadLimit != 0 out of the lock 2022-06-16 09:58:44 +08:00
Chris Lu 097a12dfb4
Merge pull request #3187 from ningfdx/remote 2022-06-15 06:34:32 -07:00
Chris Lu 55b9f281d1
Merge pull request #3185 from kmlebedev/logging_err_process_range_req 2022-06-15 06:33:33 -07:00
石昌林 78b3728169 add s3 circuit breaker support for 'simultaneous request count' and 'simultaneous request bytes' limitations
configure s3 circuit breaker by 'command_s3_circuitbreaker.go':
usage eg:
# Configure the number of simultaneous global (current s3api node) requests
s3.circuit.breaker -global -type count -actions Write -values 1000 -apply

# Configure the number of simultaneous requests for bucket x read and write
s3.circuit.breaker -buckets -type count -actions Read,Write -values 1000 -apply

# Configure the total bytes of simultaneous requests for bucket write
s3.circuit.breaker -buckets -type bytes -actions Write -values 100MiB -apply

# Disable circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -enable false -apply

# Delete circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -delete -apply
2022-06-15 21:07:55 +08:00
ningfd 338705f375 fix(wdclient): GetLocations return 2022-06-15 19:20:13 +08:00
Konstantin Lebedev 31a929f7f2 logging processRangeRequest errors 2022-06-15 15:36:43 +05:00
Chris Lu 4eeeb5f50d
Merge pull request #3180 from blacktear23/issue-3149 2022-06-15 00:55:20 -07:00
yulai.li 358c0c0b37 Fix: provide filer.ui.deleteDir options for server command 2022-06-15 15:53:31 +08:00
Guo Lei 3df84cabf6
Merge branch 'chrislusf:master' into weed_update 2022-06-15 15:28:40 +08:00
guol-fnst 695e8c7555 fix minor bug 2022-06-15 15:26:04 +08:00
Chris Lu b8ce05c904
Merge pull request #3182 from qzhello/master
feat(filer.sync): add metricsServer in filer.sync.
2022-06-14 22:39:10 -07:00
zhihao.qu 4d0d1848c6 fix(filer.sync): modify clientName format : from -> to 2022-06-15 13:33:20 +08:00
yulai.li b90d213a87 Change ui.deleteDir default to true 2022-06-15 11:37:37 +08:00
zhihao.qu 42d04c581b feat(filer.sync): add metricsServer in filer.sync.
Metrics include:
(1) the offset of the filer.sync
(2) the last send timestamp of the filer subscription
2022-06-15 11:33:18 +08:00
chrislu d4ef06cdcf 3.11 2022-06-14 12:14:52 -07:00
chrislu b347b2fb54 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-14 11:16:51 -07:00
chrislu 36d2756978 volume: avoid writing too much data for range requests in large files
related to https://github.com/chrislusf/seaweedfs/issues/3178
2022-06-14 11:16:47 -07:00
yulai.li 28cda854eb Add filer command line parameter to let Filer UI show/hide directory delete button 2022-06-15 00:30:49 +08:00
Chris Lu 14e0d8613b
Merge pull request #3179 from qzhello/master 2022-06-14 06:02:04 -07:00
zhihao.qu 14d82c3dea feat(filer.sync): add offset to path. 2022-06-14 19:46:02 +08:00
guol-fnst 78fc9cdfa0 add "copied from https://github.com/restic/restic/tree/master/internal/selfupdate" 2022-06-14 19:10:54 +08:00
guol-fnst 322dbcf372 add update feature 2022-06-14 19:01:57 +08:00
Chris Lu cc5d771088
Update container_dev.yml 2022-06-14 01:37:28 -07:00
Chris Lu 623c1a4a16
Merge pull request #3176 from kmlebedev/fix_action_build_container
fix build container
2022-06-14 01:26:34 -07:00
Konstantin Lebedev 2b159c331d fix build container 2022-06-14 13:16:09 +05:00
Chris Lu f2f9e4ec20
Merge pull request #3174 from chrislusf/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.32
Bump github.com/aws/aws-sdk-go from 1.44.14 to 1.44.32
2022-06-13 10:11:51 -07:00
Chris Lu 9bdd7e8725
Merge branch 'master' into dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.32 2022-06-13 10:11:44 -07:00
Chris Lu c1ab14ec8b
Merge pull request #3173 from chrislusf/dependabot/go_modules/github.com/Shopify/sarama-1.34.1
Bump github.com/Shopify/sarama from 1.34.0 to 1.34.1
2022-06-13 10:10:51 -07:00
Chris Lu ef8b803e33
Merge pull request #3171 from chrislusf/dependabot/go_modules/github.com/ydb-platform/ydb-go-sdk/v3-3.26.10
Bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.25.3 to 3.26.10
2022-06-13 10:10:45 -07:00
Chris Lu 46d1640505
Merge pull request #3170 from chrislusf/dependabot/go_modules/google.golang.org/api-0.83.0
Bump google.golang.org/api from 0.82.0 to 0.83.0
2022-06-13 10:10:36 -07:00
Chris Lu 101f2da3cc
Merge branch 'master' into dependabot/go_modules/google.golang.org/api-0.83.0 2022-06-13 10:09:38 -07:00
Chris Lu b847f2bdd1
Merge pull request #3172 from chrislusf/dependabot/go_modules/github.com/linxGnu/grocksdb-1.7.3
Bump github.com/linxGnu/grocksdb from 1.7.2 to 1.7.3
2022-06-13 10:08:16 -07:00