gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity
8207 commits 28 branches 278 tags 135 MiB
Commit graph

5369 commits

Author SHA1 Message Date
chrislu b9f7b6fb9a adjust log message 2022-06-26 23:12:16 -07:00
Chris Lu fdd880b111
Merge pull request #3237 from shichanglin5/remove_query_collection 
Remove the collection query param of s3api and let the collection be …
 2022-06-26 23:02:11 -07:00
石昌林 15bfc60a88 Remove the collection query param of s3api and let the collection be determined by the filer 2022-06-27 13:47:53 +08:00
yulai.li af23e63e3f Improve filer command help, add supported filer store list 2022-06-27 12:09:16 +08:00
chrislu 40a9634c3d 3.13 2022-06-26 20:13:52 -07:00
Chris Lu cc01f71752
Merge pull request #3233 from blacktear23/filerstore-tikv 
Add TiKV Filerstore back
 2022-06-26 20:12:18 -07:00
yulai.li 824cbe32be Make tikv filer enable/disable by build tags 2022-06-27 10:57:24 +08:00
chrislu 9dfea44aeb fix unit 2022-06-26 12:21:38 -07:00
chrislu 3142e77eca mount: stats report physical size instead of logical size 2022-06-26 12:14:34 -07:00
yulai.li 13159ad0d8 Merge branch 'master' into filerstore-tikv 2022-06-26 22:44:01 +08:00
yulai.li 46e0b629e5 Update tikv client version and add one PC support 2022-06-26 22:43:37 +08:00
chrislu f77eda4b4f Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-25 09:22:52 -07:00
chrislu 3ce46c3566 fix entry full url lookup 2022-06-25 09:22:49 -07:00
Chris Lu dc59ccd110
Merge pull request #3228 from shichanglin5/fix_volumeNotFound 
When the connection with the leader is disconnected, the vidMap shoul…
 2022-06-24 23:06:13 -07:00
石昌林 f1ea906c13 Code comment optimization 2022-06-25 11:56:09 +08:00
石昌林 0c8e033e68 When the connection with the leader is disconnected, the vidMap should not be reset immediately, but should be reset after connecting to a new leader 2022-06-24 17:41:46 +08:00
chrislu 9c517d2b35 masterclient: fallback to directly querying master in case of missing volume id location 2022-06-24 02:08:57 -07:00
Chris Lu 280e33092c
Merge pull request #3226 from kmlebedev/advancedtls 
Advancedtls
 2022-06-24 01:34:58 -07:00
chrislu 509a9047db test compact map with snowflake sequencer 2022-06-23 21:45:51 -07:00
chrislu 217d7dc377 verify seq is always unique 2022-06-23 21:22:05 -07:00
Konstantin Lebedev 2e782dfdcb rm defer comments 2022-06-24 01:50:13 +05:00
Konstantin Lebedev 7efaafb0ee fix Authenticate 2022-06-24 01:42:04 +05:00
Konstantin Lebedev b0aa51d7ef enable require client cert 2022-06-24 00:29:23 +05:00
Konstantin Lebedev ea7cdb8b0e seperate option 2022-06-24 00:26:56 +05:00
Konstantin Lebedev 5b388ed6c1 initial advancedtls 2022-06-23 23:32:15 +05:00
chrislu 0c13fc873c fix compilation 2022-06-23 00:45:11 -07:00
chrislu 96496d5286 master: broadcast new volume locations to clients to avoid possible racing condition 
fix https://github.com/chrislusf/seaweedfs/issues/3220
 2022-06-23 00:41:33 -07:00
chrislu 52c44d646e Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-22 00:34:27 -07:00
chrislu 530da0cc89 remove unused code 2022-06-22 00:34:25 -07:00
famosss 8a6e7a7df8
Merge branch 'chrislusf:master' into master 2022-06-22 09:58:56 +08:00
zzq09494 9df5ad5309 fix: vacuum create a lot of connections quickly 2022-06-22 09:57:22 +08:00
Chris Lu d652ce1a36
Merge pull request #3216 from kmlebedev/mk_raft_basedir 
avoid no such raft date directory
 2022-06-21 12:21:30 -07:00
chrislu 6b3beb709d fix format 2022-06-21 12:21:02 -07:00
Konstantin Lebedev c1c8dad677 avoid no such raft date directory 
https://github.com/chrislusf/seaweedfs/issues/3214
 2022-06-21 13:47:51 +05:00
chrislu 4dc27e1ed5 3.12 2022-06-20 19:07:00 -07:00
chrislu 492da3dbce master: put metadata under instance specific folder 2022-06-20 19:04:49 -07:00
chrislu 41dfe27102 Revert "remove max connection age" 
This reverts commit b9b684194f.
 2022-06-20 14:49:39 -07:00
chrislu 2295766e2c Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-20 14:16:18 -07:00
chrislu 1d0c53ea56 remote storage: stop supporting hdfs as a remote storage 2022-06-20 14:15:59 -07:00
Stephan 1eb7826909
Fix link to osxfuse github page 2022-06-20 22:36:07 +02:00
chrislu bf5a5abfb1 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-20 13:18:11 -07:00
chrislu 69a2e503ab non-recursive directory deletion 
fix a problem during git checkout a different version, where updated directories are deleted even though the directory is not empty.
 2022-06-20 13:18:08 -07:00
chrislu 76f26c4b99 mount: delete target entry first during move 2022-06-20 13:15:02 -07:00
Chris Lu 460c7cf68e
Merge pull request #3203 from shichanglin5/volume_copy_preallocate 2022-06-20 07:41:45 -07:00
石昌林 81f7f08708 Determine whether to preallocate according to the master configuration before executing copy volume 2022-06-20 21:12:44 +08:00
石昌林 be5c901bea Fix global counter key is incorrect & Add read lock when reading counter map to avoid memory problems 2022-06-20 19:16:53 +08:00
Lapshin Vitaliy 5f5fd0bc48 validate tags on copy object and add regex for validating tags 2022-06-20 11:32:58 +03:00
Chris Lu 9e2d6e897e
Merge pull request #3198 from guol-fnst/fix_statuscode 
AbortMultipartUploadHandler should return 204 instead of 200
 2022-06-19 22:57:13 -07:00
LHHDZ 8db9f13bc6
Merge branch 'master' into circuit_breaker 2022-06-20 13:42:18 +08:00
guol-fnst 1d77deccd0 AbortMultipartUploadHandler should return 204 instead of 200 
https://docs.aws.amazon.com/AmazonS3/latest/API/API_AbortMultipartUpload.html
 2022-06-20 13:26:22 +08:00
石昌林 9e036df356 remove go.uber.org/atomic 2022-06-20 12:35:29 +08:00
geekboood fdacd94af5 fix: invalid chunk data when failed to read manifests 2022-06-19 16:54:04 +08:00
石昌林 3dd60529c5 some code optimizations 2022-06-17 19:07:39 +08:00
石昌林 37df209195 add some unit tests and some code optimizes 2022-06-17 17:11:18 +08:00
Chris Lu d28f8bb88f
Merge pull request #3192 from guol-fnst/weed_update 
remove "weed" from UsageLine, or weed will not show usage of weed update
 2022-06-16 22:58:29 -07:00
guol-fnst c7c20881f5 remove "weed" from UsageLine, or weed will not show usage of weed update 2022-06-17 12:47:04 +08:00
chrislu 625fd16a2e reduce upfront memory usage for low density volume 2022-06-16 15:39:29 -07:00
Chris Lu 5f8d6b5f13
Merge pull request #3184 from guol-fnst/weed_update 
Weed update
 2022-06-16 10:02:45 -07:00
guol-fnst cd078471c4 fix path bug on windows 
fix usage
 2022-06-16 17:24:56 +08:00
chrislu aaa9938353 Revert "adjust conditions" 
This reverts commit e024586ff1.
 2022-06-16 01:26:36 -07:00
guol-fnst 995e221e97 remove -output, add -dir,-name for more flexibility 2022-06-16 16:07:32 +08:00
chrislu e024586ff1 adjust conditions 2022-06-15 23:19:39 -07:00
Chris Lu 82f3bcc65e
Merge pull request #3081 from paochiang/volume_upload_limit_fix 
exclude replication from the concurrentUploadLimitMB
 2022-06-15 23:16:44 -07:00
liubaojiang df0ce31a2e add condition when inFlightUploadDataLimitCond signal 2022-06-16 14:07:11 +08:00
zzq09494 62f74f5e3c add bucket label to s3 prometheus metrics 2022-06-16 13:21:25 +08:00
guol-fnst 4bc8792643 support specific version of weed 2022-06-16 11:40:23 +08:00
guol-fnst 1dbb925d29 remove unused function 
remove log when weed is up to date

add check whether weed is full version
 2022-06-16 11:40:20 +08:00
liubaojiang 3076ac101e move vs.concurrentUploadLimit != 0 out of the lock 2022-06-16 09:58:44 +08:00
Chris Lu 097a12dfb4
Merge pull request #3187 from ningfdx/remote 2022-06-15 06:34:32 -07:00
Chris Lu 55b9f281d1
Merge pull request #3185 from kmlebedev/logging_err_process_range_req 2022-06-15 06:33:33 -07:00
石昌林 78b3728169 add s3 circuit breaker support for 'simultaneous request count' and 'simultaneous request bytes' limitations 
configure s3 circuit breaker by 'command_s3_circuitbreaker.go':
usage eg:
# Configure the number of simultaneous global (current s3api node) requests
s3.circuit.breaker -global -type count -actions Write -values 1000 -apply

# Configure the number of simultaneous requests for bucket x read and write
s3.circuit.breaker -buckets -type count -actions Read,Write -values 1000 -apply

# Configure the total bytes of simultaneous requests for bucket write
s3.circuit.breaker -buckets -type bytes -actions Write -values 100MiB -apply

# Disable circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -enable false -apply

# Delete circuit breaker config of bucket 'x'
s3.circuit.breaker -buckets x -delete -apply
 2022-06-15 21:07:55 +08:00
ningfd 338705f375 fix(wdclient): GetLocations return 2022-06-15 19:20:13 +08:00
Konstantin Lebedev 31a929f7f2 logging processRangeRequest errors 2022-06-15 15:36:43 +05:00
Chris Lu 4eeeb5f50d
Merge pull request #3180 from blacktear23/issue-3149 2022-06-15 00:55:20 -07:00
yulai.li 358c0c0b37 Fix: provide filer.ui.deleteDir options for server command 2022-06-15 15:53:31 +08:00
Guo Lei 3df84cabf6
Merge branch 'chrislusf:master' into weed_update 2022-06-15 15:28:40 +08:00
guol-fnst 695e8c7555 fix minor bug 2022-06-15 15:26:04 +08:00
zhihao.qu 4d0d1848c6 fix(filer.sync): modify clientName format : from -> to 2022-06-15 13:33:20 +08:00
yulai.li b90d213a87 Change ui.deleteDir default to true 2022-06-15 11:37:37 +08:00
zhihao.qu 42d04c581b feat(filer.sync): add metricsServer in filer.sync. 
Metrics include:
(1) the offset of the filer.sync
(2) the last send timestamp of the filer subscription
 2022-06-15 11:33:18 +08:00
chrislu d4ef06cdcf 3.11 2022-06-14 12:14:52 -07:00
chrislu b347b2fb54 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-14 11:16:51 -07:00
chrislu 36d2756978 volume: avoid writing too much data for range requests in large files 
related to https://github.com/chrislusf/seaweedfs/issues/3178
 2022-06-14 11:16:47 -07:00
yulai.li 28cda854eb Add filer command line parameter to let Filer UI show/hide directory delete button 2022-06-15 00:30:49 +08:00
zhihao.qu 14d82c3dea feat(filer.sync): add offset to path. 2022-06-14 19:46:02 +08:00
guol-fnst 78fc9cdfa0 add "copied from https://github.com/restic/restic/tree/master/internal/selfupdate" 2022-06-14 19:10:54 +08:00
guol-fnst 322dbcf372 add update feature 2022-06-14 19:01:57 +08:00
Chris Lu b22ca85fbb
Merge pull request #3169 from shichanglin5/fix_auth 
fix: When there is no access permission configured before startup, th…
 2022-06-12 23:40:42 -07:00
shichanglin5 f01dd27752 fix: When there is no access permission configured before startup, the authentication does not take effect after configuring the permission after startup 2022-06-13 13:23:26 +08:00
chrislu e437ec5a68 3.10 2022-06-12 19:30:27 -07:00
chrislu d12f431d98 collect volume server status 2022-06-12 11:56:23 -07:00
chrislu 444ac21050 go fmt 2022-06-11 09:51:11 -07:00
chrislu a74e926063 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-11 09:51:02 -07:00
chrislu 61b8c9c361 remote object store gateway: disable tagging for backblaze 2022-06-11 09:50:59 -07:00
Chris Lu 0a8b3948db
Merge pull request #3165 from blacktear23/reload-bug-fix 2022-06-10 07:47:43 -07:00
yulai.li 83f8cdd5cb Bug Fix: force reload filer page when upload/delete/rename/create directory 2022-06-10 22:39:21 +08:00
guol-fnst eabf4d4e64 fix typo 2022-06-10 22:03:11 +08:00
Chris Lu 36757d28a8
Merge pull request #3163 from kmlebedev/metric_replica_placement_mismatch 
stats master_replica_placement_mismatch
 2022-06-10 06:44:16 -07:00
chrislu 9f8b72a54d Revert "Merge pull request #3159 from shichanglin5/_duplicateUUID" 
This reverts commit 37da689319, reversing
changes made to 00d53c34c4.
 2022-06-10 06:38:17 -07:00
Konstantin Lebedev fb57aa431c stats master_replica_placement_mismatch 2022-06-10 15:30:40 +05:00