chrislu
093fdc1621
subscriber can get assignments
2023-12-28 20:35:15 -08:00
chrislu
9ed26cd7b0
Merge branch 'master' into mq-subscribe
2023-12-28 11:57:30 -08:00
chrislu
c950a40aad
subscriber keep connected to the balancer
2023-12-28 11:56:37 -08:00
Konstantin Lebedev
183352c796
shell meta load add concurrency ( #4529 )
...
* fix: increase speed cmd fs meta load
* fix: add wg
2023-12-28 11:54:37 -08:00
Lars Lehtonen
edc0532b1d
weed/server: remove unneeded err from streamReadOneVolume() signature ( #5143 )
2023-12-28 11:45:13 -08:00
chrislu
bebbc9fe44
create volume grow request if the selected volume is close to full
2023-12-27 11:45:44 -08:00
chrislu
bb9269f3f7
Revert "Update network.go since To16 converts the IP address ip up to a 16-byte representation. If ip is not an IP address (it is the wrong length), To16 returns nil. ( #5134 )"
...
This reverts commit 838578b55f
2023-12-24 12:31:08 -08:00
chrislu
c6b1dc7058
remove unused code
2023-12-24 11:11:41 -08:00
vivekkoya
838578b55f
Update network.go since To16 converts the IP address ip up to a 16-byte representation. If ip is not an IP address (it is the wrong length), To16 returns nil. ( #5134 )
2023-12-23 15:01:57 -08:00
Seyed Mahdi Sadegh Shobeiri
97236389e8
Add modifyTimeAgo to volume.fsck ( #5133 )
...
* Add modifyTimeAgo to volume.fsck
* Fix AppendAtNs
2023-12-23 12:17:30 -08:00
Seyed Mahdi Sadegh Shobeiri
54ba2c8868
Fix cutoffTimeAgo in findMissingChunksInFiler ( #5132 )
2023-12-23 09:18:16 -08:00
chrislu
03c4b2e988
correct lock accounting
...
possibly fix https://github.com/seaweedfs/seaweedfs/issues/5082
2023-12-22 14:16:23 -08:00
chrislu
c4badf7396
adjust options
2023-12-22 11:41:10 -08:00
chrislu
6324062acc
fix
2023-12-22 11:37:15 -08:00
chrislu
e0727071c8
go fmt
2023-12-22 11:33:50 -08:00
chrislu
ee1c9bc314
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2023-12-22 11:33:02 -08:00
chrislu
034db049a0
comment fix
2023-12-22 11:33:00 -08:00
chrislu
6df44d3c95
option to filer.copy with public volume server url
...
fix https://github.com/seaweedfs/seaweedfs/issues/5126
2023-12-22 11:32:43 -08:00
chrislu
7a0d1e7fc1
minor
2023-12-22 11:29:54 -08:00
Farbod
c278f49bca
Using filer.remote.sync concurrency in filer.remote.gateway ( #5123 )
...
- Chnaged ProcessEvenFn to be concurrent just like filer.remote.sync
Co-authored-by: itsfarbod <itsfarbod@hamravesh.com>
2023-12-20 16:25:54 -08:00
jerebear12
06343f8976
Set allowed origins in config ( #5109 )
...
* Add a way to use a JWT in an HTTP only cookie
If a JWT is not included in the Authorization header or a query string, attempt to get a JWT from an HTTP only cookie.
* Added a way to specify allowed origins header from config
* Removed unecessary log
* Check list of domains from config or command flag
* Handle default wildcard and change name of config value to cors
2023-12-20 16:21:11 -08:00
Konstantin Lebedev
3c9bcfb864
chore: add dsn for connection to mysql ( #5060 )
...
* chore: add dsn for connection to mysql
* add comment
* new comment
* fix: validate dsn and adapt password
2023-12-20 16:20:58 -08:00
chrislu
915416a277
fix wrong parameter
...
fix https://github.com/seaweedfs/seaweedfs/pull/5102
2023-12-13 12:02:57 -08:00
Farbod
d5c01e5ceb
Remote gateway Bug fix ( #5100 )
2023-12-12 07:46:45 -08:00
chrislu
61b05fad95
fix test
2023-12-11 20:57:29 -08:00
Chris Lu
580940bf82
Merge accumulated changes related to message queue ( #5098 )
...
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
2023-12-11 12:05:54 -08:00
Konstantin Lebedev
125ad8fe63
falls back to update only if error contains msg "duplicate entry"
...
https://github.com/seaweedfs/seaweedfs/issues/5062
2023-12-09 10:18:18 -08:00
chrislu
c1a6e624e5
Merge branch 'master' of https://github.com/seaweedfs/seaweedfs
2023-12-07 08:13:46 -08:00
chrislu
5fe4c04a1a
add missing error in the log
...
related to https://github.com/seaweedfs/seaweedfs/issues/5084
2023-12-07 08:13:42 -08:00
Lars Lehtonen
43a5973a66
weed/storage: fix dropped test errors
2023-12-06 12:05:22 -08:00
jerebear12
d5d9fbb8aa
Add a way to use a JWT in an HTTP only cookie
...
If a JWT is not included in the Authorization header or a query string, attempt to get a JWT from an HTTP only cookie.
2023-12-05 08:57:01 -08:00
chrislu
756bcc032d
adjust logs
2023-11-27 12:57:29 -08:00
Konstantin Lebedev
dd78397fea
logging PickForWrite error
...
https://github.com/seaweedfs/seaweedfs/issues/3886
2023-11-27 12:56:15 -08:00
chrislu
81f11883e3
go fmt
2023-11-26 11:47:20 -08:00
chrislu
7a50762b9e
reduce binary size by skipping rclone
2023-11-23 00:48:27 -08:00
zehweh
d818ca9631
fix TestMisplacedChecking() and add test-case
2023-11-21 08:24:34 -08:00
julor
2fa37e0287
Update filer_server_handlers_write_autochunk.go
2023-11-20 11:17:14 -08:00
julor
9e03b916d8
verify content-md5 in header
...
if upload content by s3 client and set content-md5 in header,then will verify recived and saved content,if not equal delete thos chunks
2023-11-20 11:17:14 -08:00
SmsS4
6c1ce18541
Fix weed fix
2023-11-20 11:14:19 -08:00
Lars Lehtonen
57801687de
weed/command: fix dropped error
2023-11-20 08:05:24 -08:00
Viktor Kuzmin
06e723f629
Waiting for writes to complete with acquired locks may lead to deadlock, fixes #4952
2023-11-17 07:38:14 -08:00
Konstantin Lebedev
2b229e98ce
fix: add doDeleteFile option for filer backup
2023-11-17 07:37:28 -08:00
chrislu
17710e1ecb
adjust logs
2023-11-15 18:11:35 -08:00
Amir H. Yeganemehr
6f559fe838
fs.mergeVolumes: change dir to a named parameter
2023-11-13 08:25:44 -08:00
Amir H. Yeganemehr
d3556479be
Fix typo (dist => dest)
2023-11-13 06:41:24 -08:00
Amir H. Yeganemehr
bb274ea8a3
fs.mergeVolumes: Make a plan based on volumes size
2023-11-13 06:41:24 -08:00
Konstantin Lebedev
e55fa68848
fix: excludeFileName is empty
2023-11-13 06:23:46 -08:00
Konstantin Lebedev
3c5295a1a6
filer backup add option for exclude file names that match the regexp to sync on filer
2023-11-13 06:23:46 -08:00
Konstantin Lebedev
5e41ab1370
s3 api add not implemented response for PutBucketVersioning
2023-11-13 06:22:23 -08:00
Konstantin Lebedev
7f6152f130
s3 api add default response for GetBucketVersioning
2023-11-13 06:22:23 -08:00
