gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity
10110 commits 28 branches 278 tags 135 MiB
Commit graph

10110 commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
chrislu 2845230329 passing broker into the assignments 2023-12-28 21:13:49 -08:00
chrislu 093fdc1621 subscriber can get assignments 2023-12-28 20:35:15 -08:00
Varun Upadhyay 77626666c5
Minor cleanup & gitignore update (#5144) 2023-12-28 20:25:43 -08:00
chrislu 9ed26cd7b0 Merge branch 'master' into mq-subscribe 2023-12-28 11:57:30 -08:00
chrislu c950a40aad subscriber keep connected to the balancer 2023-12-28 11:56:37 -08:00
Konstantin Lebedev 183352c796
shell meta load add concurrency (#4529) 
* fix: increase speed cmd fs meta load

* fix: add wg
 2023-12-28 11:54:37 -08:00
dependabot[bot] 0b8f9de4ec
Bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.53.3 to 3.54.2 (#5138) 
Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk) from 3.53.3 to 3.54.2.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases)
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.53.3...v3.54.2)

---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-28 11:49:23 -08:00
Lars Lehtonen edc0532b1d
weed/server: remove unneeded err from streamReadOneVolume() signature (#5143) 2023-12-28 11:45:13 -08:00
Sébastien 59edb84253
fix: k8s-chart-helm master metrics scraping (#5142) 2023-12-28 07:46:42 -08:00
chrislu bebbc9fe44 create volume grow request if the selected volume is close to full 2023-12-27 11:45:44 -08:00
dependabot[bot] 263b7535bb
Bump golang.org/x/tools from 0.16.0 to 0.16.1 (#5139) 2023-12-25 08:18:18 -08:00
dependabot[bot] 6007318142
Bump go.etcd.io/etcd/client/v3 from 3.5.9 to 3.5.11 (#5137) 2023-12-25 08:17:18 -08:00
dependabot[bot] 3345c2e21d
Bump gocloud.dev/pubsub/natspubsub from 0.34.0 to 0.35.0 (#5136) 2023-12-25 08:16:53 -08:00
chrislu bb9269f3f7 Revert "Update network.go since To16 converts the IP address ip up to a 16-byte representation. If ip is not an IP address (it is the wrong length), To16 returns nil. (#5134)" 
This reverts commit 838578b55f.
 2023-12-24 12:31:08 -08:00
chrislu c6b1dc7058 remove unused code 2023-12-24 11:11:41 -08:00
vivekkoya 838578b55f
Update network.go since To16 converts the IP address ip up to a 16-byte representation. If ip is not an IP address (it is the wrong length), To16 returns nil. (#5134) 2023-12-23 15:01:57 -08:00
Seyed Mahdi Sadegh Shobeiri 97236389e8
Add modifyTimeAgo to volume.fsck (#5133) 
* Add modifyTimeAgo to volume.fsck

* Fix AppendAtNs
 2023-12-23 12:17:30 -08:00
Seyed Mahdi Sadegh Shobeiri 54ba2c8868
Fix cutoffTimeAgo in findMissingChunksInFiler (#5132) 2023-12-23 09:18:16 -08:00
chrislu 03c4b2e988 correct lock accounting 
possibly fix https://github.com/seaweedfs/seaweedfs/issues/5082
 2023-12-22 14:16:23 -08:00
chrislu c4badf7396 adjust options 2023-12-22 11:41:10 -08:00
chrislu 6324062acc fix 2023-12-22 11:37:15 -08:00
chrislu e0727071c8 go fmt 2023-12-22 11:33:50 -08:00
chrislu ee1c9bc314 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-12-22 11:33:02 -08:00
chrislu 034db049a0 comment fix 2023-12-22 11:33:00 -08:00
chrislu 6df44d3c95 option to filer.copy with public volume server url 
fix https://github.com/seaweedfs/seaweedfs/issues/5126
 2023-12-22 11:32:43 -08:00
chrislu 7a0d1e7fc1 minor 2023-12-22 11:29:54 -08:00
Farbod c278f49bca
Using filer.remote.sync concurrency in filer.remote.gateway (#5123) 
- Chnaged ProcessEvenFn to be concurrent just like filer.remote.sync

Co-authored-by: itsfarbod <itsfarbod@hamravesh.com>
 2023-12-20 16:25:54 -08:00
jerebear12 06343f8976
Set allowed origins in config (#5109) 
* Add a way to use a JWT in an HTTP only cookie

If a JWT is not included in the Authorization header or a query string, attempt to get a JWT from an HTTP only cookie.

* Added a way to specify allowed origins header from config

* Removed unecessary log

* Check list of domains from config or command flag

* Handle default wildcard and change name of config value to cors
 2023-12-20 16:21:11 -08:00
Konstantin Lebedev 3c9bcfb864
chore: add dsn for connection to mysql (#5060) 
* chore: add dsn for connection to mysql

* add comment

* new comment

* fix: validate dsn and adapt password
 2023-12-20 16:20:58 -08:00
Davidsod 3ec2a898b8
#5122 Add support for sidecar containers (#5125) 2023-12-20 15:04:44 -08:00
dependabot[bot] 7e95fcc963
Bump github.com/aws/aws-sdk-go-v2/config from 1.25.5 to 1.26.1 (#5114) 
Bumps [github.com/aws/aws-sdk-go-v2/config](https://github.com/aws/aws-sdk-go-v2) from 1.25.5 to 1.26.1.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/config/v1.25.5...config/v1.26.1)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/config
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-18 17:35:28 -08:00
dependabot[bot] 089445369e
Bump golang.org/x/crypto from 0.16.0 to 0.17.0 (#5118) 
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.16.0 to 0.17.0.
- [Commits](https://github.com/golang/crypto/compare/v0.16.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-18 17:35:06 -08:00
dependabot[bot] 912e6b5a1a
Bump actions/upload-artifact from 3 to 4 (#5117) 2023-12-18 08:44:29 -08:00
dependabot[bot] d92f22de8a
Bump docker/metadata-action from 5.3.0 to 5.4.0 (#5116) 2023-12-18 08:44:19 -08:00
dependabot[bot] d7ed240dd5
Bump github/codeql-action from 2 to 3 (#5115) 2023-12-18 08:44:08 -08:00
dependabot[bot] 929781be92
Bump github.com/linxGnu/grocksdb from 1.8.0 to 1.8.10 (#5113) 2023-12-18 08:43:53 -08:00
dependabot[bot] 32e45541dc
Bump cloud.google.com/go/storage from 1.35.1 to 1.36.0 (#5111) 2023-12-18 08:43:28 -08:00
dependabot[bot] 745c55da35
Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.44.0 to 1.47.5 (#5110) 2023-12-18 08:42:45 -08:00
JesseBot 2b323a8293
Fix: helm: remove deprecated values that caused helm template error for post install hook (#5108) 
* Update post-install-bucket-hook.yaml - remove deprecated volume checks

* Update Chart.yaml - update chart version to 3.60.0
 2023-12-14 08:25:33 -08:00
JesseBot fe7ff5c4db
Update helm_ci.yml - add ct flag --target-branch ${{ github.event.repository.default_branch }} (#5106) 
* Update helm_ci.yml - add ct link flag --target-branch ${{ github.event.repository.default_branch }}

This validates that the chart version has been bumped

* Update helm_ci.yml - add --target-branch to ct list-changed command
 2023-12-14 07:55:42 -08:00
chrislu 4538265412 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-12-13 12:03:09 -08:00
chrislu 915416a277 fix wrong parameter 
fix https://github.com/seaweedfs/seaweedfs/pull/5102
 2023-12-13 12:02:57 -08:00
dependabot[bot] ca53094777
Bump io.grpc:grpc-protobuf from 1.23.0 to 1.53.0 in /other/java/client (#5103) 
Bumps [io.grpc:grpc-protobuf](https://github.com/grpc/grpc-java) from 1.23.0 to 1.53.0.
- [Release notes](https://github.com/grpc/grpc-java/releases)
- [Commits](https://github.com/grpc/grpc-java/compare/v1.23.0...v1.53.0)

---
updated-dependencies:
- dependency-name: io.grpc:grpc-protobuf
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-13 11:54:35 -08:00
chrislu 1397b1ca09 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-12-13 11:38:34 -08:00
chrislu 97c26ac5eb Revert "Bump github.com/hanwen/go-fuse/v2 from 2.4.0 to 2.4.2" 
This reverts commit 3407e28a78.

> weed shell -h
panic: XTIMES (80000000) overlaps with INIT_RESERVED (80000000)

goroutine 1 [running]:
github.com/hanwen/go-fuse/v2/fuse.(*flagNames).set(0x5?, 0x80000000, {0x101f4ab0c?, 0xffffffffffffffff?})
	/Users/chrislu/go/pkg/mod/github.com/hanwen/go-fuse/v2@v2.4.2/fuse/print.go:124 +0x159
github.com/hanwen/go-fuse/v2/fuse.init.1()
	/Users/chrislu/go/pkg/mod/github.com/hanwen/go-fuse/v2@v2.4.2/fuse/print_darwin.go:12 +0x2b
 2023-12-13 11:38:31 -08:00
Farbod d5c01e5ceb
Remote gateway Bug fix (#5100) 2023-12-12 07:46:45 -08:00
chrislu 61b05fad95 fix test 2023-12-11 20:57:29 -08:00
Chris Lu 580940bf82
Merge accumulated changes related to message queue (#5098) 
* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* tracking topic=>broker

* merge

* comment
 2023-12-11 12:05:54 -08:00
dependabot[bot] 8784553501 Bump github.com/rclone/rclone from 1.64.2 to 1.65.0 
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.64.2 to 1.65.0.
- [Release notes](https://github.com/rclone/rclone/releases)
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md)
- [Commits](https://github.com/rclone/rclone/compare/v1.64.2...v1.65.0)

---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:32:04 -08:00
dependabot[bot] 157b36d59d Bump com.google.guava:guava in /other/java/client 
Bumps [com.google.guava:guava](https://github.com/google/guava) from 30.0-jre to 32.0.0-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

---
updated-dependencies:
- dependency-name: com.google.guava:guava
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:14:02 -08:00