gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity
10013 commits 28 branches 278 tags 135 MiB
Commit graph

10013 commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Lu 580940bf82
Merge accumulated changes related to message queue (#5098) 
* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* tracking topic=>broker

* merge

* comment
 2023-12-11 12:05:54 -08:00
dependabot[bot] 8784553501 Bump github.com/rclone/rclone from 1.64.2 to 1.65.0 
Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.64.2 to 1.65.0.
- [Release notes](https://github.com/rclone/rclone/releases)
- [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md)
- [Commits](https://github.com/rclone/rclone/compare/v1.64.2...v1.65.0)

---
updated-dependencies:
- dependency-name: github.com/rclone/rclone
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:32:04 -08:00
dependabot[bot] 157b36d59d Bump com.google.guava:guava in /other/java/client 
Bumps [com.google.guava:guava](https://github.com/google/guava) from 30.0-jre to 32.0.0-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

---
updated-dependencies:
- dependency-name: com.google.guava:guava
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:14:02 -08:00
dependabot[bot] 70c735f6bb Bump actions/dependency-review-action from 3.1.3 to 3.1.4 
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 3.1.3 to 3.1.4.
- [Release notes](https://github.com/actions/dependency-review-action/releases)
- [Commits](7bbfa034e7...01bc87099b)

---
updated-dependencies:
- dependency-name: actions/dependency-review-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:41 -08:00
dependabot[bot] c68220af7e Bump actions/setup-python from 4 to 5 
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:33 -08:00
dependabot[bot] dc51d9a9a9 Bump actions/setup-go from 4.1.0 to 5.0.0 
Bumps [actions/setup-go](https://github.com/actions/setup-go) from 4.1.0 to 5.0.0.
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](93397bea11...0c52d547c9)

---
updated-dependencies:
- dependency-name: actions/setup-go
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:24 -08:00
dependabot[bot] 1a6842c477 Bump gocloud.dev/pubsub/rabbitpubsub from 0.34.0 to 0.35.0 
Bumps [gocloud.dev/pubsub/rabbitpubsub](https://github.com/google/go-cloud) from 0.34.0 to 0.35.0.
- [Release notes](https://github.com/google/go-cloud/releases)
- [Commits](https://github.com/google/go-cloud/compare/v0.34.0...v0.35.0)

---
updated-dependencies:
- dependency-name: gocloud.dev/pubsub/rabbitpubsub
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:15 -08:00
dependabot[bot] 21af8d8778 Bump github.com/shirou/gopsutil/v3 from 3.23.9 to 3.23.11 
Bumps [github.com/shirou/gopsutil/v3](https://github.com/shirou/gopsutil) from 3.23.9 to 3.23.11.
- [Release notes](https://github.com/shirou/gopsutil/releases)
- [Commits](https://github.com/shirou/gopsutil/compare/v3.23.9...v3.23.11)

---
updated-dependencies:
- dependency-name: github.com/shirou/gopsutil/v3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:13:06 -08:00
dependabot[bot] f743df0f0b Bump go.mongodb.org/mongo-driver from 1.12.1 to 1.13.1 
Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.12.1 to 1.13.1.
- [Release notes](https://github.com/mongodb/mongo-go-driver/releases)
- [Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.12.1...v1.13.1)

---
updated-dependencies:
- dependency-name: go.mongodb.org/mongo-driver
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:12:56 -08:00
dependabot[bot] 3407e28a78 Bump github.com/hanwen/go-fuse/v2 from 2.4.0 to 2.4.2 
Bumps [github.com/hanwen/go-fuse/v2](https://github.com/hanwen/go-fuse) from 2.4.0 to 2.4.2.
- [Commits](https://github.com/hanwen/go-fuse/compare/v2.4.0...v2.4.2)

---
updated-dependencies:
- dependency-name: github.com/hanwen/go-fuse/v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-11 11:12:38 -08:00
Konstantin Lebedev 125ad8fe63 falls back to update only if error contains msg "duplicate entry" 
https://github.com/seaweedfs/seaweedfs/issues/5062
 2023-12-09 10:18:18 -08:00
chrislu c1a6e624e5 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-12-07 08:13:46 -08:00
chrislu 5fe4c04a1a add missing error in the log 
related to https://github.com/seaweedfs/seaweedfs/issues/5084
 2023-12-07 08:13:42 -08:00
Lars Lehtonen 43a5973a66 weed/storage: fix dropped test errors 2023-12-06 12:05:22 -08:00
Bálint József Jánvári 43a6b60375 Always include volumes in statefulsets 2023-12-05 22:39:01 -08:00
jerebear12 d5d9fbb8aa Add a way to use a JWT in an HTTP only cookie 
If a JWT is not included in the Authorization header or a query string, attempt to get a JWT from an HTTP only cookie.
 2023-12-05 08:57:01 -08:00
dependabot[bot] 4aeca48b6d Bump golang.org/x/image from 0.12.0 to 0.14.0 
Bumps [golang.org/x/image](https://github.com/golang/image) from 0.12.0 to 0.14.0.
- [Commits](https://github.com/golang/image/compare/v0.12.0...v0.14.0)

---
updated-dependencies:
- dependency-name: golang.org/x/image
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 11:00:02 -08:00
dependabot[bot] fd6de32b53 Bump golang.org/x/tools from 0.14.0 to 0.16.0 
Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.14.0 to 0.16.0.
- [Release notes](https://github.com/golang/tools/releases)
- [Commits](https://github.com/golang/tools/compare/v0.14.0...v0.16.0)

---
updated-dependencies:
- dependency-name: golang.org/x/tools
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:51:51 -08:00
dependabot[bot] 31ca7bacea Bump docker/metadata-action from 5.0.0 to 5.3.0 
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 5.0.0 to 5.3.0.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Commits](96383f4557...31cebacef4)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:55 -08:00
dependabot[bot] 14a4d5c24d Bump wangyoucao577/go-release-action from 1.40 to 1.41 
Bumps [wangyoucao577/go-release-action](https://github.com/wangyoucao577/go-release-action) from 1.40 to 1.41.
- [Release notes](https://github.com/wangyoucao577/go-release-action/releases)
- [Commits](2ac3035fa4...0a0935d79e)

---
updated-dependencies:
- dependency-name: wangyoucao577/go-release-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:47 -08:00
dependabot[bot] e47ec67dd8 Bump github.com/go-redsync/redsync/v4 from 4.10.0 to 4.11.0 
Bumps [github.com/go-redsync/redsync/v4](https://github.com/go-redsync/redsync) from 4.10.0 to 4.11.0.
- [Release notes](https://github.com/go-redsync/redsync/releases)
- [Commits](https://github.com/go-redsync/redsync/compare/v4.10.0...v4.11.0)

---
updated-dependencies:
- dependency-name: github.com/go-redsync/redsync/v4
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:31 -08:00
dependabot[bot] e792eadf13 Bump golang.org/x/sys from 0.14.0 to 0.15.0 
Bumps [golang.org/x/sys](https://github.com/golang/sys) from 0.14.0 to 0.15.0.
- [Commits](https://github.com/golang/sys/compare/v0.14.0...v0.15.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sys
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-12-04 10:50:11 -08:00
chrislu 556a242acf remove unused file 2023-11-30 08:20:01 -08:00
chrislu 756bcc032d adjust logs 2023-11-27 12:57:29 -08:00
Konstantin Lebedev dd78397fea logging PickForWrite error 
https://github.com/seaweedfs/seaweedfs/issues/3886
 2023-11-27 12:56:15 -08:00
dependabot[bot] fe3e7db9d1 Bump github.com/nats-io/nkeys from 0.4.5 to 0.4.6 
Bumps [github.com/nats-io/nkeys](https://github.com/nats-io/nkeys) from 0.4.5 to 0.4.6.
- [Release notes](https://github.com/nats-io/nkeys/releases)
- [Changelog](https://github.com/nats-io/nkeys/blob/main/.goreleaser.yml)
- [Commits](https://github.com/nats-io/nkeys/compare/v0.4.5...v0.4.6)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nkeys
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:54:02 -08:00
dependabot[bot] 27f40fae0c Bump github.com/rdleal/intervalst from 1.2.0 to 1.2.1 
Bumps [github.com/rdleal/intervalst](https://github.com/rdleal/intervalst) from 1.2.0 to 1.2.1.
- [Commits](https://github.com/rdleal/intervalst/compare/v1.2.0...v1.2.1)

---
updated-dependencies:
- dependency-name: github.com/rdleal/intervalst
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:53:20 -08:00
dependabot[bot] c8ff001b31 Bump github.com/aws/aws-sdk-go from 1.45.25 to 1.48.4 
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.45.25 to 1.48.4.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.45.25...v1.48.4)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:49:39 -08:00
dependabot[bot] 366ad5cfad Bump modernc.org/sqlite from 1.26.0 to 1.27.0 
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.26.0 to 1.27.0.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.26.0...v1.27.0)

---
updated-dependencies:
- dependency-name: modernc.org/sqlite
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 12:40:28 -08:00
dependabot[bot] b7b9f1c690 Bump github.com/aws/aws-sdk-go-v2 from 1.23.0 to 1.23.1 
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) from 1.23.0 to 1.23.1.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.23.0...v1.23.1)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-27 11:18:30 -08:00
chrislu 81f11883e3 go fmt 2023-11-26 11:47:20 -08:00
jessebot 666a22b980 fix defaults for serviceAccountName for each statefulset to follow exact from helm docs 
helm docs: https://helm.sh/docs/chart_template_guide/functions_and_pipelines/#using-the-default-function
 2023-11-26 09:26:38 -08:00
jessebot d198fd8af7 fix when we create serviceAccount value for master and volume statefulsets to be when global.createClusterRole is set to true 2023-11-26 09:26:38 -08:00
jessebot 0709361ed2 fix duplicate service account name for filer 2023-11-26 09:26:38 -08:00
jessebot c332832f0b prefer global.serviceAccountName when available for all statefulsets 2023-11-26 09:26:38 -08:00
jessebot aff03c1d00 User global.serviceAccountName to populate ServiceAccount, ClusterRole, and ClusterRoleBinding 2023-11-26 09:26:38 -08:00
Max Roby cf5703e86e existingConfigSecretshould now be consistently treated as a string in the post-install-hook 2023-11-24 06:40:19 -08:00
Max Roby c479c05f6e revert debug changes i missed 2023-11-24 06:40:19 -08:00
Max Roby d33de9f4db remove trailing spaces 2023-11-24 06:40:19 -08:00
Max Roby aac2cd23c7 add a true flag to job command 2023-11-24 06:40:19 -08:00
Max Roby e4cdfde944 add the secrets volumemount 2023-11-24 06:40:19 -08:00
Max Roby 2af6b13800 add a sercret volume mount 2023-11-24 06:40:19 -08:00
Max Roby 7a5d9d8690 bump chart version after rebase 2023-11-24 06:40:19 -08:00
Max Roby c04284cdd7 remove user job since bucket job can now create public buckets, update values.yaml 2023-11-24 06:40:19 -08:00
Max Roby b8bfd4411a add missing read action 2023-11-24 06:40:19 -08:00
Max Roby f33f7c10f0 trying to get anonymous access for buckets working 2023-11-24 06:40:19 -08:00
Max Roby ac6158818b fix issue with underscores versus dashes in secret name causing variable expansion failure 2023-11-24 06:40:19 -08:00
Max Roby f7b98ea1fb fix uneeded quote usage 2023-11-24 06:40:19 -08:00
Max Roby 2920949def templates/post-install-user-hook.yaml 2023-11-24 06:40:19 -08:00
Max Roby 5db0064ffe update hook weight order and give descriptive names to jobs 2023-11-24 06:40:19 -08:00