Commit graph

7882 commits

Author SHA1 Message Date
chrislu 968ca95b49 filer.meta.tail: support untilTimeAgo for a range 2022-05-30 16:16:23 -07:00
chrislu f214dfb1f5 stop when in memory log is done 2022-05-30 15:25:21 -07:00
chrislu aece35a64f stop when on disk log is done 2022-05-30 15:20:51 -07:00
chrislu a2b101a737 subscribe metadata between a range 2022-05-30 15:04:19 -07:00
chrislu 5b9347c938 typo 2022-05-30 12:37:41 -07:00
chrislu b8f3db0d46 s3: keep auth enabled in case identities are set to empty
fix https://github.com/chrislusf/seaweedfs/issues/3084
2022-05-29 19:00:03 -07:00
chrislu 81d6159290 volume: report error if a volume has nil data backend
fix https://github.com/chrislusf/seaweedfs/issues/3105
2022-05-29 16:59:30 -07:00
chrislu ca16fbf0ef shell: cluster.ps display filer group 2022-05-29 16:37:14 -07:00
chrislu 9219664505 reset sync offset if peer filer resets
fix https://github.com/chrislusf/seaweedfs/issues/3089
2022-05-29 13:11:24 -07:00
Chris Lu b100773afc
Merge pull request #3103 from kaiwalyajoshi/kjoshi/fix-filerstore-translator-spelling
fix: Minor spelling fixes on FilerStorePathTranlator.
2022-05-25 08:09:36 -07:00
Kaiwalya Joshi 4598581741
fix: Minor spelling fixes on FilerStorePathTranslator. 2022-05-25 01:11:02 -07:00
chrislu 5b8b022985 remove unused parameter 2022-05-24 18:52:04 -07:00
Chris Lu df50afc642
Merge pull request #3102 from coelho/fix-mount-readdir-partial
mount: fix partial ReadDir results
2022-05-24 11:10:13 -07:00
Robert Coelho 0e6e72d462 mount: ReadDir return EIO on EnsureVisited err 2022-05-24 13:02:59 -04:00
Robert Coelho 1fabbe8a25 mount: cleanup ReadDir rewrite's branches to not assume offsets 2022-05-24 12:48:32 -04:00
Robert Coelho cb422d96f7 mount: rewrite ReadDir to respect input.Offset to fix partial results 2022-05-24 12:16:58 -04:00
Robert Coelho 05602167f4 mount: do not mark meta_cache when there is an err 2022-05-24 12:13:15 -04:00
chrislu a67ad1e9e5 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-05-24 00:23:56 -07:00
chrislu 7e25a2d416 reduce busy waiting when reading metadata logs 2022-05-24 00:23:53 -07:00
Chris Lu 1386aa020e
Merge pull request #3091 from chrislusf/dependabot/go_modules/google.golang.org/api-0.80.0
Bump google.golang.org/api from 0.79.0 to 0.80.0
2022-05-23 11:10:02 -07:00
Chris Lu c9e1f3c565
Merge pull request #3092 from chrislusf/dependabot/go_modules/github.com/lib/pq-1.10.6
Bump github.com/lib/pq from 1.10.5 to 1.10.6
2022-05-23 11:09:37 -07:00
Chris Lu 730011ad3c
Merge pull request #3093 from chrislusf/dependabot/go_modules/cloud.google.com/go/storage-1.22.1
Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1
2022-05-23 11:09:27 -07:00
Chris Lu 00b46f5777
Merge pull request #3094 from chrislusf/dependabot/go_modules/github.com/arangodb/go-driver-1.3.2
Bump github.com/arangodb/go-driver from 1.3.1 to 1.3.2
2022-05-23 11:09:00 -07:00
dependabot[bot] 84583fe095
Bump github.com/arangodb/go-driver from 1.3.1 to 1.3.2
Bumps [github.com/arangodb/go-driver](https://github.com/arangodb/go-driver) from 1.3.1 to 1.3.2.
- [Release notes](https://github.com/arangodb/go-driver/releases)
- [Changelog](https://github.com/arangodb/go-driver/blob/master/CHANGELOG.md)
- [Commits](https://github.com/arangodb/go-driver/compare/v1.3.1...v1.3.2)

---
updated-dependencies:
- dependency-name: github.com/arangodb/go-driver
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-23 15:20:44 +00:00
dependabot[bot] efbf5ac900
Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1
Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.22.0 to 1.22.1.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.22.0...storage/v1.22.1)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-23 15:20:30 +00:00
dependabot[bot] 568855adad
Bump github.com/lib/pq from 1.10.5 to 1.10.6
Bumps [github.com/lib/pq](https://github.com/lib/pq) from 1.10.5 to 1.10.6.
- [Release notes](https://github.com/lib/pq/releases)
- [Commits](https://github.com/lib/pq/compare/v1.10.5...v1.10.6)

---
updated-dependencies:
- dependency-name: github.com/lib/pq
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-23 15:20:09 +00:00
dependabot[bot] 45a5629f84
Bump google.golang.org/api from 0.79.0 to 0.80.0
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.79.0 to 0.80.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.79.0...v0.80.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-23 15:19:59 +00:00
chrislu 2f846777bb 3.06 2022-05-23 01:21:48 -07:00
chrislu a5cdcc7e63 fix reading files larger than 20GB due to manifest resolving bug 2022-05-23 01:16:10 -07:00
chrislu 59cc3c0bfd fix reading files larger than 20GB due to manifest resolving bug
this is introduced since Mar 08 2022
2022-05-23 01:14:56 -07:00
chrislu acc318e12b 3.05 2022-05-22 21:43:59 -07:00
Chris Lu accf4d65c6
Create pull_request_template.md 2022-05-20 00:01:12 -07:00
Chris Lu 3a8dadcc2d
Merge pull request #3080 from kaiwalyajoshi/kjoshi/s3-template-fixes 2022-05-19 15:08:43 -07:00
Kaiwalya Joshi bee482d49e
fix: Remove invalid serviceName from s3-deployments template.
Remove `deployments.spec.serviceName` from the s3 deployment template.

`serviceName` isn't a valid field and causes issues when deploying the
chart.

This is the full output for `kubectl explain deployments.spec`
```
KIND:     Deployment
VERSION:  apps/v1

RESOURCE: spec <Object>

DESCRIPTION:
     Specification of the desired behavior of the Deployment.

     DeploymentSpec is the specification of the desired behavior of the
     Deployment.

FIELDS:
   minReadySeconds      <integer>
     Minimum number of seconds for which a newly created pod should be ready
     without any of its container crashing, for it to be considered available.
     Defaults to 0 (pod will be considered available as soon as it is ready)

   paused       <boolean>
     Indicates that the deployment is paused.

   progressDeadlineSeconds      <integer>
     The maximum time in seconds for a deployment to make progress before it is
     considered to be failed. The deployment controller will continue to process
     failed deployments and a condition with a ProgressDeadlineExceeded reason
     will be surfaced in the deployment status. Note that progress will not be
     estimated during the time a deployment is paused. Defaults to 600s.

   replicas     <integer>
     Number of desired pods. This is a pointer to distinguish between explicit
     zero and not specified. Defaults to 1.

   revisionHistoryLimit <integer>
     The number of old ReplicaSets to retain to allow rollback. This is a
     pointer to distinguish between explicit zero and not specified. Defaults to
     10.

   selector     <Object> -required-
     Label selector for pods. Existing ReplicaSets whose pods are selected by
     this will be the ones affected by this deployment. It must match the pod
     template's labels.

   strategy     <Object>
     The deployment strategy to use to replace existing pods with new ones.

   template     <Object> -required-
     Template describes the pods that will be created.
```
2022-05-19 15:01:27 -07:00
Chris Lu cb64983c6b
Merge pull request #3079 from ztinpn/hotfix_fsync 2022-05-19 10:33:42 -07:00
tianzhang 66747ee9c9 hotfix_fsync fix fsync 2022-05-19 23:17:17 +08:00
Chris Lu 8efe55f981
Merge pull request #3059 from guol-fnst/avoid_dup_vol
avoid loading duplicated volume directory
2022-05-17 23:48:57 -07:00
guol-fnst 8e2426a879 revert changes of pb file
orignal protoc-gen-go-grpc verion is 1.1.0
2022-05-18 11:52:14 +08:00
Chris Lu 92590d60ff
Merge pull request #3071 from kmlebedev/build_image_large_disk_full 2022-05-17 07:39:06 -07:00
Konstantin Lebedev d68a37d3e6 build release containers for all tags and large volume 2022-05-17 14:56:14 +05:00
guol-fnst b12944f9c6 fix naming convention
notify volume server of duplicate directoris
improve searching efficiency
2022-05-17 15:41:49 +08:00
guol-fnst 076595fbdd just exit in case of duplicated volume directories were loaded 2022-05-17 15:41:49 +08:00
guol-fnst 8fab39e775 rename UUID file
fix typo
move locationUUID  into DiskLocation
2022-05-17 15:41:47 +08:00
Chris Lu 36309e824d
Merge pull request #3063 from chrislusf/dependabot/github_actions/actions/dependency-review-action-39e692fa323107ef86d8fdac0067ce647f239bd7
Bump actions/dependency-review-action from 3f943b86c9a289f4e632c632695e2e0898d9d67d to 1
2022-05-16 09:35:06 -07:00
Chris Lu abe311e64e
Merge pull request #3068 from chrislusf/dependabot/go_modules/github.com/Shopify/sarama-1.33.0
Bump github.com/Shopify/sarama from 1.32.0 to 1.33.0
2022-05-16 09:33:05 -07:00
Chris Lu a045f97eea
Merge branch 'master' into dependabot/go_modules/github.com/Shopify/sarama-1.33.0 2022-05-16 09:16:15 -07:00
Chris Lu d415596be0
Merge pull request #3067 from chrislusf/dependabot/go_modules/github.com/prometheus/client_golang-1.12.2
Bump github.com/prometheus/client_golang from 1.12.1 to 1.12.2
2022-05-16 09:15:30 -07:00
Chris Lu 9a0cf3cf54
Merge pull request #3066 from chrislusf/dependabot/go_modules/google.golang.org/api-0.79.0
Bump google.golang.org/api from 0.78.0 to 0.79.0
2022-05-16 09:15:24 -07:00
Chris Lu f04efe710f
Merge pull request #3065 from chrislusf/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.14
Bump github.com/aws/aws-sdk-go from 1.44.9 to 1.44.14
2022-05-16 09:15:19 -07:00
Chris Lu d3b8a82813
Merge pull request #3064 from chrislusf/dependabot/go_modules/github.com/ydb-platform/ydb-go-sdk-auth-environ-0.1.2
Bump github.com/ydb-platform/ydb-go-sdk-auth-environ from 0.1.0 to 0.1.2
2022-05-16 09:15:13 -07:00