Commit graph

9111 commits

Author SHA1 Message Date
chrislu 9e4b45f9ac fix tests 2022-12-27 16:26:13 -08:00
chrislu 9926ae5d29 fix tests 2022-12-27 16:24:55 -08:00
chrislu b010eceaa7 turn off debug mode 2022-12-27 15:47:28 -08:00
chrislu 744a757809 group chunks into sections 2022-12-27 15:45:56 -08:00
chrislu 3e590d303d add SeparateGarbageChunks 2022-12-27 15:44:56 -08:00
chrislu dc311a2085 minor fix on writer 2022-12-27 15:00:23 -08:00
chrislu ab975f6a6d fix test compilation 2022-12-27 04:08:53 -08:00
chrislu 6d8bd1eedc small optimization 2022-12-27 04:08:13 -08:00
chrislu 86b9aa3173 more efficient readResolvedChunks with linked list 2022-12-27 03:29:11 -08:00
chrislu 3daaefec60 add debug mode to compare data read and write 2022-12-25 12:12:22 -08:00
chrislu a8a9589f80 comment out code that maybe used later 2022-12-25 12:11:53 -08:00
chrislu 8b915a93ce use mem chunk only, swap file chunk has problems 2022-12-25 12:10:48 -08:00
chrislu 363de28057 add entry lock on file handle release 2022-12-25 00:30:42 -08:00
chrislu bfc3c11fdc remove useless logic 2022-12-25 00:30:06 -08:00
chrislu 7398b046ce track write and read by timestamp 2022-12-25 00:28:36 -08:00
chrislu 7298129dd0 less logs 2022-12-25 00:26:51 -08:00
chrislu 886e7509bf less logs 2022-12-25 00:24:59 -08:00
chrislu 4f4fc36944 revert slat clearing 2022-12-25 00:23:06 -08:00
chrislu 01231941af remove verbose logs 2022-12-24 23:14:45 -08:00
chrislu 41226b54d8 lock on fh.entryViewCache 2022-12-23 10:41:45 -08:00
chrislu 7f1d49a123 move oldest chunk to sealed, instead of by fullness 2022-12-23 10:41:07 -08:00
chrislu b9539bc628 fix test compilation 2022-12-23 10:40:27 -08:00
chrislu b7d30812fc fix slab clearing error 2022-12-23 10:40:13 -08:00
chrislu d68b59ab4c compare chunks by timestamp 2022-12-22 20:39:24 -08:00
Konstantin Lebedev 569bc7b54d
fs.verify needles status of file (#4060)
* fs.verify needles status of file

* fix parse args

* refactor logging

* set modifyTimeAgoAtSec
2022-12-21 15:54:17 -08:00
chrislu 77b7c9f7cc lock and unlock chunks for read 2022-12-21 14:15:35 -08:00
chrislu d1797deccb remove duplicated logic of removing from writableChunks 2022-12-21 14:15:11 -08:00
chrislu 4878e0fd46 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2022-12-20 19:47:23 -08:00
chrislu 6ede19e825 add a simple file replication progress bar 2022-12-20 19:47:21 -08:00
Naden 27d187eed9
Fixes 4074: S3 Gateway fails to start when installed via Helm (#4075)
Fixes #4074: S3 Gateway fails to start when installed via Helm

Co-authored-by: Naden <naden@harana.com>
2022-12-20 17:24:54 -08:00
Naden 3b90eb1911
Fixes: 4076: Host path prefix should be configurable (#4077)
Co-authored-by: Naden <naden@harana.com>
2022-12-20 17:24:12 -08:00
chrislu f7beba8515 unlock before submitting the uploading jobs 2022-12-20 12:52:30 -08:00
chrislu 28d479e5c0 mount: adjust locking for upload pipeline 2022-12-19 15:07:22 -08:00
chrislu f9fb3cd1fc Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2022-12-19 11:32:00 -08:00
chrislu 6c7fe40305 filer sink retries reading file chunks, skipping missing chunks
if the file chunk is not available during replication time, the file is skipped
2022-12-19 11:31:58 -08:00
chrislu 3fc3e7083c metadata skip reading un-available logs
this means the volumes for metadata histories have been lost.
2022-12-19 11:30:50 -08:00
dependabot[bot] a1ffa03d75
build(deps): bump google.golang.org/api from 0.104.0 to 0.105.0 (#4067)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.104.0 to 0.105.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.104.0...v0.105.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 10:21:20 -08:00
dependabot[bot] 3886c31ed8
build(deps): bump github.com/aws/aws-sdk-go from 1.44.146 to 1.44.162 (#4069)
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.146 to 1.44.162.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.146...v1.44.162)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 09:22:36 -08:00
dependabot[bot] 9fdf98b826
build(deps): bump cloud.google.com/go/pubsub from 1.27.1 to 1.28.0 (#4068)
Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) from 1.27.1 to 1.28.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.27.1...pubsub/v1.28.0)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/pubsub
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 09:22:23 -08:00
dependabot[bot] c7a28b20b5
build(deps): bump actions/checkout from 3.1.0 to 3.2.0 (#4066)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](93ea575cb5...755da8c3cf)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 09:22:12 -08:00
dependabot[bot] 6c5d44a5c4
build(deps): bump actions/setup-go from 3.4.0 to 3.5.0 (#4065)
Bumps [actions/setup-go](https://github.com/actions/setup-go) from 3.4.0 to 3.5.0.
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](d0a58c1c4d...6edd4406fa)

---
updated-dependencies:
- dependency-name: actions/setup-go
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 09:21:49 -08:00
dependabot[bot] ae847c2780
build(deps): bump actions/dependency-review-action from 3.0.1 to 3.0.2 (#4064)
Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 3.0.1 to 3.0.2.
- [Release notes](https://github.com/actions/dependency-review-action/releases)
- [Commits](11310527b4...0ff3da6f81)

---
updated-dependencies:
- dependency-name: actions/dependency-review-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 09:21:41 -08:00
dependabot[bot] 3b85dc5fbb
build(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.40.1 to 3.41.0 (#4070)
build(deps): bump github.com/ydb-platform/ydb-go-sdk/v3

Bumps [github.com/ydb-platform/ydb-go-sdk/v3](https://github.com/ydb-platform/ydb-go-sdk) from 3.40.1 to 3.41.0.
- [Release notes](https://github.com/ydb-platform/ydb-go-sdk/releases)
- [Changelog](https://github.com/ydb-platform/ydb-go-sdk/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ydb-platform/ydb-go-sdk/compare/v3.40.1...v3.41.0)

---
updated-dependencies:
- dependency-name: github.com/ydb-platform/ydb-go-sdk/v3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 09:21:30 -08:00
dependabot[bot] b8a4ed455f
build(deps): bump golang.org/x/tools from 0.3.0 to 0.4.0 (#4071)
Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.3.0 to 0.4.0.
- [Release notes](https://github.com/golang/tools/releases)
- [Commits](https://github.com/golang/tools/compare/v0.3.0...v0.4.0)

---
updated-dependencies:
- dependency-name: golang.org/x/tools
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-19 09:21:20 -08:00
lfhy 038bab3726
add -filer.path to webdav command (#4061) 2022-12-17 20:07:02 -08:00
chrislu 8a40fa8993 more detailed logs 2022-12-17 13:18:35 -08:00
LHHDZ f84c13dabd
fix response not allowed (#4057) 2022-12-13 05:48:50 -08:00
dependabot[bot] 693e07b509
build(deps): bump golang.org/x/net from 0.2.0 to 0.4.0 (#4055) 2022-12-12 08:57:22 -08:00
dependabot[bot] 1949944e18
build(deps): bump google.golang.org/api from 0.103.0 to 0.104.0 (#4054) 2022-12-12 08:57:11 -08:00
dependabot[bot] 6c8a3d57e4
build(deps): bump go.mongodb.org/mongo-driver from 1.11.0 to 1.11.1 (#4053) 2022-12-12 08:56:35 -08:00