gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity
8171 commits 28 branches 278 tags 135 MiB
Commit graph

8171 commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
guol-fnst 5bc895673e add getting bucket quota 2022-07-04 15:36:44 +08:00
guol-fnst dd4664e610 fix usage 2022-07-04 11:31:39 +08:00
Chris Lu c349f81195
Update binaries_dev.yml 2022-07-03 16:16:44 -07:00
chrislu d0eb65ae7b update go-fuse library version 
Make OSXFUSE handle timeouts the same way as Linux
 2022-07-03 16:09:03 -07:00
chrislu 141f662734 edge case checking when volume server does not have capacity to balance 
fix https://github.com/chrislusf/seaweedfs/issues/3257
 2022-07-01 12:16:18 -07:00
chrislu bee3a7c798 fix tests 2022-07-01 12:09:42 -07:00
Chris Lu ddb0f6bc74
Merge pull request #3258 from kmlebedev/issues_3255 
volumeServer.evacuate fix select empty node
 2022-07-01 02:36:30 -07:00
Chris Lu 96c9d16c11
Merge pull request #3263 from kmlebedev/fix_pagination 
fix pagination
 2022-07-01 02:23:45 -07:00
Konstantin Lebedev 3d5f1cbc5e fix pagination 2022-07-01 14:17:49 +05:00
chrislu 06a8b174b5 also remove Sync() for idx file 2022-06-30 13:50:53 -07:00
chrislu 52580743b9 stuck with file.Sync() 
starting to get weed/storage () - (master) > go test ./...
I0630 12:19:54 65819 needle_map_metric_test.go:26] FileCount expected 10000 actual 10000
I0630 12:19:54 65819 needle_map_metric_test.go:27] DeletedSize expected 1648 actual 1648
I0630 12:19:54 65819 needle_map_metric_test.go:28] ContentSize expected 10000 actual 10000
I0630 12:19:54 65819 needle_map_metric_test.go:29] DeletedCount expected 1648 actual 1959
I0630 12:19:54 65819 needle_map_metric_test.go:30] MaxFileKey expected 10000 actual 10000
I0630 12:19:54 65819 volume_loading.go:136] loading index /var/folders/jv/0rlhdck17jzgt7b3hcnq63mc0000gp/T/TestCompaction909350722/001/1.idx to memory
I0630 12:20:36 65819 volume_vacuum.go:98] Committing volume 1 vacuuming...
panic: test timed out after 10m0s

goroutine 61 [running]:
testing.(*M).startAlarm.func1()
	/usr/local/go/src/testing/testing.go:2029 +0x8e
created by time.goFunc
	/usr/local/go/src/time/sleep.go:176 +0x32

goroutine 1 [chan receive, 10 minutes]:
testing.(*T).Run(0xc0000cd520, {0x1c09bde?, 0x5ab798ea5c102?}, 0x1c67bd8)
	/usr/local/go/src/testing/testing.go:1487 +0x37a
testing.runTests.func1(0xc0000cd520?)
	/usr/local/go/src/testing/testing.go:1839 +0x6e
testing.tRunner(0xc0000cd520, 0xc00039fcd8)
	/usr/local/go/src/testing/testing.go:1439 +0x102
testing.runTests(0xc0000dadc0?, {0x25b4460, 0x6, 0x6}, {0x2855108?, 0x40?, 0x25c4b80?})
	/usr/local/go/src/testing/testing.go:1837 +0x457
testing.(*M).Run(0xc0000dadc0)
	/usr/local/go/src/testing/testing.go:1719 +0x5d9
main.main()
	_testmain.go:57 +0x1aa

goroutine 21 [chan receive]:
github.com/chrislusf/seaweedfs/weed/glog.(*loggingT).flushDaemon(0x0?)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/glog/glog.go:883 +0x6a
created by github.com/chrislusf/seaweedfs/weed/glog.init.0
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/glog/glog.go:410 +0x1bf

goroutine 55 [syscall]:
syscall.syscall(0x44ac0f96?, 0xc00007ad80?, 0xc00098b480?, 0x10588df?)
	/usr/local/go/src/runtime/sys_darwin.go:22 +0x4e
syscall.fcntl(0x100000001?, 0xc00098b4b0?, 0x1069a7c?)
	/usr/local/go/src/syscall/zsyscall_darwin_amd64.go:319 +0x30
internal/poll.(*FD).Fsync.func1(...)
	/usr/local/go/src/internal/poll/fd_fsync_darwin.go:18
internal/poll.ignoringEINTR(...)
	/usr/local/go/src/internal/poll/fd_posix.go:74
internal/poll.(*FD).Fsync(0xc00038f1e0?)
	/usr/local/go/src/internal/poll/fd_fsync_darwin.go:17 +0xfc
os.(*File).Sync(0xc00012a030)
	/usr/local/go/src/os/file_posix.go:168 +0x4e
github.com/chrislusf/seaweedfs/weed/storage/backend.(*DiskFile).Sync(...)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/backend/disk_file.go:84
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).makeupDiff(0xc0000bb440, {0xc000633a40, 0x52}, {0xc000633aa0, 0x52}, {0xc000633b00, 0x52}, {0xc000633b60, 0x52})
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum.go:295 +0x12fa
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).CommitCompact(0xc0000bb440)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum.go:119 +0x3e8
github.com/chrislusf/seaweedfs/weed/storage.TestCompaction(0xc00025a000)
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_vacuum_test.go:89 +0x305
testing.tRunner(0xc00025a000, 0x1c67bd8)
	/usr/local/go/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:1486 +0x35f

goroutine 56 [chan receive, 10 minutes]:
github.com/chrislusf/seaweedfs/weed/storage.(*Volume).startWorker.func1()
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_write.go:244 +0x41a
created by github.com/chrislusf/seaweedfs/weed/storage.(*Volume).startWorker
	/Users/chrislu/go/src/github.com/chrislusf/seaweedfs/weed/storage/volume_write.go:234 +0x56
FAIL	github.com/chrislusf/seaweedfs/weed/storage	600.194s
?   	github.com/chrislusf/seaweedfs/weed/storage/backend	[no test files]
ok  	github.com/chrislusf/seaweedfs/weed/storage/backend/memory_map	(cached)
?   	github.com/chrislusf/seaweedfs/weed/storage/backend/s3_backend	[no test files]
ok  	github.com/chrislusf/seaweedfs/weed/storage/erasure_coding	(cached)
?   	github.com/chrislusf/seaweedfs/weed/storage/idx	[no test files]
ok  	github.com/chrislusf/seaweedfs/weed/storage/needle	(cached)
ok  	github.com/chrislusf/seaweedfs/weed/storage/needle_map	(cached)
ok  	github.com/chrislusf/seaweedfs/weed/storage/super_block	(cached)
?   	github.com/chrislusf/seaweedfs/weed/storage/types	[no test files]
?   	github.com/chrislusf/seaweedfs/weed/storage/volume_info	[no test files]
FAIL
 2022-06-30 12:32:55 -07:00
Konstantin Lebedev 5ed8165161 fix logic 
add option targetServer
https://github.com/chrislusf/seaweedfs/issues/3255
 2022-06-30 17:58:24 +05:00
Chris Lu 413cb3d389
Merge pull request #3256 from shichanglin5/fix_keep_connected 
fixed `volume xx not found` caused by missing VolumeLocation events
 2022-06-30 00:10:09 -07:00
石昌林 200a862701 fixed volume xx not found caused by missing VolumeLocation events 
When the requested master node is the leader, `VolumeLocation` or `ClusterNodeUpdate` may be returned here. If it is `VolumeLocation`, the update will be performed while resetting the vidMap, otherwise the event will be lost
 2022-06-30 13:41:56 +08:00
chrislu ffaa2163e0 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-29 12:50:33 -07:00
chrislu f3c4b07b8a Update backers.md 2022-06-29 12:50:31 -07:00
Chris Lu 4ae9884a6e
Merge pull request #3254 from shichanglin5/fix_subscribe_meta 
[Critical] Avoid synchronizing from scratch due to err
 2022-06-29 12:36:28 -07:00
Chris Lu b98556cff5
Merge pull request #3253 from kmlebedev/constMultipartUploadsFolder 
use const multipart uploads folder
 2022-06-29 12:09:03 -07:00
石昌林 2b5b37231b Make sure that onChangeEvent is called successfully before updating lastTsNs 2022-06-29 23:57:07 +08:00
石昌林 e17e6ed542 Avoid synchronizing from scratch due to err 2022-06-29 23:31:04 +08:00
Konstantin Lebedev bcbdc4cb37 use const multipart uploads folder 
avoid error bucket NotEmpty if multipart uploads folder exist
 2022-06-29 16:21:16 +05:00
chrislu a8abab2412 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-29 02:44:14 -07:00
chrislu 449ecc8890 remove max connection age 
related to https://github.com/chrislusf/seaweedfs/pull/3226
 2022-06-29 02:44:12 -07:00
Chris Lu c6e6e303db
Merge pull request #3200 from lapshin-vitaly/bufix/validate-tags-on-copy 
validate tags on copy object and add regex for validating tags
 2022-06-29 01:37:14 -07:00
Chris Lu e22c2c8012
Merge pull request #3188 from kmlebedev/fix_make_dev 
fix ip.bind cmd for docker compose
 2022-06-29 01:36:59 -07:00
Lapshin Vitaliy 7c3d9d0535 remove println 2022-06-29 10:43:02 +03:00
Lapshin Vitaliy 61b2e3f9a2 fix return 2022-06-28 18:31:46 +03:00
Lapshin Vitaliy 606252472c fix return 2022-06-28 18:24:03 +03:00
Lapshin Vitaliy e969370913 fix parseTagging function and add test for validate tags 2022-06-28 14:48:55 +03:00
Chris Lu a79bf9d92a
Merge pull request #3252 from guol-fnst/update_tbk 
remove hdfs, add tikv for full version update
 2022-06-27 22:37:41 -07:00
guol-fnst 74c9f39d48 remove hdfs, add tikv for full version update 2022-06-28 12:35:07 +08:00
Chris Lu 8d810f8305
Merge pull request #3251 from shichanglin5/fix_concurrent_write_read 2022-06-27 21:23:48 -07:00
石昌林 e1b94eb6b9 fix error: concurrent map writes when add or remove cluster node 2022-06-28 10:34:59 +08:00
chrislu 4b1f48a399 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-06-27 12:40:50 -07:00
chrislu 4a65159250 fix reading time 2022-06-27 12:40:47 -07:00
Chris Lu dc6b1a52e8
Merge pull request #3250 from xdadrm/xdadrm-patch-xweo-byte-files-from-webdav 
Fixes WebDAV 0-bytes files
 2022-06-27 11:33:35 -07:00
xdadrm 3a42269da8
Fixes WebDAV 0-bytes files 
Fixes the issue where files created via WebDAV show as 0-bytes size when read via fuse.
 2022-06-27 20:19:21 +02:00
Chris Lu 4be406a095
Merge pull request #3249 from kmlebedev/issues_2589 
avoid set currentMaster svc.local k8s discovery service domains
 2022-06-27 11:05:07 -07:00
Chris Lu 265b05c8fc
Merge pull request #3245 from chrislusf/dependabot/go_modules/github.com/klauspost/reedsolomon-1.10.0 
Bump github.com/klauspost/reedsolomon from 1.9.16 to 1.10.0
 2022-06-27 10:15:23 -07:00
Chris Lu f5273cdd5c
Merge pull request #3244 from chrislusf/dependabot/go_modules/github.com/go-redsync/redsync/v4-4.5.1 
Bump github.com/go-redsync/redsync/v4 from 4.5.0 to 4.5.1
 2022-06-27 10:03:32 -07:00
Chris Lu a9389377b5
Merge pull request #3247 from chrislusf/dependabot/go_modules/google.golang.org/api-0.85.0 
Bump google.golang.org/api from 0.83.0 to 0.85.0
 2022-06-27 10:02:19 -07:00
Konstantin Lebedev 9bff097b01 currentMaster redirected 2022-06-27 21:55:16 +05:00
Konstantin Lebedev 6c20a3b622 avoid set currentMaster k8s svc.local discoveruy service domains 
https://github.com/chrislusf/seaweedfs/issues/2589
 2022-06-27 21:47:05 +05:00
Chris Lu 201023dd15
Merge pull request #3242 from garenchan/ck-dev1 
fix 3238: handle errors for GenerateDirUuid method
 2022-06-27 09:46:46 -07:00
Chris Lu d172d07212
Merge pull request #3246 from chrislusf/dependabot/go_modules/github.com/stretchr/testify-1.7.5 
Bump github.com/stretchr/testify from 1.7.3 to 1.7.5
 2022-06-27 09:44:41 -07:00
Chris Lu 2e3d6104e4
Merge pull request #3243 from chrislusf/dependabot/go_modules/cloud.google.com/go/storage-1.23.0 
Bump cloud.google.com/go/storage from 1.22.1 to 1.23.0
 2022-06-27 09:44:25 -07:00
Lapshin Vitaliy 1a5981d583 fix test 2022-06-27 18:46:21 +03:00
dependabot[bot] 983686bb83
Bump google.golang.org/api from 0.83.0 to 0.85.0 
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.83.0 to 0.85.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.83.0...v0.85.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-06-27 15:24:20 +00:00
dependabot[bot] b5d70669ad
Bump github.com/stretchr/testify from 1.7.3 to 1.7.5 
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.7.3 to 1.7.5.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.7.3...v1.7.5)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-06-27 15:24:14 +00:00
dependabot[bot] 787103b032
Bump github.com/klauspost/reedsolomon from 1.9.16 to 1.10.0 
Bumps [github.com/klauspost/reedsolomon](https://github.com/klauspost/reedsolomon) from 1.9.16 to 1.10.0.
- [Release notes](https://github.com/klauspost/reedsolomon/releases)
- [Commits](https://github.com/klauspost/reedsolomon/compare/v1.9.16...v1.10.0)

---
updated-dependencies:
- dependency-name: github.com/klauspost/reedsolomon
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-06-27 15:24:07 +00:00