gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity
7960 commits 28 branches 278 tags 135 MiB
Commit graph

5212 commits

Author SHA1 Message Date
chrislu 8bc16f1149 rename 2022-05-06 23:38:22 -07:00
chrislu 139e039c44 filer.sync: pass attributes for mount 
fix https://github.com/chrislusf/seaweedfs/issues/3012
 2022-05-06 03:54:12 -07:00
chrislu 10207a48a4 how to setup local test env 2022-05-06 02:25:56 -07:00
chrislu db33b03735 add comments 2022-05-06 02:19:47 -07:00
chrislu e350ba8896 larger test range 2022-05-06 02:17:28 -07:00
chrislu 71e0bcc5d5 a bit optimization 2022-05-06 02:11:58 -07:00
chrislu b2a43dd044 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-05-06 01:51:28 -07:00
chrislu d5fe5d12b7 filer: etcd fix pagination 
fix https://github.com/chrislusf/seaweedfs/issues/3016
 2022-05-06 01:51:19 -07:00
Chris Lu a69bf53405
Merge pull request #2996 from kmlebedev/ydb 
ydb filer store
 2022-05-05 15:34:37 -07:00
Konstantin Lebedev e6d2cb5911 ydb add empty doc file 2022-05-05 11:12:14 +05:00
chrislu ef6c6c450e avoid fatal error if port is already in use 2022-05-04 14:55:14 -07:00
chrislu f7366a9668 skip unix socket mode for windows 
fix https://github.com/chrislusf/seaweedfs/issues/3013
 2022-05-04 10:14:34 -07:00
Konstantin Lebedev f58adaab25 build tag ydb since the growth of the binary is 5 mb 2022-05-03 23:20:09 +05:00
Konstantin Lebedev f127b326bf add options to scaffold 2022-05-03 22:54:31 +05:00
Konstantin Lebedev 7b544576af refactor 2022-05-03 20:16:00 +05:00
chrislu f17cd0d5cd return false if not found 
fix https://github.com/chrislusf/seaweedfs/issues/3011
 2022-05-03 07:18:34 -07:00
chrislu b201edb9df fix wrong assignment 2022-05-03 07:12:33 -07:00
Konstantin Lebedev 04d5dff6bb add support native ttl 2022-05-03 17:52:23 +05:00
Konstantin Lebedev cb3c7a3cdb enable query cache policy instead of prepare 2022-05-03 16:03:10 +05:00
Konstantin Lebedev 8342f651f3 fix scanNamed 2022-05-03 15:18:28 +05:00
chrislu 9271866d1e fix segmentation violation 
fix https://github.com/chrislusf/seaweedfs/issues/3000
 2022-05-02 23:56:11 -07:00
Konstantin Lebedev 2d27afb515 Merge branch 'new_master' into ydb 2022-05-03 10:47:39 +05:00
chrislu 76148ce0f7 use storage_class for backend configuration 
fix https://github.com/chrislusf/seaweedfs/issues/3008
 2022-05-02 12:20:01 -07:00
Konstantin Lebedev d8925b4e83 Merge branch 'new_master' into ydb 
# Conflicts:
#	go.mod
#	go.sum
 2022-05-03 00:13:57 +05:00
Konstantin Lebedev 7640e650e5 fix queries 2022-05-03 00:11:37 +05:00
Konstantin Lebedev 319d300d48 fix createDB 2022-05-02 22:23:07 +05:00
Konstantin Lebedev 0dc44dda63 ydb do Tx or DB 2022-05-02 15:33:29 +05:00
Konstantin Lebedev a3e48831f3 ydb BucketAware interface 2022-05-02 12:42:20 +05:00
chrislu 73961e24d8 3.01 2022-05-01 23:33:45 -07:00
chrislu 00c1dfec4f go fmt 2022-05-01 23:16:29 -07:00
chrislu ce1e8e58ae fix test 2022-05-01 23:15:58 -07:00
chrislu 2c0fdf3693 fix tests 2022-05-01 23:14:04 -07:00
chrislu 94635e9b5c filer: add filer group 2022-05-01 21:59:16 -07:00
Konstantin Lebedev 50c4f62ed4 ydb-go-sdk move to v3 2022-05-02 02:07:47 +05:00
Konstantin Lebedev 21033ff4c3 refactor use const CountEntryChunksForGzip 2022-05-01 22:28:55 +05:00
Konstantin Lebedev ec0ed41e37 ydb kv interface 2022-05-01 21:20:37 +05:00
chrislu 4bd6bea429 fix test 2022-05-01 09:02:01 -07:00
Konstantin Lebedev 6a052f6ff2 ydb Sql interface 2022-05-01 20:33:03 +05:00
Konstantin Lebedev 275c3bb19c ydb initial 
https://github.com/chrislusf/seaweedfs/issues/2942
 2022-05-01 17:28:58 +05:00
chrislu 5d081d5c3c skip if already copied to remote 
fix https://github.com/chrislusf/seaweedfs/issues/2993
 2022-04-30 20:03:04 -07:00
chrislu 1aae7a3f1b volume.tier.upload progress starts negative #2992 
fix https://github.com/chrislusf/seaweedfs/issues/2992
 2022-04-30 18:10:01 -07:00
chrislu ea8a7a5584 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-04-30 17:36:45 -07:00
chrislu 192983b464 s3 backend support customizing storage class 2022-04-30 17:36:40 -07:00
Konstantin Lebedev 03aec9ce7e avoid panic if hashicorp raft not initialized 2022-04-30 13:56:35 +05:00
guosj 1a5de36257 fix return value 2022-04-29 11:19:36 +08:00
Chris Lu 4e97b6146a
Merge pull request #2982 from kmlebedev/issues/2981 
avoid empty listMultipartUploads response
 2022-04-27 17:21:44 -07:00
chrislu b2a6111090 skip ipv6 all interfaces and localhost 
fix https://github.com/chrislusf/seaweedfs/issues/2983
 2022-04-27 17:18:09 -07:00
Konstantin Lebedev 306cf70c4a avoid empty listMultipartUploads response 2022-04-27 19:27:44 +05:00
chrislu 70e5a1b632 volume close should wait for committing compaction 2022-04-26 23:34:05 -07:00
Chris Lu ffe028f8d0
Merge pull request #2974 from kmlebedev/wait_volume_closed_compression 
waite volume being closed during compression idx
 2022-04-26 23:29:22 -07:00
chrislu 37ab8909b0 use two flags: v.isCompacting and v.isCommitCompacting 2022-04-26 23:28:34 -07:00
Chris Lu b557faf175
Merge pull request #2967 from kmlebedev/vl_chk_disk_vlid 
volume.check.disk add param volumeId
 2022-04-26 22:09:06 -07:00
Chris Lu eb49bd5638
Merge pull request #2970 from kmlebedev/vlm_fsck_forcePurging 
delete missing data from volumes in one replica
 2022-04-26 22:08:34 -07:00
chrislu 94f824e1ce volume: sync to disk before copying volume files 
address https://github.com/chrislusf/seaweedfs/issues/2976
 2022-04-26 13:03:43 -07:00
Konstantin Lebedev 7315d1d039 waite volume being closed during compression idx 2022-04-26 13:40:42 +05:00
Konstantin Lebedev d4343ab7da forcePurging desc 2022-04-25 23:11:56 +05:00
Konstantin Lebedev ae56b2c00f change forcePurging to a pointer 2022-04-25 23:10:01 +05:00
Konstantin Lebedev 6d2fda27d2 delete missing data from volumes in one replica 2022-04-25 22:59:46 +05:00
Konstantin Lebedev 67476d830a volume.check.disk add param volumeId 2022-04-25 18:27:14 +05:00
chrislu 2aef5b8b32 3.00 2022-04-24 21:46:03 -07:00
Chris Lu 184e982898
Merge pull request #2957 from guo-sj/handle_implicit_username 
Handle implicit username
 2022-04-24 09:07:48 -07:00
guosj 8fd7b24b80 remove redundant logs & add unit test 2022-04-24 16:09:10 +08:00
guol-fnst 8b2552f944 fix http response error code 2022-04-24 11:07:27 +08:00
guosj 09befe871f Merge branch 'master' into handle_implicit_username 2022-04-23 09:48:25 +08:00
guosj 893a0eea57 add more checks and comments 2022-04-22 22:47:11 +08:00
chrislu ad01c63b84 conditionally skip hdfs related code 2022-04-21 01:43:01 -07:00
chrislu 4aa39ef33f conditionally compile sqlite 2022-04-21 01:22:38 -07:00
chrislu 3885374edf conditionally build elastic, gocdk to reduce binary size 2022-04-21 01:10:46 -07:00
chrislu 6994e88192 fix typo 2022-04-21 00:02:18 -07:00
chrislu cb1e7aa27d fix build 2022-04-20 16:21:56 -07:00
a 1d6a9e66b6 Merge branch 'master' into a 2022-04-20 14:01:42 -07:00
chrislu bdc4d67de8 Revert "Merge pull request #2944 from guo-sj/handle_implicit_username" 
This reverts commit bc96e73b8d, reversing
changes made to 88a669dd19.
 2022-04-20 09:40:41 -07:00
chrislu 3aa4dc6ad5 Revert "fix index out of range" 
This reverts commit 4792e07228.
 2022-04-20 09:40:24 -07:00
chrislu 4792e07228 fix index out of range 2022-04-20 09:32:17 -07:00
chrislu f3fdfb07b8 Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-04-19 22:58:59 -07:00
chrislu 8e9ad7db5a fix bug deleting volume or unmount volume if a volume server has multiple directories 2022-04-19 22:58:57 -07:00
Chris Lu bc96e73b8d
Merge pull request #2944 from guo-sj/handle_implicit_username 
handle implicit username
 2022-04-19 21:42:21 -07:00
guosj a23629b2fe handle implicit username 2022-04-20 10:12:33 +08:00
Chris Lu 88a669dd19
Merge pull request #2858 from kmlebedev/fsck_replicas 
fsck replicas
 2022-04-19 00:17:43 -07:00
Chris Lu f76c318a1f
Merge pull request #2940 from kmlebedev/volume.list.grep 
volume.list show only readonly, collectionPattern and volumeId
 2022-04-19 00:17:32 -07:00
Konstantin Lebedev 2364fab927 volume.list show only readonly, collectionPattern and volumeId 2022-04-19 11:44:41 +05:00
guosj 94ad557d97 add missing return 2022-04-19 14:16:32 +08:00
Konstantin Lebedev 36c5a59ed8 add help 2022-04-18 19:36:14 +05:00
Konstantin Lebedev 1e35b4929f shell vacuum volume by collection and volume id 2022-04-18 18:40:58 +05:00
Chris Lu 97c6e0efb1
Merge pull request #2931 from kmlebedev/fix_nil_dataBackend 
avoid invalid memory address or nil pointer dereference
 2022-04-18 00:13:26 -07:00
Konstantin Lebedev 9438738693 avoid invalid memory address or nil pointer dereference 2022-04-18 12:10:22 +05:00
chrislu a69f0b62c2 start filer local socket only on non windows 
fix https://github.com/chrislusf/seaweedfs/issues/2930
 2022-04-18 00:08:31 -07:00
chrislu 9ae66f55fc 2.99 2022-04-17 23:01:42 -07:00
chrislu 4524ceae6b less verbose logs 
fix https://github.com/chrislusf/seaweedfs/discussions/2925#discussioncomment-2584085
 2022-04-17 22:55:26 -07:00
leyou240 89eb87c1d1
Merge branch 'master' into slices.SortFunc 2022-04-18 10:39:29 +08:00
justin 3551ca2fcf enhancement: replace sort.Slice with slices.SortFunc to reduce reflection 2022-04-18 10:35:43 +08:00
chrislu b597baf488 mount: set file write time correct to work well with rsync 
fix https://github.com/chrislusf/seaweedfs/issues/2867
 2022-04-16 22:56:45 -07:00
chrislu 460d56d283 shell: cluster.check prints out clock delta and network latency 2022-04-16 13:24:17 -07:00
chrislu b4be56bb3b add timing info during ping operation 2022-04-16 12:45:49 -07:00
chrislu 1384529eb7 Fix filer.backup deletes files in backup folder in incremental mode 
fix https://github.com/chrislusf/seaweedfs/issues/2919
 2022-04-14 13:35:01 -07:00
a 846858fb43 merge master 2022-04-12 14:42:29 -07:00
chrislu 1f03fcccb1 fix nil in cluster_check shell command 
fix https://github.com/chrislusf/seaweedfs/issues/2905
 2022-04-12 08:47:27 -07:00
Chris Lu dd13764a5c
Merge pull request #2900 from kmlebedev/fix_cleanupUploads 
avoid breaking loop in cleanupUploads if error is empty
 2022-04-12 02:03:31 -07:00
Konstantin Lebedev 76b1c5ce67 cleanupUploads use jwt token 2022-04-12 13:46:11 +05:00
Chris Lu 72db181d68
Merge pull request #2901 from guol-fnst/fix_multiupload 
check object name and uploadID when processing  multiupload
 2022-04-11 23:38:12 -07:00
guol-fnst 44d810d163 rename functions and remove uncessary check 2022-04-12 13:40:53 +08:00
guol-fnst 180aa88a92 check uploadid using object name hash string 2022-04-12 11:04:38 +08:00
guol-fnst 2232cfb5b7 Check object name and uploadID when processing multipart uploading 2022-04-11 19:53:44 +08:00
Konstantin Lebedev 2dfbe210e0 avoid breaking loop in cleanupUploads if error is empty 2022-04-11 11:16:20 +05:00
Chris Lu a87f57e47c
Merge pull request #2868 from kmlebedev/hashicorp_raft 
hashicorp raft
 2022-04-10 23:00:05 -07:00
Konstantin Lebedev 931cb9e581 use "cluster.raft.{ps,add,remove}" 2022-04-11 10:50:01 +05:00
Konstantin Lebedev d2fe0fae33 use the full ServerAddress as the identifier 2022-04-11 10:44:44 +05:00
chrislu c6ec5269f4 2.98 2022-04-10 18:56:40 -07:00
chrislu 261ba0208e lock-protected setting entry 2022-04-09 22:52:59 -07:00
Chris Lu 9f4ecd50ac
Merge pull request #2889 from blacktear23/filer-ui-bootstrap-style 
Change filer UI icon from picture to icon font.
 2022-04-08 00:50:32 -07:00
yulai.li ceb058ddd9 Change filer UI icon from picture to icon font. 2022-04-08 15:07:56 +08:00
chrislu 7f26676f57 adjust td width 2022-04-07 22:34:32 -07:00
yulai.li dff63e9024 Make operation buttons show when table row hovered 2022-04-08 13:10:12 +08:00
chrislu 4dba102137 use icon instead of button text 2022-04-07 11:15:01 -07:00
Chris Lu bbc95dac47
Merge pull request #2885 from binbinshi/master 
fix: master lose some volumes
 2022-04-07 10:16:19 -07:00
Konstantin Lebedev 104ea7b029 master ui add raft stats and Max Volume Id 2022-04-07 20:52:01 +05:00
a 41d396edc4 Merge branch 'master' into a 2022-04-07 08:22:59 -07:00
Konstantin Lebedev a2fdb3e277 fix master ui 2022-04-07 19:37:40 +05:00
Konstantin Lebedev 35bc67f030 fix conflicts 2022-04-07 18:52:13 +05:00
Konstantin Lebedev f5246b748d Merge branch 'new_master' into hashicorp_raft 
# Conflicts:
#	weed/pb/master_pb/master.pb.go
 2022-04-07 18:50:27 +05:00
yulai.li 11a9f993a8 Make filer-ui bootstrap style 2022-04-07 20:17:00 +08:00
Konstantin Lebedev 7ff248d5cd refactor OnPeerUpdate 2022-04-07 16:23:22 +05:00
Konstantin Lebedev 85d80fd36d fix removing old raft server 2022-04-07 15:31:37 +05:00
chrislu abe3cc6df2 filer UI touch up 2022-04-07 01:25:55 -07:00
Chris Lu 869d23b099
Merge pull request #2884 from blacktear23/filer-ui-new-features 
Filer UI new features
 2022-04-07 00:58:56 -07:00
chrislu 86ed27f602 mount: remove leftover socket file 2022-04-07 00:33:13 -07:00
yulai.li 2347c21cdd Tune filer UI add rename feature 2022-04-07 15:19:41 +08:00
yulai.li 2454020a92 Add upload progress support 2022-04-07 15:19:37 +08:00
yulai.li 4f87ee7755 Add create directory and delete web UI features for filer 2022-04-07 15:19:33 +08:00
shibinbin c20e1edd99 fix: master lose some volumes 2022-04-07 15:18:28 +08:00
eddy-gfx ec53eec94f
Merge branch 'master' into a 2022-04-06 18:45:55 -05:00
chrislu 3ab2c0e5c0 avoid possible nil attributes 2022-04-06 10:11:11 -07:00
chrislu 9d44b89c21 Revert "avoid possible nil attributes" 
This reverts commit 0a6703c7f7.
 2022-04-06 10:01:45 -07:00
chrislu 0a6703c7f7 avoid possible nil attributes 2022-04-06 09:58:48 -07:00
Konstantin Lebedev 14a2cc83bf raft update peers via OnPeerUpdate 2022-04-06 21:17:04 +05:00
Konstantin Lebedev 357aa818fe add raft shell cmds 2022-04-06 15:23:53 +05:00
chrislu 3d229fe45c Merge branch 'master' of https://github.com/chrislusf/seaweedfs 2022-04-06 00:28:51 -07:00
chrislu 79b8e6a8c3 add a place holder for later merge consecutive chunks 2022-04-06 00:28:48 -07:00
Konstantin Lebedev c1aeded2dd force raft bootstrap 
avoid err bootstrap only works on new clusters
 2022-04-06 12:18:43 +05:00
Chris Lu 49ecb8d11c
Merge pull request #2879 from leyou240/master 
remove Redundant type conversion and use strings.TrimSuffix to enhance readability
 2022-04-06 00:02:19 -07:00
justin d02f13c2d1 remove Redundant type conversion and use strings.TrimSuffix to enhance readability 2022-04-06 14:58:09 +08:00
root f15a737a0a Add "Location:" in response when creating bucket 
according to "https://docs.aws.amazon.com/AmazonS3/latest/API/API_CreateBucket.html"
 2022-04-06 13:56:27 +08:00
chrislu bc888226fc erasure coding: tracking encoded/decoded volumes 
If an EC shard is created but not spread to other servers, the masterclient would think this shard is not located here.
 2022-04-05 19:03:02 -07:00
chrislu 8b3d76b24d prevent concurrent access during shutdown 2022-04-05 10:53:36 -07:00
chrislu bb4beebce3 prevent nil 2022-04-05 10:49:17 -07:00
Konstantin Lebedev 0e796a5582 rm set NoSnapshotRestoreOnStart 2022-04-05 18:28:42 +05:00
Konstantin Lebedev 68f11b9687 sleep bootstraping 2022-04-05 15:42:19 +05:00
Konstantin Lebedev 1ae7f509f5 LocalID from raw string 2022-04-05 13:50:39 +05:00
Konstantin Lebedev 89d32a0670 fix glog Info 2022-04-05 13:43:34 +05:00
Konstantin Lebedev 17c6e8e39f Merge branch 'new_master' into hashicorp_raft 
# Conflicts:
#	go.mod
#	go.sum
 2022-04-05 13:29:46 +05:00