Chris Lu
|
de0c983808
|
refactoring scaffolding for master.toml
|
2019-11-14 22:20:38 -08:00 |
|
Lei Liu
|
46755ea1e1
|
fix master maintenance logic
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
|
2019-11-12 14:46:10 +08:00 |
|
Chris Lu
|
ee90236a97
|
Merge branch 'master' into refactoring_dat_backend
|
2019-11-11 21:30:14 -08:00 |
|
Chris Lu
|
d7852ebb3b
|
Merge pull request #1102 from stlpmo-jn/add_ETCD_sequencer
Add etcd sequencer
|
2019-11-11 12:43:24 -08:00 |
|
stlpmo
|
62d393d6c9
|
ut pass
|
2019-11-11 10:52:21 +08:00 |
|
stlpmo
|
802a0eb3fe
|
move from cmd-line to scaffold
|
2019-11-11 09:15:17 +08:00 |
|
zhangsong
|
61fa485700
|
add volume number param in assign operation
|
2019-11-10 20:11:03 +08:00 |
|
Chris Lu
|
c5c1d83d91
|
Merge branch 'master' into refactoring_dat_backend
|
2019-11-08 22:54:41 -08:00 |
|
Chris Lu
|
6cc9e0d788
|
volume: fix ec shard reading
fix https://github.com/chrislusf/seaweedfs/issues/1106
|
2019-11-08 22:41:02 -08:00 |
|
stlpmo
|
1c8bed3810
|
delete the var etcdClient and comments
refactor the code
add sequencer cmd-line
delete nerver used codes
|
2019-11-05 15:45:25 +08:00 |
|
Lei Liu
|
1294999d8b
|
return error when garbageThreshold is not a valid float number
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
|
2019-10-31 20:43:20 +08:00 |
|
Lei Liu
|
1bcef02a6c
|
fix dir/lookup and col/delete api
1, Fix Layouts first letter capitalized
2, Return http 204 when delete a collection
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
|
2019-10-31 16:55:45 +08:00 |
|
Lei Liu
|
f2f90436ef
|
fix leader master /dir/lookup api
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
|
2019-10-30 16:38:40 +08:00 |
|
Chris Lu
|
5b950c735e
|
Merge branch 'master' into refactoring_dat_backend
|
2019-10-29 23:18:41 -07:00 |
|
Lei Liu
|
c2884cace2
|
misc updated
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
|
2019-10-29 21:28:28 +08:00 |
|
Chris Lu
|
19b6a16003
|
changed from os.file to backend.DataStorageBackend
|
2019-10-29 00:35:16 -07:00 |
|
Chris Lu
|
71eb8efd20
|
fix error logs
|
2019-10-25 09:44:58 -07:00 |
|
Chris Lu
|
55a2221eba
|
master: add logging for volume server disconnection
add logging for https://github.com/chrislusf/seaweedfs/issues/1093
|
2019-10-25 09:35:19 -07:00 |
|
Chris Lu
|
46ed2ca902
|
refactoring
|
2019-10-24 23:41:32 -07:00 |
|
divinerapier
|
f1ee6b7a54
|
fix abused 404 status code
Signed-off-by: divinerapier <poriter.coco@gmail.com>
|
2019-10-24 16:51:26 +08:00 |
|
Chris Lu
|
c358f96aaa
|
volume: redirection follow public url
fix https://github.com/chrislusf/seaweedfs/issues/1089
|
2019-10-23 22:11:42 -07:00 |
|
Chris Lu
|
23240efa63
|
filer: add tikv support
|
2019-10-23 00:31:31 -07:00 |
|
Chris Lu
|
c71fddee2b
|
go fmt
|
2019-10-22 00:50:50 -07:00 |
|
Chris Lu
|
fc412e428b
|
refactor ScanVolumeFileFrom()
|
2019-10-22 00:50:30 -07:00 |
|
Chris Lu
|
c9a183eb69
|
refactor memory map related code
|
2019-10-22 00:49:42 -07:00 |
|
Chris Lu
|
faec9076a4
|
adjust parameter names
|
2019-10-21 22:57:01 -07:00 |
|
Chris Lu
|
d16c450682
|
fix unreachable code
|
2019-10-21 22:36:41 -07:00 |
|
joeslay
|
d53aee179b
|
Merge pull request #10 from chrislusf/master
merge seaweed master
|
2019-10-14 16:03:40 +01:00 |
|
Chris Lu
|
939e4b57a8
|
go fmt
|
2019-10-09 00:03:18 -07:00 |
|
Chris Lu
|
f8d4b7d1c0
|
support basic json filtering and selection
|
2019-10-06 22:35:08 -07:00 |
|
Chris Lu
|
cf47f657af
|
scaffold for volume server query feature
|
2019-10-06 22:35:08 -07:00 |
|
joeslay
|
9d03aa6a38
|
Merge pull request #8 from chrislusf/master
merge seaweed master
|
2019-10-01 17:55:31 +01:00 |
|
Lei Liu
|
3cc084269c
|
master api: return http 404 when volumeId not exist
Signed-off-by: Lei Liu <lei01.liu@horizon.ai>
|
2019-09-29 14:23:39 +08:00 |
|
j.laycock
|
6fc6322c90
|
Change joeslay paths to chrislusf paths
|
2019-09-12 14:18:21 +01:00 |
|
joeslay
|
d8c34b032f
|
Merge pull request #6 from chrislusf/master
merge seaweed master
|
2019-09-12 11:44:09 +01:00 |
|
Chris Lu
|
ae53f63680
|
filer: recursive deletion optionally ignoring any errors
fix https://github.com/chrislusf/seaweedfs/issues/1062
|
2019-09-11 20:26:20 -07:00 |
|
Tom Maxwell
|
4a878c0006
|
Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve
|
2019-09-04 15:27:14 +01:00 |
|
joeslay
|
6ee65356e3
|
Merge pull request #3 from chrislusf/master
merge seaweed master
|
2019-09-04 14:58:04 +01:00 |
|
j.laycock
|
cbd0a98fa1
|
Add InMemory to Volume Grow structure
|
2019-09-03 18:19:02 +01:00 |
|
Chris Lu
|
ee8bcb0c12
|
remove println
|
2019-09-03 09:22:56 -07:00 |
|
j.laycock
|
1f01eb78e8
|
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
|
2019-09-03 17:00:59 +01:00 |
|
Tom Maxwell
|
d637d86d22
|
Changes to try and pass the URL parameters through - in memory flag not working still
|
2019-09-03 15:41:28 +01:00 |
|
joeslay
|
e91139348e
|
Merge pull request #2 from chrislusf/master
merge seaweed master
|
2019-09-02 11:39:40 +01:00 |
|
j.laycock
|
595a1beff0
|
Swap imports to use joeslay
|
2019-09-02 11:28:40 +01:00 |
|
Chris Lu
|
60c9215a00
|
HCFS: avoid verbose file not found exception stack trace
|
2019-09-01 21:40:26 -07:00 |
|
Chris Lu
|
0dc43ecdca
|
skip writing content if not modified
related to https://github.com/chrislusf/seaweedfs/issues/1036
|
2019-08-09 14:38:54 -07:00 |
|
Feng Ye
|
fc0498798b
|
Add etcd filestore
|
2019-08-01 10:16:45 +08:00 |
|
Chris Lu
|
ca2b81a944
|
fix test error
|
2019-07-31 02:09:13 -07:00 |
|
Chris Lu
|
19360ab10a
|
master: redirect clients to the new leader
|
2019-07-31 01:54:42 -07:00 |
|
Chris Lu
|
8afd8d35b3
|
master: followers can also lookup and redirect
improve scalability
|
2019-07-28 03:58:13 -07:00 |
|
Chris Lu
|
898d943b25
|
refactoring
|
2019-07-17 23:43:48 -07:00 |
|
Chris Lu
|
0264a7f50a
|
set the max file key when ever possible
|
2019-07-17 23:23:01 -07:00 |
|
Chris Lu
|
aff911c00d
|
skip all azuresb
|
2019-07-17 01:24:20 -07:00 |
|
Chris Lu
|
0ea98dc6a2
|
disable azure due to api changes
|
2019-07-17 00:39:36 -07:00 |
|
Chris Lu
|
9e47c4749a
|
shell: add fs.mv
fix https://github.com/chrislusf/seaweedfs/issues/954
|
2019-07-11 09:29:04 -07:00 |
|
Chris Lu
|
1d1b355f9e
|
filer: set file name when uploading to a directory
fix https://github.com/chrislusf/seaweedfs/issues/1005
|
2019-07-11 04:20:03 -07:00 |
|
Chris Lu
|
476a7c269c
|
detect a filer path is a file or a directory
fix https://github.com/chrislusf/seaweedfs/issues/1004
|
2019-07-10 12:11:18 -07:00 |
|
Chris Lu
|
15ecf4e3bf
|
filer: default to leveldb2
|
2019-06-30 00:44:57 -07:00 |
|
Chris Lu
|
6883f9e322
|
mark volume readonly before ec encoding
|
2019-06-26 23:02:22 -07:00 |
|
Chris Lu
|
359563e95a
|
refactoring
|
2019-06-25 09:49:27 -07:00 |
|
Chris Lu
|
c777102da9
|
go fmt
|
2019-06-23 15:30:16 -07:00 |
|
Chris Lu
|
d5560f2705
|
simplify metrics settings
|
2019-06-23 15:29:49 -07:00 |
|
Chris Lu
|
f16375621f
|
big refactoring
|
2019-06-23 03:08:27 -07:00 |
|
Chris Lu
|
6c01fb6d2d
|
go fmt
|
2019-06-23 01:57:51 -07:00 |
|
Chris Lu
|
8da5d5b094
|
filer.copy: use filer settings, avoid unnecessary command line options
fix https://github.com/chrislusf/seaweedfs/issues/968
|
2019-06-23 01:57:35 -07:00 |
|
Chris Lu
|
d1cd8f8c5b
|
add metrics, refactoring
|
2019-06-22 22:53:52 -07:00 |
|
Chris Lu
|
3fa1f150d9
|
refactoring
|
2019-06-22 20:04:56 -07:00 |
|
Chris Lu
|
f88a8bda7b
|
ec deletion works
|
2019-06-21 01:14:10 -07:00 |
|
Chris Lu
|
613a2e8060
|
delete garbage only when successful
|
2019-06-20 23:46:00 -07:00 |
|
Chris Lu
|
c74dc2b306
|
go fmt
|
2019-06-20 00:55:52 -07:00 |
|
Chris Lu
|
e63317fb08
|
ec deletion code complete, not tested yet
|
2019-06-20 00:55:30 -07:00 |
|
Chris Lu
|
4cea8aefd0
|
add grpc VolumeEcBlobDelete
|
2019-06-20 00:17:11 -07:00 |
|
Chris Lu
|
856da7aae2
|
ec volume support deletes
|
2019-06-19 22:57:14 -07:00 |
|
Chris Lu
|
d8ed73926d
|
volume servers get metrics address and interval from the master
|
2019-06-17 14:51:47 -07:00 |
|
Chris Lu
|
ff6a6dd11e
|
refactoring
|
2019-06-15 21:46:55 -07:00 |
|
Chris Lu
|
8b43679ae3
|
refactoring
|
2019-06-15 12:21:44 -07:00 |
|
Chris Lu
|
5336008dcd
|
refactoring
|
2019-06-14 13:06:01 -07:00 |
|
Chris Lu
|
d67189921f
|
go fmt
|
2019-06-14 00:55:12 -07:00 |
|
Chris Lu
|
5f6c9825f8
|
volume server: adds basic metrics
|
2019-06-14 00:54:56 -07:00 |
|
Chris Lu
|
a11525fe4e
|
filer: adds basic metrics pushing to Prometheus gateway
|
2019-06-13 02:01:54 -07:00 |
|
Chris Lu
|
57092d69ac
|
go fmt
|
2019-06-10 21:33:32 -07:00 |
|
Chris Lu
|
e66bddd84c
|
customizable sleep intervals
|
2019-06-06 00:39:08 -07:00 |
|
Chris Lu
|
50aa769554
|
jwt for read access control
|
2019-06-06 00:29:02 -07:00 |
|
Chris Lu
|
d344e0a035
|
fix ec related bugs
|
2019-06-05 23:20:26 -07:00 |
|
Chris Lu
|
450f4733ce
|
report empty volume or ec shards
|
2019-06-05 13:32:33 -07:00 |
|
Chris Lu
|
7f6fb9ffd0
|
every 17 minutes instead of seconds
TODO: make this configurable
|
2019-06-05 13:32:08 -07:00 |
|
Chris Lu
|
ede876cfdb
|
periodic scripts exeuction from leader master
|
2019-06-05 01:30:24 -07:00 |
|
Chris Lu
|
ca8a2bb534
|
go fmt
|
2019-06-04 22:04:10 -07:00 |
|
Chris Lu
|
2215e81be7
|
ui add ec shard statuses
|
2019-06-04 21:52:37 -07:00 |
|
Chris Lu
|
b05456fe07
|
able to purge extra ec shard copies
|
2019-06-03 20:25:02 -07:00 |
|
Chris Lu
|
11cffb3168
|
fix ec.rebuild bugs
|
2019-06-03 11:50:54 -07:00 |
|
Chris Lu
|
d85b41b904
|
fix ec.encode not finding the local ec shards
|
2019-06-03 10:38:21 -07:00 |
|
Chris Lu
|
7e80b2b882
|
fix multiple bugs
|
2019-06-03 02:26:31 -07:00 |
|
Chris Lu
|
55be09996d
|
fix volume balance bug
|
2019-06-03 00:13:31 -07:00 |
|
Chris Lu
|
133b772fb5
|
destroy ec volume if it is empty
|
2019-06-01 01:51:28 -07:00 |
|
Chris Lu
|
ba18314aab
|
ec shard delete also check ec volumes, in addition to volumes
|
2019-06-01 01:41:22 -07:00 |
|
Chris Lu
|
f53024d79d
|
delete ec collection
|
2019-05-30 10:40:22 -07:00 |
|
Chris Lu
|
1d111d6ce8
|
collection list normal and ec volumes
|
2019-05-30 09:27:23 -07:00 |
|
Chris Lu
|
e941d0c2f4
|
list ec collections also
|
2019-05-30 09:17:58 -07:00 |
|
Chris Lu
|
3f9ecee40f
|
working with reading remote intervals
|
2019-05-28 21:29:07 -07:00 |
|