Chris Lu
|
e5506152c0
|
refactoring
|
2019-04-18 21:43:36 -07:00 |
|
Chris Lu
|
33c92b819a
|
refactoring
|
2019-04-18 21:17:43 -07:00 |
|
Chris Lu
|
fa176fe80f
|
volume tailing chunks large files
|
2019-04-18 19:22:13 -07:00 |
|
Chris Lu
|
b142f9f1d5
|
go fmt
|
2019-04-18 00:19:18 -07:00 |
|
Chris Lu
|
b09e8dbb37
|
add VolumeStreamFollow, but not used yet
|
2019-04-18 00:18:29 -07:00 |
|
Chris Lu
|
13ad5c1966
|
refactoring
|
2019-04-17 22:04:49 -07:00 |
|
Chris Lu
|
f567777d64
|
volume: fix needle checking for deleted needles
|
2019-04-15 21:58:43 -07:00 |
|
Chris Lu
|
bd76ad0ff1
|
Revert "Revert "volume: close request body if any parsing error""
This reverts commit 359b7c1650 .
|
2019-04-15 21:43:28 -07:00 |
|
Chris Lu
|
359b7c1650
|
Revert "volume: close request body if any parsing error"
This reverts commit 5996656141 .
|
2019-04-15 21:35:12 -07:00 |
|
Chris Lu
|
5996656141
|
volume: close request body if any parsing error
|
2019-04-15 21:11:45 -07:00 |
|
Chris Lu
|
3e8a3a8fec
|
fix race detector found problems
|
2019-04-14 23:00:37 -07:00 |
|
Chris Lu
|
0e33272f56
|
small refactoring
|
2019-04-10 23:39:53 -07:00 |
|
stlpmo-jn
|
c1a0403da2
|
repair the error replications of the volume
|
2019-04-10 19:41:55 +08:00 |
|
Chris Lu
|
3555628ad5
|
weed volume: fix bug, remove boltdb, btree
|
2019-04-09 10:08:59 -07:00 |
|
Chris Lu
|
8a5ce16e96
|
weed volume: remove boltdb, btree options, add options for leveldb medium, large
|
2019-04-09 09:42:06 -07:00 |
|
Chris Lu
|
9924fa3b1a
|
weed volume: disable block cache on leveldb
saving 8MB for each volume, but at the cost of slower lookup
|
2019-04-09 00:24:32 -07:00 |
|
Chris Lu
|
784c5bb73a
|
add build option support 5-byte offset
|
2019-04-08 22:01:29 -07:00 |
|
Chris Lu
|
7a4b234ea1
|
divide offset into higher and lower sections
|
2019-04-08 21:44:06 -07:00 |
|
Chris Lu
|
000ee725fc
|
refactor Offset into a struct of bytes
|
2019-04-08 19:40:56 -07:00 |
|
Chris Lu
|
94302935b2
|
weed volume: only store compressed data if compression is effective
|
2019-04-06 00:10:52 -07:00 |
|
Chris Lu
|
7a14cdc90c
|
refactoring, go fmt
|
2019-03-25 23:18:40 -07:00 |
|
Chris Lu
|
19728fe3f6
|
remove deprecated code
|
2019-03-25 23:12:14 -07:00 |
|
Chris Lu
|
df95ce0b6c
|
weed backup: efficient delta backup
fix https://github.com/chrislusf/seaweedfs/issues/399
|
2019-03-25 23:01:53 -07:00 |
|
Chris Lu
|
70815e9124
|
WIP
|
2019-03-25 09:16:12 -07:00 |
|
Chris Lu
|
95e0520182
|
weed volume: add grpc operation to relicate a volume to local
|
2019-03-23 11:33:34 -07:00 |
|
Chris Lu
|
cea5c53bf7
|
fix length checking
fix https://github.com/chrislusf/seaweedfs/issues/890
|
2019-03-19 20:56:27 -07:00 |
|
Chris Lu
|
da871896c3
|
weed filer: set grpc port to port + 10000
|
2019-03-19 05:47:41 -07:00 |
|
Chris Lu
|
916b809c08
|
add error checking
|
2019-03-19 05:34:43 -07:00 |
|
Chris Lu
|
ece9d13312
|
volume info collect compact revision number
|
2019-03-18 09:32:21 -07:00 |
|
Chris Lu
|
44647a46c0
|
needle scanner read appendAtNs
|
2019-03-17 23:28:43 -07:00 |
|
Chris Lu
|
8b26d15740
|
refactoring: simplify function parameter
|
2019-03-17 22:32:01 -07:00 |
|
Chris Lu
|
2fcc88116e
|
go fmt
|
2019-03-17 20:27:36 -07:00 |
|
Chris Lu
|
aca653c08b
|
weed shell: list volumes
|
2019-03-17 20:27:08 -07:00 |
|
Chris Lu
|
95ef4513c8
|
print out memory size
|
2019-03-13 23:14:40 -07:00 |
|
Chris Lu
|
346541a101
|
print out per entry memory usage
|
2019-03-13 23:07:24 -07:00 |
|
chenwanli
|
fd27ed7755
|
Fix https://github.com/chrislusf/seaweedfs/issues/861
|
2019-02-26 17:12:39 +08:00 |
|
Chris Lu
|
77b9af531d
|
adding grpc mutual tls
|
2019-02-18 12:11:52 -08:00 |
|
Chris Lu
|
09471b46f9
|
fix related tests
|
2019-01-26 00:10:29 -06:00 |
|
Chris Lu
|
5668ed798d
|
memory needle map mark size to be TombstoneFileSize
fix https://github.com/chrislusf/seaweedfs/issues/850
|
2019-01-26 00:05:44 -06:00 |
|
bingoohuang
|
cf0fc797ac
|
use tempFile.Truncate to reset file size to speedup test
|
2019-01-23 16:24:51 +08:00 |
|
bingoohuang
|
ab6be025d7
|
go fmt and fix some typo
|
2019-01-17 09:17:19 +08:00 |
|
bingoohuang
|
6ddfaf33cb
|
extract VolumeFileScanner for ScanVolumeFile
|
2019-01-16 17:48:59 +08:00 |
|
bingoohuang
|
27093bc2e5
|
fix needle Append return offset to avoid uint32 overflow
|
2019-01-16 16:48:03 +08:00 |
|
Chris Lu
|
badd8fdf8f
|
shortcut for empty file
|
2019-01-08 09:03:28 -08:00 |
|
Chris Lu
|
6b5d6bb5a6
|
adjust error names
|
2019-01-05 19:52:38 -08:00 |
|
Chris Lu
|
9383c91eb1
|
wait to read again if the volume is compacting
|
2019-01-05 19:52:17 -08:00 |
|
Chris Lu
|
d5ebfd5b0c
|
fix s3cmd put
1. fix volume put data size
|
2019-01-02 12:57:33 -08:00 |
|
Chris Lu
|
1478d7ea21
|
reduce file seek when writing
|
2018-12-31 15:08:32 -08:00 |
|
Chris Lu
|
0c932d1738
|
add volume delete grpc API
fix https://github.com/chrislusf/seaweedfs/issues/808
|
2018-12-29 00:03:30 -08:00 |
|
Chris Lu
|
c043fd17cb
|
detect more gzippable content
|
2018-12-22 15:05:31 -08:00 |
|
Chris Lu
|
852ee21835
|
avoid .gz auto decompression
|
2018-12-22 13:58:16 -08:00 |
|
Chris Lu
|
be946c9e54
|
filer store original data size instead of data size after gzip
|
2018-12-22 13:11:07 -08:00 |
|
Chris Lu
|
141d302492
|
fix binarySearchCompactSection
|
2018-12-22 11:52:58 -08:00 |
|
Chris Lu
|
5333f2984a
|
streaming updates for large entries or large index file
fix https://github.com/chrislusf/seaweedfs/issues/801
|
2018-12-22 11:10:08 -08:00 |
|
Chris Lu
|
36d13355bb
|
compact map fix bug when iterating
|
2018-12-22 11:05:29 -08:00 |
|
Chris Lu
|
f64dc7465b
|
remove index file
fix https://github.com/chrislusf/seaweedfs/issues/793
|
2018-12-17 20:33:32 -08:00 |
|
Chris Lu
|
42cb9b76c4
|
reduce needle map memory usage by 25%
|
2018-12-15 05:55:56 -08:00 |
|
Chris Lu
|
168f461761
|
fix MaxUint8
|
2018-12-10 20:57:51 -08:00 |
|
Chris Lu
|
8f78a069c6
|
fix possible name overflow when len(name)>255
|
2018-12-10 20:57:01 -08:00 |
|
Chris Lu
|
4a490fe35a
|
go fmt
|
2018-12-09 01:27:25 -08:00 |
|
Chris Lu
|
5741134ca0
|
change overflow from map to slice
|
2018-12-09 01:27:11 -08:00 |
|
Chris Lu
|
d9189c857c
|
remove unused file
|
2018-12-09 00:30:53 -08:00 |
|
Chris Lu
|
df4b9df142
|
add memory usage report
|
2018-12-09 00:15:23 -08:00 |
|
Chris Lu
|
ec5a305624
|
refactor
|
2018-12-09 00:12:37 -08:00 |
|
Chris Lu
|
9d3be33e5c
|
optimize a little bit
|
2018-12-08 21:45:14 -08:00 |
|
Chris Lu
|
86dd933596
|
go fmt
|
2018-11-23 00:26:15 -08:00 |
|
Chris Lu
|
2697d6a4fb
|
fix deleting bucket
|
2018-11-08 22:15:21 -08:00 |
|
Chris Lu
|
a4ceb051a7
|
use MD5 for ETag to be consistent with Amazon S3
|
2018-11-08 21:41:02 -08:00 |
|
Chris Lu
|
f9dbaf6292
|
delete file by name instead of referencing the dataFile pointer
|
2018-11-05 08:53:38 -08:00 |
|
alex8224
|
8d3f9c0b75
|
fix invalid point when delete collection
|
2018-11-05 19:53:55 +08:00 |
|
Chris Lu
|
f050b22d6c
|
close file in ScanVolumeFile()
fix https://github.com/chrislusf/seaweedfs/issues/761
|
2018-11-04 00:28:24 -07:00 |
|
Chris Lu
|
496a7398d1
|
adjust logging
|
2018-10-18 20:47:30 -07:00 |
|
Chris Lu
|
eec951cad2
|
migrate volume sync to gRpc
|
2018-10-15 21:44:41 -07:00 |
|
Chris Lu
|
66a353dcb5
|
remove volume server /admin/volume/delete
|
2018-10-15 01:26:49 -07:00 |
|
Chris Lu
|
fda771c83f
|
migrate volume sync status to grpc API on volume server
|
2018-10-15 01:19:15 -07:00 |
|
Chris Lu
|
b423bb9e2d
|
migrate assign volume to grpc API on volume server
|
2018-10-15 00:40:46 -07:00 |
|
Chris Lu
|
333709657c
|
adjust log level
|
2018-10-15 00:40:12 -07:00 |
|
Chris Lu
|
b1daede91b
|
move volume vacuum to gRpc
|
2018-10-14 23:12:43 -07:00 |
|
Chris Lu
|
a362261972
|
avoid possible racing issue if leveldb or boltdb is used.
remove the to-be-generated files during commit
fix https://github.com/chrislusf/seaweedfs/issues/738
|
2018-09-26 18:45:51 -07:00 |
|
Chris Lu
|
164091c269
|
add s3 multipart upload
|
2018-09-09 16:25:43 -07:00 |
|
Chris Lu
|
9b3bf0e46c
|
fix "weed backup" rerunning
"weed backup" rerunning will already have ReplicaPlacement set, while version is not set.
|
2018-09-09 02:48:58 -07:00 |
|
Chris Lu
|
bc8d34143d
|
Revert "fix "weed backup" rerunning"
This reverts commit 1937be2bb2 .
|
2018-09-09 02:38:30 -07:00 |
|
Chris Lu
|
1937be2bb2
|
fix "weed backup" rerunning
"weed backup" rerunning will already have ReplicaPlacement set, while version is not set.
|
2018-09-09 02:31:12 -07:00 |
|
Chris Lu
|
76cbe8bf33
|
instant notification of new volumes added or deleted
|
2018-08-24 01:26:56 -07:00 |
|
Chris Lu
|
ac793a3c5a
|
clean remove all left over files when deleting a collection
|
2018-08-23 23:33:16 -07:00 |
|
Chris Lu
|
d361a1ddf5
|
fix id String() instead
|
2018-08-23 22:44:30 -07:00 |
|
Chris Lu
|
694f93de80
|
parse needle id correctly
fix https://github.com/chrislusf/seaweedfs/issues/713
|
2018-08-23 20:48:43 -07:00 |
|
Chris Lu
|
1f030af06f
|
adjusting startup logging
|
2018-08-22 13:59:04 -07:00 |
|
Chris Lu
|
75d63db60d
|
randomize raft server startup
also some go fmt
|
2018-08-12 14:27:14 -07:00 |
|
Chris Lu
|
495a776671
|
support 128 bit NeedleId
|
2018-07-31 23:25:26 -07:00 |
|
Chris Lu
|
10bb76fe6b
|
go fmt
|
2018-07-27 02:10:42 -07:00 |
|
Chris Lu
|
4d322df95e
|
avoid reparsing the multipart form
|
2018-07-27 02:10:10 -07:00 |
|
Chris Lu
|
57ded4fd80
|
speed up leveldb bolddb loading
|
2018-07-24 22:17:56 -07:00 |
|
Chris Lu
|
ea8ecf35f4
|
set needle AppendAtNs value during writes
|
2018-07-24 02:44:33 -07:00 |
|
Chris Lu
|
77fadab560
|
go fmt
|
2018-07-24 01:38:08 -07:00 |
|
Chris Lu
|
4f317c7e3d
|
working version3
|
2018-07-24 01:36:04 -07:00 |
|
Chris Lu
|
852af28f91
|
needle priting format
|
2018-07-21 17:41:21 -07:00 |
|
Chris Lu
|
7e2031b18f
|
go fmt
|
2018-07-21 17:39:10 -07:00 |
|
Chris Lu
|
c98df05ed0
|
support PUT
|
2018-07-21 15:58:48 -07:00 |
|
Chris Lu
|
feb8eeb830
|
refactor: separate multipart parsing file
|
2018-07-21 12:01:35 -07:00 |
|