Chris Lu
|
4c1a3187bf
|
fix log error
|
2020-08-26 09:25:54 -07:00 |
|
Konstantin Lebedev
|
464d4c82ec
|
stop send heartbeat before stop volume server
|
2020-08-26 16:16:11 +05:00 |
|
Chris Lu
|
fe01191b5b
|
support read option readDeleted=true
|
2020-08-18 19:22:16 -07:00 |
|
Chris Lu
|
6a92f0bc7a
|
refactoring to typed Size
Go is amazing with refactoring!
|
2020-08-18 17:04:28 -07:00 |
|
Chris Lu
|
0983060a90
|
increase default volume file size limit to 1024
avoid possible large chunk size set on mount or filer
|
2020-08-13 09:07:22 -07:00 |
|
Chris Lu
|
eed525b717
|
FUSE mount: remove DirListCacheLimit
outdated parameter
|
2020-07-28 09:24:39 -07:00 |
|
Chris Lu
|
a566bfc6e1
|
s3: use bucket in the domain
fix https://github.com/chrislusf/seaweedfs/issues/1405
|
2020-07-28 08:47:27 -07:00 |
|
Chris Lu
|
f43146b237
|
resolve directories if containing home directory
|
2020-07-16 22:50:14 -07:00 |
|
Chris Lu
|
befb396892
|
mount: resolve home directory
fix https://github.com/chrislusf/seaweedfs/issues/1391
|
2020-07-16 22:38:55 -07:00 |
|
Chris Lu
|
2b2ca7d1dc
|
stop if the directory can not be found
related to https://github.com/chrislusf/seaweedfs/issues/1391
|
2020-07-16 13:24:53 -07:00 |
|
Chris Lu
|
ddec7b2bb9
|
go fmt
|
2020-07-14 07:34:16 -07:00 |
|
李远军
|
6608cb5f43
|
Revert "remove fixJpgOrientation"
This reverts commit de5ca9b2
|
2020-07-10 10:08:36 +08:00 |
|
Chris Lu
|
a2eb680f34
|
filer: default filer store directory
1. set default filer store directory
2. set peers, avoiding empty string counted as 1.
|
2020-07-07 23:06:48 -07:00 |
|
Chris Lu
|
d198e8c6d6
|
filer: support cross filer meta data sync if sharing the same store
|
2020-07-06 09:24:54 -07:00 |
|
Chris Lu
|
59152334c7
|
default to 1%
|
2020-07-03 16:42:53 -07:00 |
|
Chris Lu
|
acf4a9ea99
|
volume: min free space default to 1%
|
2020-07-03 16:42:02 -07:00 |
|
Chris Lu
|
4d1484628a
|
refactoring
|
2020-07-03 16:41:30 -07:00 |
|
Chris Lu
|
12f6b683fc
|
default to 8 volumes
in case all the volumes are allocated for a collection
|
2020-06-28 14:34:21 -07:00 |
|
Chris Lu
|
9033a7d369
|
removed async option
|
2020-06-28 10:18:32 -07:00 |
|
Chris Lu
|
1bb8cae65d
|
reverting and working
|
2020-06-28 10:14:17 -07:00 |
|
Chris Lu
|
98493e0152
|
volume: add default minFreeSpacePercent
fix https://github.com/chrislusf/seaweedfs/issues/1366
|
2020-06-21 08:44:06 -07:00 |
|
Chris Lu
|
e7c36f740a
|
refactoring
|
2020-06-21 08:38:00 -07:00 |
|
Chris Lu
|
8b4a32e782
|
adjust help message
|
2020-06-21 08:34:24 -07:00 |
|
Chris Lu
|
b4ec04d464
|
fix the help message
|
2020-06-21 08:31:20 -07:00 |
|
Chris Lu
|
de5ca9b258
|
remove fixJpgOrientation
|
2020-06-20 12:50:40 -07:00 |
|
Chris Lu
|
ca3516ac6d
|
adjust protoc
|
2020-06-20 08:00:25 -07:00 |
|
Chris Lu
|
e912fd15e3
|
renaming
|
2020-06-19 22:45:27 -07:00 |
|
Chris Lu
|
b78a2dc59b
|
adjust help message
|
2020-06-19 12:55:09 -07:00 |
|
Chris Lu
|
48880edc2c
|
volume: fix typo in minFreeSpacePercent option
|
2020-06-14 20:37:05 -07:00 |
|
Chris Lu
|
a0464fc267
|
fix help
fix https://github.com/chrislusf/seaweedfs/issues/1359
|
2020-06-12 22:06:21 -07:00 |
|
Chris Lu
|
0d1d83a5a5
|
mount: add option to auto create dir to mount
|
2020-06-12 11:46:58 -07:00 |
|
Chris Lu
|
628b27ef3b
|
purge old cache implementation
|
2020-06-11 01:50:00 -07:00 |
|
Chris Lu
|
b9365de47b
|
fix volume server pprof
|
2020-06-10 13:10:10 -07:00 |
|
Kimbsen
|
03e8f976d9
|
added --pprof to volume servers
|
2020-06-10 11:52:24 +02:00 |
|
Chris Lu
|
45a9d852d3
|
go fmt
|
2020-06-05 15:27:10 -07:00 |
|
Evgenii Kozlov
|
2410ffbd79
|
Name fix
|
2020-06-05 19:00:38 +03:00 |
|
Evgenii Kozlov
|
0e0db70f55
|
Set volumes ReadOnly if low free disk space
|
2020-06-05 18:18:15 +03:00 |
|
Chris Lu
|
393ab07c7c
|
disable pulse seconds
there are a few other hard coded timing settings, which will cause disconnected volume servers.
|
2020-06-04 10:52:01 -07:00 |
|
Chris Lu
|
bc2ec6774d
|
inject git version into build
|
2020-06-02 00:10:38 -07:00 |
|
Chris Lu
|
ac48c899e8
|
add printouts for synchronizing metadata which can be slow for large folders
|
2020-05-18 10:31:12 -07:00 |
|
Chris Lu
|
0c856e8387
|
avoid possible wrong arguments
fix https://github.com/chrislusf/seaweedfs/issues/1320
|
2020-05-18 10:07:12 -07:00 |
|
Chris Lu
|
2bfd810912
|
combine msgBroker into weed server command
|
2020-05-17 22:44:20 -07:00 |
|
Chris Lu
|
39e72fb23c
|
go fmt
|
2020-05-10 03:50:30 -07:00 |
|
Chris Lu
|
1e3e4b3072
|
add broker connects to filer
|
2020-05-05 02:05:28 -07:00 |
|
Chris Lu
|
78422c2f69
|
Merge pull request #1298 from song-zhang/master
add fsync option for benchmark
|
2020-04-30 20:16:42 -07:00 |
|
Chris Lu
|
871efa4fc1
|
refactoring
some previous chunk etag was using md5, which should be wrong.
|
2020-04-30 17:20:47 -07:00 |
|
zhangsong
|
d819865fe7
|
add fsync option for benchmark
|
2020-04-30 23:31:08 +08:00 |
|
Chris Lu
|
eab4c9219c
|
randomize benchmark content
fix https://github.com/chrislusf/seaweedfs/issues/1294
|
2020-04-28 01:50:56 -07:00 |
|
Chris Lu
|
5c57297bd1
|
metadata log: read from any timestamp
|
2020-04-28 00:05:57 -07:00 |
|
wuyuxiang
|
6850d28d6b
|
refacotr: move signal handling and pprof to grace package
|
2020-04-28 14:10:23 +08:00 |
|
Chris Lu
|
0c2248f83a
|
add lock/unlock to example admin scripts
|
2020-04-23 18:41:48 -07:00 |
|
Chris Lu
|
913aa0f14e
|
mount: default to enable asyncMetaDataCaching
|
2020-04-23 14:14:28 -07:00 |
|
Chris Lu
|
b8e4238ad2
|
add placeholder for cached meta data reading
|
2020-04-21 18:02:08 -07:00 |
|
Chris Lu
|
57df14f76f
|
report error if copying failed
|
2020-04-21 14:28:46 -07:00 |
|
Chris Lu
|
cf54d70311
|
filer: add -ip.bind option
|
2020-04-21 14:21:06 -07:00 |
|
Chris Lu
|
f373232227
|
Merge pull request #1280 from bukton123/filer_mongodb
Add new filer support mongodb
|
2020-04-19 20:35:19 -07:00 |
|
bukton
|
3defa718a1
|
add default config filer mongodb to scaffold.go
|
2020-04-19 17:52:38 +07:00 |
|
Chris Lu
|
71ffb98475
|
broker: add profiling
|
2020-04-19 03:03:40 -07:00 |
|
Chris Lu
|
767f14dfcd
|
master, volume default to detected host
|
2020-04-18 15:20:20 -07:00 |
|
Chris Lu
|
076c8bd3bc
|
filer master start up with default ip address instead of just localhost
|
2020-04-18 15:17:27 -07:00 |
|
Chris Lu
|
11f5a6d913
|
messaging can compile now
|
2020-04-18 01:12:01 -07:00 |
|
Chris Lu
|
826f96b6f3
|
fix unreachable code
|
2020-04-17 10:04:28 -07:00 |
|
Chris Lu
|
2a45897237
|
broker: read cipher value from filer
|
2020-04-17 02:29:00 -07:00 |
|
Chris Lu
|
f5a748d33c
|
refactoring
|
2020-04-16 02:55:09 -07:00 |
|
Chris Lu
|
ce4b369be2
|
scaffolding messaging
|
2020-04-16 02:21:23 -07:00 |
|
Chris Lu
|
d8f5985e5e
|
add logs
|
2020-04-13 12:58:45 -07:00 |
|
Chris Lu
|
7764e0465c
|
refactoring
|
2020-04-12 21:00:55 -07:00 |
|
Chris Lu
|
6f948e4887
|
remove configurable topics folder location
|
2020-04-12 13:07:59 -07:00 |
|
Chris Lu
|
b5a713be68
|
filer store: add redis2 redis_cluster2 as default redis store
|
2020-04-12 02:50:41 -07:00 |
|
Chris Lu
|
211d87cf4c
|
mount: option to disable caching
|
2020-04-12 00:52:54 -07:00 |
|
Chris Lu
|
1c65656fb4
|
s3: add option to fsync buckets
|
2020-04-11 23:37:10 -07:00 |
|
Chris Lu
|
5987810e5e
|
set default chunk size to 16
|
2020-04-11 21:22:52 -07:00 |
|
Chris Lu
|
df97da25f9
|
mount: add on disk caching
|
2020-04-11 21:12:41 -07:00 |
|
Chris Lu
|
dce2702e1b
|
fix the instruction
|
2020-04-10 14:50:10 -07:00 |
|
Chris Lu
|
8db2120bee
|
add logs
|
2020-04-09 23:42:59 -07:00 |
|
Chris Lu
|
59f40e2027
|
volume: best effort to detect ip address
fix https://github.com/chrislusf/seaweedfs/issues/1264
|
2020-04-09 00:26:24 -07:00 |
|
Chris Lu
|
f6a7e79dc3
|
weed shell: simplify CLI option for filer
|
2020-04-08 23:57:15 -07:00 |
|
Chris Lu
|
2329d9e0c1
|
add volume.fix.replication to default scaffold
|
2020-04-08 23:36:22 -07:00 |
|
Chris Lu
|
4c498e73de
|
filer replication: add s3 endpoint
|
2020-04-07 17:49:00 -07:00 |
|
Chris Lu
|
2d43f85577
|
watch entries with common path prefix
|
2020-04-05 12:51:21 -07:00 |
|
Chris Lu
|
af1f64d244
|
change from 'weed tail' to 'weed watch'
|
2020-04-05 12:39:20 -07:00 |
|
Chris Lu
|
bf270d9e8c
|
filer: able to tail meta data changes
|
2020-04-05 00:51:16 -07:00 |
|
Chris Lu
|
d2f8e50459
|
make error a little bit more clearer
fix https://github.com/chrislusf/seaweedfs/issues/1259
|
2020-04-03 00:24:09 -07:00 |
|
Chris Lu
|
5f881d2fd5
|
mount: fail early rather than after mounted the directory
fix https://github.com/chrislusf/seaweedfs/issues/1258
|
2020-04-03 00:21:03 -07:00 |
|
James Hartig
|
eae3f27c80
|
Added treat_replication_as_minimums master toml option
|
2020-04-01 19:08:48 -04:00 |
|
Chris Lu
|
a75d50bbb8
|
FUSE: add configurable in memory chunk cache size
|
2020-03-28 14:07:16 -07:00 |
|
Chris Lu
|
eedd33dda3
|
refactoring
|
2020-03-28 13:41:58 -07:00 |
|
Chris Lu
|
40601953bf
|
comments
|
2020-03-23 02:54:49 -07:00 |
|
Chris Lu
|
daeb18be30
|
scaffold: fix master.toml typo
fix https://github.com/chrislusf/seaweedfs/issues/1247
|
2020-03-23 01:45:43 -07:00 |
|
Chris Lu
|
e32999108a
|
add auto configured volume max count help messge
|
2020-03-22 16:27:15 -07:00 |
|
Chris Lu
|
7c111f7b75
|
FUSE mount: make "nonempty" optional
https://github.com/chrislusf/seaweedfs/issues/1094
|
2020-03-21 19:14:25 -07:00 |
|
Chris Lu
|
709f231e23
|
tiered storage: add s3 endpoint for private s3 implementation
fix https://github.com/chrislusf/seaweedfs/issues/1238
|
2020-03-19 21:13:56 -07:00 |
|
Chris Lu
|
d848d08944
|
use public url also for deletions
|
2020-03-18 11:16:45 -07:00 |
|
Chris Lu
|
6566c8e114
|
weed upload: add usePublicUrl option
fix https://github.com/chrislusf/seaweedfs/issues/1236
|
2020-03-18 10:50:53 -07:00 |
|
Chris Lu
|
e85da50ad4
|
remove tikv, move its support to "tikv" branch
|
2020-03-11 20:59:00 -07:00 |
|
Chris Lu
|
d439d83772
|
volume: follow compactionBytePerSecond
related to https://github.com/chrislusf/seaweedfs/issues/1108
|
2020-03-11 10:32:17 -07:00 |
|
Chris Lu
|
e73b0c2457
|
remove not ready status
|
2020-03-09 22:31:14 -07:00 |
|
Chris Lu
|
0871d2cff0
|
volume: fix memory leak during compaction
fix https://github.com/chrislusf/seaweedfs/issues/1222
|
2020-03-09 22:29:02 -07:00 |
|
Chris Lu
|
89eb05b50f
|
filer: support TTL for all filer stores
|
2020-03-09 01:02:01 -07:00 |
|
Chris Lu
|
2e3f6ad3a9
|
filer: remember content is gzipped or not
|
2020-03-08 21:39:33 -07:00 |
|
Chris Lu
|
1dc30214cb
|
mark encryptVolumeData as not ready
|
2020-03-08 17:02:47 -07:00 |
|
Chris Lu
|
9b3109a5d8
|
filer: processing all response headers, no pass through to volume server
* filer calculate MD5 etag
* filer handle response headers, instread of pass it to volume servers
|
2020-03-08 15:42:44 -07:00 |
|
Chris Lu
|
936e7cdbfb
|
pass in filer.copy cipher option
|
2020-03-07 12:46:00 -08:00 |
|
Chris Lu
|
1ae83c2938
|
go fmt
|
2020-03-07 06:12:57 -08:00 |
|
Chris Lu
|
8c3e25b38a
|
mimee type default "application/octet-stream" to empty string
|
2020-03-07 06:08:08 -08:00 |
|
Chris Lu
|
13e215ee5c
|
filer: option to encrypt data on volume server
|
2020-03-06 00:49:47 -08:00 |
|
Chris Lu
|
31c481e3fc
|
fix typo
|
2020-03-05 16:00:20 -08:00 |
|
Chris Lu
|
e031605248
|
purge code
|
2020-03-04 00:44:27 -08:00 |
|
Chris Lu
|
f90c43635d
|
refactoring
|
2020-03-04 00:39:47 -08:00 |
|
Chris Lu
|
6a8484b4ae
|
master able to list all master clients by type
|
2020-03-01 22:13:47 -08:00 |
|
Chris Lu
|
1df13d0d6d
|
adjust instructions
|
2020-02-27 13:15:21 -08:00 |
|
Chris Lu
|
555413d9fc
|
weed queue starts
|
2020-02-27 00:07:13 -08:00 |
|
Chris Lu
|
556dd76303
|
s3: wait to connect to filer
|
2020-02-26 16:49:47 -08:00 |
|
Chris Lu
|
0156e2975a
|
mount: add mode to run external to SeaweedFS container cluster
|
2020-02-26 16:46:01 -08:00 |
|
Chris Lu
|
543cf1c80e
|
fix compilation error
|
2020-02-25 23:59:30 -08:00 |
|
Chris Lu
|
b1f377f822
|
mount: fail fast when connecting to filer
fix https://github.com/chrislusf/seaweedfs/issues/1034
|
2020-02-25 23:51:34 -08:00 |
|
Chris Lu
|
97ab8a1976
|
remove ctx if possible
|
2020-02-25 22:23:59 -08:00 |
|
Chris Lu
|
892e726eb9
|
avoid reusing context object
fix https://github.com/chrislusf/seaweedfs/issues/1182
|
2020-02-25 21:50:12 -08:00 |
|
Chris Lu
|
0841bedb15
|
move filer assign volume grpc errror to response
|
2020-02-25 17:15:09 -08:00 |
|
Chris Lu
|
6ab7368ef2
|
filer: dynamically create bucket under /buckets folder
|
2020-02-24 22:28:45 -08:00 |
|
Chris Lu
|
5bcb44eda9
|
filer: move buckets folder to filer.toml since it should not be changed often
|
2020-02-24 14:42:57 -08:00 |
|
Chris Lu
|
d8dec2323b
|
s3: move buckets folder configuration to filer
|
2020-02-24 14:34:14 -08:00 |
|
Chris Lu
|
4ed6b584e2
|
s3: access control limited by bucket
|
2020-02-22 21:34:18 -08:00 |
|
Chris Lu
|
b07089cff2
|
webdav out of "unstable"
|
2020-02-18 19:38:59 -08:00 |
|
Chris Lu
|
0a57db7026
|
Merge pull request #1200 from chrislusf/add_s3_acl
Add s3 ACL
|
2020-02-17 12:53:30 -08:00 |
|
Chris Lu
|
cf5064d702
|
properly close http response
|
2020-02-14 09:09:15 -08:00 |
|
Chris Lu
|
9b6296e77a
|
volume: add grpc file read operation
This is added more for performance benchmarking.
|
2020-02-14 00:37:32 -08:00 |
|
Chris Lu
|
b90ad6f452
|
add v2 support
|
2020-02-09 16:02:05 -08:00 |
|
Chris Lu
|
e7b63d50b1
|
add s3.config to server.go
|
2020-02-09 14:31:51 -08:00 |
|
Chris Lu
|
9ed364f053
|
support acl
|
2020-02-09 14:30:02 -08:00 |
|
Chris Lu
|
dc786a63ac
|
master: add configurable volume growth toml setting
|
2020-02-03 18:15:16 -08:00 |
|
Chris Lu
|
8925f3305d
|
adjust example
|
2020-01-29 09:11:07 -08:00 |
|
Chris Lu
|
d335f04de6
|
support env variables to overwrite toml file
|
2020-01-29 09:09:55 -08:00 |
|
Chris Lu
|
72a64a5cf8
|
use the same context object in order to retry
|
2020-01-26 14:42:11 -08:00 |
|
Chris Lu
|
c48fc8b4de
|
grpc send error via response instead of grpc error
|
2020-01-25 09:17:19 -08:00 |
|
Chris Lu
|
e4b660699f
|
correct comments
fix https://github.com/chrislusf/seaweedfs/issues/1181
|
2020-01-12 20:31:33 -08:00 |
|
Chris Lu
|
dc9457fb87
|
fix compilation error
|
2020-01-07 09:03:47 -08:00 |
|
Chris Lu
|
aa73364a24
|
weed fix: add back .idx file generation
|
2020-01-06 16:29:59 -08:00 |
|
Chris Lu
|
3eafec4b29
|
volume: add option to limit file size
|
2020-01-03 00:37:26 -08:00 |
|
Chris Lu
|
86d4b18eb5
|
filer: optional recursive deletion
fix https://github.com/chrislusf/seaweedfs/issues/1176
|
2019-12-31 11:52:54 -08:00 |
|
Chris Lu
|
efd2f50ede
|
compaction changed to .idx based deletion
|
2019-12-24 14:55:50 -08:00 |
|
Chris Lu
|
abffe857a1
|
change btree map to in memory level db
|
2019-12-24 10:18:56 -08:00 |
|
Chris Lu
|
09ca936c78
|
shell: add ec.decode command
|
2019-12-23 12:48:20 -08:00 |
|
Chris Lu
|
a9b1ee18af
|
default redis reads options
details in https://github.com/chrislusf/seaweedfs/pull/1165
|
2019-12-21 09:30:51 -08:00 |
|
Chris Lu
|
fcbd04c425
|
default to false in scaffold.go
|
2019-12-21 08:31:27 -08:00 |
|
Dakota Sullivan
|
f934a85d58
|
Add readOnly and routeByLatency options to scaffold.go
|
2019-12-20 19:27:15 -07:00 |
|
Chris Lu
|
392678f8f3
|
upload skipping mimetype if not needed
|
2019-12-15 20:57:08 -08:00 |
|
Chris Lu
|
f59119cd1d
|
mount: rename to dirListCacheLimit to configure cache for long format directory list
|
2019-12-13 10:22:24 -08:00 |
|
Chris Lu
|
05c3b795dc
|
filer: configurable directory list cache size
|
2019-12-13 10:05:43 -08:00 |
|
Chris Lu
|
bbb6ebc3c0
|
filer: DeleteFolderChildren for deleting large folders
|
2019-12-13 00:23:05 -08:00 |
|