Chris Lu
2baed2e1e9
avoid possible metadata subscription data loss
...
Previous implementation append filer logs into one file. So one file is not always sorted, which can lead to miss reading some entries, especially when different filers have different write throughput.
2021-09-25 01:18:44 -07:00
Chris Lu
e5fc35ed0c
change server address from string to a type
2021-09-12 22:47:52 -07:00
Chris Lu
6923af7280
refactoring
2021-09-06 16:20:49 -07:00
Chris Lu
cc7714fdbe
logging changes to debug
2021-06-27 05:54:16 -07:00
Chris Lu
8f8738867f
add retry to assign volume
...
fix https://github.com/chrislusf/seaweedfs/issues/2056
2021-05-07 07:29:26 -07:00
Chris Lu
990fa69bfe
add back AdjustedUrl() related code
2021-01-28 14:36:29 -08:00
Chris Lu
00707ec00f
mount: outsideContainerClusterMode proxy through filer
...
Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.
2021-01-24 19:01:58 -08:00
Chris Lu
6ca10725b8
Revert "mount: when outside cluster network, use filer as proxy to access volume servers"
...
This reverts commit 096e088d7b
.
2021-01-24 03:15:19 -08:00
Chris Lu
096e088d7b
mount: when outside cluster network, use filer as proxy to access volume servers
2021-01-24 01:41:38 -08:00
Chris Lu
394513f598
filer: ensure seamless meta data updates
2021-01-11 02:08:55 -08:00
Chris Lu
723ae11db4
refactoring in order to adjust volume server url later
2020-10-11 20:15:10 -07:00
Chris Lu
daf0a449f7
properly cancel context for streaming grpc
2020-09-09 12:07:15 -07:00
Chris Lu
387ab6796f
filer: cross cluster synchronization
2020-09-09 11:21:23 -07:00
Chris Lu
eb7929a971
rename filer2 to filer
2020-09-01 00:21:19 -07:00
Chris Lu
ef75ce8a34
use UTC for all time related folders
2020-08-29 21:01:14 -07:00
Chris Lu
b69cb74c03
read meta logs by timestamp
...
pass in event ts when moving logs
meta aggregator reads in memory logs only
2020-08-29 17:37:19 -07:00
Chris Lu
ca658a97c5
add signatures to messages to avoid double processing
2020-08-28 23:48:48 -07:00
Chris Lu
55e40b08fc
refactoring
2020-07-05 15:43:06 -07:00
Chris Lu
31e23e9783
filer: support active<=>active filer replication
2020-06-30 22:53:57 -07:00
Chris Lu
081ee6fe34
reduc logs
2020-05-17 17:38:31 -07:00
Chris Lu
f11233cd49
simplify disconnected stream detection
2020-05-17 08:57:47 -07:00
Chris Lu
85b53ac510
detect disconnected subscribers
2020-05-16 18:53:54 -07:00
Chris Lu
b0de01ff3b
able to detect disconnected subscribers
2020-05-16 08:57:29 -07:00
Chris Lu
e02a8c67da
revert to one subscriber one thread
2020-05-15 21:38:42 -07:00
Chris Lu
ca4017dd87
rename
2020-05-12 22:55:55 -07:00
Chris Lu
25257acd51
rename
2020-05-12 21:26:49 -07:00
Chris Lu
a7959c1c48
multiple subscriber with same subscriberId shares the topic manager
...
rename topicControl to topicCursor
2020-05-12 21:26:02 -07:00
Chris Lu
2f243f5b0b
refactor
2020-05-12 08:48:00 -07:00
Chris Lu
39e72fb23c
go fmt
2020-05-10 03:50:30 -07:00
Chris Lu
6bf3eb69cb
async chan write read, no write for closed chan
2020-05-10 03:48:35 -07:00
Chris Lu
d693e77418
add pub sub md5
2020-05-09 00:43:53 -07:00
Chris Lu
07d7abe428
add deleteTopic, refactoring
2020-05-09 00:31:34 -07:00
Chris Lu
dfccc3c263
able to read chan and write chan
2020-05-08 02:47:22 -07:00
Chris Lu
1e3e4b3072
add broker connects to filer
2020-05-05 02:05:28 -07:00
Chris Lu
871efa4fc1
refactoring
...
some previous chunk etag was using md5, which should be wrong.
2020-04-30 17:20:47 -07:00
Chris Lu
ea809a45ab
add cipher key
2020-04-30 03:05:43 -07:00
Chris Lu
f9b6178b8f
log messages
2020-04-30 03:05:34 -07:00
Chris Lu
9e72e9e4b8
able to subscribe any topic from any point of time
2020-04-29 17:40:08 -07:00
Chris Lu
ed3cf811f5
refactoring
2020-04-29 13:26:02 -07:00
Chris Lu
8ed490164e
refactoring
2020-04-28 02:05:44 -07:00
Chris Lu
cb3985be70
go fmt
2020-04-20 17:48:06 -07:00
Chris Lu
df25ed3c5b
logs
2020-04-19 23:37:50 -07:00
Chris Lu
ce3cb25cfb
working for in memory single log buffer
2020-04-19 23:37:50 -07:00
Chris Lu
71ffb98475
broker: add profiling
2020-04-19 03:03:40 -07:00
Chris Lu
d278b4c228
basic pub and sub works!
2020-04-19 00:18:32 -07:00
Chris Lu
076c8bd3bc
filer master start up with default ip address instead of just localhost
2020-04-18 15:17:27 -07:00
Chris Lu
11f5a6d913
messaging can compile now
2020-04-18 01:12:01 -07:00