chrislu
|
3795d8dca8
|
release local topic partition if no publisher and subscribers
|
2024-01-16 08:43:07 -08:00 |
|
|
chrislu
|
ba73199174
|
reuse local partition
|
2024-01-15 21:22:41 -08:00 |
|
|
chrislu
|
fa59a5d67e
|
read from disk if not in memory
|
2024-01-15 00:20:12 -08:00 |
|
|
chrislu
|
45994641e9
|
lint
|
2024-01-11 23:03:35 -08:00 |
|
|
chrislu
|
6a7a679137
|
passing partition generation timestamp
|
2024-01-10 22:36:17 -08:00 |
|
|
chrislu
|
d51efddf5c
|
flush to disk
Need to do: read from disk
|
2024-01-08 23:27:02 -08:00 |
|
|
chrislu
|
49428a303b
|
add batch index for each memory buffer
|
2024-01-08 00:03:08 -08:00 |
|
|
chrislu
|
093fdc1621
|
subscriber can get assignments
|
2023-12-28 20:35:15 -08:00 |
|
|
Chris Lu
|
580940bf82
|
Merge accumulated changes related to message queue (#5098)
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
|
2023-12-11 12:05:54 -08:00 |
|
|
chrislu
|
bf13f3ced7
|
add subscriber coordinator
|
2023-10-02 01:02:27 -07:00 |
|
|
chrislu
|
734178093e
|
refactor TopicPartition struct
|
2023-10-02 01:01:45 -07:00 |
|
|
chrislu
|
23f334dd13
|
comment
|
2023-09-24 23:36:43 -07:00 |
|
|
chrislu
|
c7e05e4e71
|
ensure latest stats are reported
|
2023-09-24 23:34:31 -07:00 |
|
|
chrislu
|
1492bf7552
|
fix listing topics
|
2023-09-24 23:05:41 -07:00 |
|
|
chrislu
|
6c6655de9d
|
wip
|
2023-09-19 14:03:42 -07:00 |
|
|
chrislu
|
4827425146
|
balancer works
|
2023-09-16 15:05:38 -07:00 |
|
|
chrislu
|
cb470d44df
|
can pub and sub
|
2023-09-01 00:36:51 -07:00 |
|
|
chrislu
|
1eb2da46d5
|
connect and publish
|
2023-08-28 09:02:12 -07:00 |
|
|
chrislu
|
dbcba75271
|
rename to lookup
|
2023-08-27 18:59:04 -07:00 |
|
|
chrislu
|
1990456670
|
sub
|
2023-08-27 13:13:14 -07:00 |
|
|
chrislu
|
905911853d
|
adjust proto
|
2023-08-26 13:39:21 -07:00 |
|
|
chrislu
|
01d70c21f3
|
Squashed commit of the following:
commit 32f4b1a13057d56b6de487cdb80ff7c205af01a6
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 20 22:52:19 2023 -0700
fix compilation
commit e77ad33b7ca0423138fbae26a4433b60923a9588
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 20 22:46:44 2023 -0700
pub
commit f431f30cc7ca277ca299e3cd118c05537fb9f5c3
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 20 13:27:39 2023 -0700
fix generic type
commit 4e9dcb18293fd1e3e306e2dceb995dfd67a35e1d
Merge: 30f942580 16e3f2d52
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 20 12:47:14 2023 -0700
Merge branch 'master' into pubsub
commit 30f942580ad1bb32ae94aade2e3a21ec3ab63e21
Author: chrislu <chris.lu@gmail.com>
Date: Sun Aug 20 11:10:58 2023 -0700
wip
commit f8b00980bc2f3879bb43decffd9a08d842f196f2
Author: chrislu <chris.lu@gmail.com>
Date: Tue Jul 25 09:14:35 2023 -0700
add design document
commit 08d2bebe42a26ebc39f1542f54d99e73620727dd
Author: chrislu <chris.lu@gmail.com>
Date: Tue Jul 25 09:14:06 2023 -0700
minor
commit bcfa7982b262a40fcdce6fc6613fad2ce07c13da
Author: chrislu <chris.lu@gmail.com>
Date: Tue Jul 25 09:13:49 2023 -0700
rename
|
2023-08-20 22:53:05 -07:00 |
|