Chris Lu
|
8e2f3b510e
|
Hadoop client: 1.4.9
|
2020-10-10 15:43:04 -07:00 |
|
Chris Lu
|
912ef2bc53
|
Hadoop: remove unused variable bufferSize
|
2020-10-10 01:14:17 -07:00 |
|
Chris Lu
|
9449100757
|
adjust throwing exception
|
2020-10-10 01:06:54 -07:00 |
|
Chris Lu
|
d3d3609a03
|
adjust logging
|
2020-10-10 01:04:31 -07:00 |
|
Chris Lu
|
6fc272f913
|
adjust throwing exception
|
2020-10-10 01:03:04 -07:00 |
|
Chris Lu
|
00a75d7c99
|
Hadoop: fix reading file tail
|
2020-10-10 00:57:57 -07:00 |
|
Chris Lu
|
e1a3ffcdbf
|
Hadoop: add exponential back off for failed reads
|
2020-10-10 00:57:57 -07:00 |
|
Chris Lu
|
436ab7d811
|
HCFS: 1.4.8
|
2020-09-27 23:20:08 -07:00 |
|
Chris Lu
|
4929d0634e
|
Hadoop on SeaweedFS: create empty file
fix https://github.com/chrislusf/seaweedfs/issues/1494
|
2020-09-25 10:57:43 -07:00 |
|
Chris Lu
|
1012df7bb5
|
switch hardlink id from int64 to bytes
|
2020-09-24 11:11:42 -07:00 |
|
Chris Lu
|
5e239afdfc
|
hardlink works now
|
2020-09-24 03:06:48 -07:00 |
|
Chris Lu
|
cb427d48fa
|
filer report metrics configuration
|
2020-09-17 06:46:51 -07:00 |
|
Chris Lu
|
5eee4983f3
|
1.4.7 hdfs configurable fs.seaweed.buffer.size
|
2020-09-16 17:18:18 -07:00 |
|
Chris Lu
|
387ab6796f
|
filer: cross cluster synchronization
|
2020-09-09 11:21:23 -07:00 |
|
Chris Lu
|
bba90ff3c8
|
read filer signature
|
2020-09-05 22:52:15 -07:00 |
|
Chris Lu
|
ca658a97c5
|
add signatures to messages to avoid double processing
|
2020-08-28 23:48:48 -07:00 |
|
Chris Lu
|
48ed7f8a32
|
generated files
|
2020-08-16 21:25:24 -07:00 |
|
Chris Lu
|
f5d6b8b777
|
Hadoop HCFS 1.4.6 random access file
|
2020-08-16 21:17:03 -07:00 |
|
Chris Lu
|
13bfe5deef
|
same logic for reading random access files from Go
|
2020-08-16 21:14:39 -07:00 |
|
Chris Lu
|
20e0bae5d1
|
add for testing
|
2020-08-16 09:03:18 -07:00 |
|
Chris Lu
|
24bfd26719
|
make it easy to test randome access file
|
2020-08-15 14:37:07 -07:00 |
|
Chris Lu
|
4f195a54ca
|
1.4.5
change the scope for hadoop depencies to provided
|
2020-08-09 16:34:47 -07:00 |
|
Chris Lu
|
15dc0a704d
|
Revert "add read ahead input stream"
This reverts commit b3089dcc8e .
|
2020-08-03 09:11:24 -07:00 |
|
Chris Lu
|
b3089dcc8e
|
add read ahead input stream
|
2020-08-03 09:06:09 -07:00 |
|
Chris Lu
|
53190a9972
|
fix compilation
|
2020-08-03 09:05:49 -07:00 |
|
Chris Lu
|
d6073f6386
|
ensure GC
|
2020-08-03 00:40:23 -07:00 |
|
Chris Lu
|
9981748498
|
only try to cache chunk manifest chunks
|
2020-08-02 23:50:44 -07:00 |
|
Chris Lu
|
0ed1f43d29
|
decompress after decrypt if necessary
skip any decompress error
|
2020-08-02 23:50:23 -07:00 |
|
Chris Lu
|
e1f070a9a1
|
Hadoop: 1.4.4
|
2020-08-01 12:42:41 -07:00 |
|
Chris Lu
|
4d9da157bc
|
HDFS: read gzip content
|
2020-08-01 11:36:29 -07:00 |
|
Chris Lu
|
8cc35e2c13
|
fix wrong decompression logic
|
2020-08-01 11:19:57 -07:00 |
|
Chris Lu
|
6b41c5250b
|
Hadoop file system: 1.4.3
added buffered fs input stream
|
2020-07-29 21:33:10 -07:00 |
|
Chris Lu
|
703057bff9
|
mirror changes from hdfs2
|
2020-07-29 20:15:43 -07:00 |
|
Chris Lu
|
a6d0f962e8
|
add buffered seaweed input stream
|
2020-07-29 20:10:04 -07:00 |
|
Chris Lu
|
5080bc1d69
|
debug
|
2020-07-29 18:26:26 -07:00 |
|
Chris Lu
|
daf8c0c8ce
|
cache vid locations
|
2020-07-29 18:25:52 -07:00 |
|
Chris Lu
|
b684c312d2
|
minor
|
2020-07-29 18:25:35 -07:00 |
|
Chris Lu
|
735912e0f5
|
enable read cache
|
2020-07-29 17:39:44 -07:00 |
|
Chris Lu
|
6f058b3791
|
HCFS: 1.4.1
|
2020-07-22 22:56:53 -07:00 |
|
Chris Lu
|
648ef566c4
|
HCFS: avoid lock bottleneck
|
2020-07-22 22:54:06 -07:00 |
|
Chris Lu
|
6839f96c0c
|
simplify
|
2020-07-22 22:52:49 -07:00 |
|
Chris Lu
|
54f9f9138e
|
HCFS: 1.4.0
|
2020-07-20 23:25:08 -07:00 |
|
Chris Lu
|
64926d2345
|
disable ChunkCache
|
2020-07-20 21:18:58 -07:00 |
|
Chris Lu
|
ae3e6d8244
|
remove changing buffer size
|
2020-07-20 20:27:19 -07:00 |
|
Chris Lu
|
b380b9e5d7
|
shared http client
|
2020-07-20 18:27:11 -07:00 |
|
Chris Lu
|
0e341a2a9a
|
error logging
|
2020-07-20 18:26:59 -07:00 |
|
Chris Lu
|
cacc601cc8
|
ensure changing buffer size requirements
|
2020-07-20 18:26:48 -07:00 |
|
Chris Lu
|
aee6d89350
|
before writing and after reading file chunks
|
2020-07-20 18:26:17 -07:00 |
|
Chris Lu
|
6debe3c3ec
|
use 1000 as merge factor
|
2020-07-20 18:25:26 -07:00 |
|
Chris Lu
|
1d724ab237
|
hdfs: support read write chunk manifest
|
2020-07-20 03:29:17 -07:00 |
|