Chris Lu
|
48ed7f8a32
|
generated files
|
2020-08-16 21:25:24 -07:00 |
|
Chris Lu
|
f5d6b8b777
|
Hadoop HCFS 1.4.6 random access file
|
2020-08-16 21:17:03 -07:00 |
|
Chris Lu
|
13bfe5deef
|
same logic for reading random access files from Go
|
2020-08-16 21:14:39 -07:00 |
|
Chris Lu
|
20e0bae5d1
|
add for testing
|
2020-08-16 09:03:18 -07:00 |
|
Chris Lu
|
24bfd26719
|
make it easy to test randome access file
|
2020-08-15 14:37:07 -07:00 |
|
Chris Lu
|
4f195a54ca
|
1.4.5
change the scope for hadoop depencies to provided
|
2020-08-09 16:34:47 -07:00 |
|
Chris Lu
|
15dc0a704d
|
Revert "add read ahead input stream"
This reverts commit b3089dcc8e .
|
2020-08-03 09:11:24 -07:00 |
|
Chris Lu
|
b3089dcc8e
|
add read ahead input stream
|
2020-08-03 09:06:09 -07:00 |
|
Chris Lu
|
53190a9972
|
fix compilation
|
2020-08-03 09:05:49 -07:00 |
|
Chris Lu
|
d6073f6386
|
ensure GC
|
2020-08-03 00:40:23 -07:00 |
|
Chris Lu
|
9981748498
|
only try to cache chunk manifest chunks
|
2020-08-02 23:50:44 -07:00 |
|
Chris Lu
|
0ed1f43d29
|
decompress after decrypt if necessary
skip any decompress error
|
2020-08-02 23:50:23 -07:00 |
|
Chris Lu
|
e1f070a9a1
|
Hadoop: 1.4.4
|
2020-08-01 12:42:41 -07:00 |
|
Chris Lu
|
4d9da157bc
|
HDFS: read gzip content
|
2020-08-01 11:36:29 -07:00 |
|
Chris Lu
|
8cc35e2c13
|
fix wrong decompression logic
|
2020-08-01 11:19:57 -07:00 |
|
Chris Lu
|
6b41c5250b
|
Hadoop file system: 1.4.3
added buffered fs input stream
|
2020-07-29 21:33:10 -07:00 |
|
Chris Lu
|
703057bff9
|
mirror changes from hdfs2
|
2020-07-29 20:15:43 -07:00 |
|
Chris Lu
|
a6d0f962e8
|
add buffered seaweed input stream
|
2020-07-29 20:10:04 -07:00 |
|
Chris Lu
|
5080bc1d69
|
debug
|
2020-07-29 18:26:26 -07:00 |
|
Chris Lu
|
daf8c0c8ce
|
cache vid locations
|
2020-07-29 18:25:52 -07:00 |
|
Chris Lu
|
b684c312d2
|
minor
|
2020-07-29 18:25:35 -07:00 |
|
Chris Lu
|
735912e0f5
|
enable read cache
|
2020-07-29 17:39:44 -07:00 |
|
Chris Lu
|
6f058b3791
|
HCFS: 1.4.1
|
2020-07-22 22:56:53 -07:00 |
|
Chris Lu
|
648ef566c4
|
HCFS: avoid lock bottleneck
|
2020-07-22 22:54:06 -07:00 |
|
Chris Lu
|
6839f96c0c
|
simplify
|
2020-07-22 22:52:49 -07:00 |
|
Chris Lu
|
54f9f9138e
|
HCFS: 1.4.0
|
2020-07-20 23:25:08 -07:00 |
|
Chris Lu
|
64926d2345
|
disable ChunkCache
|
2020-07-20 21:18:58 -07:00 |
|
Chris Lu
|
ae3e6d8244
|
remove changing buffer size
|
2020-07-20 20:27:19 -07:00 |
|
Chris Lu
|
b380b9e5d7
|
shared http client
|
2020-07-20 18:27:11 -07:00 |
|
Chris Lu
|
0e341a2a9a
|
error logging
|
2020-07-20 18:26:59 -07:00 |
|
Chris Lu
|
cacc601cc8
|
ensure changing buffer size requirements
|
2020-07-20 18:26:48 -07:00 |
|
Chris Lu
|
aee6d89350
|
before writing and after reading file chunks
|
2020-07-20 18:26:17 -07:00 |
|
Chris Lu
|
6debe3c3ec
|
use 1000 as merge factor
|
2020-07-20 18:25:26 -07:00 |
|
Chris Lu
|
1d724ab237
|
hdfs: support read write chunk manifest
|
2020-07-20 03:29:17 -07:00 |
|
Chris Lu
|
f90d2c93c9
|
1.3.9 remove logs
|
2020-07-17 16:11:57 -07:00 |
|
Chris Lu
|
3abd74b1d7
|
1.3.8
|
2020-07-17 15:46:20 -07:00 |
|
Chris Lu
|
0b9d73fb7c
|
async copy
|
2020-07-17 15:46:20 -07:00 |
|
Chris Lu
|
54445b207d
|
Hadoop: 1.3.6
|
2020-07-16 16:20:01 -07:00 |
|
Chris Lu
|
d6d95765f9
|
reduce chunk cache size
|
2020-07-16 16:19:01 -07:00 |
|
Chris Lu
|
2629da2cb9
|
simplify inputstream
|
2020-07-16 10:54:29 -07:00 |
|
Chris Lu
|
c9b50e8a22
|
copy changes to hadoop2
|
2020-07-16 09:05:34 -07:00 |
|
李明达
|
74456b3d5e
|
1、Add SeaweedFS implementation of Hadoop AbstractFileSystem. The implementation delegates to the existing SeaweedFS FileSystem and is only necessary for use with Hadoop 2.x/3.x. Configuration example in Hadoop core-site.xml file:
<property>
<name>fs.AbstractFileSystem.seaweedfs.impl</name>
<value>seaweed.hdfs.SeaweedAbstractFileSystem</value>
</property>
2、Fix hiveserver2 startup NullPointerException
|
2020-07-16 16:47:09 +08:00 |
|
Chris Lu
|
64d7d5fe89
|
increase inbound message size
|
2020-07-16 00:33:54 -07:00 |
|
Chris Lu
|
7bca72deed
|
reuse bytebuffer
|
2020-07-15 23:33:31 -07:00 |
|
Chris Lu
|
2286d27730
|
rename
|
2020-07-15 14:19:15 -07:00 |
|
Chris Lu
|
86c8137546
|
1.3.4
|
2020-07-15 13:49:06 -07:00 |
|
Chris Lu
|
22f8aae028
|
fix compilation
|
2020-07-15 13:27:10 -07:00 |
|
Chris Lu
|
bc3be0bb37
|
Hadoop: 1.3.3
improve memory efficiency
|
2020-07-15 13:25:44 -07:00 |
|
Chris Lu
|
316e853e0e
|
option to disable chunk cache
|
2020-07-15 09:51:51 -07:00 |
|
Chris Lu
|
0db4204c81
|
add is_file_chunks to filer.proto
|
2020-07-14 22:42:52 -07:00 |
|