Commit graph

75 commits

Author SHA1 Message Date
tnextday 662915e691 Delete all chunks when delete a ChunkManifest
LoadChunkManifest can uncompress buffer
move compress.go from storage to operation because of import cycle
MakeFile add cross complete command
2015-12-02 21:27:29 +08:00
tnextday 520875d455 update 2015-12-02 18:25:18 +08:00
tnextday d0e2475ece FilePart.Upload use base name instead of full path
fix chunked file download error
2015-12-02 16:35:16 +08:00
tnextday 2c0a7fe75e complete submit chunked file 2015-12-02 15:00:46 +08:00
tnextday 6b0894d806 update ChunkedFile to seekable reader, so we can use io.* to read data 2015-12-01 20:23:50 +08:00
tnextday f825d23789 fix build error 2015-11-30 00:21:42 +08:00
tnextday 1817864a45 add chunk file helper to support large file 2015-11-29 23:49:41 +08:00
chrislusf 32ba7fc6c0 Fix a possible index out of range error. Remove unnecessary caching. 2015-05-26 10:29:49 -07:00
chrislusf 86cd40fba8 Add "weed backup" command.
This is a pre-cursor for asynchronous replication.
2015-05-26 00:58:41 -07:00
Stuart P. Bentley f0c2a2dcb3 Change all chrislusf/weed-fs links to point to chrislu/seaweedfs 2015-04-16 19:18:06 +00:00
chrislusf c1bc529654 Use public url for returned file url result 2015-04-16 11:37:05 -07:00
chrislusf 3ece066700 change count to uint64 to fix #109
fix https://github.com/chrislusf/weed-fs/issues/109
2015-04-06 14:17:36 -07:00
chrislusf 23012deccf Add better error message. 2015-03-19 10:48:28 -07:00
chrislusf b07d81fb08 follow golint suggestions 2015-03-10 00:20:34 -07:00
chrislusf f511b507a5 Add read only public port on volume server
Add read only public port on volume server
2015-03-09 01:10:04 -07:00
Chris Lu f7998f8652 merge conflicts 2015-02-07 15:35:28 -08:00
chrislusf cc724305b6 Using Url instead of PublicUrl for volume server
Originally there are only url(ip + port), and publicUrl. Because ip was
used to listen for http service, it has less flexibility and volume
server has to be accessed via publicUrl.

Recently we added ip.bind, for binding http service.

With this change, url can be used to connect to volume servers. And
publicUrl becomes a free style piece of url information, it does not
even need to be unique.
2015-02-02 10:16:50 -08:00
yanyiwu 2f10f2960b use proto "github.com/golang/protobuf/proto" 2015-01-30 15:09:37 +08:00
Chris Lu 7b4a53b2c1 Add optional admin port to volume server, to seperate admin operations from normal file operations. 2015-01-18 17:03:38 -08:00
Chris Lu 352ef2830c Add caching volume locations to batch volume id lookup. 2015-01-11 23:01:31 -08:00
yanyiwu cacfc85869 add some String() to make codes easier to read and debug 2015-01-08 15:54:50 +08:00
yanyiwu 5b7628cf08 use github.com/golang/protobuf/proto instead of code.google.com/p/goprotobuf/proto 2014-12-26 16:59:53 +08:00
Chris Lu 179d36ba0e formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
wyy 4126280d55 use github.com/chrislusf instead of github.com/aszxqw 2014-09-25 16:57:22 +08:00
wyy 1cd19447e3 use github.com/aszxqw instead of code.google.com/p 2014-09-25 00:47:09 +08:00
Chris Lu b9aee2defb add TTL support
The volume TTL and file TTL are not necessarily the same. as long as
file TTL is smaller than volume TTL, it'll be fine.

volume TTL is used when assigning file id, e.g.
http://.../dir/assign?ttl=3h

file TTL is used when uploading
2014-09-20 12:38:59 -07:00
Chris Lu a437d77431 only set lookup cache when successful 2014-06-02 09:22:23 -07:00
Chris Lu b5f99b26eb Add volume id lookup caching 2014-05-25 14:01:54 -07:00
Chris Lu 1818a2a2da Change to protocol buffer for volume-join-masster message
Reduced size to about 1/5 of the previous json format message
2014-04-21 02:11:10 -07:00
Chris Lu 9653a54766 added typed join result 2014-04-16 17:29:58 -07:00
Chris Lu 4ecf5956d7 Add types to uploading 2014-04-15 10:01:13 -07:00
Chris Lu 7ad6cd35e8 Use type ClusterStatusResult for writing and reading results 2014-04-15 09:30:08 -07:00
Chris Lu cb56322937 minor textual change 2014-04-15 09:20:28 -07:00
Chris Lu 68021c6fc3 Use type AssignResult when writing and reading result. 2014-04-15 09:20:04 -07:00
Chris Lu cbc5a76e80 Added batch file deleting. 2014-04-15 09:09:40 -07:00
Chris Lu b771f060f1 rename variable name 2014-04-14 01:07:11 -07:00
Chris Lu 2eb9014606 rename file from lookup_volume_id.go to lookup.go 2014-04-14 01:05:57 -07:00
Chris Lu 5878f7c3a1 refactor lookup result types into package "operation" 2014-04-13 23:56:15 -07:00
Chris Lu 51fafdb525 more robust filer 2014-03-30 13:26:44 -07:00
Chris Lu 2861275fb6 working filer server! 2014-03-30 11:28:04 -07:00
Chris Lu 7251e357e7 enhance deletion operation 2014-03-20 13:30:34 -07:00
Chris Lu 3dbebfd1e1 Thread-safe fixes:
1. avoid sharing []byte
2. switch to use ReadAt()
2014-03-19 04:41:16 -07:00
Chris Lu 7a8bc2e19e avoid sharing same err variable 2014-03-12 15:17:23 -07:00
Chris Lu c3ce024fc1 reusing http connections 2014-03-12 14:07:01 -07:00
Chris Lu 466a55b06d fix error message 2014-03-12 10:25:05 -07:00
Chris Lu a121453188 benchmarking writing data to a specific collection 2014-03-09 23:54:07 -07:00
Chris Lu c830b60f36 refactoring 2014-03-09 18:50:45 -07:00
Chris Lu 27c74a7e66 Major:
change replication_type to ReplicaPlacement, hopefully cleaner code
works for 9 possible ReplicaPlacement
xyz
x : number of copies on other data centers
y : number of copies on other racks
z : number of copies on current rack
x y z each can be 0,1,2

Minor:
weed server "-mdir" default to "-dir" if empty
2014-03-02 22:16:54 -08:00
Chris Lu edae676913 1. volume server auto detect clustered master nodes
2. remove operation package dependency on storage
2014-02-14 17:10:49 -08:00
Chris Lu 59b9fd26fc fix replication type parameter name 2014-02-06 11:44:18 -08:00