chrislusf
cc724305b6
Using Url instead of PublicUrl for volume server
...
Originally there are only url(ip + port), and publicUrl. Because ip was
used to listen for http service, it has less flexibility and volume
server has to be accessed via publicUrl.
Recently we added ip.bind, for binding http service.
With this change, url can be used to connect to volume servers. And
publicUrl becomes a free style piece of url information, it does not
even need to be unique.
2015-02-02 10:16:50 -08:00
yanyiwu
2f10f2960b
use proto "github.com/golang/protobuf/proto"
2015-01-30 15:09:37 +08:00
Chris Lu
7b4a53b2c1
Add optional admin port to volume server, to seperate admin operations from normal file operations.
2015-01-18 17:03:38 -08:00
Chris Lu
352ef2830c
Add caching volume locations to batch volume id lookup.
2015-01-11 23:01:31 -08:00
yanyiwu
cacfc85869
add some String() to make codes easier to read and debug
2015-01-08 15:54:50 +08:00
yanyiwu
5b7628cf08
use github.com/golang/protobuf/proto instead of code.google.com/p/goprotobuf/proto
2014-12-26 16:59:53 +08:00
Chris Lu
179d36ba0e
formatting code by: goimports -w=true .
2014-10-26 11:34:55 -07:00
wyy
4126280d55
use github.com/chrislusf instead of github.com/aszxqw
2014-09-25 16:57:22 +08:00
wyy
1cd19447e3
use github.com/aszxqw instead of code.google.com/p
2014-09-25 00:47:09 +08:00
Chris Lu
b9aee2defb
add TTL support
...
The volume TTL and file TTL are not necessarily the same. as long as
file TTL is smaller than volume TTL, it'll be fine.
volume TTL is used when assigning file id, e.g.
http://.../dir/assign?ttl=3h
file TTL is used when uploading
2014-09-20 12:38:59 -07:00
Chris Lu
a437d77431
only set lookup cache when successful
2014-06-02 09:22:23 -07:00
Chris Lu
b5f99b26eb
Add volume id lookup caching
2014-05-25 14:01:54 -07:00
Chris Lu
1818a2a2da
Change to protocol buffer for volume-join-masster message
...
Reduced size to about 1/5 of the previous json format message
2014-04-21 02:11:10 -07:00
Chris Lu
9653a54766
added typed join result
2014-04-16 17:29:58 -07:00
Chris Lu
4ecf5956d7
Add types to uploading
2014-04-15 10:01:13 -07:00
Chris Lu
7ad6cd35e8
Use type ClusterStatusResult for writing and reading results
2014-04-15 09:30:08 -07:00
Chris Lu
cb56322937
minor textual change
2014-04-15 09:20:28 -07:00
Chris Lu
68021c6fc3
Use type AssignResult when writing and reading result.
2014-04-15 09:20:04 -07:00
Chris Lu
cbc5a76e80
Added batch file deleting.
2014-04-15 09:09:40 -07:00
Chris Lu
b771f060f1
rename variable name
2014-04-14 01:07:11 -07:00
Chris Lu
2eb9014606
rename file from lookup_volume_id.go to lookup.go
2014-04-14 01:05:57 -07:00
Chris Lu
5878f7c3a1
refactor lookup result types into package "operation"
2014-04-13 23:56:15 -07:00
Chris Lu
51fafdb525
more robust filer
2014-03-30 13:26:44 -07:00
Chris Lu
2861275fb6
working filer server!
2014-03-30 11:28:04 -07:00
Chris Lu
7251e357e7
enhance deletion operation
2014-03-20 13:30:34 -07:00
Chris Lu
3dbebfd1e1
Thread-safe fixes:
...
1. avoid sharing []byte
2. switch to use ReadAt()
2014-03-19 04:41:16 -07:00
Chris Lu
7a8bc2e19e
avoid sharing same err variable
2014-03-12 15:17:23 -07:00
Chris Lu
c3ce024fc1
reusing http connections
2014-03-12 14:07:01 -07:00
Chris Lu
466a55b06d
fix error message
2014-03-12 10:25:05 -07:00
Chris Lu
a121453188
benchmarking writing data to a specific collection
2014-03-09 23:54:07 -07:00
Chris Lu
c830b60f36
refactoring
2014-03-09 18:50:45 -07:00
Chris Lu
27c74a7e66
Major:
...
change replication_type to ReplicaPlacement, hopefully cleaner code
works for 9 possible ReplicaPlacement
xyz
x : number of copies on other data centers
y : number of copies on other racks
z : number of copies on current rack
x y z each can be 0,1,2
Minor:
weed server "-mdir" default to "-dir" if empty
2014-03-02 22:16:54 -08:00
Chris Lu
edae676913
1. volume server auto detect clustered master nodes
...
2. remove operation package dependency on storage
2014-02-14 17:10:49 -08:00
Chris Lu
59b9fd26fc
fix replication type parameter name
2014-02-06 11:44:18 -08:00
Chris Lu
eeeccf2f78
ssue 59: Multi Ip Enviromment support + publicUrl is disregarded by
...
master
2013-12-02 22:58:27 -08:00
Chris Lu
1645d3c185
avoid nil cases when error
2013-11-19 02:12:56 -08:00
Chris Lu
d0473e27d9
refactor api: lookup file id
2013-11-18 23:03:59 -08:00
Chris Lu
c4a4d3609b
fix duplicated file id list entries when uploading large file
2013-11-18 23:03:06 -08:00
Chris Lu
0e5e0a3754
add option to split large files into parts and then upload
2013-11-18 21:47:31 -08:00
Chris Lu
3b68711139
support for collections!
2013-11-12 02:21:22 -08:00
Chris Lu
5eac4f043a
remove a comment
2013-11-12 02:16:07 -08:00
Chris Lu
82b74c7940
issue 43 "go fmt" chagnes from "Ryan S. Brown" <sb@ryansb.com>
...
some basic changes to parse upload url
2013-09-01 23:58:21 -07:00
Chris Lu
37b231b5dc
Only limit input parameter to io.Reader
2013-08-14 11:31:39 -07:00
Chris Lu
8e1ac16d16
refactoring submit operation
2013-08-14 10:07:42 -07:00
Chris Lu
48e4ced29d
easier for client to delete file
2013-08-14 00:31:02 -07:00
Chris Lu
d5e7c1de0a
refactoring code
...
reusable code by go clients
2013-08-13 23:26:51 -07:00
Chris Lu
f7c1a15ad1
correctly print strings in error
2013-08-13 18:21:54 -07:00
Chris Lu
ed154053c8
switching to temporarily use glog library
2013-08-08 23:57:22 -07:00
Chris Lu
e94d52c1af
replicate mime type
2013-07-29 10:09:36 -07:00
Chris Lu
5e3b6e968a
escaping upload file name special characters
...
if already gzipped, avoid gzipping again
2013-07-15 17:26:00 -07:00