Commit graph

200 commits

Author SHA1 Message Date
Chris Lu 2fe4371899 change to a more memory efficient map, implemented by several lists of
<key,offset,size>
2012-09-29 16:07:24 -07:00
Chris Lu 3a6c37aa6c configurable read timeout 2012-09-28 10:21:06 -07:00
Chris Lu 4c7eb645a1 adjusting default read timeout to 5 seconds, same as apache default
value
2012-09-28 10:15:39 -07:00
Chris Lu d2dd7d1694 add 30 seconds http read timeout 2012-09-28 09:13:17 -07:00
Chris Lu 819de58197 add pretty print to json outputs 2012-09-28 09:12:36 -07:00
Chris Lu 98022f2b3d use NeedleValue directly instead of additional pointer, to reduce memory
usage
2012-09-27 21:46:32 -07:00
Chris Lu 5cb38f9ea7 use one-liner debug(messages) 2012-09-27 12:17:27 -07:00
Chris Lu 2fd6b65a9e add versioning 2012-09-26 20:35:14 -07:00
Chris Lu 33d5778a46 cleaner error message 2012-09-26 20:30:05 -07:00
Chris Lu 46d13f6b5e clean up unused options
cleaning error handling
2012-09-26 14:57:21 -07:00
Chris Lu 20706d8cf2 more error handling 2012-09-26 14:28:46 -07:00
Chris Lu a847e2beee better error reporting and handling 2012-09-26 13:38:45 -07:00
Chris Lu 3d53f73006 remove old comments 2012-09-26 10:55:09 -07:00
Chris Lu 4b3676a54b delete replications, untested yet 2012-09-26 03:27:10 -07:00
Chris Lu b5c29e25aa fix 2012-09-26 02:34:43 -07:00
Chris Lu 5d86b50782 fixes 2012-09-26 02:29:16 -07:00
Chris Lu d63c5231ac url error 2012-09-26 02:02:15 -07:00
Chris Lu 7ee12f14a8 add option to set server's ip address 2012-09-26 01:55:56 -07:00
Chris Lu 019173b1cc adjusting error message printing 2012-09-25 23:28:16 -07:00
Chris Lu 59ca65da3c error handling 2012-09-25 16:05:31 -07:00
Chris Lu ac5f227aae correct crc
correct volume id lookup
2012-09-25 15:37:13 -07:00
Chris Lu ca8c8a56b7 adjusting tests 2012-09-24 02:25:31 -07:00
Chris Lu 729340708e adjusting version 2012-09-24 02:02:42 -07:00
Chris Lu e340fbee82 removing set volume location
display version number
add default replication type
2012-09-24 02:01:53 -07:00
Chris Lu df74f538f7 adjusting http status code for creation
switch to new lookup implementation
2012-09-23 15:45:26 -07:00
Chris Lu 2002111a80 removing volume list 2012-09-23 14:51:25 -07:00
Chris Lu d89371af99 change default configuration file location 2012-09-23 02:52:04 -07:00
Chris Lu 73dbb3aed9 load configuration file, with topology configured 2012-09-22 20:46:31 -07:00
Chris Lu a34570fc5b read topology configuration 2012-09-22 00:01:13 -07:00
Chris Lu e986dcf5e0 adjusting testing 2012-09-21 01:31:52 -07:00
Chris Lu d056c622bf refactoring 2012-09-21 01:30:31 -07:00
Chris Lu 77c0de914a now any data node can accept storing files
files are automatically copied to replicas
2012-09-20 21:03:40 -07:00
Chris Lu 08dcf2f035 refactoring allocate_volume operation 2012-09-20 18:02:56 -07:00
Chris Lu 5e97179d06 refactoring content uploading 2012-09-20 17:58:29 -07:00
Chris Lu 7d8e9f829c more error messages 2012-09-20 02:53:23 -07:00
Chris Lu 462f2ed958 for moved volumes, redirect with code 501 2012-09-20 02:47:32 -07:00
Chris Lu a1bc529db6 lots of fix
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
2012-09-20 02:11:08 -07:00
Chris Lu eae0080d75 adjusting parameter name 2012-09-19 16:56:35 -07:00
Chris Lu fc9f1da143 handle volume server up/down events 2012-09-19 16:48:04 -07:00
Chris Lu e19fd68f18 working now to start/stop volume servers 2012-09-19 01:45:30 -07:00
Chris Lu f3da0906ed channel based visitor pattern 2012-09-18 14:05:12 -07:00
Chris Lu b0e250d437 adjusting refresh topology writable volumes(not finished yet)
Need to refreshWritableVolumes for each replication type
2012-09-17 01:48:09 -07:00
Chris Lu 6671f576cb adjusting log messages 2012-09-16 23:21:18 -07:00
Chris Lu 4846a7232e adjusting return messages for growing volumes 2012-09-16 23:18:47 -07:00
Chris Lu 15ced2398e adjusting maxVolumeCount if volume server changes it 2012-09-16 19:18:37 -07:00
Chris Lu 9b99240584 can auto grow 00 and 01 replication volumes 2012-09-16 17:31:15 -07:00
Chris Lu e7c4ee1c64 register reported topology 2012-09-14 01:17:13 -07:00
Chris Lu b5ac55f012 detect existing volumes 2012-09-13 01:38:27 -07:00
Chris Lu 6892842021 verify adding columes should work well 2012-09-13 01:33:47 -07:00
Chris Lu 9e0f8d9f0d remote assigns volume to volume server 2012-09-13 00:04:56 -07:00
Chris Lu 4a7833f1bf replication related work 2012-09-12 01:07:23 -07:00
Chris Lu e4c0693b03 replication related work on data nodes 2012-09-10 17:08:52 -07:00
Chris Lu 6daf221937 volume layout for each replication level 2012-09-10 00:18:07 -07:00
Chris Lu 8684b0999d file renaming 2012-09-08 16:43:43 -07:00
Chris Lu 9f4630736d rename Server to DataNode
formatting
2012-09-08 16:25:44 -07:00
Chris Lu 9bde067f16 add comments 2012-09-08 00:05:58 -07:00
Chris Lu a7d8d46306 avoid null in json response 2012-09-04 00:34:28 -07:00
Chris Lu a74f6cf593 change to vid~machines mapping 2012-09-04 00:26:38 -07:00
Chris Lu 85a1b419c0 handling lost servers 2012-09-03 21:31:13 -07:00
Chris Lu 0349199d0e 0.18 release 2012-09-03 20:41:48 -07:00
Chris Lu 03aa23fb1b fixing help message printing 2012-09-03 20:40:38 -07:00
Chris Lu a56a523f29 refactoring 2012-09-03 19:36:35 -07:00
Chris Lu fbe828e486 reformatting 2012-09-03 19:18:02 -07:00
Chris Lu 09542d82b4 refactoring, clean up, v0.17 2012-09-03 15:41:24 -07:00
Chris Lu cdd64a8099 dc and rack aware volume allocation 2012-09-03 01:50:04 -07:00
Chris Lu b95c9860ed interface and default implementation for node 2012-09-02 14:33:48 -07:00
Chris Lu a467d5081c adjusted tests 2012-09-01 13:17:30 -07:00
Chris Lu c51884ce23 remove extra code 2012-09-01 10:54:41 -07:00
Chris Lu 1760dd083d remove reservedVolumeCount to simplify volume allocation logic 2012-09-01 10:51:07 -07:00
Chris Lu c48bda0232 return the node during assigning free volume 2012-09-01 02:43:43 -07:00
Chris Lu 7a30a48027 assign a free volume randomly 2012-09-01 02:20:59 -07:00
Chris Lu 8d0ea07f5f loading from json setup in tests 2012-08-31 01:35:11 -07:00
Chris Lu f5d981ab4d scaffold for tests 2012-08-29 01:42:24 -07:00
Chris Lu 317e12644a reserve a volume
add VolumeId.Next()
2012-08-29 01:37:40 -07:00
Chris Lu f7adf1687f reduce duplicated code by using a tree of Node 2012-08-29 00:58:03 -07:00
Chris Lu 97e4a1d6eb add code to randomly select one new volume to grow 2012-08-28 01:04:39 -07:00
Chris Lu 2dceb44ae4 add more for volume placement
fix possible nil volume cases
2012-08-27 13:52:02 -07:00
Chris Lu 58087bc64f ignore files 2012-08-24 01:17:20 -07:00
Chris Lu 09ed882e5f clean log 2012-08-24 01:15:27 -07:00
Chris Lu 869a6711bc change data center id from integer to string 2012-08-23 23:35:30 -07:00
Chris Lu 9b4ce65882 simplify volume.go file 2012-08-23 23:24:32 -07:00
Chris Lu 0c32e2e965 simplify volume id printing 2012-08-23 23:14:54 -07:00
Chris Lu 868e47f994 remove unused test 2012-08-23 23:07:46 -07:00
Chris Lu b820609088 change name: needle id instead of needle key 2012-08-23 23:06:15 -07:00
Chris Lu 9f92f2779d adjusting for types 2012-08-23 22:56:14 -07:00
Chris Lu 5e3ecc1b82 adding VolumeId type 2012-08-23 22:46:54 -07:00
Chris Lu 03f4c0b832 adding topology related types 2012-08-23 22:33:37 -07:00
Chris Lu 31e4dbfe38 change volume id type to topology.VolumeId 2012-08-23 22:20:37 -07:00
Chris Lu 0121f35c12 starting a shell 2012-08-23 20:56:09 -07:00
Chris Lu 0109cc0e30 correct wording 2012-08-23 19:13:14 -07:00
Chris Lu 5caa7bbdc9 refactoring only 2012-08-23 19:10:55 -07:00
chris.lu@gmail.com 10c2a4540e v0.16
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@67 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-08-07 08:33:13 +00:00
chris.lu@gmail.com aab5390cb5 all switching to "weed command [args]" usage mode
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@66 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-08-07 08:31:48 +00:00
chris.lu@gmail.com 85da309eed all switching to "weed command [args]" usage mode
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@65 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-08-07 08:31:22 +00:00
chris.lu@gmail.com 5e9dc0e668 all switching to "weed command [args]" usage mode
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@64 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-08-07 08:29:22 +00:00
chris.lu@gmail.com 3f1136c194 migrate fix command
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@63 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-08-07 01:20:26 +00:00
chris.lu@gmail.com 51860424a6 moving to go style commands
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@62 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-08-06 23:54:53 +00:00
chris.lu@gmail.com c627942691 adding uncompressing support!
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@61 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-07-30 08:52:11 +00:00
chris.lu@gmail.com 50c3f1d4a7 adding compressiong support!
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@60 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-07-30 08:37:10 +00:00
chris.lu@gmail.com f3a4125ee7 adding compressiong support!
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@59 282b0af5-e82d-9cf1-ede4-77906d7719d0
2012-07-30 08:36:25 +00:00