Commit graph

234 commits

Author SHA1 Message Date
Chris Lu 6201ed537e reporting volume size as early as possible 2012-12-03 22:54:08 -08:00
Chris Lu b3df7673ed move to 0.25, previous 0.23 and 0.24 are not correct when managing the
volumes
2012-12-03 21:31:12 -08:00
Chris Lu 7e83a75fba correctly count volumes, to ensure proper capacity management 2012-12-03 21:27:57 -08:00
Chris Lu e19edccf3a ensure properly make volume unwritable. Previously passing volumeInfo
reference, causing make wrong volumes unwritable!
2012-12-03 20:28:12 -08:00
Chris Lu 2deee3f47c added proper log messages 2012-11-26 13:12:21 -08:00
Chris Lu 2add211a86 adjust default read timeout to 3 seconds 2012-11-26 12:38:35 -08:00
Chris Lu 8b60de622e fix compilation error 2012-11-23 18:14:28 -08:00
Chris Lu fa61bb1867 remove log message 2012-11-23 18:07:43 -08:00
Chris Lu 3ef7a34f49 add command line option to control garbage threshold 2012-11-23 17:31:54 -08:00
Chris Lu 94dbe60233 periodically compact volumes 2012-11-23 17:03:27 -08:00
Chris Lu 5e020196f6 add version type 2012-11-21 10:52:08 -08:00
Chris Lu 5dc509c6e4 cleaner code, better error handling 2012-11-20 01:45:36 -08:00
Chris Lu e00d8dc536 adjust formatting 2012-11-20 00:54:37 -08:00
Chris Lu 084e0ab7bb adding exception handling for this case 2012-11-20 00:42:45 -08:00
Chris Lu f5a8382933 add warning message 2012-11-13 12:13:59 -08:00
Chris Lu 9782ace1bd add locking when adjusting topology 2012-11-13 12:13:40 -08:00
Chris Lu 6f606bb350 better error message 2012-11-13 12:13:12 -08:00
Chris Lu b23e51f205 remove debug message 2012-11-12 11:07:03 -08:00
Chris Lu 166a5fc524 Issue 11: Failed to write to replicas for volumen 3
Fix displaying wrong error message
2012-11-12 10:50:25 -08:00
Chris Lu ecd0399f8d Issue 11: Failed to write to replicas for volumen 3
Avoid unnecessary master lookup
2012-11-12 01:26:18 -08:00
Chris Lu ccab4217e4 comment change: 3 times of the pulse 2012-11-11 22:37:12 -08:00
Chris Lu 01f2fcf72d remove comments 2012-11-09 15:40:28 -08:00
Chris Lu 86c8f248bd support compacting a volume 2012-11-07 01:51:43 -08:00
Chris Lu 9630825576 adjusting gzip logic 2012-10-23 10:59:40 -07:00
Chris Lu 6f7b0cafee adjust time_wait to 1 second 2012-10-15 02:09:47 -07:00
Chris Lu 3aefea0fe2 show volume status 2012-10-10 01:10:05 -07:00
Chris Lu 1d0be87e0e Merge remote-tracking branch 'origin/master'
Conflicts:
	weed-fs/src/cmd/weed/master.go
2012-10-09 21:10:47 -07:00
Chris Lu ce615b4e6f setting http status code for failed requests 2012-10-09 21:06:24 -07:00
Chris Lu 8c2c5986c8 setting http status code for failed requests 2012-10-09 21:03:22 -07:00
Chris Lu 6b1e60582c adding file count and deletion count 2012-10-09 20:53:31 -07:00
Chris Lu c8eb9a7542 fix compilation error 2012-10-06 10:56:43 -07:00
Chris Lu ba55296b18 optionally change the maximun number of CPUs 2012-10-06 10:50:52 -07:00
Chris Lu 45a6323a4b bump up version 2012-09-30 02:21:20 -07:00
Chris Lu 6ce41e30a4 change to 3-digit replication types 2012-09-30 02:20:33 -07:00
Chris Lu 2fe4371899 change to a more memory efficient map, implemented by several lists of
<key,offset,size>
2012-09-29 16:07:24 -07:00
Chris Lu 3a6c37aa6c configurable read timeout 2012-09-28 10:21:06 -07:00
Chris Lu 4c7eb645a1 adjusting default read timeout to 5 seconds, same as apache default
value
2012-09-28 10:15:39 -07:00
Chris Lu d2dd7d1694 add 30 seconds http read timeout 2012-09-28 09:13:17 -07:00
Chris Lu 819de58197 add pretty print to json outputs 2012-09-28 09:12:36 -07:00
Chris Lu 98022f2b3d use NeedleValue directly instead of additional pointer, to reduce memory
usage
2012-09-27 21:46:32 -07:00
Chris Lu 5cb38f9ea7 use one-liner debug(messages) 2012-09-27 12:17:27 -07:00
Chris Lu 2fd6b65a9e add versioning 2012-09-26 20:35:14 -07:00
Chris Lu 33d5778a46 cleaner error message 2012-09-26 20:30:05 -07:00
Chris Lu 46d13f6b5e clean up unused options
cleaning error handling
2012-09-26 14:57:21 -07:00
Chris Lu 20706d8cf2 more error handling 2012-09-26 14:28:46 -07:00
Chris Lu a847e2beee better error reporting and handling 2012-09-26 13:38:45 -07:00
Chris Lu 3d53f73006 remove old comments 2012-09-26 10:55:09 -07:00
Chris Lu 4b3676a54b delete replications, untested yet 2012-09-26 03:27:10 -07:00
Chris Lu b5c29e25aa fix 2012-09-26 02:34:43 -07:00
Chris Lu 5d86b50782 fixes 2012-09-26 02:29:16 -07:00
Chris Lu d63c5231ac url error 2012-09-26 02:02:15 -07:00
Chris Lu 7ee12f14a8 add option to set server's ip address 2012-09-26 01:55:56 -07:00
Chris Lu 019173b1cc adjusting error message printing 2012-09-25 23:28:16 -07:00
Chris Lu 59ca65da3c error handling 2012-09-25 16:05:31 -07:00
Chris Lu ac5f227aae correct crc
correct volume id lookup
2012-09-25 15:37:13 -07:00
Chris Lu ca8c8a56b7 adjusting tests 2012-09-24 02:25:31 -07:00
Chris Lu 729340708e adjusting version 2012-09-24 02:02:42 -07:00
Chris Lu e340fbee82 removing set volume location
display version number
add default replication type
2012-09-24 02:01:53 -07:00
Chris Lu df74f538f7 adjusting http status code for creation
switch to new lookup implementation
2012-09-23 15:45:26 -07:00
Chris Lu 2002111a80 removing volume list 2012-09-23 14:51:25 -07:00
Chris Lu d89371af99 change default configuration file location 2012-09-23 02:52:04 -07:00
Chris Lu 73dbb3aed9 load configuration file, with topology configured 2012-09-22 20:46:31 -07:00
Chris Lu a34570fc5b read topology configuration 2012-09-22 00:01:13 -07:00
Chris Lu e986dcf5e0 adjusting testing 2012-09-21 01:31:52 -07:00
Chris Lu d056c622bf refactoring 2012-09-21 01:30:31 -07:00
Chris Lu 77c0de914a now any data node can accept storing files
files are automatically copied to replicas
2012-09-20 21:03:40 -07:00
Chris Lu 08dcf2f035 refactoring allocate_volume operation 2012-09-20 18:02:56 -07:00
Chris Lu 5e97179d06 refactoring content uploading 2012-09-20 17:58:29 -07:00
Chris Lu 7d8e9f829c more error messages 2012-09-20 02:53:23 -07:00
Chris Lu 462f2ed958 for moved volumes, redirect with code 501 2012-09-20 02:47:32 -07:00
Chris Lu a1bc529db6 lots of fix
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
2012-09-20 02:11:08 -07:00
Chris Lu eae0080d75 adjusting parameter name 2012-09-19 16:56:35 -07:00
Chris Lu fc9f1da143 handle volume server up/down events 2012-09-19 16:48:04 -07:00
Chris Lu e19fd68f18 working now to start/stop volume servers 2012-09-19 01:45:30 -07:00
Chris Lu f3da0906ed channel based visitor pattern 2012-09-18 14:05:12 -07:00
Chris Lu b0e250d437 adjusting refresh topology writable volumes(not finished yet)
Need to refreshWritableVolumes for each replication type
2012-09-17 01:48:09 -07:00
Chris Lu 6671f576cb adjusting log messages 2012-09-16 23:21:18 -07:00
Chris Lu 4846a7232e adjusting return messages for growing volumes 2012-09-16 23:18:47 -07:00
Chris Lu 15ced2398e adjusting maxVolumeCount if volume server changes it 2012-09-16 19:18:37 -07:00
Chris Lu 9b99240584 can auto grow 00 and 01 replication volumes 2012-09-16 17:31:15 -07:00
Chris Lu e7c4ee1c64 register reported topology 2012-09-14 01:17:13 -07:00
Chris Lu b5ac55f012 detect existing volumes 2012-09-13 01:38:27 -07:00
Chris Lu 6892842021 verify adding columes should work well 2012-09-13 01:33:47 -07:00
Chris Lu 9e0f8d9f0d remote assigns volume to volume server 2012-09-13 00:04:56 -07:00
Chris Lu 4a7833f1bf replication related work 2012-09-12 01:07:23 -07:00
Chris Lu e4c0693b03 replication related work on data nodes 2012-09-10 17:08:52 -07:00
Chris Lu 6daf221937 volume layout for each replication level 2012-09-10 00:18:07 -07:00
Chris Lu 8684b0999d file renaming 2012-09-08 16:43:43 -07:00
Chris Lu 9f4630736d rename Server to DataNode
formatting
2012-09-08 16:25:44 -07:00
Chris Lu 9bde067f16 add comments 2012-09-08 00:05:58 -07:00
Chris Lu a7d8d46306 avoid null in json response 2012-09-04 00:34:28 -07:00
Chris Lu a74f6cf593 change to vid~machines mapping 2012-09-04 00:26:38 -07:00
Chris Lu 85a1b419c0 handling lost servers 2012-09-03 21:31:13 -07:00
Chris Lu 0349199d0e 0.18 release 2012-09-03 20:41:48 -07:00
Chris Lu 03aa23fb1b fixing help message printing 2012-09-03 20:40:38 -07:00
Chris Lu a56a523f29 refactoring 2012-09-03 19:36:35 -07:00
Chris Lu fbe828e486 reformatting 2012-09-03 19:18:02 -07:00
Chris Lu 09542d82b4 refactoring, clean up, v0.17 2012-09-03 15:41:24 -07:00
Chris Lu cdd64a8099 dc and rack aware volume allocation 2012-09-03 01:50:04 -07:00
Chris Lu b95c9860ed interface and default implementation for node 2012-09-02 14:33:48 -07:00