gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity
247 commits 28 branches 278 tags 135 MiB
Commit graph

230 commits

Author SHA1 Message Date
Chris Lu 019173b1cc adjusting error message printing 2012-09-25 23:28:16 -07:00
Chris Lu 59ca65da3c error handling 2012-09-25 16:05:31 -07:00
Chris Lu ac5f227aae correct crc 
correct volume id lookup
 2012-09-25 15:37:13 -07:00
Chris Lu ca8c8a56b7 adjusting tests 2012-09-24 02:25:31 -07:00
Chris Lu 729340708e adjusting version 2012-09-24 02:02:42 -07:00
Chris Lu e340fbee82 removing set volume location 
display version number
add default replication type
 2012-09-24 02:01:53 -07:00
Chris Lu df74f538f7 adjusting http status code for creation 
switch to new lookup implementation
 2012-09-23 15:45:26 -07:00
Chris Lu 2002111a80 removing volume list 2012-09-23 14:51:25 -07:00
Chris Lu d89371af99 change default configuration file location 2012-09-23 02:52:04 -07:00
Chris Lu 73dbb3aed9 load configuration file, with topology configured 2012-09-22 20:46:31 -07:00
Chris Lu a34570fc5b read topology configuration 2012-09-22 00:01:13 -07:00
Chris Lu e986dcf5e0 adjusting testing 2012-09-21 01:31:52 -07:00
Chris Lu d056c622bf refactoring 2012-09-21 01:30:31 -07:00
Chris Lu 77c0de914a now any data node can accept storing files 
files are automatically copied to replicas
 2012-09-20 21:03:40 -07:00
Chris Lu 08dcf2f035 refactoring allocate_volume operation 2012-09-20 18:02:56 -07:00
Chris Lu 5e97179d06 refactoring content uploading 2012-09-20 17:58:29 -07:00
Chris Lu 7d8e9f829c more error messages 2012-09-20 02:53:23 -07:00
Chris Lu 462f2ed958 for moved volumes, redirect with code 501 2012-09-20 02:47:32 -07:00
Chris Lu a1bc529db6 lots of fix 
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
 2012-09-20 02:11:08 -07:00
Chris Lu eae0080d75 adjusting parameter name 2012-09-19 16:56:35 -07:00
Chris Lu fc9f1da143 handle volume server up/down events 2012-09-19 16:48:04 -07:00
Chris Lu e19fd68f18 working now to start/stop volume servers 2012-09-19 01:45:30 -07:00
Chris Lu f3da0906ed channel based visitor pattern 2012-09-18 14:05:12 -07:00
Chris Lu b0e250d437 adjusting refresh topology writable volumes(not finished yet) 
Need to refreshWritableVolumes for each replication type
 2012-09-17 01:48:09 -07:00
Chris Lu 6671f576cb adjusting log messages 2012-09-16 23:21:18 -07:00
Chris Lu 4846a7232e adjusting return messages for growing volumes 2012-09-16 23:18:47 -07:00
Chris Lu 15ced2398e adjusting maxVolumeCount if volume server changes it 2012-09-16 19:18:37 -07:00
Chris Lu 9b99240584 can auto grow 00 and 01 replication volumes 2012-09-16 17:31:15 -07:00
Chris Lu e7c4ee1c64 register reported topology 2012-09-14 01:17:13 -07:00
Chris Lu 6892842021 verify adding columes should work well 2012-09-13 01:33:47 -07:00
Chris Lu 9e0f8d9f0d remote assigns volume to volume server 2012-09-13 00:04:56 -07:00
Chris Lu 4a7833f1bf replication related work 2012-09-12 01:07:23 -07:00
Chris Lu e4c0693b03 replication related work on data nodes 2012-09-10 17:08:52 -07:00
Chris Lu 6daf221937 volume layout for each replication level 2012-09-10 00:18:07 -07:00
Chris Lu 8684b0999d file renaming 2012-09-08 16:43:43 -07:00
Chris Lu 9f4630736d rename Server to DataNode 
formatting
 2012-09-08 16:25:44 -07:00
Chris Lu 9bde067f16 add comments 2012-09-08 00:05:58 -07:00
Chris Lu a7d8d46306 avoid null in json response 2012-09-04 00:34:28 -07:00
Chris Lu a74f6cf593 change to vid~machines mapping 2012-09-04 00:26:38 -07:00
Chris Lu 85a1b419c0 handling lost servers 2012-09-03 21:31:13 -07:00
Chris Lu 0349199d0e 0.18 release 2012-09-03 20:41:48 -07:00
Chris Lu 03aa23fb1b fixing help message printing 2012-09-03 20:40:38 -07:00
Chris Lu a56a523f29 refactoring 2012-09-03 19:36:35 -07:00
Chris Lu fbe828e486 reformatting 2012-09-03 19:18:02 -07:00
Chris Lu 09542d82b4 refactoring, clean up, v0.17 2012-09-03 15:41:24 -07:00
Chris Lu cdd64a8099 dc and rack aware volume allocation 2012-09-03 01:50:04 -07:00
Chris Lu b95c9860ed interface and default implementation for node 2012-09-02 14:33:48 -07:00
Chris Lu a467d5081c adjusted tests 2012-09-01 13:17:30 -07:00
Chris Lu c51884ce23 remove extra code 2012-09-01 10:54:41 -07:00
Chris Lu 1760dd083d remove reservedVolumeCount to simplify volume allocation logic 2012-09-01 10:51:07 -07:00
Chris Lu c48bda0232 return the node during assigning free volume 2012-09-01 02:43:43 -07:00
Chris Lu 7a30a48027 assign a free volume randomly 2012-09-01 02:20:59 -07:00
Chris Lu 8d0ea07f5f loading from json setup in tests 2012-08-31 01:35:11 -07:00
Chris Lu f5d981ab4d scaffold for tests 2012-08-29 01:42:24 -07:00
Chris Lu 317e12644a reserve a volume 
add VolumeId.Next()
 2012-08-29 01:37:40 -07:00
Chris Lu f7adf1687f reduce duplicated code by using a tree of Node 2012-08-29 00:58:03 -07:00
Chris Lu 97e4a1d6eb add code to randomly select one new volume to grow 2012-08-28 01:04:39 -07:00
Chris Lu 2dceb44ae4 add more for volume placement 
fix possible nil volume cases
 2012-08-27 13:52:02 -07:00
Chris Lu 09ed882e5f clean log 2012-08-24 01:15:27 -07:00
Chris Lu 869a6711bc change data center id from integer to string 2012-08-23 23:35:30 -07:00
Chris Lu 9b4ce65882 simplify volume.go file 2012-08-23 23:24:32 -07:00
Chris Lu 0c32e2e965 simplify volume id printing 2012-08-23 23:14:54 -07:00
Chris Lu 868e47f994 remove unused test 2012-08-23 23:07:46 -07:00
Chris Lu b820609088 change name: needle id instead of needle key 2012-08-23 23:06:15 -07:00
Chris Lu 9f92f2779d adjusting for types 2012-08-23 22:56:14 -07:00
Chris Lu 5e3ecc1b82 adding VolumeId type 2012-08-23 22:46:54 -07:00
Chris Lu 03f4c0b832 adding topology related types 2012-08-23 22:33:37 -07:00
Chris Lu 31e4dbfe38 change volume id type to topology.VolumeId 2012-08-23 22:20:37 -07:00
Chris Lu 0121f35c12 starting a shell 2012-08-23 20:56:09 -07:00
Chris Lu 0109cc0e30 correct wording 2012-08-23 19:13:14 -07:00
Chris Lu 5caa7bbdc9 refactoring only 2012-08-23 19:10:55 -07:00
chris.lu@gmail.com 10c2a4540e v0.16 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@67 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:33:13 +00:00
chris.lu@gmail.com aab5390cb5 all switching to "weed command [args]" usage mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@66 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:31:48 +00:00
chris.lu@gmail.com 85da309eed all switching to "weed command [args]" usage mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@65 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:31:22 +00:00
chris.lu@gmail.com 5e9dc0e668 all switching to "weed command [args]" usage mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@64 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:29:22 +00:00
chris.lu@gmail.com 3f1136c194 migrate fix command 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@63 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 01:20:26 +00:00
chris.lu@gmail.com 51860424a6 moving to go style commands 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@62 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-06 23:54:53 +00:00
chris.lu@gmail.com c627942691 adding uncompressing support! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@61 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 08:52:11 +00:00
chris.lu@gmail.com 50c3f1d4a7 adding compressiong support! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@60 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 08:37:10 +00:00
chris.lu@gmail.com f3a4125ee7 adding compressiong support! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@59 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 08:36:25 +00:00
chris.lu@gmail.com 2e1ffa189b The extension ext should begin with a leading dot, as in ".html" 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@58 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 07:28:06 +00:00
chris.lu@gmail.com 2af8c354a7 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@57 282b0af5-e82d-9cf1-ede4-77906d7719d0 2012-07-17 05:07:19 +00:00
chris.lu@gmail.com 577bbcb2e3 convenient tool to submit serveral versions of the same file 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@56 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-17 04:11:38 +00:00
chris.lu@gmail.com 008b3fbbc9 remove debug message 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@55 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-17 04:10:54 +00:00
chris.lu@gmail.com d46e588200 simplify delta of file id, for multi-versioning of a file 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@54 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 17:15:16 +00:00
chris.lu@gmail.com eb9456d7d5 handle special case when browser also asks for favicon.ico 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@53 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 07:41:39 +00:00
chris.lu@gmail.com bcffffbc5e add capability to assign a batch of file ids 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@51 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 04:33:21 +00:00
chris.lu@gmail.com 68a216586f add capability to assign a batch of file ids 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@50 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 04:12:42 +00:00
chris.lu@gmail.com 74989d69c9 add error handling when non-multipart request comes in 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@49 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-03 06:46:26 +00:00
chris.lu@gmail.com de6e1442d7 also return publicUrl when assigning the fid 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@48 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-06-30 09:14:51 +00:00
chris.lu@gmail.com 8aba24a3f8 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@47 282b0af5-e82d-9cf1-ede4-77906d7719d0 2012-06-29 07:55:33 +00:00
chris.lu@gmail.com bb01324482 compatible with Go1 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@46 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-06-29 07:53:47 +00:00
chris.lu@gmail.com 8edf12f026 fix test 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@45 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-03-29 21:47:52 +00:00
chris.lu@gmail.com 4c31b6d533 delete entry from file index also 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@44 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-19 18:28:54 +00:00
chris.lu@gmail.com 3c7c85b1d4 remove verbose logging 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@43 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-19 18:28:33 +00:00
chris.lu@gmail.com 659bf1940f correctly deleting a file 
correctly setting volume file size limit

git-svn-id: https://weed-fs.googlecode.com/svn/trunk@42 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-19 00:49:41 +00:00
chris.lu@gmail.com 380953692b generating makefiles from a newer version of gb 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@41 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-18 22:59:33 +00:00
chris.lu@gmail.com 50b1eff390 add usage instructions 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@40 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-02 01:20:12 +00:00
chris.lu@gmail.com 0701286243 adding makefiles created by go-gb 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@36 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-02 00:52:43 +00:00
chris.lu@gmail.com 97a1d587d4 adding makefiles created by go-gb 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@35 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-02 00:45:32 +00:00
chris.lu@gmail.com 4c2ca916ec fix enforcing volume size limit 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@34 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-29 08:07:19 +00:00
chris.lu@gmail.com 298fdb4603 add configurable volume size limit 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@33 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-29 01:57:02 +00:00
chris.lu@gmail.com 0eff4311f5 add more error handling, adjust volume size to 32G 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@32 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-29 01:46:38 +00:00
chris.lu@gmail.com 2ccc098882 better error messages 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@31 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-28 20:31:13 +00:00
chris.lu@gmail.com 60c17068a6 correct sequence generating 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@30 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-27 06:09:21 +00:00
chris.lu@gmail.com b2f4a4e739 adjust weedc heartbeat to be randomly between (1*pulse, 2*pulse) seconds 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@29 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-27 01:51:18 +00:00
chris.lu@gmail.com 3c98f1a119 better log messages 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@28 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-27 01:40:16 +00:00
chris.lu@gmail.com 4c36190dd3 rename weedc option name to publicUrl 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@27 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-26 10:07:53 +00:00
chris.lu@gmail.com c27f6175d7 update volume status on each heartbeat 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@26 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-26 09:58:07 +00:00
chris.lu@gmail.com 6913fabc64 simplifying volume id mechanism, removing automatic volume id generation and discovering 
periodically report machine status

git-svn-id: https://weed-fs.googlecode.com/svn/trunk@25 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-26 09:43:17 +00:00
chris.lu@gmail.com ae3a53388f refactoring code 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@24 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-25 05:30:57 +00:00
chris.lu@gmail.com 6813f118d4 get and delete now checks cookie 
adding super block
adding tool to fix volume index

git-svn-id: https://weed-fs.googlecode.com/svn/trunk@23 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-24 08:40:56 +00:00
chris.lu@gmail.com cf7094f3c9 return written bytes, add debug mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@22 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-24 01:25:22 +00:00
chris.lu@gmail.com cc8af2e7dc print error message if invalid file id is used 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@21 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-22 19:55:13 +00:00
chris.lu@gmail.com ea75165e85 works now! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@20 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-22 04:04:47 +00:00
chris.lu@gmail.com 9c6a9bf518 simplify the file id format 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@19 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-20 09:00:01 +00:00
chris.lu@gmail.com a657eec299 use uint64, instead of key+alternativeKey, as file id 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@18 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-20 02:34:53 +00:00
chris.lu@gmail.com d018809830 efficiently assign file id 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@17 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-19 09:18:13 +00:00
chris.lu@gmail.com b39d1a77b4 cleaner 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@16 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-19 05:59:37 +00:00
chris.lu@gmail.com 041a93887c now join, status, read, write for weed server are working! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@15 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-18 10:35:59 +00:00
chris.lu@gmail.com 2c7a4eea1f simplified to one machine per volume 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@14 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-18 07:22:04 +00:00
chris.lu@gmail.com 1fed603df9 now working for registering volume id ~ machine mapping 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@13 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-17 06:50:51 +00:00
chris.lu@gmail.com 10930ce6b6 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@12 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-17 06:47:23 +00:00
chris.lu@gmail.com 23ecd7bb33 split into server and clients 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@9 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-16 14:51:26 +00:00
chris.lu@gmail.com 02f4e7b82c split into server and clients 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@8 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-16 14:51:15 +00:00
chris.lu@gmail.com 5381479177 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@7 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-13 00:17:36 +00:00
chris.lu@gmail.com 2858701e6c git-svn-id: https://weed-fs.googlecode.com/svn/trunk@6 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-11 20:48:01 +00:00
chris.lu@gmail.com 70be76735c git-svn-id: https://weed-fs.googlecode.com/svn/trunk@5 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-11 09:30:09 +00:00
chris.lu@gmail.com da97f86447 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@4 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-11 08:42:21 +00:00
chris.lu@gmail.com 8fade18e40 store is sort of working 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@3 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-11-30 02:18:15 +00:00