gitlab-com-seaweedfs/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-01-19 02:48:24 +00:00
Code Issues Projects Releases Wiki Activity
237 commits 28 branches 278 tags 135 MiB
Commit graph

224 commits

Author SHA1 Message Date
Chris Lu d89371af99 change default configuration file location 2012-09-23 02:52:04 -07:00
Chris Lu 73dbb3aed9 load configuration file, with topology configured 2012-09-22 20:46:31 -07:00
Chris Lu a34570fc5b read topology configuration 2012-09-22 00:01:13 -07:00
Chris Lu e986dcf5e0 adjusting testing 2012-09-21 01:31:52 -07:00
Chris Lu d056c622bf refactoring 2012-09-21 01:30:31 -07:00
Chris Lu 77c0de914a now any data node can accept storing files 
files are automatically copied to replicas
 2012-09-20 21:03:40 -07:00
Chris Lu 08dcf2f035 refactoring allocate_volume operation 2012-09-20 18:02:56 -07:00
Chris Lu 5e97179d06 refactoring content uploading 2012-09-20 17:58:29 -07:00
Chris Lu 7d8e9f829c more error messages 2012-09-20 02:53:23 -07:00
Chris Lu 462f2ed958 for moved volumes, redirect with code 501 2012-09-20 02:47:32 -07:00
Chris Lu a1bc529db6 lots of fix 
1. sending 404 if not found
2. handle node-up/node-down/changing-max/volume-become-full
 2012-09-20 02:11:08 -07:00
Chris Lu eae0080d75 adjusting parameter name 2012-09-19 16:56:35 -07:00
Chris Lu fc9f1da143 handle volume server up/down events 2012-09-19 16:48:04 -07:00
Chris Lu e19fd68f18 working now to start/stop volume servers 2012-09-19 01:45:30 -07:00
Chris Lu f3da0906ed channel based visitor pattern 2012-09-18 14:05:12 -07:00
Chris Lu b0e250d437 adjusting refresh topology writable volumes(not finished yet) 
Need to refreshWritableVolumes for each replication type
 2012-09-17 01:48:09 -07:00
Chris Lu 6671f576cb adjusting log messages 2012-09-16 23:21:18 -07:00
Chris Lu 4846a7232e adjusting return messages for growing volumes 2012-09-16 23:18:47 -07:00
Chris Lu 15ced2398e adjusting maxVolumeCount if volume server changes it 2012-09-16 19:18:37 -07:00
Chris Lu 9b99240584 can auto grow 00 and 01 replication volumes 2012-09-16 17:31:15 -07:00
Chris Lu e7c4ee1c64 register reported topology 2012-09-14 01:17:13 -07:00
Chris Lu b5ac55f012 detect existing volumes 2012-09-13 01:38:27 -07:00
Chris Lu 6892842021 verify adding columes should work well 2012-09-13 01:33:47 -07:00
Chris Lu 9e0f8d9f0d remote assigns volume to volume server 2012-09-13 00:04:56 -07:00
Chris Lu 4a7833f1bf replication related work 2012-09-12 01:07:23 -07:00
Chris Lu e4c0693b03 replication related work on data nodes 2012-09-10 17:08:52 -07:00
Chris Lu 6daf221937 volume layout for each replication level 2012-09-10 00:18:07 -07:00
Chris Lu 8684b0999d file renaming 2012-09-08 16:43:43 -07:00
Chris Lu 9f4630736d rename Server to DataNode 
formatting
 2012-09-08 16:25:44 -07:00
Chris Lu 9bde067f16 add comments 2012-09-08 00:05:58 -07:00
Chris Lu a7d8d46306 avoid null in json response 2012-09-04 00:34:28 -07:00
Chris Lu a74f6cf593 change to vid~machines mapping 2012-09-04 00:26:38 -07:00
Chris Lu 85a1b419c0 handling lost servers 2012-09-03 21:31:13 -07:00
Chris Lu 0349199d0e 0.18 release 2012-09-03 20:41:48 -07:00
Chris Lu 03aa23fb1b fixing help message printing 2012-09-03 20:40:38 -07:00
Chris Lu a56a523f29 refactoring 2012-09-03 19:36:35 -07:00
Chris Lu fbe828e486 reformatting 2012-09-03 19:18:02 -07:00
Chris Lu 09542d82b4 refactoring, clean up, v0.17 2012-09-03 15:41:24 -07:00
Chris Lu cdd64a8099 dc and rack aware volume allocation 2012-09-03 01:50:04 -07:00
Chris Lu b95c9860ed interface and default implementation for node 2012-09-02 14:33:48 -07:00
Chris Lu a467d5081c adjusted tests 2012-09-01 13:17:30 -07:00
Chris Lu c51884ce23 remove extra code 2012-09-01 10:54:41 -07:00
Chris Lu 1760dd083d remove reservedVolumeCount to simplify volume allocation logic 2012-09-01 10:51:07 -07:00
Chris Lu c48bda0232 return the node during assigning free volume 2012-09-01 02:43:43 -07:00
Chris Lu 7a30a48027 assign a free volume randomly 2012-09-01 02:20:59 -07:00
Chris Lu 8d0ea07f5f loading from json setup in tests 2012-08-31 01:35:11 -07:00
Chris Lu f5d981ab4d scaffold for tests 2012-08-29 01:42:24 -07:00
Chris Lu 317e12644a reserve a volume 
add VolumeId.Next()
 2012-08-29 01:37:40 -07:00
Chris Lu f7adf1687f reduce duplicated code by using a tree of Node 2012-08-29 00:58:03 -07:00
Chris Lu 97e4a1d6eb add code to randomly select one new volume to grow 2012-08-28 01:04:39 -07:00
Chris Lu 2dceb44ae4 add more for volume placement 
fix possible nil volume cases
 2012-08-27 13:52:02 -07:00
Chris Lu 58087bc64f ignore files 2012-08-24 01:17:20 -07:00
Chris Lu 09ed882e5f clean log 2012-08-24 01:15:27 -07:00
Chris Lu 869a6711bc change data center id from integer to string 2012-08-23 23:35:30 -07:00
Chris Lu 9b4ce65882 simplify volume.go file 2012-08-23 23:24:32 -07:00
Chris Lu 0c32e2e965 simplify volume id printing 2012-08-23 23:14:54 -07:00
Chris Lu 868e47f994 remove unused test 2012-08-23 23:07:46 -07:00
Chris Lu b820609088 change name: needle id instead of needle key 2012-08-23 23:06:15 -07:00
Chris Lu 9f92f2779d adjusting for types 2012-08-23 22:56:14 -07:00
Chris Lu 5e3ecc1b82 adding VolumeId type 2012-08-23 22:46:54 -07:00
Chris Lu 03f4c0b832 adding topology related types 2012-08-23 22:33:37 -07:00
Chris Lu 31e4dbfe38 change volume id type to topology.VolumeId 2012-08-23 22:20:37 -07:00
Chris Lu 0121f35c12 starting a shell 2012-08-23 20:56:09 -07:00
Chris Lu 0109cc0e30 correct wording 2012-08-23 19:13:14 -07:00
Chris Lu 5caa7bbdc9 refactoring only 2012-08-23 19:10:55 -07:00
chris.lu@gmail.com 10c2a4540e v0.16 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@67 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:33:13 +00:00
chris.lu@gmail.com aab5390cb5 all switching to "weed command [args]" usage mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@66 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:31:48 +00:00
chris.lu@gmail.com 85da309eed all switching to "weed command [args]" usage mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@65 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:31:22 +00:00
chris.lu@gmail.com 5e9dc0e668 all switching to "weed command [args]" usage mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@64 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 08:29:22 +00:00
chris.lu@gmail.com 3f1136c194 migrate fix command 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@63 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-07 01:20:26 +00:00
chris.lu@gmail.com 51860424a6 moving to go style commands 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@62 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-08-06 23:54:53 +00:00
chris.lu@gmail.com c627942691 adding uncompressing support! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@61 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 08:52:11 +00:00
chris.lu@gmail.com 50c3f1d4a7 adding compressiong support! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@60 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 08:37:10 +00:00
chris.lu@gmail.com f3a4125ee7 adding compressiong support! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@59 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 08:36:25 +00:00
chris.lu@gmail.com 2e1ffa189b The extension ext should begin with a leading dot, as in ".html" 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@58 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-30 07:28:06 +00:00
chris.lu@gmail.com 2af8c354a7 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@57 282b0af5-e82d-9cf1-ede4-77906d7719d0 2012-07-17 05:07:19 +00:00
chris.lu@gmail.com 577bbcb2e3 convenient tool to submit serveral versions of the same file 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@56 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-17 04:11:38 +00:00
chris.lu@gmail.com 008b3fbbc9 remove debug message 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@55 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-17 04:10:54 +00:00
chris.lu@gmail.com d46e588200 simplify delta of file id, for multi-versioning of a file 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@54 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 17:15:16 +00:00
chris.lu@gmail.com eb9456d7d5 handle special case when browser also asks for favicon.ico 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@53 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 07:41:39 +00:00
chris.lu@gmail.com bcffffbc5e add capability to assign a batch of file ids 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@51 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 04:33:21 +00:00
chris.lu@gmail.com 68a216586f add capability to assign a batch of file ids 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@50 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-16 04:12:42 +00:00
chris.lu@gmail.com 74989d69c9 add error handling when non-multipart request comes in 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@49 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-07-03 06:46:26 +00:00
chris.lu@gmail.com de6e1442d7 also return publicUrl when assigning the fid 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@48 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-06-30 09:14:51 +00:00
chris.lu@gmail.com 8aba24a3f8 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@47 282b0af5-e82d-9cf1-ede4-77906d7719d0 2012-06-29 07:55:33 +00:00
chris.lu@gmail.com bb01324482 compatible with Go1 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@46 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-06-29 07:53:47 +00:00
chris.lu@gmail.com 8edf12f026 fix test 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@45 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-03-29 21:47:52 +00:00
chris.lu@gmail.com 4c31b6d533 delete entry from file index also 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@44 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-19 18:28:54 +00:00
chris.lu@gmail.com 3c7c85b1d4 remove verbose logging 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@43 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-19 18:28:33 +00:00
chris.lu@gmail.com 659bf1940f correctly deleting a file 
correctly setting volume file size limit

git-svn-id: https://weed-fs.googlecode.com/svn/trunk@42 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-19 00:49:41 +00:00
chris.lu@gmail.com 380953692b generating makefiles from a newer version of gb 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@41 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-18 22:59:33 +00:00
chris.lu@gmail.com 50b1eff390 add usage instructions 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@40 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-02 01:20:12 +00:00
chris.lu@gmail.com 0701286243 adding makefiles created by go-gb 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@36 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-02 00:52:43 +00:00
chris.lu@gmail.com 97a1d587d4 adding makefiles created by go-gb 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@35 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2012-01-02 00:45:32 +00:00
chris.lu@gmail.com 4c2ca916ec fix enforcing volume size limit 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@34 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-29 08:07:19 +00:00
chris.lu@gmail.com 298fdb4603 add configurable volume size limit 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@33 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-29 01:57:02 +00:00
chris.lu@gmail.com 0eff4311f5 add more error handling, adjust volume size to 32G 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@32 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-29 01:46:38 +00:00
chris.lu@gmail.com 2ccc098882 better error messages 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@31 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-28 20:31:13 +00:00
chris.lu@gmail.com 60c17068a6 correct sequence generating 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@30 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-27 06:09:21 +00:00
chris.lu@gmail.com b2f4a4e739 adjust weedc heartbeat to be randomly between (1*pulse, 2*pulse) seconds 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@29 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-27 01:51:18 +00:00
chris.lu@gmail.com 3c98f1a119 better log messages 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@28 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-27 01:40:16 +00:00
chris.lu@gmail.com 4c36190dd3 rename weedc option name to publicUrl 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@27 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-26 10:07:53 +00:00
chris.lu@gmail.com c27f6175d7 update volume status on each heartbeat 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@26 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-26 09:58:07 +00:00
chris.lu@gmail.com 6913fabc64 simplifying volume id mechanism, removing automatic volume id generation and discovering 
periodically report machine status

git-svn-id: https://weed-fs.googlecode.com/svn/trunk@25 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-26 09:43:17 +00:00
chris.lu@gmail.com ae3a53388f refactoring code 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@24 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-25 05:30:57 +00:00
chris.lu@gmail.com 6813f118d4 get and delete now checks cookie 
adding super block
adding tool to fix volume index

git-svn-id: https://weed-fs.googlecode.com/svn/trunk@23 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-24 08:40:56 +00:00
chris.lu@gmail.com cf7094f3c9 return written bytes, add debug mode 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@22 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-24 01:25:22 +00:00
chris.lu@gmail.com cc8af2e7dc print error message if invalid file id is used 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@21 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-22 19:55:13 +00:00
chris.lu@gmail.com ea75165e85 works now! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@20 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-22 04:04:47 +00:00
chris.lu@gmail.com 9c6a9bf518 simplify the file id format 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@19 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-20 09:00:01 +00:00
chris.lu@gmail.com a657eec299 use uint64, instead of key+alternativeKey, as file id 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@18 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-20 02:34:53 +00:00
chris.lu@gmail.com d018809830 efficiently assign file id 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@17 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-19 09:18:13 +00:00
chris.lu@gmail.com b39d1a77b4 cleaner 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@16 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-19 05:59:37 +00:00
chris.lu@gmail.com 041a93887c now join, status, read, write for weed server are working! 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@15 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-18 10:35:59 +00:00
chris.lu@gmail.com 2c7a4eea1f simplified to one machine per volume 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@14 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-18 07:22:04 +00:00
chris.lu@gmail.com 1fed603df9 now working for registering volume id ~ machine mapping 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@13 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-17 06:50:51 +00:00
chris.lu@gmail.com 10930ce6b6 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@12 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-17 06:47:23 +00:00
chris.lu@gmail.com 23ecd7bb33 split into server and clients 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@9 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-16 14:51:26 +00:00
chris.lu@gmail.com 02f4e7b82c split into server and clients 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@8 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-12-16 14:51:15 +00:00
chris.lu@gmail.com 5381479177 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@7 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-13 00:17:36 +00:00
chris.lu@gmail.com 2858701e6c git-svn-id: https://weed-fs.googlecode.com/svn/trunk@6 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-11 20:48:01 +00:00
chris.lu@gmail.com 70be76735c git-svn-id: https://weed-fs.googlecode.com/svn/trunk@5 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-11 09:30:09 +00:00
chris.lu@gmail.com da97f86447 git-svn-id: https://weed-fs.googlecode.com/svn/trunk@4 282b0af5-e82d-9cf1-ede4-77906d7719d0 2011-12-11 08:42:21 +00:00
chris.lu@gmail.com 8fade18e40 store is sort of working 
git-svn-id: https://weed-fs.googlecode.com/svn/trunk@3 282b0af5-e82d-9cf1-ede4-77906d7719d0
 2011-11-30 02:18:15 +00:00