21 commits

Author	SHA1	Message	Date
Chris Lu	6923af7280	refactoring	2021-09-06 16:20:49 -07:00
Chris Lu	18c40686d9	s3: multipart upload miss data if file is chunked in 4MB ... fix https://github.com/chrislusf/seaweedfs/issues/2195	2021-07-15 11:56:28 -07:00
Chris Lu	da7bd62822	/etc files are stored inside metadata store	2021-07-09 02:33:14 -07:00
Chris Lu	5e6dfbc25f	locks for data racing	2021-06-07 12:04:50 -07:00
Chris Lu	452c6ef183	limits concurrent uploads for one file	2021-06-06 23:05:17 -07:00
Chris Lu	8295e2feb6	skip md5 checking for now because of race condition	2021-06-06 22:16:32 -07:00
Chris Lu	19caeb7b02	fix writing the small file	2021-06-06 20:57:03 -07:00
Chris Lu	bb45dea15a	filer: parallel data upload	2021-06-06 20:23:36 -07:00
Chris Lu	44f1ba6894	refactor	2021-06-06 18:43:04 -07:00
Chris Lu	6c82326575	use bytes.Buffer to reduce memory allocation and gc	2021-06-06 13:42:36 -07:00
Chris Lu	c899bdf063	a little optimization	2021-05-06 03:03:00 -07:00
Chris Lu	3eb336e0b0	report error only for the first multipart upload ... the glog.Errorf would always print for s3 multipart uploads	2021-05-06 01:57:54 -07:00
Konstantin Lebedev	c2269123d3	fix aws style Etag for chunks	2021-04-28 22:28:05 +05:00
Chris Lu	0b82edc0d2	filer: avoid stuck uploader ... fix https://github.com/chrislusf/seaweedfs/issues/1980 reverting the file upload batch executor	2021-04-09 13:05:15 -07:00
Chris Lu	2327c0756b	fix to avoid loop	2021-04-05 23:24:26 -07:00
Chris Lu	c131764c34	ensure error is sent back in channel ... fix https://github.com/chrislusf/seaweedfs/issues/1966 avoid shared readErr variable	2021-04-05 19:40:12 -07:00
Chris Lu	8251d1140e	refactor	2021-04-04 18:38:33 -07:00
Chris Lu	67e019d54b	add missing changes	2021-04-02 01:11:44 -07:00
Chris Lu	7e8edc3c4a	refactoring	2021-04-02 01:10:24 -07:00
Chris Lu	cefe66f159	dedicated upload processor ... avoid thundering effect of overloading volume servers	2021-04-01 02:21:40 -07:00
Chris Lu	b5880334fc	refactor	2021-03-30 21:07:34 -07:00