Commit graph

9626 commits

Author SHA1 Message Date
Patrick Schmidt 98dcec0ee2 Clean up old signature hash pools 2023-09-05 10:33:27 -07:00
Patrick Schmidt cdd817edf9 Improve S3 request signing performance
This change is caching HMAC hashers for repeated use in subsequent
requests and chunks, so they don't have to be initialized from
scratch every time.
On my local computer this gives me ~5-6 times faster signature
calculation and ~5-6.5% more throughput in S3 requests. The smaller
the payload the better the throughput gets.
2023-09-05 10:33:27 -07:00
dependabot[bot] f07876cb23
Bump actions/checkout from 3 to 4 (#4812)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...3df4ab11eba7bda6032a0b82a6bb43b11571feac)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-04 10:03:49 -07:00
dependabot[bot] f3dfeb3735
Bump github.com/tidwall/gjson from 1.14.4 to 1.16.0 (#4811)
Bumps [github.com/tidwall/gjson](https://github.com/tidwall/gjson) from 1.14.4 to 1.16.0.
- [Commits](https://github.com/tidwall/gjson/compare/v1.14.4...v1.16.0)

---
updated-dependencies:
- dependency-name: github.com/tidwall/gjson
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-04 10:03:41 -07:00
dependabot[bot] 41ebc9c3cb
Bump github.com/puzpuzpuz/xsync/v2 from 2.4.1 to 2.5.0 (#4810)
Bumps [github.com/puzpuzpuz/xsync/v2](https://github.com/puzpuzpuz/xsync) from 2.4.1 to 2.5.0.
- [Release notes](https://github.com/puzpuzpuz/xsync/releases)
- [Commits](https://github.com/puzpuzpuz/xsync/compare/v2.4.1...v2.5.0)

---
updated-dependencies:
- dependency-name: github.com/puzpuzpuz/xsync/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-04 10:03:33 -07:00
dependabot[bot] 5c613f18ad
Bump github.com/go-redsync/redsync/v4 from 4.8.1 to 4.8.2 (#4807)
Bumps [github.com/go-redsync/redsync/v4](https://github.com/go-redsync/redsync) from 4.8.1 to 4.8.2.
- [Release notes](https://github.com/go-redsync/redsync/releases)
- [Commits](https://github.com/go-redsync/redsync/compare/v4.8.1...v4.8.2)

---
updated-dependencies:
- dependency-name: github.com/go-redsync/redsync/v4
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-04 10:03:03 -07:00
fibbanachi 7374ceecda
improve k8s probes templating in helm chart (#4805) 2023-09-02 13:26:27 -07:00
Lars Lehtonen e6385e5e8b
weed/util: fix dropped errors (#4803) 2023-09-01 13:10:45 -07:00
ginn13 f139a56cb9
Add master servers to grafana dashboard (#4801) 2023-08-31 06:42:07 -07:00
Dmitriy Pavlov de1dcf3b2f
[heml] fix default affinity and allow owerride ingress annotations (#4799) 2023-08-29 08:43:11 -07:00
Alexandre Viau 271c51f273
helm: allow setting master.toml config (#4797) 2023-08-28 20:44:09 -07:00
dependabot[bot] 03389bf844
Bump github.com/gocql/gocql from 1.5.2 to 1.6.0 (#4794)
Bumps [github.com/gocql/gocql](https://github.com/gocql/gocql) from 1.5.2 to 1.6.0.
- [Release notes](https://github.com/gocql/gocql/releases)
- [Changelog](https://github.com/gocql/gocql/blob/master/CHANGELOG.md)
- [Commits](https://github.com/gocql/gocql/compare/v1.5.2...v1.6.0)

---
updated-dependencies:
- dependency-name: github.com/gocql/gocql
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-28 09:18:44 -07:00
dependabot[bot] 1faf9afb91
Bump modernc.org/sqlite from 1.24.0 to 1.25.0 (#4793)
Bumps [modernc.org/sqlite](https://gitlab.com/cznic/sqlite) from 1.24.0 to 1.25.0.
- [Commits](https://gitlab.com/cznic/sqlite/compare/v1.24.0...v1.25.0)

---
updated-dependencies:
- dependency-name: modernc.org/sqlite
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-28 09:18:35 -07:00
dependabot[bot] cf44633491
Bump github.com/aws/aws-sdk-go-v2/credentials from 1.13.34 to 1.13.35 (#4792)
Bumps [github.com/aws/aws-sdk-go-v2/credentials](https://github.com/aws/aws-sdk-go-v2) from 1.13.34 to 1.13.35.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/credentials/v1.13.34...credentials/v1.13.35)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/credentials
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-28 09:18:22 -07:00
Alexandre Viau db5d23defe
k8s: allow configuring serviceAccountName (#4790) 2023-08-28 09:06:06 -07:00
dependabot[bot] ac1b144526
Bump gocloud.dev from 0.33.0 to 0.34.0 (#4795)
Bumps [gocloud.dev](https://github.com/google/go-cloud) from 0.33.0 to 0.34.0.
- [Release notes](https://github.com/google/go-cloud/releases)
- [Commits](https://github.com/google/go-cloud/compare/v0.33.0...v0.34.0)

---
updated-dependencies:
- dependency-name: gocloud.dev
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-28 09:04:59 -07:00
dependabot[bot] 67f1bb69c4
Bump github.com/jinzhu/copier from 0.3.5 to 0.4.0 (#4791)
Bumps [github.com/jinzhu/copier](https://github.com/jinzhu/copier) from 0.3.5 to 0.4.0.
- [Commits](https://github.com/jinzhu/copier/compare/v0.3.5...v0.4.0)

---
updated-dependencies:
- dependency-name: github.com/jinzhu/copier
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-08-28 09:04:10 -07:00
dependabot[bot] 47fae7d0eb
Bump docker/setup-buildx-action from 2.9.1 to 2.10.0 (#4789) 2023-08-28 08:33:51 -07:00
Dmitriy Pavlov 56aef67912
[heml] complete redesign of labels (#4788) 2023-08-28 07:37:05 -07:00
Dmitriy Pavlov 3d45ecd326
[helm] fix log to stderr and default host for ingress (#4787) 2023-08-27 13:53:28 -07:00
Nico D'Cotta 796b7508f3
Implement SRV lookups for filer (#4767) 2023-08-24 07:08:56 -07:00
tikhon-opsfleet 5251b4d50e
[helm] add possibility to use array for imagePullSecrets (#4782)
add possibility to use array for imagePullSecrets
2023-08-23 01:01:41 -07:00
chrislu 733db2bc88 turn on streaming assign file id 2023-08-23 00:34:21 -07:00
chrislu 99f037b958 streaming assign file ids 2023-08-23 00:31:33 -07:00
chrislu eac92c334a Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-08-23 00:28:32 -07:00
gfhe d7937f9738
fix bugs: seaweedfs master ingress host configuration do not work (#4781)
fix bugs: seaweedfs hem charts ignore the master ingress configuration
2023-08-22 20:11:11 -07:00
chrislu 94b7e2a37c add stream assign server side implementation 2023-08-22 09:59:04 -07:00
chrislu ccedad5196 refactor files 2023-08-22 09:54:06 -07:00
chrislu 010c5e91e3 add stream assign proto 2023-08-22 09:53:54 -07:00
chrislu a1149f060b upgrade jwt 2023-08-22 08:26:31 -07:00
chrislu c49caff5a1 change from deprecated jwt.StandardClaims to new jwt.RegisteredClaims 2023-08-21 23:42:39 -07:00
chrislu 3d5ecc627e Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-08-21 23:34:58 -07:00
Chris Lu 9215ba24be
Revert "Add disk type to prometheus metrics" (#4777)
Revert "Add disk type to prometheus metrics (#4736)"

This reverts commit 9956d93a40.
2023-08-21 11:38:12 -07:00
Dmitry Mishin 9956d93a40
Add disk type to prometheus metrics (#4736)
* Add disk type to prometheus metrics

* Del metrics

* Disk type as readable string

---------

Co-authored-by: Dima Mishin <dimm@dimm.dev>
2023-08-21 11:37:27 -07:00
chrislu c45665eb97 Merge branch 'master' of https://github.com/seaweedfs/seaweedfs 2023-08-21 09:47:36 -07:00
dependabot[bot] 88fca2b0da
Bump wangyoucao577/go-release-action from 1.39 to 1.40 (#4775) 2023-08-21 08:50:02 -07:00
dependabot[bot] b6d8b87c70
Bump actions/dependency-review-action from 3.0.7 to 3.0.8 (#4776) 2023-08-21 08:49:53 -07:00
dependabot[bot] 6f5ff4f9e8
Bump github.com/prometheus/procfs from 0.11.0 to 0.11.1 (#4773) 2023-08-21 08:49:31 -07:00
dependabot[bot] 558545500f
Bump cloud.google.com/go/storage from 1.31.0 to 1.32.0 (#4774) 2023-08-21 08:49:19 -07:00
dependabot[bot] 0485880761
Bump github.com/aws/aws-sdk-go-v2/credentials from 1.13.32 to 1.13.34 (#4772) 2023-08-21 08:49:08 -07:00
dependabot[bot] 3e4726c442
Bump golang.org/x/net from 0.13.0 to 0.14.0 (#4770) 2023-08-21 08:48:49 -07:00
SmsS4 f61490966f
Add time to first byte metric for s3 (#4768)
* Add time to first byte metric for s3

* Change second to millisecond
2023-08-21 00:42:39 -07:00
chrislu 01d70c21f3 Squashed commit of the following:
commit 32f4b1a13057d56b6de487cdb80ff7c205af01a6
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:52:19 2023 -0700

    fix compilation

commit e77ad33b7ca0423138fbae26a4433b60923a9588
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 22:46:44 2023 -0700

    pub

commit f431f30cc7ca277ca299e3cd118c05537fb9f5c3
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 13:27:39 2023 -0700

    fix generic type

commit 4e9dcb18293fd1e3e306e2dceb995dfd67a35e1d
Merge: 30f942580 16e3f2d52
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 12:47:14 2023 -0700

    Merge branch 'master' into pubsub

commit 30f942580ad1bb32ae94aade2e3a21ec3ab63e21
Author: chrislu <chris.lu@gmail.com>
Date:   Sun Aug 20 11:10:58 2023 -0700

    wip

commit f8b00980bc2f3879bb43decffd9a08d842f196f2
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:35 2023 -0700

    add design document

commit 08d2bebe42a26ebc39f1542f54d99e73620727dd
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:14:06 2023 -0700

    minor

commit bcfa7982b262a40fcdce6fc6613fad2ce07c13da
Author: chrislu <chris.lu@gmail.com>
Date:   Tue Jul 25 09:13:49 2023 -0700

    rename
2023-08-20 22:53:05 -07:00
Victor Adossi ("vados") 3650e5adda
chore: add nimbus web services to backers.md (#4769) 2023-08-20 15:31:23 -07:00
chrislu 16e3f2d528 fix log buffer test 2023-08-20 12:46:15 -07:00
chrislu 3e9c32a3f0 refactoring to use atomic bool
fix compilation
2023-08-20 12:13:06 -07:00
SmsS4 1e72579ac7
Fix s3.clean.uploads (#4766) 2023-08-19 06:30:18 -07:00
chrislu 710e88f713 Java: upgrade to 3.55 2023-08-17 08:49:33 -07:00
chrislu 88fa37a35a fix compilation 2023-08-17 08:49:19 -07:00
chrislu 4523cd7a32 Java: SeaweedOutputStream add option to pass in collection 2023-08-17 08:20:50 -07:00