165 Commits
Author SHA1 Message Date
Robert Fairburn 5a99186fe2 Some documentation updates (#15369) 2023-11-29 17:23:49 -06:00
Lucas Manuel Rodriguez 3122d93ce4 loadtesting: Redirect osquery results and status logs to /dev/null (#14848)
This is to avoid firehose (rate limit) errors when load testing query
reports with thousands of hosts. (And may reduce cost by storing logs
nowhere.)

Thanks @rfairburn:
https://github.com/fleetdm/fleet/pull/14754#issuecomment-1788887575
2023-11-01 12:11:21 -03:00
Robert Fairburn dae94c3129 Fix ACL Errors (#14525) 2023-10-27 10:20:07 -05:00
Roberto Dip ad9e30f120 Update Go to v1.21.3 (#14634)
for #14633
2023-10-19 10:01:05 -03:00
Lucas Manuel Rodriguez 910e26b93e Amend loadtesting terraform docs (#14549) 2023-10-13 17:05:00 -03:00
Roberto DipandMartin Angers e46e83baf8 upgrade Go to 1.21.1 for infra (#13878)
related to #13715, this updates the infra dependencies for the general
go upgrade that's happening at
https://github.com/fleetdm/fleet/pull/13877

I'm thinking we probably want to merge this after we're sure that
everything works well, maybe even after we have a release with go 1.21.1
out, so I'm making a separate PR.

---------

Co-authored-by: Martin Angers <martin.n.angers@gmail.com>
2023-10-12 21:09:17 -05:00
Luke Heath 191348208e Update contact instructions (#14333) 2023-10-05 15:09:09 -05:00
Martin Angers 1ce9eb5976 Fix invalid digest used in loadtest dockerfile (#13916) 2023-09-13 16:02:33 -04:00
Roberto Dip 5ad734d617 upgrade go to v1.19.12 (#13617) 2023-08-31 13:49:24 -05:00
Lucas Manuel Rodriguez 22b879bcef Add instructions to deploy server code changes to a loadtest env (#13563)
#12696
2023-08-29 11:06:32 -03:00
Roberto Dip d9de78e9fc upgrade Go version to 1.19.11 (#12902) 2023-07-26 11:09:22 -07:00
Lucas Manuel Rodriguez b803bbe5bf osquery-perf changes needed for load testing with simulated Windows hosts (#12754)
Changes in osquery-perf to allow for testing of Windows hosts in
loadtest environments.
2023-07-14 13:06:34 -03:00
Roberto Dip ab9ac28538 upgrade go version to 1.19.10 (#12187)
for #12177
2023-06-07 17:59:30 -03:00
Luke Heath 1f8ca0bbb4 Use personal access token for workflows (#12118) 2023-06-02 16:23:23 -05:00
Lucas Manuel Rodriguez ef16e1b41f Add docs to loadtest with MDM enabled and configured (#11891) 2023-05-25 09:07:24 -03:00
Lucas Manuel Rodriguez 2c13f16db7 Add some improvements to the loadtesting environment (#11564)
The default max open conns (50) was causing issues with small DB
instances (`db.t4g.medium`) in loadtesting (we run 10 fleet instances,
and 500 was over the limit number of connections for that instance
type).

Also upgrading Redis version to a more recent version that users are
most likely using.
2023-05-12 13:43:15 -03:00
Zach Wasserman 1a521133f4 Upgrade Go version to 1.19.8 (#11057)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [x] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
2023-04-07 12:05:22 -07:00
KanchiMoe 12e2047af9 replication_group_description is deprecated (#11047)
`replication_group_description` is a deprecated argument for
`aws_elasticache_replication_group`.
The replacement is `description`.

Highlighted on this job:
https://github.com/fleetdm/fleet/actions/runs/4613224383/jobs/8154983457#step:4:54

---
From:
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/elasticache_replication_group#argument-reference

> `replication_group_description` – (Deprecated use `description`
instead) User-created description for the replication group. Must not be
empty.
2023-04-06 19:44:10 -04:00
KanchiMoe 8c10b54388 number_cache_clusters is a deprecated argument in loadtesting/redis.tf (#10979)
`number_cache_clusters` is a deprecated argument for
`aws_elasticache_replication_group`.
The replacement is `num_cache_clusters`.

Highlighted on this job:
https://github.com/fleetdm/fleet/actions/runs/4600246486/jobs/8126589394#step:4:54

---
From
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/elasticache_replication_group#argument-reference:

> `number_cache_clusters` - (Optional, Deprecated use
`num_cache_clusters` instead)
2023-04-04 19:59:44 -04:00
KanchiMoe a0b10d4e49 acl is deprecated on aws_s3_bucket (#10944)
`acl` is a deprecated argument on `aws_s3_bucket`.

Identified by this job:
https://github.com/fleetdm/fleet/actions/runs/4585758981/jobs/8098079111#step:4:58
2023-04-03 14:53:13 -04:00
KanchiMoe 23fe4bc718 lifecycle_rule on aws_s3_bucket is deprecated on loadtesting/firehose.tf (#10929)
`lifecycle_rule` on `aws_s3_bucket` is a deprecated argument.

Highlighted in this job:
https://github.com/fleetdm/fleet/actions/runs/4583725754/jobs/8094753489#step:4:57
2023-04-01 19:37:59 -04:00
Zachary Winnerman 14f9c14a84 Fix rds deprecations in loadtesting (#10922)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [ ] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)
- [ ] Documented any permissions changes
- [ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.
- [ ] Added/updated tests
- [ ] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [ ] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- [ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).

Closes #10869
2023-03-31 16:11:21 -04:00
KanchiMoe 56187894e6 firehose.tf acl argument on aws_s3_bucket is deprecated (#10906)
The `acl` argument on `aws_s3_bucket` is deprecated, as noted by the
warning on this job:
https://github.com/fleetdm/fleet/actions/runs/4568874872/jobs/8064463410#step:4:54
2023-03-30 19:58:21 -04:00
KanchiMoe c56677af10 firehose.tf lifecycle_rule on "osquery-results" is deprecated (#10898)
`lifecycle_rule` on s3 buckets is deprecated, as noted by the warning on
this job:
https://github.com/fleetdm/fleet/actions/runs/4568578149/jobs/8063810135#step:4:54
2023-03-30 16:54:59 -04:00
Benjamin Edwards 4161ee5679 create vuln processing addon (#10526)
two things here:

1. create addon for use in new modular terraform
2. create vuln processing terraform for legacy terraform, but by default
its disabled
2023-03-29 08:57:10 -04:00
Robert Fairburn e4803819a1 Update references from fleet-infra to confidential (#10388)
Updates to support https://github.com/fleetdm/fleet/issues/10330
2023-03-08 12:38:40 -06:00
Martin Angers e3ddb5f3ce Support matching a host in orbit enrollment using the serial number (#9612) 2023-02-28 12:55:04 -05:00
Luke Heath 71f2a62b4c Prepare for 4.28.0 (#10103) 2023-02-27 15:19:15 -08:00
Luke Heath 13e821d059 Prepare for 4.27.1 (#9885) 2023-02-17 19:19:02 -08:00
Lucas Manuel Rodriguez c6ab010833 Amend the loadtesting README.md (#9650)
Amending some parts of the README.md after following the guide to load
test #9559.

PS: Great documentation we have here!
2023-02-06 06:54:44 -03:00
Luke Heath b3daf3d715 Prepare for 4.27.0 (#9683) 2023-02-03 17:03:06 -08:00
Zachary Winnerman 3ba801a43b Quick fixup (#9614)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [ ] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)
- [ ] Documented any permissions changes
- [ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.
- [ ] Added/updated tests
- [ ] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [ ] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- [ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).
2023-02-01 12:40:12 -05:00
Robert Fairburn 68673cfa6a Initial osquery-perf terraform module addon (#9556)
Added some outputs to re-use the execution and other iam roles in terraform module.
Added osquery-perf addon terraform module
2023-01-31 15:28:57 -06:00
Luke Heath b6a6ac454f Prepare for 4.26.0 (#9326) 2023-01-13 16:26:22 -08:00
Zachary Winnerman da7329cbcd Add fix for destroying loadtesting ECR (#9154) 2023-01-02 16:07:37 -05:00
Robert Fairburn b19233e21d Loadtesting db size (#9152)
* Allow for customizable DB instance type loadtesting
2023-01-02 14:33:30 -06:00
Zachary Winnerman d64728a5b1 Fix tags for loadtesting (#9151) 2023-01-02 15:21:10 -05:00
Robert Fairburn 75ea8b8b88 Allow loadtests to separate git branch from dockerhub tag (#9130) 2022-12-27 15:48:54 -06:00
Luke Heath dd29a4e718 Bump loadtest aurora version to latest (#9120) 2022-12-23 15:59:30 -06:00
Tomas Touceda 71dbb71df4 Update go to 1.19.4 (#8945)
* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update go to 1.19.4

* Comment out failing package test

* Comment out ALL the packaging tests for windows for the moment

* Update changelog

* Bump versions

* Update changelog to reflect this being a security release
2022-12-09 11:47:17 -03:00
Robert Fairburn 44609419b2 arm64 Mac support for loadtesting. Quickly expire loadtesting secrets on destroy (#8889) 2022-12-01 07:35:10 -06:00
Roberto Dip 665cac41f6 enable a reader replica in load testing RDS (#8805)
We discussed in the @fleetdm/g-platform weekly meeting that it would be good to have a read replica enabled by default in load testing, as it matches what we would recommend to customers for deployments of the size we use to load test with.

This is just what I did to get it working in the past, but I'm happy to adjust as you consider appropriate.
2022-11-23 16:13:57 -03:00
Zach WassermanandTomas Touceda efbe4c0777 Update Go to 1.19.3 (#8525) (#8614)
Co-authored-by: Tomas Touceda <chiiph@gmail.com>
2022-11-08 13:03:23 -03:00
Roberto Dip f5d3aa233c reduce the build time of loadtest.Dockerfile (#8584)
- yarn is not needed to build osquery-perf
- we can change the clone step to not fetch unnecessary data
2022-11-04 13:20:38 -03:00
Robert Fairburn 3c87299082 Improve loadtesting documentation (#8576) 2022-11-03 17:11:22 -05:00
Roberto Dip c51927e873 enhance support for orbit and fleet desktop in osquery-perf (#8217)
This improves osquery-perf with support for a more realistic orbit + fleet desktop simulation as described in #8212

This was based on the work done by @sharvilshah in his branch.
2022-10-28 14:27:21 -03:00
Robert Fairburn dc0427117e Add loadtesting ECR Cleanup one-liner (#8041) 2022-10-10 10:02:11 -05:00
Martin Angers 7356378d0f Update hashicorp/aws provider version for loadtesting and add CI validation (#7937)
* Update hashicorp/aws provider version for loadtesting and add CI validation

* Update name of the new workflow
2022-09-28 09:38:56 -05:00
KanchiMoe cde973293b server_side_encryption_configuration attribute is deprecated (#7866) 2022-09-21 14:25:08 -04:00
KanchiMoe fc3f980cff server_side_encryption_configuration argument is deprecated (#7577)
https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/s3_bucket#enable-default-server-side-encryption
2022-09-19 13:04:52 -04:00