Commit Graph
104 Commits
Author SHA1 Message Date
Eric 98e825e434 Update osquery schema version, regenerate merged schema JSON (#16597)
For https://github.com/fleetdm/fleet/issues/13891

Changes:
- Updated the version of the osquery schema used to generate
osqeury_fleet_schema.json (`5.9.1` » `5.11.0`)
- Removed the table override file for the `atom_packages` table (It was
removed from the osquery schema, our override file was previously hiding
the table)
- Ran the `generate-merged-schema` script to regenerate
osquery_fleet_schema.json
2024-02-05 17:30:41 -06:00
Noah Talerman 558ef6497f fleetdm.com/tables: Add Fleet override for process_file_events docs (#16503)
- To address the bug, we decided to document the current behavior: The
`process_file_events table` will only emit events for changes and files
in directories that existed before osquery starts.
2024-02-02 15:47:23 -05:00
Eric b133e51a59 Regenerate osquery_fleet_schema.json (#16072)
Changes:
- Ran the `generate-merged-schema` script to regenerate
`osquery_fleet_schema.json`
2024-01-11 15:34:08 -06:00
Rachael Shaw 7f7eafb54f Fix platform documentation for windows_updates table (#16071)
Compatible with Windows (not macOS)
2024-01-11 15:26:59 -06:00
Lucas Manuel Rodriguez bd16acb66e Adding doc changes for configuring fleetd channels remotely (#15872)
#13825

Creating a separate PR to not block on docs review.
2024-01-04 10:23:51 -03:00
Eric cda91571b8 2023-12-06 Regenerate osquery_fleet_schema.json (#15474)
Changes:
- Ran the `update-merged-schema` script to regenerate
`schema/osquery_fleet_schema.json`
2023-12-08 17:00:12 -06:00
Sharon Katz 29580a242d 15135 remove atom package (#15410) 2023-12-04 14:26:26 -05:00
Eric 597dafa187 (2023-11-17) Regenerate osquery_fleet_schema.json (#15189)
Changes:
- Regenerated `schema/osquery_fleet_schema.json`
2023-11-17 13:23:11 -06:00
ba8ae8797e Add docs for new tables (#15046)
- Add documentation for new tables so that they show up on fleetdm.com
and the sidebar in the Fleet UI

---------

Co-authored-by: Rachael Shaw <r@rachael.wtf>
Co-authored-by: Jack-Daniyel Strong <jack@jdstrong.com>
Co-authored-by: Eric <eashaw@sailsjs.com>
2023-11-17 12:17:23 -06:00
Eric bd68426b03 Update osquery table YAML template (#15078)
Changes:
- Added the `evented` attribute to the osquery schema table YAML
template in the `schema/` folder README.
2023-11-16 13:52:22 -06:00
Rachael Shaw 7be8419393 Fix typo in example query (#15097)
Fix typo in example query for user_ssh_keys table
2023-11-10 15:11:30 -06:00
Rachael ShawandEric ae669e1749 2023-10-17 Update osquery schema version & regenerate merged schema (#14436)
When running a live query recently, I noticed some columns in the
results that we didn't have documented, and realized we weren't using
the latest osquery schema version when regenerating the merged schema.

According to the docs, [we support the latest version of
osquery](https://fleetdm.com/docs/using-fleet/enroll-hosts#supported-osquery-versions),
so figure we ought to update the schema version to the latest.

---------

Co-authored-by: Eric <eashaw@sailsjs.com>
2023-10-26 18:04:23 -05:00
JD d6456029b9 Adds attribution to MacAdmins osquery extension. (#14616)
Adds attribution to MacAdmins foundation osquery extension.
2023-10-20 06:57:04 -07:00
Eric 4bea8a4c92 Schema: update override column descriptions for system_info and chrome_extensions tables (#14395)
Related to: #14166

Changes:
- updated the override column descriptions for the `system_info` and
`chrome_extensions` tables to include the descriptions from the osquery
schema.
2023-10-10 13:10:49 -05:00
Eric 1d9299dea2 Regenerate osquery_fleet_schema.json (2023-09-26) (#14161)
Changes:
- Ran the `generate-merged-schema` script to regenerate
`/schema/osquery_fleet_schema.json`
2023-09-27 16:29:58 -05:00
Eric 2de35a0ff7 Schema: Hide iptables table. (#14054)
Changes:
- Created an override file for the `iptables` table
- Regenerated merged schema.
2023-09-26 16:49:48 -05:00
Mo Zhu 1c7359b117 Update certificates.yml to include warning about potential corruption… (#13976)
Partially addresses #13065
2023-09-25 10:33:53 -07:00
Mo Zhu 2e09371aaf Update keychain_items.yml to include warning about potential corruption of the certificate (#13975)
Partially addresses #13065
2023-09-25 10:33:30 -07:00
Eric 45e1b56bb1 Website: sort merged osquery schema (#13959)
Closes: #13722

Changes:
- Updated the `get-extended-osquery-schema` helper to sort the merged
schema by table name.
- Regenerated `/schema/osquery_fleet_schema.JSON`
2023-09-15 18:40:57 -05:00
Eric 51485beb40 Regenerate osquery_fleet_schema.json (#13723)
Changes:
- Ran the `generate-merged-schema` script to regenerate
`schema/osquery_fleet_schema.json`.
2023-09-05 16:29:39 -05:00
Eric 08af35d294 Schema: Regenerate merged schema JSON (#13311)
Changes
- Ran the `generate-merged-schema` script to regenerate
`schema/osquery_fleet_schema.json`.
2023-08-15 18:35:19 -05:00
JD 31a308c6ed Update schema example for mounts table (#12779)
Noticed this had the wrong table example. Updated mounts table schema
example with an example from my PSU MacAdmins presentation.
2023-07-18 15:30:33 -07:00
Mike McNeilandEric 92ccd71b87 Update npm_packages.yml (#12489)
Clarify docs for https://fleetdm.com/tables/npm_packages

---------

Co-authored-by: Eric <eashaw@sailsjs.com>
2023-07-14 16:27:18 -05:00
Mo ZhuandRachael Shaw 5fbc368e46 Warning about installing extension on Chrome browsers (#12596)
Co-authored-by: Rachael Shaw <r@rachael.wtf>
2023-07-07 09:55:38 -07:00
Lucas Manuel Rodriguez 810eb58b95 macOS CIS: Use find command (exposed as fleetd table) instead of relying on the osquery core file table (#12560)
#10292, #12554

When scanning tens of thousands of files for permissions, using the
`find` command exposed as a fleetd table is more performant than trying
to use the `file` table. This change caused the watchdog to *stop*
killing osquery because of exceeding memory or CPU limit.

- [X] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- ~[ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)~
- ~[ ] Documented any permissions changes~
- ~[ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)~
- ~[ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.~
- [X] Added/updated tests
- [X] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [X] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- ~[ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).~
2023-06-29 16:22:41 -03:00
Mo Zhu d98ca0052d Update xprotect_reports.yml (#12486) 2023-06-28 11:33:06 -07:00
RachelElysia 4c073278a8 ChromeOS tables: Add min chrome version to table schemas (#12540) 2023-06-27 14:16:51 -07:00
Sharon Katz 519982990c Add disk_info table to chromeos (#12344) 2023-06-26 15:40:37 -04:00
RachelElysia 044935b02f ChromeOS support: ChromeOS tables (add chromeos to existing table: screenlock, new table: system_state) (#12358) 2023-06-26 11:18:12 -07:00
Mike McNeil 4be1da6724 Update wifi_networks.yml (#12488) 2023-06-26 10:51:09 -05:00
Jacob ShandlingandJacob Shandling 2855bc8f7f ChromeOS privacy_preferences table (#12441)
## Addresses #11037 

### Implement the `privacy_preferences` table for the Fleetd Chrome
extension. Columns correspond to the available properties of
[`chrome.privacy`](https://developer.chrome.com/docs/extensions/reference/privacy/).

Chrome on mac:
<img width="816" alt="Screenshot 2023-06-23 at 11 55 21 AM"
src="https://github.com/fleetdm/fleet/assets/61553566/a4700749-6325-442e-acf2-c14b1c9adf8f">

Chromebook with enterprise access (actual use case):
![Image from
iOS](https://github.com/fleetdm/fleet/assets/61553566/93f2243d-357a-4d85-bd20-0aebd178388c)

* Chromebook w/o enterprise access: as you can see, sometimes certain
APIs are not available - this error occurs because the expected API
object that would have a `get` method is actually `undefined` TODO – How
to handle this case given that we want to let errors bubble up to the
level at which Fleet can catch them? Maybe it would be nice to catch
such errors and send them up to the Fleet layer, and still allow the
loop to continue to populate the columns whose APIs _are_ available.
_Decision: catch API errors here to preserve functionality of the
remaining columns_

![IMG_9407](https://github.com/fleetdm/fleet/assets/61553566/7fb26eb4-44e8-43f8-90c0-8b3d718c5ace)

- [x] Changes file
- [x] Manual QA

---------

Co-authored-by: Jacob Shandling <jacob@fleetdm.com>
2023-06-23 14:52:16 -07:00
Mo ZhuandEric 282af8244f Update screenlock table doc to be more explicit about its limitations (#12432)
Co-authored-by: Eric <eashaw@sailsjs.com>
2023-06-21 10:29:49 -07:00
gillespi314 87fe00db71 Create new Fleet osquery extension table to read escrowed FileVault key (#12198) 2023-06-15 10:23:59 -05:00
Eric 01106d05a6 Update platform value for ChromeOS tables, Update Fleet website to use new value, and regenerate schema JSON (#12091)
Changes:
- Updated the `platform` value for osquery tables and columns that
support chromeos to be `chrome` (Previously `chromeos`)
- Updated `get-exteneded-osquery-schema.js` to use the new `platform`
value
- Updated the Fleet website to use the `chrome` `platform`.
- Regenerated `schema/osquery_fleet_schema.json` with ChromeOS tables.
2023-06-02 17:44:06 -05:00
Eric 05783d60b7 Schema: Remove platforms for columns that are compatible with all platforms. (#12070)
Changes:
- Removed the `platforms` value of columns that support all platforms on
the schema tables added in https://github.com/fleetdm/fleet/pull/11784.
Columns in our YAML table overrides should only have a `platforms` value
if it is not compatible with all platforms
2023-05-31 14:56:45 -05:00
Mo Zhu 2c6a6a4649 Initial chromeos tables (#11784)
Added initial schema for chromeos tables.
2023-05-30 22:04:29 -04:00
Rachael Shaw c70872607b Add documentation for how to specify platforms on fleetdm.com/tables (#11697)
Updated the README to clarify how to document platform support for the
entire table or for specific columns.
2023-05-16 10:26:29 -05:00
Rachael Shaw 85cfd0d2d8 Update icloud_private_relay.yml (#11700)
Updated the platform name to "darwin" to fix missing icon:
<img width="977" alt="Screenshot 2023-05-15 at 1 19 17 PM"
src="https://github.com/fleetdm/fleet/assets/3065949/4c2163b8-aa30-4b55-838e-c0a36cb20a6d">
2023-05-15 13:45:24 -05:00
Marcos OviedoandSharon Katz 3ec04887e6 New CIS Audit table (#11381)
This relates to #11244 

If some of the following don't apply, delete the relevant line.

- [x] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [x] Manual QA for all new/changed functionality
- [x] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.

---------

Co-authored-by: Sharon Katz <121527325+sharon-fdm@users.noreply.github.com>
2023-05-12 11:16:36 -03:00
3f0111964f Add macos_rsr table from macadmins extension (#11537)
# Checklist for submitter

If some of the following don't apply, delete the relevant line.

- [ ] Changes file added for user-visible changes in `changes/` or
`orbit/changes/`.
See [Changes
files](https://fleetdm.com/docs/contributing/committing-changes#changes-files)
for more information.
- [ ] Documented any API changes (docs/Using-Fleet/REST-API.md or
docs/Contributing/API-for-contributors.md)
- [ ] Documented any permissions changes
- [ ] Input data is properly validated, `SELECT *` is avoided, SQL
injection is prevented (using placeholders for values in statements)
- [ ] Added support on fleet's osquery simulator `cmd/osquery-perf` for
new osquery data ingestion features.
- [ ] Added/updated tests
- [ ] Manual QA for all new/changed functionality
  - For Orbit and Fleet Desktop changes:
- [ ] Manual QA must be performed in the three main OSs, macOS, Windows
and Linux.
- [ ] Auto-update manual QA, from released version of component to new
version (see [tools/tuf/test](../tools/tuf/test/README.md)).

---------

Co-authored-by: Roberto Dip <me@roperzh.com>
Co-authored-by: Lucas Rodriguez <lucas@fleetdm.com>
2023-05-05 11:02:28 -03:00
Eric 0abdc6261e Regenerate osquery_fleet_schema.json (#11487)
Changes:
- Ran the `generate-merged-schema` script to regenerate
`/schema/osquery_fleet_schema.json`.
2023-05-02 15:15:57 -05:00
Mo Zhu 2ae011b962 clarify blank username attribute is global (#10836)
Came from https://github.com/fleetdm/fleet/issues/8119
2023-03-29 10:12:04 -07:00
Sharon Katz d54e354022 CIS MAC 1.1 fix (#10619) 2023-03-29 09:24:33 -04:00
Artemis Tosini 1d2ae58d5f Add macOS CIS 5.3.2 (#10726)
Add 2 new tables: corestorage_logical_volumes and corestorage_logical_volume_families.
Add a query that uses these tables
2023-03-28 11:57:38 -04:00
EricandMike McNeil 767fc39387 Update osquery schema version & regenerate merged schema (#10471)
Changes:
- Changed the version of osquery schema we merge with Fleet's overrides
from `5.7.0` to `5.8.1`
- Rand the `generate-merged-schema` script to regenerate
`osquery_fleet_schema.json` .


## EDIT
Mike: Hi Eric, if my changes look good to you, and if it's passing CI,
would you merge?

.

---------

Co-authored-by: Mike McNeil <mikermcneil@users.noreply.github.com>
2023-03-17 19:32:34 -05:00
Artemis Tosini af4c3f7061 Add macOS CIS 5.3.1 (#10397)
This adds a new check about whether all APFS volumes are encrypted. I
needed to add a new table, and I took that opportunity to add another so
that osquery has all information from `diskutil apfs list -plist`.

Note that it is somewhat unclear whether to use the `encryption` or
`filevault` field in the query. FileVault is about whether the volume is
encrypted with a password and Encryption is about whether it is
encrypted at all, since all modern macs have hardware-backed disk
encryption.
2023-03-10 12:29:14 -05:00
Sharon Katz 8c04711f60 add minimumMixedCaseCharacters (#10401) 2023-03-09 15:44:28 -05:00
Eric 9f87abe8d5 Regenerate osquery_fleet_schema.json (#10200)
Changes: 
- Ran the `generate-merged-schema` script to regenerate
`schema/osquery_fleet_schema.json`.
2023-02-28 17:00:13 -06:00
Lucas Manuel Rodriguez 4784217b57 Add documentation for missing fleetd tables and regenerate JSON (#9960)
Updating documentation of Fleetd tables as part of the oncall duty.

Updating the json used by Fleet using the following command:
```sh
cd website
 ./node_modules/sails/bin/sails.js run generate-merged-schema
```

Samples:
![Screenshot 2023-02-20 at 17 20
55](https://user-images.githubusercontent.com/2073526/220192112-69a116e4-badb-4328-92d3-9a2a6f8657fe.png)
![Screenshot 2023-02-20 at 17 21
09](https://user-images.githubusercontent.com/2073526/220192117-dfa06c69-2166-47d4-99c3-e108911e2084.png)


@mikermcneil @eashaw: `generate-merged-schema` generates a different
output every time it's executed. Guess: It seems it should sort the
output lexicograhically?
2023-02-22 16:05:36 -03:00
Mike McNeil 6091556b7a Fix build (#10018)
mikermcneil
  3 minutes ago
@Kathy Satterlee
 I think https://github.com/fleetdm/fleet/pull/9881 broke the build
4 replies

 .
mikermcneil
  2 minutes ago
https://github.com/fleetdm/fleet/pull/9979#issuecomment-1440604277


Zay Hanlon
  1 minute ago
Oops. That was my approval/merge on Kathy's change


Zay Hanlon
  1 minute ago
How do I fix?


mikermcneil
  < 1 minute ago
@Zay Hanlon
All good. I think we should make it so that PRs can't be merged until
they pass the CI checks. It's annoying but would prevent things like
this, which are expensive and involve multiple folks' time.
@Zach Wasserman
 
@Luke Heath
I'm going to turn on the branch protection that prevents merging when
automated CI checks are failing.
@Kathy Satterlee
 I'll follow up with a fix now.
@Jarod Reyes
 Feel free to go ahead and merge your PR in the meantime.


Zay Hanlon
:spiral_calendar_pad: [11 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677091760162369?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
Sorry 😞


mikermcneil
[10 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677091789685699?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
All good, inevitable


Zach Wasserman
[9 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677091841779269?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
FWIW turning that on will really slow down my dev process at times.


Zach Wasserman
[8 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677091942206439?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
eg. if I make one tiny change on a PR that I already know passes all the
tests then I'll have to wait 15 mins for the whole CI to run before I
can merge.


mikermcneil
[7 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677091967828479?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
it was an indentation issue:
https://github.com/fleetdm/fleet/pull/10018/files#diff-68623aac08ce48b5c1275a38ea9f42a8a730a9c2e04ab1946174cdc67f4ce686R8
:ty:
1



Luke Heath
[7 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677092006055779?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
Is it possible to conditionally enable the required CI checks?


Zach Wasserman
[6 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677092018873739?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
Maybe you can just turn on a limited set of checks that we know go
really fast and have a high true-positive rate?


Luke Heath
[6 minutes
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677092062859149?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
That's a good idea. FWIW we'll be removing e2e test runs in CI later
this week, which will reduce the CI run time by ~25 minutes.


mikermcneil
[< 1 minute
ago](https://fleetdm.slack.com/archives/C01EZVBHFHU/p1677092432337109?thread_ts=1677091575.384279&cid=C01EZVBHFHU)
This is not the first time this has happened and I'd like to put an end
to the emergency remediation that takes a chunk of the day's focus away
from multiple people each time it occurs. If it causes a drain on our
ability to move quickly, let's def change it back. If it's worth the
friction (like the PR approval restriction), then we can keep it.
I'm running into the problem of being able to select the "test-website"
job from [this
list](https://github.com/fleetdm/fleet/settings/branch_protection_rules/18283834),
likely because it is already conditional:
image.png
2023-02-22 13:00:45 -06:00