Commit Graph
254 Commits
Author SHA1 Message Date
Andrey KizimenkoandNoah Talerman 700370a298 Add universal QA checks and improve confirmation guidance in test plan template (#41613)
## Summary

Updates the test plan template to include a set of optional, reusable
testing sections that help ensure broader and more consistent test
coverage across features.

New sections:

- Core flow
- UI
- API
- GitOps
- Permissions
- Edge cases
- Supplemental testing

The goal is to make it easier for teams to reliably consider these areas
without requiring every issue to manually outline them.

## Core flow ownership

The **Core flow** section represents the original test plan content that
Product typically outlined for a user story. It captures the primary
feature behavior and expected functionality that must work for the story
to be considered complete.

This section is owned by **Product** and should describe the main user
flow and expected outcomes, similar to how the test plan was previously
documented.

## Edge case ownership

The **Edge cases** section is owned by **QA**, or shared between QA and
Product when Product wants QA to validate specific scenarios.

This helps ensure that less obvious scenarios (invalid inputs, boundary
conditions, missing configuration, etc.) are explicitly considered
rather than overlooked.

## Optional sections

Sections such as UI, API, GitOps, and Permissions are intentionally
designed to be **optional**.
They can be removed when they are not applicable to the feature being
implemented.

These sections act as reminders for areas that frequently require
validation in Fleet.

## Confirmation improvements

The **Confirmation** section has also been expanded to encourage
engineers to include any special setup or test data used during
development.

Providing this context helps QA reproduce the setup faster and reduces
time spent recreating test environments.

---------

Co-authored-by: Noah Talerman <47070608+noahtalerman@users.noreply.github.com>
2026-03-16 13:01:06 -06:00
Andrey Kizimenko 241d63895d Revise Release QA checklist (#41609)
Changes:
1. Adding Fleet free checks for each product group
2. Adding UI/UX checks for each product group
3. Expanding the IdP coverage and moving it to orchestration (postmortem
action item: https://github.com/fleetdm/fleet/issues/39684)
4. Moving Certificates to S&C
5. Adjusting assignee list
2026-03-16 10:27:07 -06:00
Andrey KizimenkoandBrayan Jimenez 561efeba21 Split "Fleet version" into Discovered and Reproduced fields in bug template (#41612)
Replaces the single **Fleet version** field in the bug template with two
fields:

- **Discovered** – the Fleet version where the issue was first observed
- **Reproduced** – the Fleet version, where we confirmed the issue can
also be reproduced

Co-authored-by: Brayan Jimenez <137363326+Brajim20@users.noreply.github.com>
2026-03-12 20:01:14 -04:00
Noah Talerman 09590bc6e2 "Teams" => "fleets", "queries" => "reports" doc changes (#39585) 2026-03-11 23:41:14 -05:00
Luke Heath 6981a740bc Update story template to remove QA header (#40814) 2026-03-02 11:17:24 -06:00
Lucas Manuel Rodriguez e7d967f022 Update release QA for fleetd (#40219)
To prevent P0s like https://github.com/fleetdm/fleet/issues/40200 in the
future.
2026-02-20 19:27:28 -03:00
Noah Talerman efc67f8d09 Remove automation for audit-logs.md (#39937)
- Instead, changes to activity will be specified as a PR to
`audit-logs.md` in the reference doc release branch just like API and
YAML (GitOps) changes
2026-02-18 09:16:57 -05:00
Lucas Manuel Rodriguez 89425cb441 Fix template and while we're at it, typos (#39956) 2026-02-17 15:45:59 -06:00
Steven PalmesanoandIsabell Reedy 0b149701cc Create a task for a CSA (#39298)
Discussed at
https://fleetdm.slack.com/archives/C062D0THVV1/p1770164068675939?thread_ts=1770160046.178359&cid=C062D0THVV1

---------

Co-authored-by: Isabell Reedy <113355639+ireedy@users.noreply.github.com>
2026-02-06 12:15:21 +00:00
Reed Haynes b652a4285d Enhance release QA template with UI testing steps (#39267)
Added steps to confirm UI functionality and updated testing
instructions.

Small template change.
2026-02-05 13:35:58 +00:00
melpike 33e5fe2599 Update permissions changes link in story template (#39336)
Updated permissions changes section to include a link to the
documentation for easy reference.

The term "Manage access" isn't referenced on the permissions/role-based
access page, and it wasn't clear in a search of the docs that you should
go to the role-based access doc. Using redirect url and term
"permissions" in case we change the name of this doc again in the
future.
2026-02-05 13:31:31 +00:00
Noah Talerman d5ba60db3e Create "quick win" issue template and update handbook (#39081) 2026-02-03 13:06:51 -06:00
Noah Talerman d463c3e44e Update story template (#38997) 2026-01-29 16:28:03 -06:00
Ian Littman 37c09ecf34 Drop performance issue comment about debug archive (#38978) 2026-01-29 16:21:20 -06:00
Andrey Kizimenko 5659251b70 Add new QA Engineers to the Release QA template (#38873) 2026-01-28 13:45:23 -06:00
Noah Talerman 26c534878f Story template: Remove "Roadmap item" and "Resources" section (#38838) 2026-01-27 09:14:15 -06:00
Noah Talerman 07d44f9b95 Update story template (#38738) 2026-01-26 15:27:39 -06:00
Noah Talerman 23e8444e34 Feature request template (#38571) 2026-01-21 10:06:41 -06:00
Lucas Manuel Rodriguez 0b884a609d Update instructions to not use main for testing/building fleetd before push to edge (#38515) 2026-01-21 09:58:15 -06:00
Ian Littman 8c9e9e2ccb Add database migration performance test to release QA template (#38407) 2026-01-15 16:47:25 -06:00
Ian Littman 67aab3625c Add story template item for pre-QA load test by engineers on high risk stories (#38365)
For #35367.
2026-01-15 09:53:50 -06:00
Noah Talerman b13e5fab3f Add interpretation section to feature request template (#38317)
Based on feedback:
https://fleetdm.slack.com/archives/C062D0THVV1/p1768403785790319?thread_ts=1768338830.048449&cid=C062D0THVV1
2026-01-14 17:52:34 -05:00
Noah Talerman 446856112c Revise feature request template instructions: Be more explicit for Fleeties (#38290) 2026-01-13 18:13:08 -06:00
Noah Talerman b6095ab5a6 Simplify feature request template & update "Unpacking the why" (#38243) 2026-01-13 14:35:44 -06:00
Noah Talerman bbc1aef298 Update story template: Add Fleet server config, exposed API endpoints, and fleetdm.com checkboxes (#38186) 2026-01-13 14:28:49 -06:00
Katheryn Satterlee 9b744ea67d Update bug report template for clarity (#35284)
Clarified steps to reproduce section in bug report template.

# Checklist for submitter

Docs-only change
2025-11-20 17:42:39 -06:00
Sam Pfluger 4d0fba76ff Redistribute QA responsibilities (#35779) 2025-11-14 14:00:55 -06:00
1c1e19197c Contributing Fleet-maintained apps (#35235)
- Simplify steps. Why? Fewer handoffs / approvals
- #g-software EM reviews all PRs within 3 business days
- Commit to automated tests. No need to do manual testing because the CI
already installs the app and checks, via osquery, if the
install/uninstalls worked
- Remove issue template

Why now?
- https://github.com/fleetdm/confidential/issues/12844

---------

Co-authored-by: Martin Angers <martin.n.angers@gmail.com>
Co-authored-by: George Karr <georgekarrv@users.noreply.github.com>
2025-11-14 10:12:24 -06:00
Ian Littman 5d98ea9347 Add GitOps and generate-gitops smoke tests to release QA (#35303)
Action item from the #33677 / #34527 postmortem.
2025-11-11 13:32:08 -06:00
Sam Pfluger a59b5d2d5b Removing access (#35480) 2025-11-10 18:08:14 -06:00
Noah Talerman 1554e8b265 New bugs go to Product Designer before QA (#35133) 2025-11-06 09:42:37 -06:00
Noah Talerman b4cf896545 Story template: Add "hosted environment" to QA section (#35132) 2025-11-05 16:08:16 -06:00
Luke Heath b8f6a4c46b Simplify OS updates verification steps (#35010) 2025-10-30 13:46:06 -05:00
Marko Lisica 71eda16d17 Update Product Designer responsibilities for stories drafted by another designer (#34600)
- Product group Product Designers are DRI for all stories/bugs that
their group implements
- Rename "Context" to "Resources" in story template. Today, we're using
it for resources
2025-10-22 09:47:09 -04:00
Gabe Lopez df176aa047 Update release-qa.md MDM tests (#34470)
added the following to the MDM smoke tests:

- account-driven user enrollments for iOS/iPadOS
- Windows Autopilot enrollments
- Android tests
- Certificate Authorities
- IdP provisioning SCIM
2025-10-21 08:17:36 -07:00
Noah Talerman 34049215c7 Tech leads are the DRIs (#34437) 2025-10-17 10:14:37 -04:00
Andrey Kizimenko cff96a24f5 Modify Release QA template to include Security and compliance (#34406) 2025-10-16 17:22:27 -05:00
Marko LisicaandNoah Talerman 02c75f516e [Update story template] Add name for the type filter in the activity feed (#33856)
- We're adding an option to filter the activity feed on the dashboard,
and we introduced a dropdown to filter by activity type. We want to use
more human friendly names.

e.g. `edited_macos_min_version` -> "OS updates: edited macOS"

---------

Co-authored-by: Noah Talerman <47070608+noahtalerman@users.noreply.github.com>
2025-10-06 09:42:05 -04:00
Noah Talerman 3d73adfc5c User story template: Add "Usage statistics" checkbox (#33289)
Consider adding usage statistics as part of every user story. PRs
(wireframes) should be made to the JSON object in the usage statistics
guide:
https://fleetdm.com/guides/fleet-usage-statistics#what-is-included-in-usage-statistics-in-fleet



Why did this come up now? We're having to spend a lot of time to figure
out which customers to notify re breaking changes to the certificate
authorities (CAs) YAML:
https://docs.google.com/document/d/1w8_q4HyehCIoG1xDc-vD91xkBVajwbYbX_mwQWUtu9A/edit?tab=t.0
2025-09-23 18:49:46 -04:00
Sharon Katz 83fb73a5a8 Add a checkbox for premium dev (#33043) 2025-09-17 09:33:58 -05:00
Ian Littman 197c14f722 Add smoke test item, QA considerations for testing Fleet Desktop with Fleet Free (#32805) 2025-09-10 13:53:51 -05:00
Ian Littman 49b1dcdb3c Fix broken HTML comment in story template for osquery/load testing (#31892) 2025-08-13 21:40:27 -05:00
Sam PflugerandEric f2df737a0b Create CEO and People pages and reorg (#31559)
<ins>*🌐 IT and Enablement:*</ins>
- Rename "🌐 Digital Experience" to "🌐 IT and Enablement" dept
- Rename "digital-experience.rituals.yml" to
"it-and-enablement.rituals.yml"

<ins>*🧑‍🚀 People*</ins>
- Create 🧑‍🚀 People dept
  - Create "people.rituals.yml"

<ins>*🔭 CEO*</ins> (<= WHY? To maintain the [structure of the
handbook](https://fleetdm.com/handbook/company/leadership#outline-of-departmental-page-structure).)
- Create 🔭 CEO page and link to leadership
- Create ceo.rituals.yml

<ins>*💸 Finance*</ins>
- Renamed label "#g-finance" to ":help-finance" to match the rest of the
departmental labels.

---------

Co-authored-by: Eric <eashaw@sailsjs.com>
2025-08-04 13:07:18 -05:00
Sam Pfluger 2fd248c77a Update website-request.md (#31544) 2025-08-01 19:41:32 -05:00
Rachael Shaw 91c076eb9d Update bug report template (#31465)
Moved "To fix" toward the top so it's harder to miss in estimation
sessions. Also uncommented so it's always visible.
2025-07-31 15:59:58 -05:00
Noah Talerman 33062791e4 Story template (#31340) 2025-07-29 07:41:39 -05:00
Gabe Lopez a44403a4d9 Update release-qa.md (#31242)
adding MDM tests for windows mdm migration, iPhone/iPadOS turning MDM
off, Locking & Wiping hosts
2025-07-24 12:48:59 -07:00
Ian Littman cab2af30d6 Move osquery-perf changes from PR template to story template, include load test environment changes in scope (#31153)
This attempts to surface load test environment work (e.g. allowing
configuring Cloudfront in a load test environment, or adding
osquery-perf improvements) while spec'ing stories rather than catching
at the QA stage, allowing us to properly estimate effort and parallelize
work.
2025-07-22 18:41:47 -04:00
Noah Talerman b8f75b2b96 New 🗺️ Roadmap board (#30919) 2025-07-16 11:43:28 -06:00
814d7cfda0 Update FMA contributor docs (#30551)
Updating FMA process for adding new apps by internal and external
contributors. Goals:
- A fast-track experience for contributors if the app does not have
complications (don't need to wait for issue prioritization)
- As few handoffs as possible

---------

Co-authored-by: Ian Littman <iansltx@gmail.com>
Co-authored-by: Marko Lisica <83164494+marko-lisica@users.noreply.github.com>
2025-07-10 11:13:11 -06:00