GitHub Actions Step Flake Audit

Use this skill to catch flaky CI steps that alternate between passing and failing across workflow runs.

What this skill does

• - Reads GitHub Actions run JSON exports (gh run view --json ...)
• Groups step outcomes by repository + workflow + job + step name
• Scores each step for flake risk when both success and failure outcomes are present
• Ranks the most unstable steps by failure rate and failed-run volume
• Supports text/json outputs and optional fail gate for CI enforcement

Inputs

• - RUN_GLOB (default: artifacts/github-actions/*.json)
• INLINECODE3 (default: 20)
• INLINECODE5 (text or json, default: text)
• INLINECODE9 (default: 3) — minimum observed step runs before scoring
• INLINECODE11 (default: 0.20) — flaky failure-rate threshold
• INLINECODE13 (default: 0.40) — critical flaky failure-rate threshold
• INLINECODE15 (0 or 1, default: 0)
• INLINECODE19 / REPO_EXCLUDE (regex, optional)
• INLINECODE21 / WORKFLOW_EXCLUDE (regex, optional)
• INLINECODE23 / JOB_EXCLUDE (regex, optional)
• INLINECODE25 / STEP_EXCLUDE (regex, optional)

Collect run JSON

CODEBLOCK0

Run

Text report:

CODEBLOCK1

JSON output + fail gate:

CODEBLOCK2

Run against bundled fixtures:

CODEBLOCK3

Output contract

• - Exit 0 in reporting mode (default)
• Exit 1 when FAIL_ON_CRITICAL=1 and one or more flaky step groups are critical
• Text mode prints summary + top flaky steps
• JSON mode prints summary + ranked groups + critical groups