Skip to content
Benchmarks

redact-secret · Report · Detector

github-fine-grained-pat

  • 40 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival contract (#211, research #223, observed 2026-09-24). T2, not T1: GitHub documents only the github_pat_ prefix; the 22 + "_" + 59 body positives depend on rests on a community grammar (discussion 36441, the magnetikonline gist) that a GitHub PM endorsed in-thread, and on exact-82 tool rules (gitleaks 8.30.1, Nosey Parker, secretlint). No checksum, fixed "11" lead or GHES parity is claimed. Twins mutate only properties no source admits (prefix spelling, case, the "_" separator, a non-alphanumeric byte, a glued leading letter); none mutates width, because TruffleHog and r-lib/gh accept 36–255 and GitHub's 2021 guidance says tokens may grow to 255. The product matches this shape inside its shared github-token detector, so a product finding on a twin is recorded as co-detection by that family, not as a false alarm for this one.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of github-fine-grained-pat fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated15False alarmsat most 20.4%0 of 15 controls flagged15 quiet · 0 flagged
  • flare-redact at most 20.4%
  • gitleaks at most 45.2%
  • trufflehog at most 29.8%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Tool-corroborated17Secret spans left readableat most 18.4%0 of 17 spansNear-twins told apartinsufficient-coverage8 of 8 pairs17 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 18.4%
  • gitleaks at most 18.4%
  • trufflehog at most 18.4%
40 of 40 rows
Fixtures
40
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

40 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in github-fine-grained-pat
FixtureKind and evidenceredact-secret
github-fine-grained-pat-audit-log-hashed-token-encoded-valuegithub · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
github-fine-grained-pat-git-remote-userinfo-boundary-twingithub · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-revocation-fingerprint-log-encoded-valuegithub · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
github-fine-grained-pat-terraform-provider-alphabet-twingithub · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-actions-envgithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-actions-secret-reference-referencegithub · templated-referenceMust not flagT3 · Project policyQuiet
github-fine-grained-pat-angle-placeholder-placeholdergithub · documentation-placeholderMust not flagT3 · Project policyQuiet
github-fine-grained-pat-audit-log-token-id-public-idgithub · public-identifierMust not flagT2 · Tool-corroboratedQuiet
github-fine-grained-pat-bearer-headergithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-bearer-header-case-twingithub · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-bearer-header-plus-alphabet-twingithub · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-command-substitution-referencegithub · templated-referenceMust not flagT3 · Project policyQuiet
github-fine-grained-pat-compose-renovategithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-composer-auth-jsongithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-composer-auth-json-separator-twingithub · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-curl-basic-authgithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-docs-sentence-prosegithub · prose-mentionMust not flagT3 · Project policyQuiet
github-fine-grained-pat-dotenv-gh-tokengithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-dotenv-gh-token-hyphen-prefix-twingithub · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-dotenv-gh-token-prefix-twingithub · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-expiry-variable-near-missgithub · format-near-missMust not flagT2 · Tool-corroboratedQuiet
github-fine-grained-pat-export-github-patgithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-gh-auth-logingithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-git-credential-fillgithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-git-remote-userinfogithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-gitlab-ci-mirrorgithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-go-oauth2-staticgithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-hub-configgithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-identifier-name-near-missgithub · format-near-missMust not flagT2 · Tool-corroboratedQuiet
github-fine-grained-pat-k8s-secret-stringdatagithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-masked-list-entry-placeholdergithub · documentation-placeholderMust not flagT3 · Project policyQuiet
github-fine-grained-pat-octokit-debug-loggithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-org-token-requests-listing-public-idgithub · public-identifierMust not flagT2 · Tool-corroboratedQuiet
github-fine-grained-pat-pygithub-auth-tokengithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-redacted-dotenv-placeholdergithub · documentation-placeholderMust not flagT3 · Project policyQuiet
github-fine-grained-pat-request-id-header-public-idgithub · public-identifierMust not flagT2 · Tool-corroboratedQuiet
github-fine-grained-pat-rotation-policy-prosegithub · prose-mentionMust not flagT3 · Project policyQuiet
github-fine-grained-pat-terraform-providergithub · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
github-fine-grained-pat-terraform-provider-prefix-separator-twingithub · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
github-fine-grained-pat-vault-kv-lookup-referencegithub · templated-referenceMust not flagT3 · Project policyQuiet