Skip to content
Benchmarks

redact-secret · Report · Detector

GitHub tokens

  • 201 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Re-checked 2026-09-20 (#46): docs.github.com also documents github_pat_ (fine-grained token) as a real, different prefix outside this contract's ghp_/gho_/ghu_/ghs_/ghr_ set, backing a prefix twin. github.blog/security/application-security/behind-githubs-new-authentication-token-formats confirms the parenthetical checksum claim (CRC32, Base62-encoded, last six characters) but the checksum is not part of this contract's lexical pattern, so a checksum-only mutation still satisfies it and cannot be constructed as a twin here.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of GitHub tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Provider-documented4False alarmsinsufficient-evidence0 of 4 controls flagged4 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must not flag · Tool-corroborated54False alarmsat most 6.6%0 of 54 controls flagged54 quiet · 0 flagged
  • flare-redact at most 6.6%
  • gitleaks at most 6.6%
  • trufflehog at most 15.1%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 29.9%
  • trufflehog at most 29.9%
Must redact · Provider-documented96Secret spans left readableat most 3.7%0 of 101 spansNear-twins told apartat least 92.7%49 of 49 pairs101 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 12.4%
  • gitleaks at most 23.1%
  • trufflehog at most 39.2%
Project policy · Project policy35Secret spans left readableat most 8.0%0 of 44 spans44 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 8.0%
  • gitleaks at most 95.0%
  • trufflehog at most 100.0%
Pending review3UnscoredNot scoredInspect only: never scored until evidence existsNot scored
201 of 201 rows
Fixtures
201
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

201 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in GitHub tokens
FixtureKind and evidenceredact-secret
github-tokenauthored-github · early-filler-token-assignmentsProject policyT3 · Project policyRedacted
quoted-tokenauthored-github · early-filler-token-contextsProject policyT3 · Project policyRedacted
unicode-prefixauthored-github · early-filler-token-contextsProject policyT3 · Project policyRedacted
github-classic-pat-base-acontext-and-large-input-bases-authored · environment-assignmentProject policyT3 · Project policyRedacted
github-classic-pat-base-bcontext-and-large-input-bases-authored · environment-assignmentProject policyT3 · Project policyRedacted
github-classic-pat-bare-valuecontext-carrier-projections-generated · value-at-input-edgesProject policyT3 · Project policyRedacted
github-classic-pat-bearer-headercontext-carrier-projections-generated · partial-span-leakageProject policyT3 · Project policyRedacted
github-classic-pat-bom-prefixcontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
github-classic-pat-crlf-linescontext-carrier-projections-generated · crlf-line-endingsProject policyT3 · Project policyRedacted
github-classic-pat-emoji-prefixcontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
github-classic-pat-json-fieldcontext-carrier-projections-generated · structured-text-valueProject policyT3 · Project policyRedacted
github-classic-pat-korean-text-prefixcontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
github-classic-pat-log-linecontext-carrier-projections-generated · environment-assignmentProject policyT3 · Project policyRedacted
github-classic-pat-markdown-code-spancontext-carrier-projections-generated · markdown-and-comment-valueProject policyT3 · Project policyRedacted
github-classic-pat-nbsp-before-valuecontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
github-classic-pat-shell-export-quotedcontext-carrier-projections-generated · quoted-value-extentProject policyT3 · Project policyRedacted
github-classic-pat-url-querycontext-carrier-projections-generated · partial-span-leakageProject policyT3 · Project policyRedacted
github-classic-pat-xml-elementcontext-carrier-projections-generated · structured-text-valueProject policyT3 · Project policyRedacted
github-classic-pat-yaml-scalarcontext-carrier-projections-generated · structured-text-valueProject policyT3 · Project policyRedacted
default-literaldocker-compose-resolution-authored · compose-default-value-holds-literal-credentialMust redactT1 · Provider-documentedRedacted
resolved-config-literaldocker-compose-resolution-authored · compose-resolved-config-renders-referenced-credentialMust redactT1 · Provider-documentedRedacted
installation-token-lifetime-noteenvironment-and-test-values-authored · app-installation-token-with-one-hour-lifetime-noteProject policyT3 · Project policyRedacted
github-token-ghp-prefix-plain-twingithub · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
github-token-ghp-prefix-unicode-crlf-twingithub · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
github-token-short-body-35-twingithub · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
add-mask-literal-argumentgithub-actions-workflow-commands-authored · workflow-command-literal-credential-in-command-textMust redactT1 · Provider-documentedRedacted
base-tokengithub-actions-workflow-commands-authored · workflow-command-literal-credential-in-command-textMust redactT1 · Provider-documentedRedacted
env-file-echogithub-actions-workflow-commands-authored · workflow-command-literal-credential-in-command-textMust redactT1 · Provider-documentedRedacted
multiline-record-eof-delimitergithub-actions-workflow-commands-authored · workflow-command-file-multiline-record-valueMust redactT1 · Provider-documentedRedacted
multiline-record-guid-delimitergithub-actions-workflow-commands-authored · workflow-command-file-multiline-record-valueMust redactT1 · Provider-documentedRedacted
multiline-record-written-by-brace-groupgithub-actions-workflow-commands-authored · workflow-command-file-multiline-record-valueMust redactT1 · Provider-documentedRedacted
output-file-echogithub-actions-workflow-commands-authored · workflow-command-literal-credential-in-command-textMust redactT1 · Provider-documentedRedacted
base-opaquegithub-installation-token-authored · opaque-installation-token-forty-characters-literalMust redactT1 · Provider-documentedRedacted
base-stateless-agithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
base-stateless-bgithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
projection-opaque-crlfgithub-installation-token-authored · opaque-installation-token-forty-characters-literalMust redactT1 · Provider-documentedRedacted
projection-opaque-envgithub-installation-token-authored · opaque-installation-token-forty-characters-literalMust redactT1 · Provider-documentedRedacted
projection-opaque-jsongithub-installation-token-authored · opaque-installation-token-forty-characters-literalMust redactT1 · Provider-documentedRedacted
projection-stateless-a-authorizationgithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
projection-stateless-a-crlfgithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
projection-stateless-a-git-urlgithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
projection-stateless-a-jsongithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
projection-stateless-a-korean-emojigithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
projection-stateless-b-envgithub-installation-token-authored · stateless-jwt-installation-token-literalMust redactT1 · Provider-documentedRedacted
github-classic-pat-head-of-1miblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
github-classic-pat-head-of-256kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
github-classic-pat-head-of-64kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
github-classic-pat-middle-of-1miblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
github-classic-pat-middle-of-256kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
github-classic-pat-middle-of-64kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted