Skip to content
Benchmarks

redact-secret · Report · Detector

GitLab tokens

  • 57 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Re-checked 2026-09-20 (#46): the same prefix table documents glpat- as shared by four token kinds (none the positive this contract covers) and lists gldt-, glrt-/glrtr-, glcbt- and others as the gl- stem's other members; the prefix twin instead breaks the gl- stem itself (xlpat- vs glpat-), since a mutation matching one of those other real prefixes (gldt-) was empirically not discriminated by the redact-secret scanner.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of GitLab tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated12False alarmsat most 24.3%0 of 12 controls flagged12 quiet · 0 flagged
  • flare-redact at most 24.3%
  • gitleaks at most 24.3%
  • trufflehog at most 24.3%
Must not flag · Project policy3False alarmsinsufficient-evidence0 of 3 controls flagged3 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must redact · Provider-documented11Secret spans left readableat most 25.9%0 of 11 spansNear-twins told apartat least 64.6%7 of 7 pairs11 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 25.9%
  • gitleaks at most 25.9%
  • trufflehog at most 25.9%
Project policy · Project policy31Secret spans left readableat most 8.8%0 of 40 spans40 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 8.8%
  • gitleaks at most 8.8%
  • trufflehog at most 100.0%
57 of 57 rows
Fixtures
57
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

57 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in GitLab tokens
FixtureKind and evidenceredact-secret
gitlab-legacy-pat-base-acontext-and-large-input-bases-authored · environment-assignmentProject policyT3 · Project policyRedacted
gitlab-legacy-pat-base-bcontext-and-large-input-bases-authored · environment-assignmentProject policyT3 · Project policyRedacted
gitlab-legacy-pat-bare-valuecontext-carrier-projections-generated · value-at-input-edgesProject policyT3 · Project policyRedacted
gitlab-legacy-pat-bearer-headercontext-carrier-projections-generated · partial-span-leakageProject policyT3 · Project policyRedacted
gitlab-legacy-pat-bom-prefixcontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
gitlab-legacy-pat-crlf-linescontext-carrier-projections-generated · crlf-line-endingsProject policyT3 · Project policyRedacted
gitlab-legacy-pat-emoji-prefixcontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
gitlab-legacy-pat-json-fieldcontext-carrier-projections-generated · structured-text-valueProject policyT3 · Project policyRedacted
gitlab-legacy-pat-korean-text-prefixcontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
gitlab-legacy-pat-log-linecontext-carrier-projections-generated · environment-assignmentProject policyT3 · Project policyRedacted
gitlab-legacy-pat-markdown-code-spancontext-carrier-projections-generated · markdown-and-comment-valueProject policyT3 · Project policyRedacted
gitlab-legacy-pat-nbsp-before-valuecontext-carrier-projections-generated · multibyte-text-offsetsProject policyT3 · Project policyRedacted
gitlab-legacy-pat-shell-export-quotedcontext-carrier-projections-generated · quoted-value-extentProject policyT3 · Project policyRedacted
gitlab-legacy-pat-url-querycontext-carrier-projections-generated · partial-span-leakageProject policyT3 · Project policyRedacted
gitlab-legacy-pat-xml-elementcontext-carrier-projections-generated · structured-text-valueProject policyT3 · Project policyRedacted
gitlab-legacy-pat-yaml-scalarcontext-carrier-projections-generated · structured-text-valueProject policyT3 · Project policyRedacted
gitlab-legacy-pat-head-of-1miblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-head-of-256kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-head-of-64kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-middle-of-1miblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-middle-of-256kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-middle-of-64kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-tail-of-1miblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-tail-of-256kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-tail-of-64kiblarge-and-repeated-input-projections-generated · credential-after-long-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-three-occurrences-in-1miblarge-and-repeated-input-projections-generated · multiple-credentials-per-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-three-occurrences-in-256kiblarge-and-repeated-input-projections-generated · multiple-credentials-per-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-three-occurrences-in-64kiblarge-and-repeated-input-projections-generated · multiple-credentials-per-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-two-distinct-keys-in-1miblarge-and-repeated-input-projections-generated · multiple-credentials-per-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-two-distinct-keys-in-256kiblarge-and-repeated-input-projections-generated · multiple-credentials-per-inputProject policyT3 · Project policyRedacted
gitlab-legacy-pat-two-distinct-keys-in-64kiblarge-and-repeated-input-projections-generated · multiple-credentials-per-inputProject policyT3 · Project policyRedacted
prefix-onlycross-provider · bare-prefixes-and-truncated-tokensMust not flagT2 · Tool-corroboratedQuiet
gitlab-1gitlab · documented-format-literalMust redactT1 · Provider-documentedRedacted
gitlab-1-twingitlab · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
gitlab-2gitlab · documented-format-literalMust redactT1 · Provider-documentedRedacted
gitlab-2-twingitlab · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
gitlab-3gitlab · documented-format-literalMust redactT1 · Provider-documentedRedacted
gitlab-3-twingitlab · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
gitlab-token-ci-predefined-ids-public-idgitlab · public-identifierMust not flagT2 · Tool-corroboratedQuiet
gitlab-token-expiry-note-prosegitlab · prose-mentionMust not flagT3 · Project policyQuiet
gitlab-token-glab-auth-logingitlab · documented-format-literalMust redactT1 · Provider-documentedRedacted
gitlab-token-maskgitlab · benign-lookalikeMust not flagT3 · Project policyQuiet
gitlab-token-pat-plaingitlab · documented-format-literalMust redactT1 · Provider-documentedRedacted
gitlab-token-pat-plain-twingitlab · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
gitlab-token-pat-prefix-plain-twingitlab · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
gitlab-token-pat-prefix-unicode-crlf-twingitlab · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
gitlab-token-pat-unicode-crlfgitlab · documented-format-literalMust redactT1 · Provider-documentedRedacted
gitlab-token-pat-unicode-crlf-twingitlab · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
gitlab-token-prefix-onlygitlab · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
gitlab-token-private-token-headergitlab · documented-format-literalMust redactT1 · Provider-documentedRedacted