Skip to content
Benchmarks

redact-secret · Report · Detector

RunPod API keys

  • 36 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#464, product redact-secret#974; #860 handoff runpod.md, READY with an open-ended body by ruling R10). T1: the prefix is the provider blog and the alphabet and provider floor of 16 are a provider-authored scrubber (R2). POLICY under R10, not T1: a floor of 16 would claim Redirect.pizza's rpa_ + 30 tokens, so project policy raises it to 31, the first width above that shape, and every RunPod width seen (46 empirical; a withdrawn 48-character docs example) is above it; the 128-byte upper bound is policy too (a bounded run for streaming; rejected whole, never truncated). The alphabet stays the provider's [A-Za-z0-9]. The contract pattern therefore carries the policy floor and the twin at 30 says POLICY; a body of 16-30 is an accepted false negative (none known), positives reach 128 and nothing asserts silence on 129. The 46-byte body and the 40-upper-plus-6-mixed layout are tool and empirical facts, so positives are authored with and without that layout. Excluded: Redirect.pizza rpa_ + 30 (another issuer), RunPod S3-compatible rps_ secrets and access keys (another credential), legacy unprefixed keys, and rpa_..., rpa_xxxx, rpa_your_key placeholders. A Redirect.pizza token of 31 or more bytes, if one exists, would read as RunPod: misattributed, still redacted. Graduated to a registry detector at the 4fb7882 re-pin (redact-secret PR #1037).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of RunPod API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated11False alarmsat most 25.9%0 of 11 controls flagged11 quiet · 0 flagged
  • flare-redact at most 25.9%
  • gitleaks at most 25.9%
  • trufflehog at most 25.9%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 29.9%
  • trufflehog at most 29.9%
Must redact · Provider-documented16Secret spans left readableat most 19.4%0 of 16 spansNear-twins told apartinsufficient-coverage7 of 7 pairs16 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 96.5%
  • gitleaks at most 66.8%
  • trufflehog at most 100.0%
36 of 36 rows
Fixtures
36
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

36 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in RunPod API keys
FixtureKind and evidenceredact-secret
runpod-api-key-bare-proserunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-bearer-headerrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-chat-pasterunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-curl-graphql-bearerrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-dotenvrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-exportrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-json-api-keyrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-json-tokenrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-key-shape-barerunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-key-shape-quotedrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-key-shape-unicode-crlfrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-mcp-envrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-python-modulerunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-runpodctl-configrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-sdk-kwargrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-x-api-key-headerrunpod · documented-format-literalMust redactT1 · Provider-documentedRedacted
runpod-api-key-actions-secret-referencerunpod · templated-referenceMust not flagT3 · Project policyQuiet
runpod-api-key-body-30-policy-floor-twinrunpod · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
runpod-api-key-ellipsis-placeholderrunpod · documentation-placeholderMust not flagT3 · Project policyQuiet
runpod-api-key-env-reference-referencerunpod · templated-referenceMust not flagT3 · Project policyQuiet
runpod-api-key-hyphen-prefix-twinrunpod · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
runpod-api-key-key-guidance-proserunpod · prose-mentionMust not flagT3 · Project policyQuiet
runpod-api-key-label-proserunpod · benign-lookalikeMust not flagT3 · Project policyQuiet
runpod-api-key-leading-glue-twinrunpod · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
runpod-api-key-leading-underscore-twinrunpod · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
runpod-api-key-maskrunpod · benign-lookalikeMust not flagT3 · Project policyQuiet
runpod-api-key-prefix-at-eol-near-missrunpod · format-near-missMust not flagT2 · Tool-corroboratedQuiet
runpod-api-key-prefix-onlyrunpod · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
runpod-api-key-referencerunpod · benign-lookalikeMust not flagT3 · Project policyQuiet
runpod-api-key-short-bodyrunpod · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
runpod-api-key-trailing-hyphen-twinrunpod · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
runpod-api-key-trailing-underscore-twinrunpod · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
runpod-api-key-truncated-near-missrunpod · format-near-missMust not flagT2 · Tool-corroboratedQuiet
runpod-api-key-uppercase-prefix-twinrunpod · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
runpod-api-key-word-fixture-placeholderrunpod · documentation-placeholderMust not flagT3 · Project policyQuiet
runpod-api-key-x-run-placeholderrunpod · documentation-placeholderMust not flagT3 · Project policyQuiet