Skip to content
Benchmarks

redact-secret · Report · Detector

OpenRouter API keys

  • 32 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Graduated arrival evidence (#208, registry detector since redact-secret#727; research #220). A mixed-evidence contract: the prefix and the 64-lowercase-hex body are provider-stated in a guardrail detection description and match the provider's create-key example, and every peer rule agrees. Management keys (sk-or-mgmt-) are openrouter:management-api-key, not members of this family, and are never used as benign controls. The public key hash shares the body shape without the prefix.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of OpenRouter API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated12False alarmsat most 24.3%0 of 12 controls flagged12 quiet · 0 flagged
  • flare-redact at most 24.3%
  • gitleaks at most 35.4%
  • trufflehog at most 24.3%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Provider-documented12Secret spans left readableat most 24.3%0 of 12 spansNear-twins told apartat least 61.0%6 of 6 pairs12 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 24.3%
  • gitleaks at most 60.9%
  • trufflehog at most 24.3%
32 of 32 rows
Fixtures
32
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

32 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in OpenRouter API keys
FixtureKind and evidenceredact-secret
openrouter-api-key-bearer-long-body-twinopenrouter · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
openrouter-api-key-chat-pasteopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-key-shape-bareopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-key-shape-quotedopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-key-shape-unicode-crlfopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-base64-config-encoded-valueopenrouter · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
openrouter-api-key-bearer-headeropenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-composeopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-compose-half-body-twinopenrouter · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
openrouter-api-key-create-key-responseopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-docs-proseopenrouter · prose-mentionMust not flagT3 · Project policyQuiet
openrouter-api-key-envopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-env-lookup-referenceopenrouter · templated-referenceMust not flagT3 · Project policyQuiet
openrouter-api-key-env-short-body-twinopenrouter · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
openrouter-api-key-env-template-placeholderopenrouter · documentation-placeholderMust not flagT3 · Project policyQuiet
openrouter-api-key-exportopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-guardrail-marker-placeholderopenrouter · documentation-placeholderMust not flagT3 · Project policyQuiet
openrouter-api-key-key-hash-public-idopenrouter · public-identifierMust not flagT2 · Tool-corroboratedQuiet
openrouter-api-key-label-proseopenrouter · benign-lookalikeMust not flagT3 · Project policyQuiet
openrouter-api-key-maskopenrouter · benign-lookalikeMust not flagT3 · Project policyQuiet
openrouter-api-key-masked-label-placeholderopenrouter · documentation-placeholderMust not flagT3 · Project policyQuiet
openrouter-api-key-openai-compatibleopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-openai-non-hex-body-twinopenrouter · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
openrouter-api-key-openrouter-sdkopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-prefix-check-near-missopenrouter · format-near-missMust not flagT2 · Tool-corroboratedQuiet
openrouter-api-key-prefix-onlyopenrouter · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
openrouter-api-key-printenvopenrouter · documented-format-literalMust redactT1 · Provider-documentedRedacted
openrouter-api-key-printenv-glued-twinopenrouter · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
openrouter-api-key-referenceopenrouter · benign-lookalikeMust not flagT3 · Project policyQuiet
openrouter-api-key-sdk-wrong-prefix-twinopenrouter · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
openrouter-api-key-short-bodyopenrouter · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
openrouter-api-key-user-and-models-public-idopenrouter · public-identifierMust not flagT2 · Tool-corroboratedQuiet