Skip to content
Benchmarks

redact-secret · Report · Detector

Helicone API keys

  • 45 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#434, product redact-secret#907; #860 handoff helicone.md, READY). The read-write key reads every logged prompt and response and administers the org. The provider validator regexes (R1) fix the prefix, segments and four 7-byte groups, the docs name the sk/pk/eu roles, and the server generator builds the proxy key. The alphabet is the provider's [a-z0-9] (R8). Excluded: the unattributable legacy bare sk- and -cp- forms (twins, since they are Helicone credentials outside the contract), -gov (unresolved, not authored) and the exact-width all-x placeholder (claimed by the contract, so neither positive nor control). Neither pinned peer has a Helicone rule. Graduated to a registry detector at the 1127bf9 re-pin (redact-secret PR #938).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Helicone API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated21False alarmsat most 15.5%0 of 21 controls flagged21 quiet · 0 flagged
  • flare-redact at most 22.7%
  • gitleaks at most 22.7%
  • trufflehog at most 15.5%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Provider-documented16Secret spans left readableat most 19.4%0 of 16 spansNear-twins told apartat least 78.5%14 of 14 pairs16 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 28.3%
  • gitleaks at most 100.0%
  • trufflehog at most 100.0%
45 of 45 rows
Fixtures
45
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

45 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Helicone API keys
FixtureKind and evidenceredact-secret
helicone-api-key-actions-envhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-bare-prosehelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-bearer-headerhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-chat-pastehelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-compose-envhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-digest-encoded-valuehelicone · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
helicone-api-key-dotenvhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-exporthelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-helicone-authhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-json-api-keyhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-json-tokenhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-key-shape-barehelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-key-shape-quotedhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-key-shape-unicode-crlfhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-openai-default-headershelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-sdk-kwarghelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-word-groups-near-misshelicone · format-near-missMust not flagT2 · Tool-corroboratedQuiet
helicone-api-key-x-api-key-headerhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-api-key-angle-placeholderhelicone · documentation-placeholderMust not flagT3 · Project policyQuiet
helicone-api-key-customer-portal-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-dot-in-group-twinhelicone · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-ellipsis-placeholderhelicone · documentation-placeholderMust not flagT3 · Project policyQuiet
helicone-api-key-env-reference-referencehelicone · templated-referenceMust not flagT3 · Project policyQuiet
helicone-api-key-five-groups-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-group-of-6-twinhelicone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-group-of-8-twinhelicone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-label-prosehelicone · benign-lookalikeMust not flagT3 · Project policyQuiet
helicone-api-key-leading-glue-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-legacy-bare-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-maskhelicone · benign-lookalikeMust not flagT3 · Project policyQuiet
helicone-api-key-prefix-onlyhelicone · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
helicone-api-key-provider-segment-glued-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-proxy-malformed-uuid-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-python-environ-referencehelicone · templated-referenceMust not flagT3 · Project policyQuiet
helicone-api-key-referencehelicone · benign-lookalikeMust not flagT3 · Project policyQuiet
helicone-api-key-request-id-public-idhelicone · public-identifierMust not flagT2 · Tool-corroboratedQuiet
helicone-api-key-role-guidance-prosehelicone · prose-mentionMust not flagT3 · Project policyQuiet
helicone-api-key-segment-order-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-short-bodyhelicone · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
helicone-api-key-three-groups-twinhelicone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-trailing-glue-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-truncated-near-misshelicone · format-near-missMust not flagT2 · Tool-corroboratedQuiet
helicone-api-key-underscore-separators-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-uppercase-byte-twinhelicone · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
helicone-api-key-urls-public-idhelicone · public-identifierMust not flagT2 · Tool-corroboratedQuiet