Skip to content
Benchmarks

redact-secret · Report · Detector

helicone-write-api-key

  • 36 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#434, product redact-secret#907; #860 handoff helicone.md, READY). The write-only key can send requests and logs into the org; no provider source says it is safe to publish (unlike PostHog phc_ or Stripe pk_), so the handoff detects and redacts it under its own type, which a user policy can downgrade. It may appear in the gateway URL path (https://gateway.helicone.ai/<key>/v1/), where / delimits it. Neither pinned peer has a Helicone rule.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of helicone-write-api-key fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated19False alarmsat most 16.8%0 of 19 controls flagged19 quiet · 0 flagged
  • flare-redact at most 16.8%
  • gitleaks at most 24.6%
  • trufflehog at most 16.8%
Must not flag · Project policy5False alarmsat most 43.4%0 of 5 controls flagged5 quiet · 0 flagged
  • flare-redact at most 43.4%
  • gitleaks at most 43.4%
  • trufflehog at most 43.4%
Must redact · Provider-documented12Secret spans left readableat most 24.3%0 of 12 spansNear-twins told apartat least 78.5%14 of 14 pairs12 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 91.1%
  • gitleaks at most 100.0%
  • trufflehog at most 100.0%
36 of 36 rows
Fixtures
36
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

36 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in helicone-write-api-key
FixtureKind and evidenceredact-secret
helicone-write-api-key-bare-prosehelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-bearer-headerhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-chat-pastehelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-digest-encoded-valuehelicone · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
helicone-write-api-key-dotenvhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-exporthelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-gateway-url-pathhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-helicone-authhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-json-api-keyhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-json-tokenhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-openai-default-headershelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-sdk-kwarghelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-x-api-key-headerhelicone · documented-format-literalMust redactT1 · Provider-documentedRedacted
helicone-write-api-key-angle-placeholderhelicone · documentation-placeholderMust not flagT3 · Project policyQuiet
helicone-write-api-key-customer-portal-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-dot-in-group-twinhelicone · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-ellipsis-placeholderhelicone · documentation-placeholderMust not flagT3 · Project policyQuiet
helicone-write-api-key-env-reference-referencehelicone · templated-referenceMust not flagT3 · Project policyQuiet
helicone-write-api-key-five-groups-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-group-of-6-twinhelicone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-group-of-8-twinhelicone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-leading-glue-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-legacy-bare-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-provider-segment-glued-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-python-environ-referencehelicone · templated-referenceMust not flagT3 · Project policyQuiet
helicone-write-api-key-request-id-public-idhelicone · public-identifierMust not flagT2 · Tool-corroboratedQuiet
helicone-write-api-key-role-guidance-prosehelicone · prose-mentionMust not flagT3 · Project policyQuiet
helicone-write-api-key-segment-order-twinhelicone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-three-groups-twinhelicone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-trailing-glue-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-truncated-near-misshelicone · format-near-missMust not flagT2 · Tool-corroboratedQuiet
helicone-write-api-key-underscore-separator-in-path-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-underscore-separators-twinhelicone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-uppercase-byte-twinhelicone · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
helicone-write-api-key-urls-public-idhelicone · public-identifierMust not flagT2 · Tool-corroboratedQuiet
helicone-write-api-key-word-groups-near-misshelicone · format-near-missMust not flagT2 · Tool-corroboratedQuiet