Skip to content
Benchmarks

redact-secret · Report · Detector

openai-admin-api-key

  • 43 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#384, product redact-secret#863; research #777). T2: no OpenAI documentation states a length or alphabet for sk-admin- keys. Gitleaks corroborates the marker-bearing 58 + T3BlbkFJ + 58 shape with three test vectors, trufflehog 3.97.4 matches exactly that shape in its dedicated openaiadmin detector (PR #4689, which is why the generic openai detector skips sk-admin-: a move, not an exclusion; corrected by redact-secret#1013), and openai/codex fixes the prefix set and the T3BlbkFJ watermark for the OpenAI family. The product decision recorded in redact-secret#863 contracts sk-admin- under the same marker-gated 58/74-byte grammar as sk-proj- and sk-svcacct-, so the shipped detector admits 58/58 and 74/74 and no mixed width. The benchmark claim is 58/58 only (redact-secret#1013): no source anywhere shows a 74/74 admin value, so 74/74 is outside the claim and no fixture asserts it either way, while the product keeps accepting it (security-first). No source shows a 74/74 admin value: only the gitleaks union shared with sk-proj-/sk-svcacct- admits it, while trufflehog openaiadmin, nuclei-templates and poltergeist admit 58/58 only (redact-secret#1013 recommends taking 74/74 out of the positive set). A marker-less sk-admin- body (the 124-character trufflehog request) is out of contract: no source shows such a key, so it is authored as a negative twin, and the product accepts a false negative for it when bare or in unquoted env, YAML or tool-call text.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of openai-admin-api-key fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated16False alarmsat most 19.4%0 of 16 controls flagged16 quiet · 0 flagged
  • flare-redact at most 55.6%
  • gitleaks at most 43.0%
  • trufflehog at most 19.4%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Tool-corroborated19Secret spans left readableat most 16.8%0 of 19 spansNear-twins told apartinsufficient-coverage9 of 9 pairs19 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 94.5%
  • gitleaks at most 24.6%
  • trufflehog at most 24.6%
43 of 43 rows
Fixtures
43
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

43 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in openai-admin-api-key
FixtureKind and evidenceredact-secret
openai-admin-api-key-actions-usage-exportopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-admn-prefix-twinopenai · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-compose-envopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-config-tomlopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-curl-beareropenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-dotenvopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-exportopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-first-segment-57-twinopenai · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-gitlab-ci-variablesopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-go-constopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-json-configopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-key-digest-encoded-valueopenai · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
openai-admin-api-key-lowercase-marker-twinopenai · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-markerless-test-name-near-missopenai · format-near-missMust not flagT2 · Tool-corroboratedQuiet
openai-admin-api-key-oncall-handoffopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-powershell-envopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-prefix-only-near-missopenai · format-near-missMust not flagT2 · Tool-corroboratedQuiet
openai-admin-api-key-python-requests-headersopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-python-sdkopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-requests-debugopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-short-second-segment-twinopenai · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-tfvars-admin-keyopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-tool-callopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-ts-clientopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-usage-cli-flagopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-usage-logopenai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
openai-admin-api-key-actions-secret-referenceopenai · templated-referenceMust not flagT3 · Project policyQuiet
openai-admin-api-key-admin-keys-listing-public-idopenai · public-identifierMust not flagT2 · Tool-corroboratedQuiet
openai-admin-api-key-console-mask-placeholderopenai · documentation-placeholderMust not flagT3 · Project policyQuiet
openai-admin-api-key-docs-ellipsis-placeholderopenai · documentation-placeholderMust not flagT3 · Project policyQuiet
openai-admin-api-key-embedded-leading-twinopenai · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-env-reference-referenceopenai · templated-referenceMust not flagT3 · Project policyQuiet
openai-admin-api-key-inside-identifier-near-missopenai · format-near-missMust not flagT2 · Tool-corroboratedQuiet
openai-admin-api-key-key-resource-public-idopenai · public-identifierMust not flagT2 · Tool-corroboratedQuiet
openai-admin-api-key-marker-fk-twinopenai · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-marker-less-body-twinopenai · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-org-and-project-public-idopenai · public-identifierMust not flagT2 · Tool-corroboratedQuiet
openai-admin-api-key-permissions-paragraph-proseopenai · prose-mentionMust not flagT3 · Project policyQuiet
openai-admin-api-key-prefix-guidance-proseopenai · prose-mentionMust not flagT3 · Project policyQuiet
openai-admin-api-key-secrets-manager-arn-referenceopenai · templated-referenceMust not flagT3 · Project policyQuiet
openai-admin-api-key-short-first-segment-twinopenai · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-underscore-delimiter-twinopenai · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
openai-admin-api-key-your-key-here-placeholderopenai · documentation-placeholderMust not flagT3 · Project policyQuiet