Skip to content
Benchmarks

redact-secret · Report · Detector

xAI API keys

  • 41 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Graduated arrival evidence (#208, registry detector since redact-secret#727; research #216). T2: the xai- prefix is provider-documented, but the 80-character body rests on the provider's one example value and a third-party masked key, corroborated by tool rules; xAI states no length or alphabet in prose. Management keys are a separate credential and are not in this family.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of xAI API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated14False alarmsat most 21.5%0 of 14 controls flagged14 quiet · 0 flagged
  • flare-redact at most 54.6%
  • gitleaks at most 31.5%
  • trufflehog at most 21.5%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Tool-corroborated19Secret spans left readableat most 16.8%0 of 19 spansNear-twins told apartinsufficient-coverage8 of 8 pairs19 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 16.8%
  • gitleaks at most 63.7%
  • trufflehog at most 16.8%
41 of 41 rows
Fixtures
41
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

41 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in xAI API keys
FixtureKind and evidenceredact-secret
xai-api-key-bearer-long-body-twinxai · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
xai-api-key-chat-pastexai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-curl-chatxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-env-short-body-twinxai · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
xai-api-key-http-debugxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-key-shape-barexai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-key-shape-quotedxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-key-shape-unicode-crlfxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-litellm-half-body-twinxai · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
xai-api-key-openai-compatiblexai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-openai-dot-body-twinxai · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
xai-api-key-retry-logxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-short-body-twinxai · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
xai-api-key-vault-readxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-base64-config-encoded-valuexai · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
xai-api-key-bearer-headerxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-docs-prosexai · prose-mentionMust not flagT3 · Project policyQuiet
xai-api-key-envxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-env-grepxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-env-grep-glued-twinxai · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
xai-api-key-env-lookup-referencexai · templated-referenceMust not flagT3 · Project policyQuiet
xai-api-key-env-template-placeholderxai · documentation-placeholderMust not flagT3 · Project policyQuiet
xai-api-key-exportxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-json-profilexai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-k8s-secretxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-key-metadata-public-idxai · public-identifierMust not flagT2 · Tool-corroboratedQuiet
xai-api-key-label-prosexai · benign-lookalikeMust not flagT3 · Project policyQuiet
xai-api-key-litellm-configxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-maskxai · benign-lookalikeMust not flagT3 · Project policyQuiet
xai-api-key-masked-error-placeholderxai · documentation-placeholderMust not flagT3 · Project policyQuiet
xai-api-key-packages-and-models-public-idxai · public-identifierMust not flagT2 · Tool-corroboratedQuiet
xai-api-key-prefix-check-near-missxai · format-near-missMust not flagT2 · Tool-corroboratedQuiet
xai-api-key-prefix-letter-twinxai · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
xai-api-key-prefix-onlyxai · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
xai-api-key-redacted-api-placeholderxai · documentation-placeholderMust not flagT3 · Project policyQuiet
xai-api-key-referencexai · benign-lookalikeMust not flagT3 · Project policyQuiet
xai-api-key-short-bodyxai · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
xai-api-key-twin-base-dotenvxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-twin-base-tsxai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-vercel-aixai · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
xai-api-key-vercel-underscore-prefix-twinxai · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet