Skip to content
Benchmarks

redact-secret · Report · Detector

Fireworks AI API keys

  • 32 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Graduated arrival contract (registry detector since redact-secret#730). Lexical separability decided before authoring (#212): the fw_ prefix plus a 22- or 24-character alphanumeric body separates a key from the recorded confusables (fw_version/fw_id/fw_spec identifiers, the console's short display prefix, placeholders), none of which carries a 22+ alphanumeric run after fw_. Frozen fields are the provider-documented fw_ prefix and the provider code's startsWith("fw_") check (fireconnect key-type.mjs); the body widths are the two widths seen in a small aggregate observation of public values (n=9, #227 row 17) and stay provisional, so the pattern admits exactly the observed widths and no twin or control asserts silence on any other width (23 is not a negative boundary) or on any body alphabet. No pinned peer has a Fireworks rule. Not claimed: an unprefixed legacy key (GitGuardian lists its detector as "Not prefixed"; unconfirmed) and the fpk_ Fire Pass key (a real, separately scoped secret with no public grammar), which is never a control.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Fireworks AI API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated12False alarmsat most 24.3%0 of 12 controls flagged12 quiet · 0 flagged
  • flare-redact at most 24.3%
  • gitleaks at most 35.4%
  • trufflehog at most 24.3%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 29.9%
  • trufflehog at most 29.9%
Must redact · Provider-documented11Secret spans left readableat most 25.9%0 of 11 spansNear-twins told apartinsufficient-coverage5 of 5 pairs11 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 98.4%
  • gitleaks at most 64.6%
  • trufflehog at most 100.0%
32 of 32 rows
Fixtures
32
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

32 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Fireworks AI API keys
FixtureKind and evidenceredact-secret
fireworks-ai-api-key-bearer-curlfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-dotenvfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-firectl-flagfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-key-shape-barefireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-key-shape-quotedfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-key-shape-unicode-crlffireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-letter-prefix-twinfireworks-ai · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
fireworks-ai-api-key-litellm-exportfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-litellm-yamlfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-python-clientfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-vercel-ai-sdkfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-x-fireworks-headerfireworks-ai · documented-format-literalMust redactT1 · Provider-documentedRedacted
fireworks-ai-api-key-account-and-model-public-idfireworks-ai · public-identifierMust not flagT2 · Tool-corroboratedQuiet
fireworks-ai-api-key-base64-account-encoded-valuefireworks-ai · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
fireworks-ai-api-key-console-prefix-placeholderfireworks-ai · documentation-placeholderMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-docs-placeholder-placeholderfireworks-ai · documentation-placeholderMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-ellipsis-placeholderfireworks-ai · documentation-placeholderMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-firmware-version-near-missfireworks-ai · format-near-missMust not flagT2 · Tool-corroboratedQuiet
fireworks-ai-api-key-hyphen-delimiter-twinfireworks-ai · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
fireworks-ai-api-key-key-guidance-prosefireworks-ai · prose-mentionMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-keychain-reference-referencefireworks-ai · templated-referenceMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-label-prosefireworks-ai · benign-lookalikeMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-maskfireworks-ai · benign-lookalikeMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-missing-delimiter-twinfireworks-ai · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
fireworks-ai-api-key-prefix-onlyfireworks-ai · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
fireworks-ai-api-key-referencefireworks-ai · benign-lookalikeMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-sdk-environ-referencefireworks-ai · templated-referenceMust not flagT3 · Project policyQuiet
fireworks-ai-api-key-service-account-public-idfireworks-ai · public-identifierMust not flagT2 · Tool-corroboratedQuiet
fireworks-ai-api-key-short-bodyfireworks-ai · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
fireworks-ai-api-key-transposed-prefix-twinfireworks-ai · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
fireworks-ai-api-key-uppercase-prefix-twinfireworks-ai · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
fireworks-ai-api-key-workflow-ids-near-missfireworks-ai · format-near-missMust not flagT2 · Tool-corroboratedQuiet