Skip to content
Benchmarks

redact-secret · Report · Detector

Firecrawl API keys

  • 48 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#434, product redact-secret#908; #860 handoff firecrawl.md, READY). A Firecrawl key spends the team's crawl and scrape credits and is common in agent web tools and MCP servers. The prefix is documented and checked by the SDK and MCP server; the body is a dashless Postgres random UUIDv4 by the server normalizer, schema default and validator (R1), so the version and variant nibbles are enforced, rejecting 63 of 64 arbitrary 32-hex runs (an fc- + MD5, say) at no cost for issued keys. Excluded: legacy bare dashed UUIDs (not attributable), fc- + a dashed UUID (not an issued form), another UUID version or variant, uppercase hex, fco_ and fcmcp_. Neither pinned peer has a Firecrawl rule. Graduated to a registry detector at the 1127bf9 re-pin (redact-secret PR #938).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Firecrawl API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated20False alarmsat most 16.1%0 of 20 controls flagged20 quiet · 0 flagged
  • flare-redact at most 16.1%
  • gitleaks at most 30.1%
  • trufflehog at most 16.1%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 29.9%
  • trufflehog at most 29.9%
Must redact · Provider-documented19Secret spans left readableat most 16.8%0 of 19 spansNear-twins told apartat least 78.5%14 of 14 pairs19 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 94.5%
  • gitleaks at most 68.3%
  • trufflehog at most 100.0%
48 of 48 rows
Fixtures
48
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

48 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Firecrawl API keys
FixtureKind and evidenceredact-secret
firecrawl-api-key-actions-envfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-bare-prosefirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-bearer-headerfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-chat-pastefirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-compose-envfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-curl-bearerfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-digest-encoded-valuefirecrawl · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
firecrawl-api-key-dotenvfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-exportfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-go-httpfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-js-clientfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-json-api-keyfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-json-tokenfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-key-shape-barefirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-key-shape-quotedfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-key-shape-unicode-crlffirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-mcp-envfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-python-appfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-sdk-kwargfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-uppercase-prefix-twinfirecrawl · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-x-api-key-headerfirecrawl · documented-format-literalMust redactT1 · Provider-documentedRedacted
firecrawl-api-key-actions-secret-referencefirecrawl · templated-referenceMust not flagT3 · Project policyQuiet
firecrawl-api-key-body-31-twinfirecrawl · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-body-33-twinfirecrawl · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-css-classes-near-missfirecrawl · format-near-missMust not flagT2 · Tool-corroboratedQuiet
firecrawl-api-key-dashed-uuid-twinfirecrawl · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-docs-ctor-placeholderfirecrawl · documentation-placeholderMust not flagT3 · Project policyQuiet
firecrawl-api-key-env-reference-referencefirecrawl · templated-referenceMust not flagT3 · Project policyQuiet
firecrawl-api-key-g-in-body-twinfirecrawl · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-key-guidance-prosefirecrawl · prose-mentionMust not flagT3 · Project policyQuiet
firecrawl-api-key-label-prosefirecrawl · benign-lookalikeMust not flagT3 · Project policyQuiet
firecrawl-api-key-leading-glue-twinfirecrawl · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-maskfirecrawl · benign-lookalikeMust not flagT3 · Project policyQuiet
firecrawl-api-key-md5-cache-key-near-missfirecrawl · format-near-missMust not flagT2 · Tool-corroboratedQuiet
firecrawl-api-key-prefix-onlyfirecrawl · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
firecrawl-api-key-referencefirecrawl · benign-lookalikeMust not flagT3 · Project policyQuiet
firecrawl-api-key-request-uuid-public-idfirecrawl · public-identifierMust not flagT2 · Tool-corroboratedQuiet
firecrawl-api-key-short-bodyfirecrawl · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
firecrawl-api-key-short-samples-placeholderfirecrawl · documentation-placeholderMust not flagT3 · Project policyQuiet
firecrawl-api-key-trailing-glue-twinfirecrawl · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-underscore-prefix-twinfirecrawl · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-uppercase-hex-twinfirecrawl · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-variant-7-twinfirecrawl · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-variant-c-twinfirecrawl · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-version-0-twinfirecrawl · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-version-1-twinfirecrawl · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-version-7-twinfirecrawl · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
firecrawl-api-key-your-api-key-placeholderfirecrawl · documentation-placeholderMust not flagT3 · Project policyQuiet