Skip to content
Benchmarks

redact-secret · Report · Detector

Resend API keys

  • 42 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#436, product redact-secret#915; #860 handoff resend.md, READY). T1: the provider CLI enforces the re_ prefix (code and README); the 8/_/24 layout is the docs response example and three distinct provider-authored SDK fixture values, which ruling R5 weighs like a docs example. The alphabet is taken as the alphanumeric superset: the samples are base58-consistent, but three samples show what is present, not what is excluded. re_ is short and ends many identifiers (are_, pre_, score_), so the leading boundary matters; the product adds a mixed-case guard (at least one upper- and one lower-case letter in the body) as false-positive policy. That guard is not a provider fact, so the corpus asserts silence only on word-built identifiers of the same layout, never on a random one-case body. Excluded: re_ + GUID mock keys, the 36-lowercase Go webhook placeholder, placeholders and masks, key object UUIDs, and whsec_ webhook signing secrets (another credential class: a twin, never a control). Graduated to a registry detector at the 1127bf9 re-pin (redact-secret PR #938).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Resend API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated16False alarmsat most 19.4%0 of 16 controls flagged16 quiet · 0 flagged
  • flare-redact at most 28.3%
  • gitleaks at most 28.3%
  • trufflehog at most 19.4%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 43.5%
  • trufflehog at most 29.9%
Must redact · Provider-documented17Secret spans left readableat most 18.4%0 of 17 spansNear-twins told apartat least 74.1%11 of 11 pairs17 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 96.7%
  • gitleaks at most 69.0%
  • trufflehog at most 100.0%
42 of 42 rows
Fixtures
42
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

42 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Resend API keys
FixtureKind and evidenceredact-secret
resend-api-key-bare-proseresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-bearer-headerresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-chat-pasteresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-compose-envresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-curl-bearerresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-digits-placeholderresend · documentation-placeholderMust not flagT3 · Project policyQuiet
resend-api-key-dotenvresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-exportresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-json-api-keyresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-json-tokenresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-key-shape-bareresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-key-shape-quotedresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-key-shape-unicode-crlfresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-mcp-envresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-python-moduleresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-sdk-kwargresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-trailing-glue-twinresend · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-ts-clientresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-webhook-secret-twinresend · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-x-api-key-headerresend · documented-format-literalMust redactT1 · Provider-documentedRedacted
resend-api-key-are-glue-twinresend · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-env-reference-referenceresend · templated-referenceMust not flagT3 · Project policyQuiet
resend-api-key-hyphen-separator-twinresend · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-key-guidance-proseresend · prose-mentionMust not flagT3 · Project policyQuiet
resend-api-key-label-proseresend · benign-lookalikeMust not flagT3 · Project policyQuiet
resend-api-key-maskresend · benign-lookalikeMust not flagT3 · Project policyQuiet
resend-api-key-masked-placeholderresend · documentation-placeholderMust not flagT3 · Project policyQuiet
resend-api-key-pre-identifier-public-idresend · public-identifierMust not flagT2 · Tool-corroboratedQuiet
resend-api-key-prefix-onlyresend · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
resend-api-key-python-re-names-public-idresend · public-identifierMust not flagT2 · Tool-corroboratedQuiet
resend-api-key-referenceresend · benign-lookalikeMust not flagT3 · Project policyQuiet
resend-api-key-second-underscore-twinresend · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-segment1-7-twinresend · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-segment1-9-twinresend · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-segment2-23-twinresend · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-segment2-25-twinresend · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-short-bodyresend · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
resend-api-key-truncated-near-missresend · format-near-missMust not flagT2 · Tool-corroboratedQuiet
resend-api-key-underscore-glue-twinresend · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-uppercase-prefix-twinresend · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
resend-api-key-x-run-placeholderresend · documentation-placeholderMust not flagT3 · Project policyQuiet
resend-api-key-your-key-placeholderresend · documentation-placeholderMust not flagT3 · Project policyQuiet