Skip to content
Benchmarks

redact-secret · Report · Detector

Twilio auth tokens

  • 64 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

  • trufflehog 3.97.4
  • Twin source context twin: same-line twilio keyword or Account SID removed · observed 2026-09-24 · Un-probeable record lifted 2026-09-24 (#207): the value is opaque and context-gated (CONTEXT_GATED), so #207 requires context twins and no bare-value claim. Each twin keeps the 32-character value byte-for-byte and removes only the same-line marker the detector contract names (the word twilio or the AC Account SID), per the context-twin decision; the twin is policy-tier, like the positive.

Twilio documents the Auth Token's functional role but no character-class grammar. The bare 32-character lowercase-hex shape, gated on a same-line Account SID or the word "twilio", is corroborated by TruffleHog's twilio detector; no pinned gitleaks rule covers this bare value.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Twilio auth tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Provider-documented3False alarmsinsufficient-evidence0 of 3 controls flagged3 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must not flag · Tool-corroborated2False alarmsinsufficient-evidence0 of 2 controls flagged2 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must not flag · Project policy27False alarmsat most 12.5%0 of 27 controls flagged27 quiet · 0 flagged
  • flare-redact at most 32.5%
  • gitleaks at most 18.3%
  • trufflehog at most 12.5%
Must redact · Provider-documented4Secret spans left readableinsufficient-evidence0 of 4 spans4 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Project policy · Project policy28Secret spans left readableat most 12.1%0 of 28 spansNear-twins told apartat least 75.7%12 of 12 pairs28 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 99.4%
  • gitleaks at most 76.4%
  • trufflehog at most 99.4%
64 of 64 rows
Fixtures
64
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

64 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Twilio auth tokens
FixtureKind and evidenceredact-secret
twilio-auth-token-account-sid-public-idtwilio · public-identifierMust not flagT3 · Project policyQuiet
twilio-auth-token-actions-envtwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-api-key-sid-masked-public-idtwilio · public-identifierMust not flagT3 · Project policyQuiet
twilio-auth-token-bomtwilio · multibyte-text-offsetsProject policyT3 · Project policyRedacted
twilio-auth-token-client-sidtwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-compose-envtwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-config-settwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-csharp-inittwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-curl-basictwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-envtwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-exporttwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-incident-chattwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-init-logtwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-jsontwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-json-structured-text-valuetwilio · structured-text-valueProject policyT3 · Project policyRedacted
twilio-auth-token-markdowntwilio · markdown-and-comment-valueProject policyT3 · Project policyRedacted
twilio-auth-token-message-resource-public-idtwilio · public-identifierMust not flagT3 · Project policyQuiet
twilio-auth-token-no-final-newlinetwilio · value-at-input-edgesProject policyT3 · Project policyRedacted
twilio-auth-token-paired-account-sid-baretwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-paired-account-sid-quotedtwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-paired-account-sid-unicode-crlftwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-profiles-auth-tokentwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-pythontwilio · source-code-string-literalProject policyT3 · Project policyRedacted
twilio-auth-token-serverless-ymltwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-short-tokentwilio · benign-lookalikeMust not flagT3 · Project policyQuiet
twilio-auth-token-single-quotestwilio · quoted-value-extentProject policyT3 · Project policyRedacted
twilio-auth-token-support-notetwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-tomltwilio · structured-text-valueProject policyT3 · Project policyRedacted
twilio-auth-token-userinfo-urltwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-validator-debugtwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-yamltwilio · documented-format-literalProject policyT3 · Project policyRedacted
twilio-auth-token-yaml-structured-text-valuetwilio · structured-text-valueProject policyT3 · Project policyRedacted
account-sid-and-token-envtwilio-compound-credentials-authored · twilio-account-sid-and-auth-token-secret-boundaryMust redactT1 · Provider-documentedRedacted
repeated-sid-separated-tokentwilio-compound-credentials-authored · twilio-account-sid-and-auth-token-secret-boundaryMust redactT1 · Provider-documentedRedacted
token-before-sid-basic-authtwilio-compound-credentials-authored · twilio-account-sid-and-auth-token-secret-boundaryMust redactT1 · Provider-documentedRedacted
token-without-sid-named-fieldtwilio-compound-credentials-authored · twilio-account-sid-and-auth-token-secret-boundaryMust redactT1 · Provider-documentedRedacted
twilio-auth-token-account-sid-column-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-actions-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-actions-secret-referencetwilio · templated-referenceMust not flagT3 · Project policyQuiet
twilio-auth-token-cli-hidden-placeholdertwilio · documentation-placeholderMust not flagT3 · Project policyQuiet
twilio-auth-token-client-sid-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-compose-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-config-set-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-env-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-etag-keyword-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-export-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-functions-context-referencetwilio · templated-referenceMust not flagT3 · Project policyQuiet
twilio-auth-token-init-log-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-json-context-twintwilio · missing-context-markerMust not flagT3 · Project policy · twinQuiet
twilio-auth-token-label-prosetwilio · benign-lookalikeMust not flagT3 · Project policyQuiet