Skip to content
Benchmarks

redact-secret · Report · Detector

Shopify tokens

  • 27 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Re-checked 2026-09-20 (#33): the page calls the body an "opaque string" and states no length or character class. No length/alphabet twin is authored for this family; it is un-probeable from provider evidence.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Shopify tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated10False alarmsat most 27.8%0 of 10 controls flagged10 quiet · 0 flagged
  • flare-redact at most 27.8%
  • gitleaks at most 27.8%
  • trufflehog at most 27.8%
Must not flag · Project policy4False alarmsinsufficient-evidence0 of 4 controls flagged4 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must redact · Provider-documented4Secret spans left readableinsufficient-evidence0 of 4 spansNear-twins told apartat least 61.0%6 of 6 pairs4 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Project policy · Project policy9Secret spans left readableat most 29.9%0 of 9 spans9 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 29.9%
  • gitleaks at most 29.9%
  • trufflehog at most 87.9%
27 of 27 rows
Fixtures
27
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

27 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Shopify tokens
FixtureKind and evidenceredact-secret
shopify-token-shape-1-bareshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-shape-1-quotedshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-shape-1-unicode-crlfshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-shape-2-bareshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-shape-2-quotedshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-shape-2-unicode-crlfshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-admin-envshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-admin-graphql-headershopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-app-toml-client-id-public-idshopify · public-identifierMust not flagT2 · Tool-corroboratedQuiet
shopify-token-label-proseshopify · benign-lookalikeMust not flagT3 · Project policyQuiet
shopify-token-maskshopify · benign-lookalikeMust not flagT3 · Project policyQuiet
shopify-token-prefix-onlyshopify · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
shopify-token-private-app-clientshopify · documented-format-literalProject policyT3 · Project policyRedacted
shopify-token-referenceshopify · benign-lookalikeMust not flagT3 · Project policyQuiet
shopify-token-reinstall-note-proseshopify · prose-mentionMust not flagT3 · Project policyQuiet
shopify-token-short-bodyshopify · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
shopify-token-shpat-boundary-plain-twinshopify · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
shopify-token-shpat-boundary-unicode-crlf-twinshopify · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
shopify-token-shpat-plainshopify · documented-format-literalMust redactT1 · Provider-documentedRedacted
shopify-token-shpat-plain-twinshopify · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
shopify-token-shpat-unicode-crlfshopify · documented-format-literalMust redactT1 · Provider-documentedRedacted
shopify-token-shpat-unicode-crlf-twinshopify · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
shopify-token-shppa-plainshopify · documented-format-literalMust redactT1 · Provider-documentedRedacted
shopify-token-shppa-plain-twinshopify · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
shopify-token-shppa-unicode-crlfshopify · documented-format-literalMust redactT1 · Provider-documentedRedacted
shopify-token-shppa-unicode-crlf-twinshopify · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
shopify-token-webhook-hmac-header-encoded-valueshopify · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet