Skip to content
Benchmarks

redact-secret · Report · Detector

Slack tokens

  • 47 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Re-checked 2026-09-20 (#45): the page documents the xoxb-/xoxp-/xapp-/xwfp- prefixes (workflow tokens are stated to begin xwfp-) but gives no section widths or alphabet for any of them, including xoxb-'s own team-id, bot-id and secret segments. No length/alphabet twin is authored for this family; it is un-probeable from provider evidence. Re-checked again 2026-09-20 (#46): a prefix twin using xoxp- (the documented user-token prefix) was empirically not discriminated by the redact-secret scanner, so the prefix twin instead breaks the xox- stem every documented Slack prefix shares or extends (xoyb- vs xoxb-).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Slack tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated17False alarmsat most 18.4%0 of 17 controls flagged17 quiet · 0 flagged
  • flare-redact at most 47.3%
  • gitleaks at most 34.3%
  • trufflehog at most 34.3%
Must not flag · Project policy2False alarmsinsufficient-evidence0 of 2 controls flagged2 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must redact · Provider-documented10Secret spans left readableat most 27.8%0 of 10 spansNear-twins told apartat least 61.0%6 of 6 pairs10 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 27.8%
  • gitleaks at most 27.8%
  • trufflehog at most 27.8%
Project policy · Project policy15Secret spans left readableat most 20.4%0 of 15 spans15 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 100.0%
  • gitleaks at most 80.2%
  • trufflehog at most 93.0%
Pending review3UnscoredNot scoredInspect only: never scored until evidence existsNot scored
47 of 47 rows
Fixtures
47
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

47 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Slack tokens
FixtureKind and evidenceredact-secret
short-slackslack · bare-prefixes-and-truncated-tokensMust not flagT2 · Tool-corroboratedQuiet
slack-token-bot-plain-twinslack · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
slack-token-bot-unicode-crlf-twinslack · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
slack-token-dash-identifier-embeddingslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-shape-2-bareslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-2-quotedslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-2-unicode-crlfslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-3-bareslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-3-quotedslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-3-unicode-crlfslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-5-bareslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-5-quotedslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-5-unicode-crlfslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-6-bareslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-6-quotedslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-6-unicode-crlfslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-7-bareslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-7-quotedslack · documented-format-literalProject policyT3 · Project policyRedacted
slack-token-shape-7-unicode-crlfslack · documented-format-literalProject policyT3 · Project policyRedacted
prefix-onlycross-provider · bare-prefixes-and-truncated-tokensMust not flagT2 · Tool-corroboratedQuiet
slack-1slack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-2slack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-3slack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-bearer-headerslack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-bolt-app-pythonslack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-bot-plainslack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-bot-prefix-plain-twinslack · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
slack-token-bot-prefix-unicode-crlf-twinslack · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
slack-token-bot-team-boundary-plain-twinslack · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
slack-token-bot-team-boundary-unicode-crlf-twinslack · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
slack-token-bot-unicode-crlfslack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-leading-identifier-embeddingslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-maskslack · benign-lookalikeMust not flagT3 · Project policyQuiet
slack-token-prefix-onlyslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-referenceslack · benign-lookalikeMust not flagT3 · Project policyQuiet
slack-token-rotation-dash-identifier-embeddingslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-rotation-leading-identifier-embeddingslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-rotation-trailing-identifier-embeddingslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-shape-1-bareslack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-shape-1-quotedslack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-shape-1-unicode-crlfslack · documented-format-literalMust redactT1 · Provider-documentedRedacted
slack-token-shape-4-bareslack · unsettled-evidence-inputPending reviewT0 · PendingUnscored
slack-token-shape-4-quotedslack · unsettled-evidence-inputPending reviewT0 · PendingUnscored
slack-token-shape-4-unicode-crlfslack · unsettled-evidence-inputPending reviewT0 · PendingUnscored
slack-token-short-bodyslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-trailing-identifier-embeddingslack · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
slack-token-workspace-identifiers-public-idslack · public-identifierMust not flagT2 · Tool-corroboratedQuiet