Skip to content
Benchmarks

redact-secret · Report · Detector

slack-app-level-token

  • 40 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival contract (#211, research #222, observed 2026-09-24). T2: Slack documents only the xapp- prefix; the four-section order comes from provider-authored placeholders (Java SDK, Slack CLI tests) that the python SDK mock contradicts, and widths/alphabet come from veles/kingfisher (one lineage; gitleaks fixes only the section order, its 1/11/13/64 being test samples, not enforced widths, per redact-secret#1013), which Nosey Parker's two-section 42-character rule contradicts outright. The pattern therefore fixes the prefix and section order with open widths; widths and alphabet are unresolved. Positives use the 1/11/13/64 shape so every candidate relied on accepts them; no fixture uses a 42-character value or removes the version section. The pinned trufflehog 3.97.4 has no xapp- detector. Slack's own CLI redacts xapp-[\w.-]* on prefix alone.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of slack-app-level-token fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated15False alarmsat most 20.4%0 of 15 controls flagged15 quiet · 0 flagged
  • flare-redact at most 20.4%
  • gitleaks at most 37.9%
  • trufflehog at most 20.4%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 47.1%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Tool-corroborated17Secret spans left readableat most 18.4%0 of 17 spansNear-twins told apartinsufficient-coverage8 of 8 pairs17 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 96.7%
  • gitleaks at most 18.4%
  • trufflehog at most 100.0%
40 of 40 rows
Fixtures
40
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

40 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in slack-app-level-token
FixtureKind and evidenceredact-secret
slack-app-level-token-actions-socket-mode-envslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-agent-env-echoslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-agent-yamlslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-agent-yaml-boundary-twinslack · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-bolt-js-app-tokenslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-bolt-python-handlerslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-chat-messageslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-cli-install-jsonslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-connections-open-headerslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-connections-open-header-boundary-twinslack · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-curl-connections-openslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-dockerfile-envslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-docs-sentence-proseslack · prose-mentionMust not flagT3 · Project policyQuiet
slack-app-level-token-dotenv-app-tokenslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-export-app-tokenslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-fish-setslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-helm-valuesslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-java-socket-mode-appslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-printenv-grepslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-socket-mode-debugslack · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
slack-app-level-token-actions-secret-referenceslack · templated-referenceMust not flagT3 · Project policyQuiet
slack-app-level-token-agent-yaml-alphabet-twinslack · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-angle-dotenv-placeholderslack · documentation-placeholderMust not flagT3 · Project policyQuiet
slack-app-level-token-angle-placeholder-placeholderslack · documentation-placeholderMust not flagT3 · Project policyQuiet
slack-app-level-token-app-and-enterprise-ids-public-idslack · public-identifierMust not flagT2 · Tool-corroboratedQuiet
slack-app-level-token-app-id-url-public-idslack · public-identifierMust not flagT2 · Tool-corroboratedQuiet
slack-app-level-token-bolt-python-handler-separator-twinslack · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-bolt-python-handler-short-prefix-twinslack · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-cli-install-json-digit-section-twinslack · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-compose-interpolation-referenceslack · templated-referenceMust not flagT3 · Project policyQuiet
slack-app-level-token-dotenv-app-token-prefix-twinslack · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-dotenv-app-token-underscore-prefix-twinslack · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
slack-app-level-token-environ-lookup-referenceslack · templated-referenceMust not flagT3 · Project policyQuiet
slack-app-level-token-masked-env-placeholderslack · documentation-placeholderMust not flagT3 · Project policyQuiet
slack-app-level-token-package-name-near-missslack · format-near-missMust not flagT2 · Tool-corroboratedQuiet
slack-app-level-token-prefix-only-near-missslack · format-near-missMust not flagT2 · Tool-corroboratedQuiet
slack-app-level-token-scopes-paragraph-proseslack · prose-mentionMust not flagT3 · Project policyQuiet
slack-app-level-token-scopes-variable-near-missslack · format-near-missMust not flagT2 · Tool-corroboratedQuiet
slack-app-level-token-team-and-client-id-public-idslack · public-identifierMust not flagT2 · Tool-corroboratedQuiet
slack-app-level-token-token-digest-log-encoded-valueslack · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet