Skip to content
Benchmarks

redact-secret · Report · Detector

Sentry user auth tokens

  • 40 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

  • gitleaks 8.30.1
  • Twin source sntryu_ + secrets.token_hex(32) · observed 2026-09-24 · Un-probeable record lifted 2026-09-24 (#207): Sentry's own server code (provider code on github.com, so the tier stays T2) builds the token as the sntryu_ prefix plus 64 lowercase hex characters. Twins mutate the prefix, the _ delimiter, the length or a non-hex byte; none is a bare 64-hex value, since legacy unprefixed tokens are still valid secrets.

Sentry documents auth-token creation and scoping but no character-class grammar. Gitleaks's sentry-user-token rule matches this shape exactly; no pinned TruffleHog detector covers the user (non-organization) token.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Sentry user auth tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Provider-documented13False alarmsat most 22.8%0 of 13 controls flagged13 quiet · 0 flagged
  • flare-redact at most 33.3%
  • gitleaks at most 33.3%
  • trufflehog at most 33.3%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 29.9%
  • trufflehog at most 29.9%
Must redact · Provider-documented10Secret spans left readableat most 27.8%0 of 10 spansNear-twins told apartat least 67.6%8 of 8 pairs10 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 98.2%
  • gitleaks at most 27.8%
  • trufflehog at most 27.8%
Must redact · Tool-corroborated8Secret spans left readableat most 32.4%0 of 8 spans8 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 100.0%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
40 of 40 rows
Fixtures
40
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

40 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Sentry user auth tokens
FixtureKind and evidenceredact-secret
sentry-user-auth-token-actions-envsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-api-curlsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-bomsentry · multibyte-text-offsetsMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-compose-envsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-dash-delimiter-twinsentry · boundary-violationMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-dsn-public-idsentry · public-identifierMust not flagT1 · Provider-documentedQuiet
sentry-user-auth-token-envsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-jsonsentry · structured-text-valueMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-markdownsentry · markdown-and-comment-valueMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-no-final-newlinesentry · value-at-input-edgesMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-prefix-twinsentry · prefix-near-missMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-pythonsentry · source-code-string-literalMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-script-constantsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-sentry-clisentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-sentryclircsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-shape-1-baresentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-shape-1-quotedsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-shape-1-unicode-crlfsentry · documented-format-literalMust redactT1 · Provider-documentedRedacted
sentry-user-auth-token-single-quotessentry · quoted-value-extentMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-tomlsentry · structured-text-valueMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-yamlsentry · structured-text-valueMust redactT2 · Tool-corroboratedRedacted
sentry-user-auth-token-actions-secret-referencesentry · templated-referenceMust not flagT3 · Project policyQuiet
sentry-user-auth-token-docs-ellipsis-placeholdersentry · documentation-placeholderMust not flagT3 · Project policyQuiet
sentry-user-auth-token-half-body-in-prose-near-misssentry · format-near-missMust not flagT1 · Provider-documentedQuiet
sentry-user-auth-token-label-prosesentry · benign-lookalikeMust not flagT3 · Project policyQuiet
sentry-user-auth-token-last-four-placeholdersentry · documentation-placeholderMust not flagT3 · Project policyQuiet
sentry-user-auth-token-masksentry · benign-lookalikeMust not flagT3 · Project policyQuiet
sentry-user-auth-token-missing-delimiter-twinsentry · boundary-violationMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-naming-note-prosesentry · prose-mentionMust not flagT3 · Project policyQuiet
sentry-user-auth-token-non-hex-cli-twinsentry · wrong-alphabetMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-non-hex-twinsentry · wrong-alphabetMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-org-prefix-hex-in-log-near-misssentry · format-near-missMust not flagT1 · Provider-documentedQuiet
sentry-user-auth-token-org-slug-public-idsentry · public-identifierMust not flagT3 · Project policyQuiet
sentry-user-auth-token-prefix-compose-twinsentry · prefix-near-missMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-prefix-onlysentry · benign-lookalikeMust not flagT1 · Provider-documentedQuiet
sentry-user-auth-token-referencesentry · benign-lookalikeMust not flagT3 · Project policyQuiet
sentry-user-auth-token-short-bodysentry · benign-lookalikeMust not flagT1 · Provider-documentedQuiet
sentry-user-auth-token-short-ci-twinsentry · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-short-twinsentry · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
sentry-user-auth-token-tarball-digest-encoded-valuesentry · benign-encoded-valueMust not flagT3 · Project policyQuiet