Skip to content
Benchmarks

redact-secret · Report · Detector

Sentry org auth tokens

  • 40 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

  • trufflehog 3.97.4
  • gitleaks 8.30.1
  • Twin source sntrys_ + base64(JSON facts) + _ + 43-character standard-base64 secret · observed 2026-09-24 · Un-probeable record lifted 2026-09-24 (#207): Sentry's own generator and RFC 0091 (provider code on github.com; not yet accepted as documentation, so the tier stays T2) fix the sntrys_ prefix, the eyJ JSON marker, exactly two _ delimiters and a 43-character standard-base64 secret. Twins mutate one of those properties.

Sentry documents no character-class grammar. Gitleaks's sentry-org-token rule anchors on a stricter literal marker (a base64-encoded "region_url" JSON key) than this contract requires; TruffleHog's sentryorgtoken detector matches a coarser fixed-length body. Both corroborate the same sntrys_eyJ...-prefixed, underscore-separated, 43-byte-signature family.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Sentry org auth tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated15False alarmsat most 20.4%0 of 15 controls flagged15 quiet · 0 flagged
  • flare-redact at most 29.8%
  • gitleaks at most 20.4%
  • trufflehog at most 20.4%
Must not flag · Project policy7False alarmsat most 35.4%0 of 7 controls flagged7 quiet · 0 flagged
  • flare-redact at most 35.4%
  • gitleaks at most 35.4%
  • trufflehog at most 35.4%
Must redact · Tool-corroborated18Secret spans left readableat most 17.6%0 of 18 spansNear-twins told apartinsufficient-coverage8 of 8 pairs18 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 100.0%
  • gitleaks at most 79.7%
  • trufflehog at most 100.0%
40 of 40 rows
Fixtures
40
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

40 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Sentry org auth tokens
FixtureKind and evidenceredact-secret
sentry-org-auth-token-actions-envsentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-bomsentry · multibyte-text-offsetsMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-dockerfile-envsentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-dsn-public-idsentry · public-identifierMust not flagT2 · Tool-corroboratedQuiet
sentry-org-auth-token-envsentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-jsonsentry · structured-text-valueMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-markdownsentry · markdown-and-comment-valueMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-next-configsentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-no-final-newlinesentry · value-at-input-edgesMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-org-token-baresentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-org-token-quotedsentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-org-token-unicode-crlfsentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-pythonsentry · source-code-string-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-sentry-clisentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-sentry-propertiessentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-sentryclircsentry · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-single-quotessentry · quoted-value-extentMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-tomlsentry · structured-text-valueMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-yamlsentry · structured-text-valueMust redactT2 · Tool-corroboratedRedacted
sentry-org-auth-token-actions-secret-referencesentry · templated-referenceMust not flagT3 · Project policyQuiet
sentry-org-auth-token-decoded-facts-encoded-valuesentry · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
sentry-org-auth-token-docs-ellipsis-placeholdersentry · documentation-placeholderMust not flagT3 · Project policyQuiet
sentry-org-auth-token-dotted-delimiter-twinsentry · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-json-marker-twinsentry · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-label-prosesentry · benign-lookalikeMust not flagT3 · Project policyQuiet
sentry-org-auth-token-masksentry · benign-lookalikeMust not flagT3 · Project policyQuiet
sentry-org-auth-token-missing-delimiter-twinsentry · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-missing-json-markersentry · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
sentry-org-auth-token-missing-payload-in-prose-near-misssentry · format-near-missMust not flagT2 · Tool-corroboratedQuiet
sentry-org-auth-token-missing-secret-in-log-near-misssentry · format-near-missMust not flagT2 · Tool-corroboratedQuiet
sentry-org-auth-token-org-project-public-idsentry · public-identifierMust not flagT2 · Tool-corroboratedQuiet
sentry-org-auth-token-prefix-twinsentry · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-referencesentry · benign-lookalikeMust not flagT3 · Project policyQuiet
sentry-org-auth-token-scope-note-prosesentry · prose-mentionMust not flagT3 · Project policyQuiet
sentry-org-auth-token-short-secret-ci-twinsentry · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-short-secret-twinsentry · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-short-signaturesentry · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
sentry-org-auth-token-urlsafe-payload-twinsentry · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-urlsafe-secret-twinsentry · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
sentry-org-auth-token-your-token-here-placeholdersentry · documentation-placeholderMust not flagT3 · Project policyQuiet