Skip to content
Benchmarks

redact-secret · Report · Detector

crates.io tokens

  • 37 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#528, product redact-secret#1031; #1014 handoff crates-io.md, READY). An API token publishes, yanks and changes owners of crates within its scopes. T1 for every fact under R1 from the provider server code; unprefixed pre-cio tokens are no longer accepted. cio is a trigram, so the exact 32-byte body and both identifier boundaries (handoff decision) keep it precise: a random standalone 35-byte alphanumeric value that starts with cio (about 1 in 238,000) is the accepted false positive. The body excludes _, so a cio_tp_ token never reads as an API token. Excluded: words and identifiers that start with cio (ciound, cio_config) and cio + 32 inside a longer run. Neither pinned peer has a crates.io rule. Graduated to a registry detector at the 4fb7882 re-pin (redact-secret PR #1039).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of crates.io tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Provider-documented8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must not flag · Project policy13False alarmsat most 22.8%0 of 13 controls flagged13 quiet · 0 flagged
  • flare-redact at most 22.8%
  • gitleaks at most 22.8%
  • trufflehog at most 22.8%
Must redact · Provider-documented16Secret spans left readableat most 19.4%0 of 16 spansNear-twins told apartat least 67.6%8 of 8 pairs16 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 98.9%
  • gitleaks at most 72.0%
  • trufflehog at most 100.0%
37 of 37 rows
Fixtures
37
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

37 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in crates.io tokens
FixtureKind and evidenceredact-secret
crates-io-token-actions-envcrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-bare-prosecrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-bearer-headercrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-cargo-logincrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-cargo-publish-tokencrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-chat-pastecrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-credentials-tomlcrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-dotenvcrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-exportcrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-json-api-keycrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-json-tokencrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-key-shape-barecrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-key-shape-quotedcrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-key-shape-unicode-crlfcrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-sdk-kwargcrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-x-api-key-headercrates-io · documented-format-literalMust redactT1 · Provider-documentedRedacted
crates-io-token-actions-secret-referencecrates-io · templated-referenceMust not flagT3 · Project policyQuiet
crates-io-token-angle-brackets-placeholdercrates-io · documentation-placeholderMust not flagT3 · Project policyQuiet
crates-io-token-body-31-twincrates-io · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
crates-io-token-body-33-twincrates-io · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
crates-io-token-cio-identifiers-public-idcrates-io · public-identifierMust not flagT3 · Project policyQuiet
crates-io-token-cio-inside-long-run-encoded-valuecrates-io · benign-encoded-valueMust not flagT3 · Project policyQuiet
crates-io-token-cio-words-prosecrates-io · prose-mentionMust not flagT3 · Project policyQuiet
crates-io-token-ellipsis-placeholdercrates-io · documentation-placeholderMust not flagT3 · Project policyQuiet
crates-io-token-env-reference-referencecrates-io · templated-referenceMust not flagT3 · Project policyQuiet
crates-io-token-hyphen-in-body-twincrates-io · wrong-alphabetMust not flagT1 · Provider-documented · twinQuiet
crates-io-token-label-prosecrates-io · benign-lookalikeMust not flagT3 · Project policyQuiet
crates-io-token-leading-glue-twincrates-io · boundary-violationMust not flagT3 · Project policy · twinQuiet
crates-io-token-leading-underscore-twincrates-io · boundary-violationMust not flagT3 · Project policy · twinQuiet
crates-io-token-maskcrates-io · benign-lookalikeMust not flagT3 · Project policyQuiet
crates-io-token-prefix-onlycrates-io · benign-lookalikeMust not flagT1 · Provider-documentedQuiet
crates-io-token-referencecrates-io · benign-lookalikeMust not flagT3 · Project policyQuiet
crates-io-token-short-bodycrates-io · benign-lookalikeMust not flagT1 · Provider-documentedQuiet
crates-io-token-trailing-underscore-twincrates-io · boundary-violationMust not flagT3 · Project policy · twinQuiet
crates-io-token-truncated-near-misscrates-io · format-near-missMust not flagT1 · Provider-documentedQuiet
crates-io-token-underscore-in-body-twincrates-io · wrong-alphabetMust not flagT1 · Provider-documented · twinQuiet
crates-io-token-uppercase-prefix-twincrates-io · prefix-near-missMust not flagT1 · Provider-documented · twinQuiet