Skip to content
Benchmarks

redact-secret · Report · Detector

Replicate API tokens

  • 32 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Graduated arrival evidence (#208, registry detector since redact-secret#727; research #217). T1 because every frozen field a positive depends on (prefix, 40-character total) is provider-stated. Positives use an alphanumeric body, which every source admits; the body alphabet stays provisional and no fixture asserts silence on a - or _ body byte.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Replicate API tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated13False alarmsat most 22.8%0 of 13 controls flagged13 quiet · 0 flagged
  • flare-redact at most 33.3%
  • gitleaks at most 33.3%
  • trufflehog at most 22.8%
Must not flag · Project policy7False alarmsat most 35.4%0 of 7 controls flagged7 quiet · 0 flagged
  • flare-redact at most 35.4%
  • gitleaks at most 35.4%
  • trufflehog at most 35.4%
Must redact · Provider-documented12Secret spans left readableat most 24.3%0 of 12 spansNear-twins told apartat least 61.0%6 of 6 pairs12 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 24.3%
  • gitleaks at most 74.6%
  • trufflehog at most 24.3%
32 of 32 rows
Fixtures
32
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

32 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Replicate API tokens
FixtureKind and evidenceredact-secret
replicate-api-token-bearer-long-body-twinreplicate · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
replicate-api-token-chat-pastereplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-env-short-body-twinreplicate · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
replicate-api-token-go-sdkreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-legacy-token-headerreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-token-shape-barereplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-token-shape-quotedreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-token-shape-unicode-crlfreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-actions-literalreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-actions-secret-referencereplicate · templated-referenceMust not flagT3 · Project policyQuiet
replicate-api-token-base64-input-encoded-valuereplicate · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
replicate-api-token-bearer-headerreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-docs-prosereplicate · prose-mentionMust not flagT3 · Project policyQuiet
replicate-api-token-envreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-env-template-placeholderreplicate · documentation-placeholderMust not flagT3 · Project policyQuiet
replicate-api-token-go-uppercase-prefix-twinreplicate · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
replicate-api-token-identifier-near-missreplicate · format-near-missMust not flagT2 · Tool-corroboratedQuiet
replicate-api-token-label-prosereplicate · benign-lookalikeMust not flagT3 · Project policyQuiet
replicate-api-token-maskreplicate · benign-lookalikeMust not flagT3 · Project policyQuiet
replicate-api-token-masked-docs-placeholderreplicate · documentation-placeholderMust not flagT3 · Project policyQuiet
replicate-api-token-mcp-configreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-mcp-hyphen-prefix-twinreplicate · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
replicate-api-token-model-version-public-idreplicate · public-identifierMust not flagT2 · Tool-corroboratedQuiet
replicate-api-token-prefix-onlyreplicate · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
replicate-api-token-printenvreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-printenv-glued-twinreplicate · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
replicate-api-token-python-dot-body-twinreplicate · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
replicate-api-token-python-sdkreplicate · documented-format-literalMust redactT1 · Provider-documentedRedacted
replicate-api-token-referencereplicate · benign-lookalikeMust not flagT3 · Project policyQuiet
replicate-api-token-registry-image-public-idreplicate · public-identifierMust not flagT2 · Tool-corroboratedQuiet
replicate-api-token-short-bodyreplicate · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
replicate-api-token-truncated-near-missreplicate · format-near-missMust not flagT2 · Tool-corroboratedQuiet