Skip to content
Benchmarks

redact-secret · Report · Detector

anthropic-api01-key

  • 37 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#384, product redact-secret#862; research #776). T1 on the prefix only: two provider pages document sk-ant-api01- (compliance-api-access, admin-api-keys). The body is undocumented and no scanner rule exists for this prefix, so nothing here asserts a length, alphabet or AA tail: positives borrow the api03 93-character + AA shape, which the product accepts as a subset of its >= 20 byte run, and no twin is authored on the body. The prefix is the general Claude Enterprise organization key for any scope set; "Compliance" describes the scopes chosen at creation, which the value does not show, so a finding must not claim it. sk-ant-api03- and sk-ant-admin01- are different provider classes and back prefix twins.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of anthropic-api01-key fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Provider-documented4False alarmsinsufficient-evidence0 of 4 controls flagged4 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must not flag · Project policy18False alarmsat most 17.6%0 of 18 controls flagged18 quiet · 0 flagged
  • flare-redact at most 25.8%
  • gitleaks at most 32.8%
  • trufflehog at most 17.6%
Must redact · Provider-documented15Secret spans left readableat most 20.4%0 of 15 spansNear-twins told apartinsufficient-coverage7 of 7 pairs15 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 20.4%
  • gitleaks at most 96.3%
  • trufflehog at most 100.0%
37 of 37 rows
Fixtures
37
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

37 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in anthropic-api01-key
FixtureKind and evidenceredact-secret
anthropic-api01-key-admin01-prefix-twinanthropic · prefix-near-missMust not flagT1 · Provider-documented · twinQuiet
anthropic-api01-key-apl-letter-twinanthropic · prefix-near-missMust not flagT3 · Project policy · twinQuiet
anthropic-api01-key-buildkite-envanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-compliance-export-yamlanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-compose-envanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-curl-x-api-keyanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-dotenvanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-exportanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-go-const-longanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-httpx-clientanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-job-loganthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-json-configanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-key-digest-encoded-valueanthropic · benign-encoded-valueMust not flagT3 · Project policyQuiet
anthropic-api01-key-pasted-keyanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-python-sdkanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-secretsmanager-getanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-ticket-parenanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-tool-callanthropic · documented-format-literalMust redactT1 · Provider-documentedRedacted
anthropic-api01-key-underscore-delimiters-twinanthropic · boundary-violationMust not flagT3 · Project policy · twinQuiet
anthropic-api01-key-actions-secret-referenceanthropic · templated-referenceMust not flagT3 · Project policyQuiet
anthropic-api01-key-activity-feed-public-idanthropic · public-identifierMust not flagT3 · Project policyQuiet
anthropic-api01-key-activity-ids-public-idanthropic · public-identifierMust not flagT3 · Project policyQuiet
anthropic-api01-key-allowlist-comment-near-missanthropic · format-near-missMust not flagT1 · Provider-documentedQuiet
anthropic-api01-key-angle-key-placeholderanthropic · documentation-placeholderMust not flagT3 · Project policyQuiet
anthropic-api01-key-api03-prefix-twinanthropic · prefix-near-missMust not flagT1 · Provider-documented · twinQuiet
anthropic-api01-key-body-only-twinanthropic · prefix-near-missMust not flagT3 · Project policy · twinQuiet
anthropic-api01-key-docs-ellipsis-placeholderanthropic · documentation-placeholderMust not flagT3 · Project policyQuiet
anthropic-api01-key-embedded-leading-twinanthropic · boundary-violationMust not flagT3 · Project policy · twinQuiet
anthropic-api01-key-env-reference-referenceanthropic · templated-referenceMust not flagT3 · Project policyQuiet
anthropic-api01-key-fingerprint-table-encoded-valueanthropic · benign-encoded-valueMust not flagT3 · Project policyQuiet
anthropic-api01-key-masked-display-placeholderanthropic · documentation-placeholderMust not flagT3 · Project policyQuiet
anthropic-api01-key-prefix-guidance-proseanthropic · prose-mentionMust not flagT3 · Project policyQuiet
anthropic-api01-key-prefix-only-near-missanthropic · format-near-missMust not flagT1 · Provider-documentedQuiet
anthropic-api01-key-procurement-note-proseanthropic · prose-mentionMust not flagT3 · Project policyQuiet
anthropic-api01-key-uppercase-prefix-twinanthropic · prefix-near-missMust not flagT3 · Project policy · twinQuiet
anthropic-api01-key-vault-path-referenceanthropic · templated-referenceMust not flagT3 · Project policyQuiet
anthropic-api01-key-version-and-org-public-idanthropic · public-identifierMust not flagT3 · Project policyQuiet