Skip to content
Benchmarks

redact-secret · Report · Detector

Cerebras API keys

  • 46 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#464, product redact-secret#975; #860 handoff cerebras.md, READY by ruling R10). T1: the length comes from the provider VS Code extension validator, which rejects any key that does not start csk_ or csk- or is not 52 long (R1), and both prefixes are a dated provider-staff statement (R3, as of 2025-10; provider docs state "starts with csk-"). POLICY under R10, not T1: no provider source states the alphabet (the validator accepts any 48 code units) and the [a-z0-9] class is tool-only, so project policy fills it with [A-Za-z0-9_-], a superset of every class seen with no narrowing from third-party rules (R8). Positives therefore include lowercase-only bodies and bodies with _ and -, and no fixture asserts silence on a byte outside the policy class (a dot or plus in the body is not authored either way). The leading boundary is load-bearing: it excludes Pinecone pcsk_ / pcsk- (the byte before csk is p; Pinecone keeps pcsk_ with a 69- or 70-byte body, so no width overlaps). Excluded: Management API keys (shape unknown), csk-your-key-here style placeholders and other widths. The tool rules' [a-z0-9] body is narrower than the policy class, so a tool that follows it lags on any uppercase, _ or - body. Graduated to a registry detector at the 4fb7882 re-pin (redact-secret PR #1037).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Cerebras API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated13False alarmsat most 22.8%0 of 13 controls flagged13 quiet · 0 flagged
  • flare-redact at most 22.8%
  • gitleaks at most 22.8%
  • trufflehog at most 22.8%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 29.9%
  • trufflehog at most 29.9%
Must redact · Provider-documented24Secret spans left readableat most 13.8%0 of 24 spansNear-twins told apartinsufficient-coverage8 of 8 pairs24 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 97.7%
  • gitleaks at most 57.3%
  • trufflehog at most 100.0%
46 of 46 rows
Fixtures
46
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

46 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Cerebras API keys
FixtureKind and evidenceredact-secret
cerebras-api-key-bare-prosecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-bare-prose-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-bearer-headercerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-bearer-header-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-chat-pastecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-chat-paste-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-dotenvcerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-dotenv-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-exportcerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-export-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-json-api-keycerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-json-api-key-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-json-tokencerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-json-token-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-key-shape-barecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-key-shape-quotedcerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-key-shape-unicode-crlfcerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-openai-compat-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-pinecone-neighbour-dotenvcerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-python-sdkcerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-sdk-kwargcerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-sdk-kwarg-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-x-api-key-headercerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-x-api-key-header-underscorecerebras · documented-format-literalMust redactT1 · Provider-documentedRedacted
cerebras-api-key-actions-secret-referencecerebras · templated-referenceMust not flagT3 · Project policyQuiet
cerebras-api-key-body-47-twincerebras · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-body-49-twincerebras · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-dot-separator-twincerebras · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-ellipsis-placeholdercerebras · documentation-placeholderMust not flagT3 · Project policyQuiet
cerebras-api-key-env-reference-referencecerebras · templated-referenceMust not flagT3 · Project policyQuiet
cerebras-api-key-key-guidance-prosecerebras · prose-mentionMust not flagT3 · Project policyQuiet
cerebras-api-key-label-prosecerebras · benign-lookalikeMust not flagT3 · Project policyQuiet
cerebras-api-key-leading-glue-twincerebras · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-leading-underscore-twincerebras · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-maskcerebras · benign-lookalikeMust not flagT3 · Project policyQuiet
cerebras-api-key-pinecone-hyphen-glue-twincerebras · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-pinecone-underscore-glue-twincerebras · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-prefix-at-eol-near-misscerebras · format-near-missMust not flagT2 · Tool-corroboratedQuiet
cerebras-api-key-prefix-onlycerebras · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
cerebras-api-key-referencecerebras · benign-lookalikeMust not flagT3 · Project policyQuiet
cerebras-api-key-short-bodycerebras · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
cerebras-api-key-snake-case-name-public-idcerebras · public-identifierMust not flagT2 · Tool-corroboratedQuiet
cerebras-api-key-truncated-near-misscerebras · format-near-missMust not flagT2 · Tool-corroboratedQuiet
cerebras-api-key-uppercase-prefix-twincerebras · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
cerebras-api-key-x-run-placeholdercerebras · documentation-placeholderMust not flagT3 · Project policyQuiet
cerebras-api-key-your-key-here-placeholdercerebras · documentation-placeholderMust not flagT3 · Project policyQuiet