redact-secret · Report · Detector

OpenAI tokens

47 fixtures
Format evidence: T2 · Tool-corroborated
Run 2026-10-07
Mode published · redact-secret 0.1.0-beta.14

New pipelineAuthority

Built from the new pipeline

The new pipeline is the authority for credential qualification. These numbers are read from the qualification view derived from the official credential-eval run of the public-evidence-snapshot population. The regression and policy populations keep their own counts on the qualification pages and are not added in here.

Authority: new
Population: public-evidence-snapshot
Engine: credential-eval 0.1.0-alpha.16
Evidence: snapshot-2026.10.06.4
Run: sha256:4bec6e539482…
Recorded: 2026-10-07
Authorised for: @redact-secret/core@0.1.0-beta.14

Maintainer-reviewed (independent review pending)

598 fixtures of the 7,041 in evidence release snapshot-2026.10.06.4 carry this label. They are counted in the numbers on this page.

Passed the project’s own verification (source evidence, automated checks, recorded counter-arguments); not yet independently reviewed.

OpenRedaction default (all patterns): not measured in this run (optional)

The default (all-pattern) profile is slow and noisy for credential evaluation: personal data and resource identifiers dominate its findings, and its last official measurement took 7 minutes of scanner time on a population the credential profile scans in seconds (its methods run takes 40+ minutes), so it is a manual measurement and never blocks other scanners or core verification (#763). Its earlier results stay as history with their run identity; the credential profile is a separate scanner, never spliced with it.

Last measurement: policy-corpus@linux-x64 (configuration sha256:2451ce7bf380), public-evidence-snapshot+methods@linux-x64 (configuration sha256:d47d081ce5fb), public-evidence-snapshot@linux-x64 (configuration sha256:2451ce7bf380), regression-corpus@linux-x64 (configuration sha256:2451ce7bf380) · engine 0.1.0-alpha.5 · recorded 2026-10-05 · retained record, no longer listed by the run registry. It stays labelled with that run identity and is never combined with another profile or another run.

Open the qualification page for this pointer

OpenRedaction credential profile (33 types): not measured in an official run (local exploratory diagnostics only: see ADR)

The credential profile is the comparison profile chosen in docs/decisions/2026-10-06-choose-the-openredaction-credential-bearing-profile-as-the-comparison-scanner.md. It is optional in the official run class because no pinned engine configuration measures it yet: making it required would refuse every official view until the owner approves the one profile-only run. Its own history starts with that run; nothing of the default's is reused for it.

No earlier measurement of it is recorded. Nothing is shown in its place.

Official measurement: pending: requires owner approval (one profile-only run; see the decision).

Open the qualification page for this pointer

Every population and its qualification

Format evidence

OpenAI publishes no key-format documentation (platform docs require authentication). Marker and lengths are tool-corroborated only. Since 2026-09-24 (docs/decisions/2026-09-24-stop-asserting-provider-undecided-format-properties.md) the benchmark claims sk-svcacct- keys only at the 74/74 widths its positives carry and asserts no silence on any other service-account width: whether those widths vary with the account name is disputed and no OpenAI source decides it.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.

Groups of OpenAI tokens fixtures
Group	Fixtures	Leaked or false alarms	Near-twins	Outcomes	Other scanners, same cell
Must not flag · Tool-corroborated	17	False alarmsat most 18.4%0 of 17 controls flagged		17 quiet · 0 flagged	flare-redact at most 58.7% gitleaks at most 18.4% trufflehog at most 41.0%
Must not flag · Project policy	6	False alarmsat most 39.0%0 of 6 controls flagged		6 quiet · 0 flagged	flare-redact at most 39.0% gitleaks at most 39.0% trufflehog at most 39.0%
Must redact · Tool-corroborated	13	Secret spans left readableat most 22.8%0 of 13 spans	Near-twins told apartat least 67.6%8 of 8 pairs	13 redacted · 0 too much · 0 partly exposed · 0 missed	flare-redact at most 82.3% gitleaks at most 22.8% trufflehog at most 22.8%
Project policy · Project policy	9	Secret spans left readableat most 29.9%0 of 9 spans		9 redacted · 0 too much · 0 partly exposed · 0 missed	flare-redact at most 29.9% gitleaks at most 100.0% trufflehog at most 100.0%
Pending review	2	UnscoredNot scoredInspect only: never scored until evidence exists		Not scored

Find

Scanners

47 of 47 rows

Fixtures: 47
Left readable: 0
Redacted too much: 0
False alarms: 0

Fixtures for this detector

47 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.

Fixtures in OpenAI tokens
Fixture	Kind and evidence	redact-secret
`openai-token-alphabet-twin`openai · wrong-alphabet	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-compose-short-twin`openai · wrong-length	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-dash-identifier-embedding`openai · benign-lookalike	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-env`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-legacy-plain-twin`openai · boundary-violation	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-legacy-unicode-crlf-twin`openai · boundary-violation	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-mcp-server-env`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-proj-plain`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-proj-plain-twin`openai · wrong-length	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-proj-unicode-crlf`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-proj-unicode-crlf-twin`openai · wrong-length	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-python-client`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-shape-1-bare`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-1-quoted`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-1-unicode-crlf`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-2-bare`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-2-quoted`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-2-unicode-crlf`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-3-bare`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-3-quoted`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shape-3-unicode-crlf`openai · documented-format-literal	Project policyT3 · Project policy	Redacted
`openai-token-shell-export`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-svcacct-plain`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-svcacct-unicode-crlf`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-trailing-identifier-embedding`openai · benign-lookalike	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-actions-env`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-actions-secret-reference`openai · templated-reference	Must not flagT3 · Project policy	Quiet
`openai-token-compose-alphabet-twin`openai · wrong-alphabet	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-compose-env`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-docs-template-placeholder`openai · documentation-placeholder	Must not flagT3 · Project policy	Quiet
`openai-token-leading-identifier-embedding`openai · benign-lookalike	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-legacy-plain`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-legacy-unicode-crlf`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-mask`openai · benign-lookalike	Must not flagT3 · Project policy	Quiet
`openai-token-org-and-project-ids-public-id`openai · public-identifier	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-prefix-only`openai · benign-lookalike	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-prefix-twin`openai · prefix-near-miss	Must not flagT2 · Tool-corroborated · twin	Quiet
`openai-token-project-keys-note-prose`openai · prose-mention	Must not flagT3 · Project policy	Quiet
`openai-token-python-env-reference`openai · templated-reference	Must not flagT3 · Project policy	Quiet
`openai-token-raw-request`openai · documented-format-literal	Must redactT2 · Tool-corroborated	Redacted
`openai-token-reference`openai · benign-lookalike	Must not flagT3 · Project policy	Quiet
`openai-token-response-ids-public-id`openai · public-identifier	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-short-body`openai · benign-lookalike	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-svcacct-plain-twin`openai · unsettled-evidence-input	Pending reviewT0 · Pending · twin	Unscored
`openai-token-svcacct-unicode-crlf-twin`openai · unsettled-evidence-input	Pending reviewT0 · Pending · twin	Unscored
`openai-token-truncated-log-near-miss`openai · format-near-miss	Must not flagT2 · Tool-corroborated	Quiet
`openai-token-wheel-checksum-encoded-value`openai · benign-encoded-value	Must not flagT2 · Tool-corroborated	Quiet