Skip to content
Benchmarks

redact-secret · Report

API key (unprefixed)

32 alphanumeric characters recognised only beside a same-line AI21 name, host or SDK constructor; the shape rests on one ten-sample maintainer observation.

  • AI21 Labs
  • Detectors: ai21-api-key
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14
  • Dossier verdictReady
  • Dossier evidence levelT2 · Tool-corroborated
  • Dossier researched2026-09-29
Registry detector ai21-api-key since redact-secret#868 (registry pinned at cfe2aec); graduated from a Beta.10 arrival family (#384, research #784), contract in benchmarks/lib/beta8/384e.ts. T0, context-gated: no provider statement and no scanner rule; pending.

Research record

From credential-evidence snapshot-2026.10.06.4 · records at 77ce761 · schema 1.8.0. It describes the research on the format, not what any scanner or the product does, and not a support status.
  • Review stateDraft, not reviewed
  • Format revision1 · current
  • ResearchResearched
  • Researched2026-09-29

3 events in the review history: 2 observed, 1 reviewed. Latest: observed on 2026-09-29 by automation, project maintainer. Project-maintained review is not independent validation. The family record at this release.

Format

Provider format research from credential-evidence snapshot-2026.10.06.4 · records at 77ce761 · schema 1.8.0.

What it looks like

Descriptive pattern
^[A-Za-z0-9]{32}$

Parts are shown as recorded. Evidence classes belong to the facts below; no class is assigned to a part.

Format facts

Open questions

No open question is recorded for this revision.

Benchmark dossier notes

From the provider dossier, as written. The evidence level above says how well the format is backed; a fact the dossier does not record is not shown.
Shape
no prefix; exactly 32 characters [A-Za-z0-9], mixed case, recognised only beside a same-line AI21 name, host or SDK constructor (context-constrained, never bare). Not stated in provider prose.
Basis
T2 on the corroborated route (redact-secret#1013, 2026-09-29), context-constrained. Without any provider material, three references from three owners in two non-summary classes clear the bar: - Vulnetix vnx-sec-315 (peer-scanner-rule, 2026-06-14): ai21[_-]?api[_-]?key assignment + exactly 32 [A-Za-z0-9]; - cunnymessiah/keychecker (independent-implementation, 2023-12-16): a 32-alphanumeric filter before a live AI21 check; - MCERQUA/LLM-Runner-Router (independent-implementation, 2025-08-26): ai21: { keyFormat: '[A-Za-z0-9]{32}' }. AI21 staff also committed key literals to AI21Labs example code (ai21-python 2024-08 to 2025-03, one pointing at a staging host; a 2023 AI21 demo app's Bearer value): six literals, each 32 mixed alphanumerics, none a UUID. Their validity is unknown and was not tested. Whether a provider-committed literal of unknown validity counts as a provider example (R5) or as a leak is maintainer ruling Q-AI, pending; the T2 verdict holds without them, so they are recorded as bounded evidence pending Q-AI, not counted. Values are never reproduced. The 2026-09-27 ten-sample maintainer observation (#784) agrees and is kept as authoring input only.
Issuance
not attempted. The #784 checklist covers length, charset, fixed segments, case mix, the masked suffix shown afterwards, and a second workspace.
Contract in core
detector-families.md, section Keyword-gated provider keys (#868). #774 lists it as pending, needing "real issuance evidence, not more fixtures".

In this benchmark

Fixture rows on the current run. Counts are for redact-secret in published · redact-secret 0.1.0-beta.14 mode.
Fixtures
60
Left readable
0
Redacted too much
0
False alarms
0

60 fixtures: 43 must stay quiet, 17 record project policy. See every row

redact-secret fixture counts by evidence level
Evidence levelFixturesLeft readableToo muchFalse alarms
T2Tool-corroborated18000
T3Project policy42000

Every scanner on the same fixtures

In run order. Counts are what each scanner recorded on this family's fixtures, whichever rules it has; a scanner with no rule for the family has nothing to report on it.

Counts per scanner on this family's fixtures
ScannerFixturesLeft readableToo muchFalse alarms
flare-redactRuntime library · 1.6.1 · Published npm package · secrets-only (pii, generic_assignment disabled) · JavaScript engineNo rule maps to it601610
gitleaksRepository scanner · 8.30.1 · Directory scan · default rulesNo rule maps to it60001
redact-secretProduct measured here · 0.1.0-beta.14 · Published npm package · default detectors1 detector mapped60000
trufflehogRepository scanner · 3.97.4 · Filesystem scan · verification disabledNo rule maps to it601700

Looks like it, but isn't

Values the dossier records as resembling this credential without being one.
Collisions
MD5 and other 32-character hashes, UUIDs without dashes, session ids, other vendors' 32-byte keys, and the non-secret AI21_API_HOST, AI21_API_VERSION and AI21_AWS_REGION variables.

Scanner rules for this family

Mapped by hand (reviewed 2026-09-30) from each scanner's pinned rule file, never from what a scanner found on the fixtures.

No peer rule maps to this family

None of the reviewed peer scanners has a rule that can match a credential of this family.

None mapped

60 of 60 rows

Fixtures in this family

60 rows, redact-secret's outcome on each. Rows that need a look come first (0), then the rest in corpus order. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in API key (unprefixed)
FixtureKind and evidenceredact-secret
ai21-api-key-actions-env-literalai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-compose-envai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-curl-headerai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-docker-run-envai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-dotenvai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-dotenv-altai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-exportai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-json-configai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-key-shape-bareai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-key-shape-quotedai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-key-shape-unicode-crlfai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-langchain-kwargai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-litellm-yamlai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-other-host-curl-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-proxy-logai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-python-ctorai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-tool-callai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-ts-ctorai21 · documented-format-literalProject policyT3 · Project policyRedacted
ai21-api-key-actions-secret-referenceai21 · templated-referenceMust not flagT3 · Project policyQuiet
ai21-api-key-angle-key-placeholderai21 · documentation-placeholderMust not flagT3 · Project policyQuiet
ai21-api-key-bare-in-prose-near-missai21 · format-near-missMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-bare-line-near-missai21 · format-near-missMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-base64-text-encoded-valueai21 · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-data-uri-encoded-valueai21 · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-docs-ctor-placeholderai21 · documentation-placeholderMust not flagT3 · Project policyQuiet
ai21-api-key-embedded-run-near-missai21 · format-near-missMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-env-reference-referenceai21 · templated-referenceMust not flagT3 · Project policyQuiet
ai21-api-key-id-named-compose-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-id-named-env-alt-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-id-named-env-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-id-named-export-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-id-named-json-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-id-named-kwarg-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-id-named-tool-call-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-key-guidance-proseai21 · prose-mentionMust not flagT3 · Project policyQuiet
ai21-api-key-key-shape-bare-twinai21 · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
ai21-api-key-key-shape-quoted-twinai21 · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
ai21-api-key-key-shape-unicode-crlf-twinai21 · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
ai21-api-key-label-proseai21 · benign-lookalikeMust not flagT3 · Project policyQuiet
ai21-api-key-long-value-twinai21 · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
ai21-api-key-maskai21 · benign-lookalikeMust not flagT3 · Project policyQuiet
ai21-api-key-missing-keywordai21 · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-model-id-public-idai21 · public-identifierMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-model-notes-proseai21 · prose-mentionMust not flagT3 · Project policyQuiet
ai21-api-key-object-id-public-idai21 · public-identifierMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-other-host-log-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-other-provider-model-twinai21 · missing-context-markerMust not flagT3 · Project policy · twinQuiet
ai21-api-key-project-uuid-public-idai21 · public-identifierMust not flagT2 · Tool-corroboratedQuiet
ai21-api-key-python-environ-referenceai21 · templated-referenceMust not flagT3 · Project policyQuiet
ai21-api-key-referenceai21 · benign-lookalikeMust not flagT3 · Project policyQuiet

Sources

Researched 2026-09-29.

Documentation and code

  • docs.ai21.com/docs/create-api-key
  • github.com/Vulnetix/cli/blob/c6e24fc9b0148dc0a227da70774300fba7f339ee/internal/sast/rules/vnx-sec-315.rego#L25
  • github.com/cunnymessiah/keychecker/blob/122eadc6bdbbeec9f31e94878f98c4692d5b5718/main.py#L242
  • github.com/MCERQUA/LLM-Runner-Router/blob/dc020cfeb6ae071d5582bed6ce3563eea64ae8fd/src/auth/BYOKManager.js#L287-L290
  • github.com/AI21Labs/ai21-python/blob/bbc422f6f955134c2e33a9473ec0f71d21611764/examples/studio/batches/batches.py#L6

Research log