Skip to content
Benchmarks

redact-secret · Report

Project API key (ak_)

ak_ + 20 URL-safe nanoid [A-Za-z0-9_-] with at least one upper- and one lower-case letter (the short-prefix guard).

  • Composio
  • Detectors: composio-api-key
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14
  • Dossier verdictReady
  • Dossier evidence levelT1 · Provider-documented
  • Dossier researched2026-09-28
Registry detector composio-api-key since redact-secret#909 (registry pinned at 1127bf9); graduated from a Beta.11 arrival family (#434 slice g, #860 Tier A handoff), contract in benchmarks/lib/beta8/434g.ts. T1.

Research record

From credential-evidence snapshot-2026.10.06.4 · records at 77ce761 · schema 1.8.0. It describes the research on the format, not what any scanner or the product does, and not a support status.
  • Review stateDraft, not reviewed
  • Format revision1 · current
  • ResearchResearched
  • Researched2026-09-28

3 events in the review history: 2 observed, 1 reviewed. Latest: observed on 2026-09-28 by automation, project maintainer. Project-maintained review is not independent validation. The family record at this release.

Format

Provider format research from credential-evidence snapshot-2026.10.06.4 · records at 77ce761 · schema 1.8.0.

What it looks like

Descriptive pattern
^ak_(?=[A-Za-z0-9_-]*[A-Z])(?=[A-Za-z0-9_-]*[a-z])[A-Za-z0-9_-]{20}$

Parts are shown as recorded. Evidence classes belong to the facts below; no class is assigned to a part.

Format facts

Open questions

No open question is recorded for this revision.

Benchmark dossier notes

From the provider dossier, as written. The evidence level above says how well the format is backed; a fact the dossier does not record is not shown.
Shape
prefix ak_, exactly 20 body characters from [A-Za-z0-9_-] (URL-safe nanoid), no checksum.
Basis
T1. Width and alphabet from a dated staff statement (2026-09-17, Composio's Head of Security, on trufflehog#5321 and gitleaks#2276; ruling R3), plus the provider OpenAPI example (ak_ + 20) and CLI redaction regexes (alphabet, R2). trufflehog PR 5322 carries the same widths and was still open on 2026-09-28.
Issuance
optional confirmation only (checklist in the handoff).
Contract in core
detector-families.md.

In this benchmark

Fixture rows on the current run. Counts are for redact-secret in published · redact-secret 0.1.0-beta.14 mode.
Fixtures
48
Left readable
0
Redacted too much
0
False alarms
0

48 fixtures: 19 expect a redaction, 29 must stay quiet. See every row

redact-secret fixture counts by evidence level
Evidence levelFixturesLeft readableToo muchFalse alarms
T1Provider-documented19000
T2Tool-corroborated21000
T3Project policy8000

Every scanner on the same fixtures

In run order. Counts are what each scanner recorded on this family's fixtures, whichever rules it has; a scanner with no rule for the family has nothing to report on it.

Counts per scanner on this family's fixtures
ScannerFixturesLeft readableToo muchFalse alarms
flare-redactRuntime library · 1.6.1 · Published npm package · secrets-only (pii, generic_assignment disabled) · JavaScript engineNo rule maps to it481810
gitleaksRepository scanner · 8.30.1 · Directory scan · default rulesNo rule maps to it48702
redact-secretProduct measured here · 0.1.0-beta.14 · Published npm package · default detectors1 detector mapped48000
trufflehogRepository scanner · 3.97.4 · Filesystem scan · verification disabledNo rule maps to it481900

Looks like it, but isn't

Values the dossier records as resembling this credential without being one.
Collisions
ak_ is short and its alphabet includes _ and -, so a 20-character snake_case identifier fits; the handoff proposes a mixed-case post check (false-negative cost about 6e-5). oak_ and uak_ contain ak_ but are excluded by the leading boundary. A bkend.ai ak_ + 64 hex is another provider.

Scanner rules for this family

Mapped by hand (reviewed 2026-09-30) from each scanner's pinned rule file, never from what a scanner found on the fixtures.

No peer rule maps to this family

None of the reviewed peer scanners has a rule that can match a credential of this family.

None mapped

48 of 48 rows

Fixtures in this family

48 rows, redact-secret's outcome on each. Rows that need a look come first (0), then the rest in corpus order. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Project API key (ak_)
FixtureKind and evidenceredact-secret
composio-api-key-actions-envcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-bare-prosecomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-bearer-headercomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-chat-pastecomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-compose-envcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-csv-commacomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-digest-encoded-valuecomposio · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
composio-api-key-dotenvcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-end-of-inputcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-exportcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-inside-xak-twincomposio · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-json-api-keycomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-json-tokencomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-key-shape-barecomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-key-shape-quotedcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-key-shape-unicode-crlfcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-mcp-configcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-provider-headercomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-sdk-kwargcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-ts-constructorcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-x-api-key-headercomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-api-key-actions-secret-referencecomposio · templated-referenceMust not flagT3 · Project policyQuiet
composio-api-key-all-lowercase-body-twincomposio · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-all-uppercase-body-twincomposio · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-bkend-ak-64-hex-twincomposio · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-body-long-twincomposio · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-body-short-twincomposio · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-dot-in-body-twincomposio · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-ellipsis-placeholdercomposio · documentation-placeholderMust not flagT3 · Project policyQuiet
composio-api-key-env-reference-referencecomposio · templated-referenceMust not flagT3 · Project policyQuiet
composio-api-key-hyphen-prefix-twincomposio · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-inside-cak-twincomposio · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-inside-oak-twincomposio · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-inside-uak-twincomposio · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-kebab-case-identifier-near-misscomposio · format-near-missMust not flagT2 · Tool-corroboratedQuiet
composio-api-key-key-guidance-prosecomposio · prose-mentionMust not flagT3 · Project policyQuiet
composio-api-key-label-prosecomposio · benign-lookalikeMust not flagT3 · Project policyQuiet
composio-api-key-maskcomposio · benign-lookalikeMust not flagT3 · Project policyQuiet
composio-api-key-plus-in-body-twincomposio · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-prefix-onlycomposio · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
composio-api-key-project-id-public-idcomposio · public-identifierMust not flagT2 · Tool-corroboratedQuiet
composio-api-key-referencecomposio · benign-lookalikeMust not flagT3 · Project policyQuiet
composio-api-key-short-bodycomposio · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
composio-api-key-sibling-placeholders-placeholdercomposio · documentation-placeholderMust not flagT3 · Project policyQuiet
composio-api-key-snake-case-identifier-near-misscomposio · format-near-missMust not flagT2 · Tool-corroboratedQuiet
composio-api-key-trailing-glue-twincomposio · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
composio-api-key-truncated-near-misscomposio · format-near-missMust not flagT2 · Tool-corroboratedQuiet
composio-api-key-uppercase-prefix-twincomposio · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet

Sources

Researched 2026-09-28.

Documentation and code

  • docs.composio.dev/reference/authenticating-to-composio
  • github.com/trufflesecurity/trufflehog/issues/5321
  • github.com/redact-secret/redact-secret/blob/270faf84dc12f6a4a4cf61fe3ffab7aadc4f7262/docs/audits/evidence/860/composio.md
  • github.com/ComposioHQ/composio/tree/34484551843e575e79cca244d9fca3e4459f59e9
  • github.com/gitleaks/gitleaks/issues/2276

Research log

Other Composio families