Skip to content
Benchmarks

redact-secret · Report · Detector

composio-user-api-key

  • 36 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#434, product redact-secret#909; #860 handoff composio.md, READY under R6). The user key is issued by composio login (x-user-api-key, COMPOSIO_USER_API_KEY). T1 for 43: the dated staff statement (R3); the CLI code comment showing uak_ + 20 is T2 (R6), so a 20-byte uak_ is outside the contract and a length twin. The optional issuance check would confirm or contradict the width; a contradiction changes the contract through a follow-up, never by widening. Neither pinned peer has a Composio rule.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of composio-user-api-key fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated15False alarmsat most 20.4%0 of 15 controls flagged15 quiet · 0 flagged
  • flare-redact at most 20.4%
  • gitleaks at most 29.8%
  • trufflehog at most 20.4%
Must not flag · Project policy5False alarmsat most 43.4%0 of 5 controls flagged5 quiet · 0 flagged
  • flare-redact at most 43.4%
  • gitleaks at most 43.4%
  • trufflehog at most 43.4%
Must redact · Provider-documented16Secret spans left readableat most 19.4%0 of 16 spansNear-twins told apartat least 72.2%10 of 10 pairs16 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 98.9%
  • gitleaks at most 49.5%
  • trufflehog at most 100.0%
36 of 36 rows
Fixtures
36
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

36 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in composio-user-api-key
FixtureKind and evidenceredact-secret
composio-user-api-key-actions-envcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-bare-prosecomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-bearer-headercomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-chat-pastecomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-compose-envcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-csv-commacomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-digest-encoded-valuecomposio · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
composio-user-api-key-dotenvcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-end-of-inputcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-exportcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-json-api-keycomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-json-tokencomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-mcp-configcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-provider-headercomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-sdk-kwargcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-ts-constructorcomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-x-api-key-headercomposio · documented-format-literalMust redactT1 · Provider-documentedRedacted
composio-user-api-key-actions-secret-referencecomposio · templated-referenceMust not flagT3 · Project policyQuiet
composio-user-api-key-body-44-twincomposio · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-body-long-twincomposio · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-body-short-twincomposio · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-dot-in-body-twincomposio · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-ellipsis-placeholdercomposio · documentation-placeholderMust not flagT3 · Project policyQuiet
composio-user-api-key-env-reference-referencecomposio · templated-referenceMust not flagT3 · Project policyQuiet
composio-user-api-key-hyphen-prefix-twincomposio · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-kebab-case-identifier-near-misscomposio · format-near-missMust not flagT2 · Tool-corroboratedQuiet
composio-user-api-key-key-guidance-prosecomposio · prose-mentionMust not flagT3 · Project policyQuiet
composio-user-api-key-leading-glue-twincomposio · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-legacy-width-20-twincomposio · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-plus-in-body-twincomposio · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-project-id-public-idcomposio · public-identifierMust not flagT2 · Tool-corroboratedQuiet
composio-user-api-key-sibling-placeholders-placeholdercomposio · documentation-placeholderMust not flagT3 · Project policyQuiet
composio-user-api-key-snake-case-identifier-near-misscomposio · format-near-missMust not flagT2 · Tool-corroboratedQuiet
composio-user-api-key-trailing-glue-twincomposio · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
composio-user-api-key-truncated-near-misscomposio · format-near-missMust not flagT2 · Tool-corroboratedQuiet
composio-user-api-key-uppercase-prefix-twincomposio · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet