Skip to content
Benchmarks

redact-secret · Report · Detector

Convex deployment keys

  • 41 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#436, product redact-secret#912; #860 handoff convex.md, READY for the hex body). T1 under ruling R1: the provider backend joins {deployment_name}|{encrypted_part}, writes version byte 01, a 12-byte nonce, the AES-GCM-SIV ciphertext and a 16-byte tag, and hex-encodes it in lower case; the 74–96 even length is derived from the proto fields the broker always sets. The CLI accepts prod:/dev: + a cloud name and preview:/project: + two slugs; the slug grammar is project policy (bounded, no source). The secret span is the whole key, name included, because it is the one string the CLI consumes. Excluded: CONVEX_DEPLOYMENT=dev:<name> selectors (no |), convex.cloud URLs, pre-0.16.0 bare keys, team and OAuth tokens, docs placeholders whose body fails the grammar. The current cloud deploy-key body (eyJ2…) is issuance-gated: ruling R4 fixes only its prefix, so no fixture asserts it either way. Neither pinned peer has a Convex rule. Graduated to a registry detector at the 1127bf9 re-pin (redact-secret PR #938).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Convex deployment keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated17False alarmsat most 18.4%0 of 17 controls flagged17 quiet · 0 flagged
  • flare-redact at most 18.4%
  • gitleaks at most 18.4%
  • trufflehog at most 18.4%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Provider-documented16Secret spans left readableat most 19.4%0 of 16 spansNear-twins told apartat least 72.2%10 of 10 pairs16 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 100.0%
  • gitleaks at most 100.0%
  • trufflehog at most 100.0%
41 of 41 rows
Fixtures
41
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

41 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Convex deployment keys
FixtureKind and evidenceredact-secret
convex-deployment-key-actions-deployconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-bare-proseconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-bearer-headerconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-chat-pasteconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-compose-self-hostedconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-curl-authorization-convexconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-dotenvconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-exportconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-json-api-keyconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-json-tokenconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-key-shape-bareconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-key-shape-quotedconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-key-shape-unicode-crlfconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-mcp-envconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-sdk-kwargconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-x-api-key-headerconvex · documented-format-literalMust redactT1 · Provider-documentedRedacted
convex-deployment-key-actions-secret-referenceconvex · templated-referenceMust not flagT3 · Project policyQuiet
convex-deployment-key-adjective-animal-placeholderconvex · documentation-placeholderMust not flagT3 · Project policyQuiet
convex-deployment-key-body-72-twinconvex · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-body-98-twinconvex · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-body-variable-referenceconvex · templated-referenceMust not flagT3 · Project policyQuiet
convex-deployment-key-deployment-selector-public-idconvex · public-identifierMust not flagT2 · Tool-corroboratedQuiet
convex-deployment-key-deployment-urls-public-idconvex · public-identifierMust not flagT2 · Tool-corroboratedQuiet
convex-deployment-key-digest-after-pipe-encoded-valueconvex · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
convex-deployment-key-docs-name-and-key-placeholderconvex · documentation-placeholderMust not flagT3 · Project policyQuiet
convex-deployment-key-double-separator-twinconvex · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-g-in-body-twinconvex · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-key-guidance-proseconvex · prose-mentionMust not flagT3 · Project policyQuiet
convex-deployment-key-label-proseconvex · benign-lookalikeMust not flagT3 · Project policyQuiet
convex-deployment-key-maskconvex · benign-lookalikeMust not flagT3 · Project policyQuiet
convex-deployment-key-odd-length-body-twinconvex · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-prefix-onlyconvex · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
convex-deployment-key-prod-selector-public-idconvex · public-identifierMust not flagT2 · Tool-corroboratedQuiet
convex-deployment-key-referenceconvex · benign-lookalikeMust not flagT3 · Project policyQuiet
convex-deployment-key-short-bodyconvex · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
convex-deployment-key-space-before-separator-twinconvex · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-table-cell-near-missconvex · format-near-missMust not flagT2 · Tool-corroboratedQuiet
convex-deployment-key-trailing-glue-twinconvex · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-underscore-name-twinconvex · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-uppercase-hex-byte-twinconvex · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
convex-deployment-key-version-02-twinconvex · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet