Skip to content
Benchmarks

redact-secret · Report · Detector

Pinecone API keys

  • 43 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Graduated arrival contract (registry detector since redact-secret#730). Lexical separability decided before authoring (#212): the pcsk_ prefix with a label segment and a 63-character secret segment separates a current key from every recorded confusable (UUID key/project/service-account ids, index hosts, environment names, masked pcsk*** values). The pcsk_ prefix and the <label>_<secret> segmenting come from provider code (Pinecone CLI help, Python SDK unit tests, the pinecone-io/skills guidance), not provider documentation; the 5-6 label width and 63-character secret come from peer rules (trufflehog 3.97.4 pinecone; betterleaks pinecone-api-key.2, which likely shares its grammar), hence T2. benchmarks/detector-inventory.json records the trufflehog detector as feature-gated (PineconeDetectorEnabled), yet the pinned 3.97.4 filesystem scan reported every pcsk_ positive in this corpus's first run (2026-09-24); that inventory contradiction is recorded, not resolved here. Contradiction kept open: Pinecone's Admin API documentation and generated SDK models describe new keys as pckey_<public-label>_<unique-key>, a prefix no tool, code sample or observation shows. No fixture asserts silence on pckey_. Legacy bare-UUID keys are the separate context-gated pinecone-api-key-legacy family; service-account client secrets are another credential class and are not controls.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Pinecone API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated15False alarmsat most 20.4%0 of 15 controls flagged15 quiet · 0 flagged
  • flare-redact at most 20.4%
  • gitleaks at most 29.8%
  • trufflehog at most 20.4%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 29.9%
  • gitleaks at most 43.5%
  • trufflehog at most 29.9%
Must redact · Tool-corroborated18Secret spans left readableat most 17.6%0 of 18 spansNear-twins told apartinsufficient-coverage8 of 8 pairs18 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 100.0%
  • gitleaks at most 56.3%
  • trufflehog at most 17.6%
Project policy · Project policy1Secret spans left readableinsufficient-evidence0 of 1 spans1 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
43 of 43 rows
Fixtures
43
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

43 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Pinecone API keys
FixtureKind and evidenceredact-secret
cerebras-api-key-pinecone-key-near-misspinecone · credential-named-literal-near-missProject policyT3 · Project policyRedacted
pinecone-api-key-actions-envpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-api-key-headerpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-compose-envpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-dotenvpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-error-logpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-exportpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-header-placeholder-placeholderpinecone · documentation-placeholderMust not flagT3 · Project policyQuiet
pinecone-api-key-json-configpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-key-shape-barepinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-key-shape-quotedpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-key-shape-unicode-crlfpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-n8n-credentialpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-pc-configpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-python-clientpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-secret-printpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-short-secret-twinpinecone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
pinecone-api-key-ts-clientpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-twin-base-dotenvpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-twin-base-exportpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-twin-base-pythonpinecone · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
pinecone-api-key-base64-host-encoded-valuepinecone · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
pinecone-api-key-cli-environment-public-idpinecone · public-identifierMust not flagT2 · Tool-corroboratedQuiet
pinecone-api-key-cli-mask-placeholderpinecone · documentation-placeholderMust not flagT3 · Project policyQuiet
pinecone-api-key-ellipsis-placeholderpinecone · documentation-placeholderMust not flagT3 · Project policyQuiet
pinecone-api-key-env-reference-referencepinecone · templated-referenceMust not flagT3 · Project policyQuiet
pinecone-api-key-hyphen-delimiter-twinpinecone · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
pinecone-api-key-index-host-public-idpinecone · public-identifierMust not flagT2 · Tool-corroboratedQuiet
pinecone-api-key-key-guidance-prosepinecone · prose-mentionMust not flagT3 · Project policyQuiet
pinecone-api-key-label-prosepinecone · benign-lookalikeMust not flagT3 · Project policyQuiet
pinecone-api-key-long-label-twinpinecone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
pinecone-api-key-long-secret-twinpinecone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
pinecone-api-key-maskpinecone · benign-lookalikeMust not flagT3 · Project policyQuiet
pinecone-api-key-prefix-letter-twinpinecone · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
pinecone-api-key-prefix-onlypinecone · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
pinecone-api-key-prefix-only-near-misspinecone · format-near-missMust not flagT2 · Tool-corroboratedQuiet
pinecone-api-key-project-id-public-idpinecone · public-identifierMust not flagT2 · Tool-corroboratedQuiet
pinecone-api-key-referencepinecone · benign-lookalikeMust not flagT3 · Project policyQuiet
pinecone-api-key-sdk-environ-referencepinecone · templated-referenceMust not flagT3 · Project policyQuiet
pinecone-api-key-short-bodypinecone · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
pinecone-api-key-short-label-twinpinecone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
pinecone-api-key-short-label-twin-wrong-lengthpinecone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
pinecone-api-key-short-secret-twin-wrong-lengthpinecone · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet