Skip to content
Benchmarks

redact-secret · Report · Detector

Tavily API keys

  • 45 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#384, product redact-secret#867; research #786). T2 pending hands-on corroboration: Tavily's docs show the tvly- prefix in a placeholder (tvly-YOUR_API_KEY) and tvly-dev- in truncated sample values, and state no length or alphabet. The 32-alphanumeric body rests on one scanner rule (noseyparker, which predates tvly-dev- and so cannot match that form) and three maintainer-observed samples from 2024-2025 (tvly- and tvly-dev-, each with a 32-character mixed-case alphanumeric body). GitGuardian confirms a prefixed detector without a length. Whether a tvly-prod- prefix exists and the width of production or enterprise keys are unresolved (a third-party integration doc says production keys begin with plain tvly-), so no fixture asserts silence on either. Neither pinned scanner has a Tavily rule.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Tavily API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated18False alarmsat most 17.6%0 of 18 controls flagged18 quiet · 0 flagged
  • flare-redact at most 17.6%
  • gitleaks at most 39.2%
  • trufflehog at most 17.6%
Must not flag · Project policy9False alarmsat most 29.9%0 of 9 controls flagged9 quiet · 0 flagged
  • flare-redact at most 43.5%
  • gitleaks at most 43.5%
  • trufflehog at most 29.9%
Must redact · Tool-corroborated18Secret spans left readableat most 17.6%0 of 18 spansNear-twins told apartinsufficient-coverage8 of 8 pairs18 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 96.9%
  • gitleaks at most 79.7%
  • trufflehog at most 100.0%
45 of 45 rows
Fixtures
45
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

45 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Tavily API keys
FixtureKind and evidenceredact-secret
tavily-api-key-actions-envtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-cli-flagtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-compose-envtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-curl-bearertavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-docs-bearer-placeholdertavily · documentation-placeholderMust not flagT3 · Project policyQuiet
tavily-api-key-dotenv-devtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-export-baretavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-js-clienttavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-json-bodytavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-key-digest-encoded-valuetavily · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-key-shape-baretavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-key-shape-quotedtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-key-shape-unicode-crlftavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-langchain-kwargtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-mcp-client-envtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-prefix-absent-twintavily · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-python-clienttavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-remote-mcp-querytavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-search-logtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-tool-calltavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-uppercase-prefix-twintavily · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-yaml-configtavily · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
tavily-api-key-base64-etag-encoded-valuetavily · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-cli-and-prefix-prosetavily · prose-mentionMust not flagT3 · Project policyQuiet
tavily-api-key-cli-login-reference-referencetavily · templated-referenceMust not flagT3 · Project policyQuiet
tavily-api-key-dev-ellipsis-placeholdertavily · documentation-placeholderMust not flagT3 · Project policyQuiet
tavily-api-key-dev-word-run-near-misstavily · format-near-missMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-docs-url-public-idtavily · public-identifierMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-embedded-leading-twintavily · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-env-reference-referencetavily · templated-referenceMust not flagT3 · Project policyQuiet
tavily-api-key-hyphen-in-body-twintavily · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-key-name-public-idtavily · public-identifierMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-label-prosetavily · benign-lookalikeMust not flagT3 · Project policyQuiet
tavily-api-key-long-body-twintavily · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-masktavily · benign-lookalikeMust not flagT3 · Project policyQuiet
tavily-api-key-prefix-onlytavily · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-prefix-only-near-misstavily · format-near-missMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-referencetavily · benign-lookalikeMust not flagT3 · Project policyQuiet
tavily-api-key-request-id-public-idtavily · public-identifierMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-short-bodytavily · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-short-body-near-misstavily · format-near-missMust not flagT2 · Tool-corroboratedQuiet
tavily-api-key-short-body-twintavily · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-underscore-delimiter-twintavily · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-underscore-in-body-twintavily · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
tavily-api-key-x-run-placeholdertavily · documentation-placeholderMust not flagT3 · Project policyQuiet