Skip to content
Benchmarks

redact-secret · Report · Detector

Langfuse secret keys

  • 42 fixtures
  • Format evidence: T2 · Tool-corroborated
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Graduated arrival contract (#210, registry detector since redact-secret#728; research #221 observed 2026-09-24). Covers only issuer-minted keys: Langfuse's own key generator (provider code, unchanged from 2023-06 to 2026-09) builds sk-lf-${randomUUID()}, i.e. sk-lf- plus a lowercase RFC 4122 version-4 UUID (42 characters; version nibble 4, variant nibble 8/9/a/b), and uses the same generator for project, organization and AI-gateway keys. Langfuse documentation shows the sk-lf-/pk-lf- prefixes and the contexts (LANGFUSE_SECRET_KEY, SDK constructors, Basic auth public-key:secret-key, OTLP Authorization=Basic) but states no body grammar, so the tier stays T2: the body is provider code corroborated by trufflehog 3.97.4 (which also requires a langfuse keyword and the paired pk) and betterleaks. The public key pk-lf-<uuid> is documented as safe for browser code and is this family's public-prefix twin and public-id control. Self-hosted operator-defined keys (headless init accepts any string; the admin API enforces only the sk-lf- prefix) are simply outside the minted-shape claim: none is fixtured, and none is asserted silent. The sk-lf-gw- form appears only in a PR description, Storybook stories and a unit-test fixture; it is recorded, neither claimed nor asserted silent. A base64 Basic-auth blob carries the secret only in encoded form; this contract makes no claim on it and it is not fixtured as a control. gitleaks 8.30.1 has no Langfuse rule.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Langfuse secret keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated17False alarmsat most 18.4%0 of 17 controls flagged17 quiet · 0 flagged
  • flare-redact at most 18.4%
  • gitleaks at most 27.0%
  • trufflehog at most 27.0%
Must not flag · Project policy7False alarmsat most 35.4%0 of 7 controls flagged7 quiet · 0 flagged
  • flare-redact at most 35.4%
  • gitleaks at most 35.4%
  • trufflehog at most 35.4%
Must redact · Tool-corroborated18Secret spans left readableat most 17.6%0 of 18 spansNear-twins told apartinsufficient-coverage8 of 8 pairs18 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 17.6%
  • gitleaks at most 56.3%
  • trufflehog at most 87.5%
42 of 42 rows
Fixtures
42
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

42 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Langfuse secret keys
FixtureKind and evidenceredact-secret
langfuse-secret-key-curl-basiclangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-curl-basic-authlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-exportlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-gateway-bearerlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-handover-notelangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-key-shape-barelangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-key-shape-quotedlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-key-shape-unicode-crlflangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-python-clientlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-secret-getlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-twin-base-cilangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-twin-base-pythonlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-typescript-clientlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-variant-nibble-twinlangfuse · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
langfuse-secret-key-version-nibble-twin-wrong-alphabetlangfuse · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
langfuse-secret-key-browser-public-key-public-idlangfuse · public-identifierMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-compose-initlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-dotenvlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-env-example-placeholderlangfuse · documentation-placeholderMust not flagT3 · Project policyQuiet
langfuse-secret-key-error-log-team-settingslangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-hashed-key-row-encoded-valuelangfuse · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-k8s-secret-ref-referencelangfuse · templated-referenceMust not flagT3 · Project policyQuiet
langfuse-secret-key-key-pair-doc-proselangfuse · prose-mentionMust not flagT3 · Project policyQuiet
langfuse-secret-key-litellm-configlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-long-last-group-twinlangfuse · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
langfuse-secret-key-masklangfuse · benign-lookalikeMust not flagT3 · Project policyQuiet
langfuse-secret-key-masked-display-placeholderlangfuse · documentation-placeholderMust not flagT3 · Project policyQuiet
langfuse-secret-key-no-hyphens-twinlangfuse · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
langfuse-secret-key-prefix-onlylangfuse · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-prefix-only-grep-near-misslangfuse · format-near-missMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-public-idlangfuse · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-public-key-twinlangfuse · public-sibling-prefixMust not flagT2 · Tool-corroborated · twinQuiet
langfuse-secret-key-python-env-lookup-referencelangfuse · templated-referenceMust not flagT3 · Project policyQuiet
langfuse-secret-key-referencelangfuse · benign-lookalikeMust not flagT3 · Project policyQuiet
langfuse-secret-key-region-hosts-env-public-idlangfuse · public-identifierMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-short-bodylangfuse · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-short-last-group-twinlangfuse · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
langfuse-secret-key-trace-url-ids-public-idlangfuse · public-identifierMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-truncated-uuid-near-misslangfuse · format-near-missMust not flagT2 · Tool-corroboratedQuiet
langfuse-secret-key-twin-base-dotenvlangfuse · documented-format-literalMust redactT2 · Tool-corroboratedRedacted
langfuse-secret-key-variant-nibble-twin-wrong-alphabetlangfuse · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
langfuse-secret-key-version-nibble-twinlangfuse · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet