Skip to content
Benchmarks

redact-secret · Report

langsmith

Cases of the public evidence snapshot whose id starts with langsmith--.

  • 42 fixtures
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14
42 of 42 rows
Fixtures
42
Left readable
0
Redacted too much
0
False alarms
0

Fixtures in this suite

42 fixtures in this suite. Open a fixture for its bytes, expected spans and what each scanner reported.
Fixtures in langsmith
FixtureKind and evidenceflare-redactgitleaksredact-secrettrufflehog
langsmith-api-key-export-patlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-langgraph-clilangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableLeft readableRedactedRedacted
langsmith-api-key-op-readlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableLeft readableRedactedRedacted
langsmith-api-key-pat-dotenvlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-pat-nested-run-metadatalangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-pat-otlp-header-listlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableLeft readableRedactedRedacted
langsmith-api-key-pat-profile-jsonlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-pat-shape-barelangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableLeft readableRedactedRedacted
langsmith-api-key-pat-shape-quotedlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableLeft readableRedactedRedacted
langsmith-api-key-pat-shape-unicode-crlflangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableLeft readableRedactedRedacted
langsmith-api-key-runbooklangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableLeft readableRedactedRedacted
langsmith-api-key-service-key-legacy-exportlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-service-key-python-clientlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-service-key-workflow-envlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-service-key-x-api-keylangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-short-tail-twinlangsmith · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuietFlaggedQuietQuiet
langsmith-api-key-twin-base-cilangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-twin-base-dotenvlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-twin-base-jsonlangsmith · documented-format-literalMust redactT2 · Tool-corroboratedLeft readableRedactedRedactedRedacted
langsmith-api-key-env-example-placeholderlangsmith · documentation-placeholderMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-key-roles-doc-proselangsmith · prose-mentionMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-label-proselangsmith · benign-lookalikeMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-legacy-readme-placeholderlangsmith · documentation-placeholderMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-long-tail-twinlangsmith · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuietQuietQuietQuiet
langsmith-api-key-masklangsmith · benign-lookalikeMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-masked-short-key-placeholderlangsmith · documentation-placeholderMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-merged-segments-twinlangsmith · boundary-violationMust not flagT2 · Tool-corroborated · twinQuietQuietQuietQuiet
langsmith-api-key-missing-tail-near-misslangsmith · format-near-missMust not flagT2 · Tool-corroboratedQuietQuietQuietQuiet
langsmith-api-key-non-hex-body-twinlangsmith · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuietQuietQuietQuiet
langsmith-api-key-non-hex-tail-twinlangsmith · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuietQuietQuietQuiet
langsmith-api-key-prefix-onlylangsmith · benign-lookalikeMust not flagT2 · Tool-corroboratedQuietQuietQuietQuiet
langsmith-api-key-prefix-only-grep-near-misslangsmith · format-near-missMust not flagT2 · Tool-corroboratedQuietQuietQuietQuiet
langsmith-api-key-python-env-lookup-referencelangsmith · templated-referenceMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-referencelangsmith · benign-lookalikeMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-requirements-hash-encoded-valuelangsmith · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuietQuietQuietQuiet
langsmith-api-key-role-code-twinlangsmith · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuietQuietQuietQuiet
langsmith-api-key-short-bodylangsmith · benign-lookalikeMust not flagT2 · Tool-corroboratedQuietQuietQuietQuiet
langsmith-api-key-short-first-segment-twinlangsmith · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuietQuietQuietQuiet
langsmith-api-key-trace-share-link-public-idlangsmith · public-identifierMust not flagT2 · Tool-corroboratedQuietQuietQuietQuiet
langsmith-api-key-unknown-role-code-twinlangsmith · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuietQuietQuietQuiet
langsmith-api-key-workflow-secret-ref-referencelangsmith · templated-referenceMust not flagT3 · Project policyQuietQuietQuietQuiet
langsmith-api-key-workspace-ids-env-public-idlangsmith · public-identifierMust not flagT2 · Tool-corroboratedQuietQuietQuietQuiet

FIXTURE

 

  •  
Loading the fixture