Skip to content
Benchmarks

redact-secret · Report · Detector

New Relic user API keys

  • 36 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

The provider's word “Most” is a material qualifier: this contract covers the documented NRAK- family, not every possible New Relic user key. Both pinned scanners corroborate the exact contracted shape.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of New Relic user API keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated15False alarmsat most 20.4%0 of 15 controls flagged15 quiet · 0 flagged
  • flare-redact at most 20.4%
  • gitleaks at most 20.4%
  • trufflehog at most 20.4%
Must not flag · Project policy4False alarmsinsufficient-evidence0 of 4 controls flagged4 quiet · 0 flagged
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
Must redact · Provider-documented17Secret spans left readableat most 18.4%0 of 17 spansNear-twins told apartat least 74.1%11 of 11 pairs17 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 18.4%
  • gitleaks at most 47.3%
  • trufflehog at most 18.4%
36 of 36 rows
Fixtures
36
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

36 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in New Relic user API keys
FixtureKind and evidenceredact-secret
new-relic-user-api-key-newrelic-profiles-addnew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-shape-1-barenew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-shape-1-quotednew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-shape-1-unicode-crlfnew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-account-and-entity-ids-public-idnew-relic · public-identifierMust not flagT2 · Tool-corroboratedQuiet
new-relic-user-api-key-bomnew-relic · multibyte-text-offsetsMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-bom-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-env-api-keynew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-gitlab-ci-variablesnew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-jsonnew-relic · structured-text-valueMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-json-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-key-fingerprint-encoded-valuenew-relic · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
new-relic-user-api-key-key-types-note-prosenew-relic · prose-mentionMust not flagT3 · Project policyQuiet
new-relic-user-api-key-label-prosenew-relic · benign-lookalikeMust not flagT3 · Project policyQuiet
new-relic-user-api-key-markdownnew-relic · markdown-and-comment-valueMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-markdown-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-masknew-relic · benign-lookalikeMust not flagT3 · Project policyQuiet
new-relic-user-api-key-nerdgraph-api-key-headernew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-no-final-newlinenew-relic · value-at-input-edgesMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-no-final-newline-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-prefix-onlynew-relic · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
new-relic-user-api-key-pythonnew-relic · source-code-string-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-python-nerdgraph-clientnew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-python-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-referencenew-relic · benign-lookalikeMust not flagT3 · Project policyQuiet
new-relic-user-api-key-shape-1-bare-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-shape-1-quoted-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-shape-1-unicode-crlf-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-short-bodynew-relic · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
new-relic-user-api-key-single-quotesnew-relic · quoted-value-extentMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-single-quotes-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-terraform-providernew-relic · documented-format-literalMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-tomlnew-relic · structured-text-valueMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-toml-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
new-relic-user-api-key-yamlnew-relic · structured-text-valueMust redactT1 · Provider-documentedRedacted
new-relic-user-api-key-yaml-twinnew-relic · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet