Skip to content
Benchmarks

redact-secret · Report · Detector

Datadog application keys

  • 29 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Re-checked 2026-09-22 (redact-secret#162, product research at redact-secret#645): the legacy bare 40-character shape, gated on a same-line datadog/dd marker, is unchanged and corroborated only by TruffleHog's datadogtoken detector and gitleaks's datadog-access-token rule, neither of which accepts ddapp_. The current shape carries its own identifying grammar: a ddapp_ prefix Datadog documents on its own domain (personal-access-tokens and service-access-tokens comparison tables), plus a 34-character body corroborated only by Datadog-owned code (the Agent app-key validator, the Agent scrubber, CloudFormation and ARM templates) and AWS's partner doc. The Agent scrubber alone allows an underscore inside the body where every other Datadog-owned validator, and every corroborating source, states pure alphanumeric; that source is read as lenient-by-design, not as the real grammar, so `pattern` stays alphanumeric-only. Neither pinned scanner registers any rule for this shape. Re-checked 2026-09-23 (redact-secret#671, PR #679): the product split the legacy bare-hex generation into its own datadog-application-key-legacy detector, so that shape is the separate datadog-application-key-legacy contract here and this family now carries the ddapp_ shape only.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Datadog application keys fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated12False alarmsat most 24.3%0 of 12 controls flagged12 quiet · 0 flagged
  • flare-redact at most 24.3%
  • gitleaks at most 24.3%
  • trufflehog at most 24.3%
Must not flag · Project policy5False alarmsat most 43.4%0 of 5 controls flagged5 quiet · 0 flagged
  • flare-redact at most 43.4%
  • gitleaks at most 43.4%
  • trufflehog at most 43.4%
Must redact · Provider-documented12Secret spans left readableat most 24.3%0 of 12 spansNear-twins told apartat least 70.1%9 of 9 pairs12 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 100.0%
  • gitleaks at most 100.0%
  • trufflehog at most 100.0%
29 of 29 rows
Fixtures
29
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

29 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Datadog application keys
FixtureKind and evidenceredact-secret
datadog-application-key-api-client-pythondatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-datadog-ci-jsondatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-dogshell-flagdatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-env-app-keydatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-gitlab-ci-variablesdatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-helm-valuesdatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-http-headerdatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-prefixed-env-marker-baredatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-prefixed-env-marker-quoteddatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-prefixed-env-marker-unicode-crlfdatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-shell-export-app-keydatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-terraform-providerdatadog · documented-format-literalMust redactT1 · Provider-documentedRedacted
datadog-application-key-api-client-python-prefix-twindatadog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-app-key-template-placeholderdatadog · documentation-placeholderMust not flagT3 · Project policyQuiet
datadog-application-key-audit-fingerprint-encoded-valuedatadog · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
datadog-application-key-http-header-separator-twindatadog · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-key-id-listing-public-iddatadog · public-identifierMust not flagT2 · Tool-corroboratedQuiet
datadog-application-key-label-prosedatadog · benign-lookalikeMust not flagT3 · Project policyQuiet
datadog-application-key-maskdatadog · benign-lookalikeMust not flagT3 · Project policyQuiet
datadog-application-key-ordinary-prosedatadog · benign-lookalikeMust not flagT3 · Project policyQuiet
datadog-application-key-prefixed-env-marker-bare-twindatadog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-prefixed-env-marker-boundary-bare-twindatadog · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-prefixed-env-marker-boundary-quoted-twindatadog · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-prefixed-env-marker-boundary-unicode-crlf-twindatadog · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-prefixed-env-marker-quoted-twindatadog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-prefixed-env-marker-unicode-crlf-twindatadog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
datadog-application-key-prefixed-short-keydatadog · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
datadog-application-key-referencedatadog · benign-lookalikeMust not flagT3 · Project policyQuiet
datadog-application-key-terraform-provider-prefix-case-twindatadog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet