Skip to content
Benchmarks

redact-secret · Report · Detector

Azure DevOps personal access tokens

  • 29 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

  • Provider documentation 84-character PAT with AZDO signature · observed 2026-09-23 · tokens are 84 characters long with a fixed AZDO signature at positions 76-80; Microsoft Purview separately supplies the alphanumeric detail used by the pattern
  • Reference 1

Microsoft Purview's detailed pattern says the 84 characters are a-z, A-Z or 0-9 with AZDO fixed at positions 76-80, while its Format summary also says letters, digits and special characters. The detailed pattern and credential example agree with this contract; the contradictory summary is retained as a limitation. The pinned TruffleHog rule still targets the legacy 52-character form and is not corroboration for this shape.

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of Azure DevOps personal access tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Provider-documented12False alarmsat most 24.3%0 of 12 controls flagged12 quiet · 0 flagged
  • flare-redact at most 24.3%
  • gitleaks at most 24.3%
  • trufflehog at most 24.3%
Must not flag · Project policy5False alarmsat most 43.4%0 of 5 controls flagged5 quiet · 0 flagged
  • flare-redact at most 43.4%
  • gitleaks at most 43.4%
  • trufflehog at most 43.4%
Must redact · Provider-documented9Secret spans left readableat most 29.9%0 of 9 spansNear-twins told apartinsufficient-coverage3 of 3 pairs9 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 98.0%
  • gitleaks at most 93.7%
  • trufflehog at most 100.0%
Project policy · Project policy3Secret spans left readableinsufficient-evidence0 of 3 spansNear-twins told apartat least 61.0%6 of 6 pairs3 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact insufficient-evidence
  • gitleaks insufficient-evidence
  • trufflehog insufficient-evidence
29 of 29 rows
Fixtures
29
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

29 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in Azure DevOps personal access tokens
FixtureKind and evidenceredact-secret
azure-devops-personal-access-token-az-devops-login-stdinazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-azdo-marker-bareazure-devops · documented-format-literalProject policyT3 · Project policyRedacted
azure-devops-personal-access-token-azdo-marker-quotedazure-devops · documented-format-literalProject policyT3 · Project policyRedacted
azure-devops-personal-access-token-azdo-marker-unicode-crlfazure-devops · documented-format-literalProject policyT3 · Project policyRedacted
azure-devops-personal-access-token-env-ext-patazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-git-remote-urlazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-github-actions-boards-syncazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-nuget-config-passwordazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-python-sdk-connectionazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-self-hosted-agent-composeazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-shell-export-ext-patazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-terraform-providerazure-devops · documented-format-literalMust redactT1 · Provider-documentedRedacted
azure-devops-personal-access-token-azdo-marker-bare-twinazure-devops · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-azdo-marker-quoted-twinazure-devops · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-azdo-marker-signature-bare-twinazure-devops · boundary-violationMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-azdo-marker-signature-quoted-twinazure-devops · boundary-violationMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-azdo-marker-signature-unicode-crlf-twinazure-devops · boundary-violationMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-azdo-marker-unicode-crlf-twinazure-devops · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-env-ext-pat-signature-offset-twinazure-devops · boundary-violationMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-ext-pat-template-placeholderazure-devops · documentation-placeholderMust not flagT3 · Project policyQuiet
azure-devops-personal-access-token-git-remote-url-length-twinazure-devops · wrong-lengthMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-label-proseazure-devops · benign-lookalikeMust not flagT3 · Project policyQuiet
azure-devops-personal-access-token-maskazure-devops · benign-lookalikeMust not flagT3 · Project policyQuiet
azure-devops-personal-access-token-missing-markerazure-devops · benign-lookalikeMust not flagT1 · Provider-documentedQuiet
azure-devops-personal-access-token-nuget-config-password-signature-case-twinazure-devops · boundary-violationMust not flagT1 · Provider-documented · twinQuiet
azure-devops-personal-access-token-pipeline-ids-public-idazure-devops · public-identifierMust not flagT1 · Provider-documentedQuiet
azure-devops-personal-access-token-referenceazure-devops · benign-lookalikeMust not flagT3 · Project policyQuiet
azure-devops-personal-access-token-rotation-note-proseazure-devops · prose-mentionMust not flagT3 · Project policyQuiet
azure-devops-personal-access-token-short-bodyazure-devops · benign-lookalikeMust not flagT1 · Provider-documentedQuiet