Skip to content
Benchmarks

redact-secret · Report · Detector

PostHog tokens

  • 44 fixtures
  • Format evidence: T1 · Provider-documented
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14

Format evidence

Arrival evidence (#434, product redact-secret#906; #860 handoff posthog.md, READY). A personal API key acts as the user across every organization and project the user can reach. The prefix is documented; the alphabet and algorithm are provider code and unit tests (R1); the 42–49 band is the union of the three prefixed eras (base57 48/49 since 2026-03-30, 35-byte base62 at most 48, 32-byte base62 at most 43) with the 42 floor keeping the 1.6% of 32-byte-era keys that render at 42. The phc_ project token is public and only ever a benign control. Peers lag: trufflehog 3.97.4 stops at 48 (missing the 2.9% of base57 keys at 49 and the 42-byte keys) and admits _, gitleaks 8.30.1 has no PostHog rule. Graduated to a registry detector at the 1127bf9 re-pin (redact-secret PR #938).

What the run recorded, by group

Detector views overlap, so their groups are never summed across detectors. Other scanners are reference values on the same inputs, in run order.
Groups of PostHog tokens fixtures
GroupFixturesLeaked or false alarmsNear-twinsOutcomesOther scanners, same cell
Must not flag · Tool-corroborated19False alarmsat most 16.8%0 of 19 controls flagged19 quiet · 0 flagged
  • flare-redact at most 16.8%
  • gitleaks at most 24.6%
  • trufflehog at most 24.6%
Must not flag · Project policy8False alarmsat most 32.4%0 of 8 controls flagged8 quiet · 0 flagged
  • flare-redact at most 32.4%
  • gitleaks at most 32.4%
  • trufflehog at most 32.4%
Must redact · Provider-documented17Secret spans left readableat most 18.4%0 of 17 spansNear-twins told apartat least 74.1%11 of 11 pairs17 redacted · 0 too much · 0 partly exposed · 0 missed
  • flare-redact at most 93.8%
  • gitleaks at most 64.0%
  • trufflehog at most 47.3%
44 of 44 rows
Fixtures
44
Left readable
0
Redacted too much
0
False alarms
0

Fixtures for this detector

44 fixtures. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in PostHog tokens
FixtureKind and evidenceredact-secret
posthog-token-actions-envposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-bare-proseposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-bearer-headerposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-chat-pasteposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-compose-envposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-curl-projectsposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-dotenvposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-exportposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-json-api-keyposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-json-tokenposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-key-shape-bareposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-key-shape-quotedposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-key-shape-unicode-crlfposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-mcp-configposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-project-token-prefix-twinposthog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-sdk-kwargposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-underscore-in-body-twinposthog · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-x-api-key-headerposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-yaml-configposthog · documented-format-literalMust redactT1 · Provider-documentedRedacted
posthog-token-actions-secret-referenceposthog · templated-referenceMust not flagT3 · Project policyQuiet
posthog-token-body-41-twinposthog · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-body-50-twinposthog · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-ellipsis-placeholderposthog · documentation-placeholderMust not flagT3 · Project policyQuiet
posthog-token-env-reference-referenceposthog · templated-referenceMust not flagT3 · Project policyQuiet
posthog-token-event-uuid-encoded-valueposthog · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
posthog-token-host-urls-public-idposthog · public-identifierMust not flagT2 · Tool-corroboratedQuiet
posthog-token-hyphen-in-body-twinposthog · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-hyphen-prefix-twinposthog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-key-guidance-proseposthog · prose-mentionMust not flagT3 · Project policyQuiet
posthog-token-label-proseposthog · benign-lookalikeMust not flagT3 · Project policyQuiet
posthog-token-leading-glue-twinposthog · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-maskposthog · benign-lookalikeMust not flagT3 · Project policyQuiet
posthog-token-masked-placeholderposthog · documentation-placeholderMust not flagT3 · Project policyQuiet
posthog-token-prefix-onlyposthog · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
posthog-token-project-token-bare-public-idposthog · public-identifierMust not flagT2 · Tool-corroboratedQuiet
posthog-token-project-token-html-public-idposthog · public-identifierMust not flagT2 · Tool-corroboratedQuiet
posthog-token-project-token-init-public-idposthog · public-identifierMust not flagT2 · Tool-corroboratedQuiet
posthog-token-referenceposthog · benign-lookalikeMust not flagT3 · Project policyQuiet
posthog-token-short-bodyposthog · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
posthog-token-short-prefix-twinposthog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-trailing-glue-twinposthog · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-truncated-near-missposthog · format-near-missMust not flagT2 · Tool-corroboratedQuiet
posthog-token-unknown-role-prefix-twinposthog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
posthog-token-uppercase-prefix-twinposthog · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet