Skip to content
Benchmarks

redact-secret · Evaluation · Qualification

github-token

Taxonomy families: github · Classic personal access token; github · OAuth access token; github · GitHub App user-to-server token; github · GitHub App server-to-server token; github · OAuth refresh token. The status and its evidence, then what each scanner recorded per population.

  • View public
  • Policy revision rs-policy-1:sha256:94c247cf72ea

Support status of the product

Provisional The product’s qualification, derived by the adapter. It is not a scanner observation.

Route
No route
Evidence tier
T1
Evidence basis
provider-documented
Contract tier
T1
Fixture profile claimed
stable-documented
Fixture profile cells met
arrival-provisional, stable-documented, stable-empirical, context-constrained-empirical

Why the status is not stable

  • differential.unresolvedContractDisagreements: 23 > 0 — An unresolved disagreement with a peer scanner over what the provider contract requires means the contract itself may be wrong; stable requires it settled.

Evidence the status was judged on

Floors and fixture-profile cells are read from public-evidence-snapshot alone; a gate reads each gate-bearing population on its own.
Scored cases
198
Positive cases
131
Positive context axes
44
Benign controls
21
Benign control axes
9
Twin pairs
46
Metamorphic critical failures
0
Mutation unresolved critical
0
Differential unresolved disagreements
23

Zero-tolerance gates

The classifier receives the worst gate-bearing population, never a sum. Each population is shown on its own.
Zero-tolerance gates
PopulationTwin pairs that did not discriminateBenign controls flagged
public-evidence-snapshot0 of 460 of 21
regression-corpusNo pairNo control

Scanner observations

What each scanner recorded for this family, per population. These are counts and carry no support status; a case that is pending or not measured is not a miss.
Scanner observations
PopulationScannerCasesPositive spansSpan outcomesLeakedBenign controls flaggedTwin pairs discriminatedPending / not measured
policy-corpuspolicy routeflare-redact0No caseNo case in this populationNo positive spanNo controlNo pairNone
policy-corpuspolicy routegitleaks0No caseNo case in this populationNo positive spanNo controlNo pairNone
policy-corpuspolicy routeredact-secret0No caseNo case in this populationNo positive spanNo controlNo pairNone
policy-corpuspolicy routetrufflehog0No caseNo case in this populationNo positive spanNo controlNo pairNone
public-evidence-snapshotfloors and gatesflare-redact201145EXACT 135 · COVERED 1 · OVERBROAD 3 · MISS 66 spans · 3,104 bytes0 of 2146 of 463 pending
public-evidence-snapshotfloors and gatesgitleaks201145EXACT 91 · MISS 5454 spans · 5,984 bytes0 of 2146 of 463 pending
public-evidence-snapshotfloors and gatesredact-secret201145EXACT 1450 spans · 0 bytes0 of 2146 of 463 pending
public-evidence-snapshotfloors and gatestrufflehog201145EXACT 71 · MISS 7474 spans · 6,784 bytes0 of 2142 of 463 pending
regression-corpusgatesflare-redact0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatesgitleaks0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatesredact-secret0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatestrufflehog0No caseNo case in this populationNo positive spanNo controlNo pairNone

Cases

Each case of this family, per population, with what every scanner recorded for it and the case’s own facts.

Open the cases of github-token