Skip to content
Benchmarks

redact-secret · Evaluation · Qualification

vercel-app-refresh-token

Taxonomy families: vercel · App refresh token. The status and its evidence, then what each scanner recorded per population.

  • View public
  • Policy revision rs-policy-1:sha256:94c247cf72ea

Support status of the product

Provisional The product’s qualification, derived by the adapter. It is not a scanner observation.

Route
No route
Evidence tier
T2
Evidence basis
corroborated
Contract tier
T2
Fixture profile claimed
stable-empirical
Fixture profile cells met
arrival-provisional, stable-documented

Why the status is not stable

  • empirical.minimumTwinPairs: 5 < 8 — Eight independently authored twin pairs complete the 40-fixture empirical profile.
  • twinFailures: 1 > 0 — A twin failure is a recorded false negative on the exact discrimination this project exists to make; stable tolerates none, however small the sample.
  • mutation.unresolvedCritical: 2 > 0 — An unresolved critical mutation finding is a fixture-versus-detector disagreement nobody has reviewed yet; tier or sample size cannot substitute for that review.
  • fixtureProfile stable-empirical: 37 total fixtures < 40 (3 short)
  • fixtureProfile stable-empirical: 5 twin pairs < 8 (3 short)

Evidence the status was judged on

Floors and fixture-profile cells are read from public-evidence-snapshot alone; a gate reads each gate-bearing population on its own.
Scored cases
37
Positive cases
18
Positive context axes
10
Benign controls
14
Benign control axes
5
Twin pairs
5
Metamorphic critical failures
0
Mutation unresolved critical
2
Differential unresolved disagreements
0

Zero-tolerance gates

The classifier receives the worst gate-bearing population, never a sum. Each population is shown on its own.
Zero-tolerance gates
PopulationTwin pairs that did not discriminateBenign controls flagged
public-evidence-snapshot1 of 50 of 14
regression-corpusNo pairNo control

Scanner observations

What each scanner recorded for this family, per population. These are counts and carry no support status; a case that is pending or not measured is not a miss.
Scanner observations
PopulationScannerCasesPositive spansSpan outcomesLeakedBenign controls flaggedTwin pairs discriminatedPending / not measured
policy-corpuspolicy routeflare-redact0No caseNo case in this populationNo positive spanNo controlNo pairNone
policy-corpuspolicy routegitleaks0No caseNo case in this populationNo positive spanNo controlNo pairNone
policy-corpuspolicy routeredact-secret0No caseNo case in this populationNo positive spanNo controlNo pairNone
policy-corpuspolicy routetrufflehog0No caseNo case in this populationNo positive spanNo controlNo pairNone
public-evidence-snapshotfloors and gatesflare-redact4018OVERBROAD 1 · MISS 1717 spans · 1,020 bytes0 of 140 of 53 pending
public-evidence-snapshotfloors and gatesgitleaks4018EXACT 12 · MISS 66 spans · 360 bytes0 of 143 of 53 pending
public-evidence-snapshotfloors and gatesredact-secret4018EXACT 180 spans · 0 bytes0 of 144 of 53 pending
public-evidence-snapshotfloors and gatestrufflehog4018MISS 1818 spans · 1,080 bytes0 of 140 of 53 pending
regression-corpusgatesflare-redact0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatesgitleaks0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatesredact-secret0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatestrufflehog0No caseNo case in this populationNo positive spanNo controlNo pairNone

Cases

Each case of this family, per population, with what every scanner recorded for it and the case’s own facts.

Open the cases of vercel-app-refresh-token