Skip to content
Benchmarks

redact-secret · Evaluation · Qualification

otpauth-uri

Taxonomy families: No provider · OTP seed. The status and its evidence, then what each scanner recorded per population.

  • View public
  • Policy revision rs-policy-1:sha256:94c247cf72ea

Support status of the product

Provisional The product’s qualification, derived by the adapter. It is not a scanner observation.

Route
No route
Evidence tier
T3
Evidence basis
project-policy
Contract tier
T3
Fixture profile claimed
Not recorded
Fixture profile cells met
None

Why the status is not stable

  • policy.positive-cases: 3 (requires 6)
  • policy.positive-axes: 3 (requires 4)
  • policy.benign-cases: 3 (requires 8)
  • policy.benign-axes: 3 (requires 4)
  • policy.twin-pairs: 1 (requires 5)
  • policy.protected-holdout: not-run (requires pass on frozen candidate)

Evidence the status was judged on

Floors and fixture-profile cells are read from public-evidence-snapshot alone; a gate reads each gate-bearing population on its own.
Scored cases
24
Positive cases
9
Positive context axes
2
Benign controls
8
Benign control axes
3
Twin pairs
7
Metamorphic critical failures
0
Mutation unresolved critical
0
Differential unresolved disagreements
0

Zero-tolerance gates

The classifier receives the worst gate-bearing population, never a sum. Each population is shown on its own.
Zero-tolerance gates
PopulationTwin pairs that did not discriminateBenign controls flagged
public-evidence-snapshot0 of 70 of 8
regression-corpusNo pairNo control

Scanner observations

What each scanner recorded for this family, per population. These are counts and carry no support status; a case that is pending or not measured is not a miss.
Scanner observations
PopulationScannerCasesPositive spansSpan outcomesLeakedBenign controls flaggedTwin pairs discriminatedPending / not measured
policy-corpuspolicy routeflare-redact73MISS 33 spans · 96 bytes0 of 30 of 1None
policy-corpuspolicy routegitleaks73MISS 33 spans · 96 bytes0 of 30 of 1None
policy-corpuspolicy routeredact-secret73EXACT 30 spans · 0 bytes0 of 31 of 1None
policy-corpuspolicy routetrufflehog73MISS 33 spans · 96 bytes0 of 30 of 1None
public-evidence-snapshotfloors and gatesflare-redact249MISS 99 spans · 288 bytes0 of 80 of 7None
public-evidence-snapshotfloors and gatesgitleaks249MISS 99 spans · 288 bytes0 of 80 of 7None
public-evidence-snapshotfloors and gatesredact-secret249EXACT 90 spans · 0 bytes0 of 87 of 7None
public-evidence-snapshotfloors and gatestrufflehog249MISS 99 spans · 288 bytes0 of 80 of 7None
regression-corpusgatesflare-redact0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatesgitleaks0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatesredact-secret0No caseNo case in this populationNo positive spanNo controlNo pairNone
regression-corpusgatestrufflehog0No caseNo case in this populationNo positive spanNo controlNo pairNone

Cases

Each case of this family, per population, with what every scanner recorded for it and the case’s own facts.

Open the cases of otpauth-uri