Skip to content
Benchmarks

redact-secret · Evaluation · Qualification

connection-string

Taxonomy families: No provider · Connection-string password. The status and its evidence, then what each scanner recorded per population.

  • View public
  • Policy revision rs-policy-1:sha256:94c247cf72ea

Support status of the product

Provisional The product’s qualification, derived by the adapter. It is not a scanner observation.

Route
No route
Evidence tier
T3
Evidence basis
project-policy
Contract tier
T3
Fixture profile claimed
Not recorded
Fixture profile cells met
arrival-provisional, stable-documented, stable-empirical, context-constrained-empirical

Why the status is not stable

  • policy.positive-cases: 2 (requires 6)
  • policy.positive-axes: 2 (requires 4)
  • policy.benign-cases: 1 (requires 8)
  • policy.benign-axes: 1 (requires 4)
  • policy.twin-pairs: 1 (requires 5)
  • policy.critical-failure: 2 (requires 0)
  • policy.protected-holdout: not-run (requires pass on frozen candidate)
  • differential.unresolvedContractDisagreements: 2 > 0 — An unresolved disagreement with a peer scanner over what the provider contract requires means the contract itself may be wrong; stable requires it settled.

Evidence the status was judged on

Floors and fixture-profile cells are read from public-evidence-snapshot alone; a gate reads each gate-bearing population on its own.
Scored cases
104
Positive cases
45
Positive context axes
19
Benign controls
41
Benign control axes
13
Twin pairs
18
Metamorphic critical failures
0
Mutation unresolved critical
0
Differential unresolved disagreements
2

Zero-tolerance gates

The classifier receives the worst gate-bearing population, never a sum. Each population is shown on its own.
Zero-tolerance gates
PopulationTwin pairs that did not discriminateBenign controls flagged
public-evidence-snapshot0 of 180 of 41
regression-corpusNo pair0 of 13

Scanner observations

What each scanner recorded for this family, per population. These are counts and carry no support status; a case that is pending or not measured is not a miss.
Scanner observations
PopulationScannerCasesPositive spansSpan outcomesLeakedBenign controls flaggedTwin pairs discriminatedPending / not measured
policy-corpuspolicy routeflare-redact42OVERBROAD 1 · MISS 11 spans · 24 bytes1 of 10 of 1None
policy-corpuspolicy routegitleaks42MISS 22 spans · 48 bytes0 of 10 of 1None
policy-corpuspolicy routeredact-secret42EXACT 20 spans · 0 bytes0 of 11 of 1None
policy-corpuspolicy routetrufflehog42OVERBROAD 1 · MISS 11 spans · 24 bytes0 of 10 of 1None
public-evidence-snapshotfloors and gatesflare-redact10445COVERED 30 · OVERBROAD 9 · MISS 66 spans · 81 bytes18 of 4117 of 18None
public-evidence-snapshotfloors and gatesgitleaks10445EXACT 2 · MISS 4343 spans · 1,045 bytes0 of 410 of 18None
public-evidence-snapshotfloors and gatesredact-secret10445EXACT 450 spans · 0 bytes0 of 4118 of 18None
public-evidence-snapshotfloors and gatestrufflehog10445EXACT 1 · COVERED 15 · OVERBROAD 6 · MISS 2323 spans · 502 bytes12 of 418 of 18None
regression-corpusgatesflare-redact229COVERED 90 spans · 0 bytes13 of 13No pairNone
regression-corpusgatesgitleaks229MISS 99 spans · 294 bytes0 of 13No pairNone
regression-corpusgatesredact-secret229EXACT 90 spans · 0 bytes0 of 13No pairNone
regression-corpusgatestrufflehog229COVERED 6 · MISS 33 spans · 96 bytes10 of 13No pairNone

Cases

Each case of this family, per population, with what every scanner recorded for it and the case’s own facts.

Open the cases of connection-string