Skip to content
Benchmarks

redact-secret · Report

Providers

Counts are fixture rows for redact-secret on the current run. Open a provider to see its families, then pick a family to see every row behind it. A fixture in two families counts once for its provider. Choose an evidence level to count only the rows at that level.

  • 102 providers
  • 184 families
  • 6,140 fixtures
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14
103 providers · 184 families
Amazon Web Services5 families · 126 fixtures1 left readable0 too much0 false alarms
GitHub6 families · 235 fixtures0 left readable0 too much0 false alarms
GitLab3 families · 130 fixtures0 left readable0 too much7 false alarms
OpenAI2 families · 90 fixtures0 left readable0 too much0 false alarms
Anthropic3 families · 106 fixtures0 left readable0 too much0 false alarms
Shopify2 families · 21 fixtures0 left readable0 too much0 false alarms
HashiCorp Vault3 families · 22 fixtures0 left readable0 too much0 false alarms
Stripe6 families · 158 fixtures0 left readable0 too much0 false alarms
Slack4 families · 113 fixtures0 left readable0 too much0 false alarms
Python Package Index (PyPI)1 family · 26 fixtures0 left readable0 too much0 false alarms
Hugging Face1 family · 26 fixtures0 left readable0 too much0 false alarms
Docker Hub2 families · 36 fixtures0 left readable0 too much0 false alarms
Cloudflare1 family · 24 fixtures0 left readable0 too much0 false alarms
DigitalOcean3 families · 34 fixtures0 left readable0 too much0 false alarms
Linear2 families · 27 fixtures0 left readable0 too much0 false alarms
Supabase2 families · 56 fixtures0 left readable0 too much0 false alarms
Vercel6 families · 140 fixtures0 left readable0 too much3 false alarms
npm2 families · 54 fixtures0 left readable0 too much0 false alarms
Google3 families · 72 fixtures0 left readable0 too much0 false alarms
Twilio SendGrid1 family · 167 fixtures30 left readable0 too much0 false alarms
Microsoft Entra ID1 family · 45 fixtures0 left readable0 too much0 false alarms
Azure DevOps1 family · 29 fixtures0 left readable0 too much0 false alarms
Notion2 families · 53 fixtures0 left readable0 too much0 false alarms
Atlassian2 families · 45 fixtures0 left readable0 too much0 false alarms
Twilio2 families · 114 fixtures0 left readable0 too much0 false alarms
Telegram1 family · 40 fixtures0 left readable0 too much0 false alarms
Discord1 family · 46 fixtures0 left readable0 too much0 false alarms
Sentry2 families · 80 fixtures0 left readable0 too much0 false alarms
Datadog3 families · 117 fixtures0 left readable0 too much0 false alarms
Grafana2 families · 72 fixtures0 left readable0 too much0 false alarms
New Relic2 families · 78 fixtures0 left readable0 too much0 false alarms
Firebase1 family · 45 fixtures0 left readable0 too much0 false alarms
HashiCorp Terraform Cloud/Enterprise3 families · 15 fixtures0 left readable0 too much0 false alarms
Pulumi3 families · 15 fixtures0 left readable0 too much0 false alarms
Databricks1 family · 47 fixtures0 left readable0 too much0 false alarms
Confluent Cloud2 families · 91 fixtures0 left readable0 too much0 false alarms
Postman2 families · 88 fixtures0 left readable0 too much0 false alarms
Netlify2 families · 24 fixtures0 left readable0 too much0 false alarms
Heroku2 families · 92 fixtures0 left readable0 too much0 false alarms
Mailchimp1 family · 54 fixtures0 left readable0 too much0 false alarms
Mailgun3 families · 43 fixtures0 left readable0 too much0 false alarms
Okta1 family · 40 fixtures0 left readable0 too much0 false alarms
Replicate1 family · 32 fixtures0 left readable0 too much0 false alarms
Groq1 family · 41 fixtures0 left readable0 too much0 false alarms
xAI1 family · 41 fixtures0 left readable0 too much0 false alarms
OpenRouter2 families · 32 fixtures0 left readable0 too much0 false alarms
LangSmith (LangChain)1 family · 42 fixtures0 left readable0 too much0 false alarms
Langfuse1 family · 42 fixtures0 left readable0 too much0 false alarms
Perplexity1 family · 41 fixtures0 left readable0 too much0 false alarms
Fireworks AI1 family · 32 fixtures0 left readable0 too much0 false alarms
Pinecone2 families · 91 fixtures0 left readable0 too much0 false alarms
Travis CI1 family · 48 fixtures0 left readable0 too much0 false alarms
Neon1 family · 42 fixtures0 left readable0 too much0 false alarms
Amazon Bedrock2 families · 78 fixtures0 left readable0 too much0 false alarms
ElevenLabs1 family · 38 fixtures0 left readable0 too much0 false alarms
Together AI1 family · 56 fixtures0 left readable0 too much0 false alarms
Tavily1 family · 45 fixtures0 left readable0 too much0 false alarms
Mistral AI2 families · 68 fixtures0 left readable0 too much0 false alarms
Cohere1 family · 78 fixtures0 left readable0 too much0 false alarms
Deepgram1 family · 82 fixtures0 left readable0 too much0 false alarms
AI21 Labs1 family · 60 fixtures0 left readable0 too much0 false alarms
Exa1 family · 30 fixtures2 left readable0 too much0 false alarms
Voyage AI1 family · 0 fixturesNo fixtures
Convex1 family · 41 fixtures0 left readable0 too much0 false alarms
1Password1 family · 39 fixtures0 left readable0 too much0 false alarms
Inngest1 family · 40 fixtures0 left readable0 too much0 false alarms
Resend1 family · 42 fixtures0 left readable0 too much0 false alarms
Apify1 family · 38 fixtures0 left readable0 too much0 false alarms
Weights & Biases1 family · 35 fixtures0 left readable0 too much0 false alarms
Doppler7 families · 268 fixtures0 left readable0 too much0 false alarms
Trigger.dev2 families · 78 fixtures0 left readable0 too much0 false alarms
E2B1 family · 43 fixtures0 left readable0 too much0 false alarms
PostHog2 families · 80 fixtures0 left readable0 too much0 false alarms
Helicone2 families · 81 fixtures0 left readable0 too much0 false alarms
Firecrawl1 family · 48 fixtures0 left readable0 too much0 false alarms
Composio3 families · 120 fixtures0 left readable0 too much0 false alarms
Daytona1 family · 44 fixtures0 left readable0 too much0 false alarms
ClickHouse Cloud1 family · 45 fixtures0 left readable0 too much0 false alarms
NVIDIA1 family · 39 fixtures0 left readable0 too much0 false alarms
Browserbase1 family · 38 fixtures0 left readable0 too much0 false alarms
Cerebras1 family · 46 fixtures0 left readable0 too much0 false alarms
RunPod1 family · 36 fixtures0 left readable0 too much0 false alarms
Bitwarden1 family · 46 fixtures0 left readable0 too much0 false alarms
Polar2 families · 66 fixtures0 left readable0 too much0 false alarms
SonarQube2 families · 68 fixtures0 left readable0 too much0 false alarms
RubyGems.org1 family · 39 fixtures0 left readable0 too much0 false alarms
Clojars1 family · 37 fixtures0 left readable0 too much0 false alarms
crates.io2 families · 66 fixtures0 left readable0 too much0 false alarms
Dynatrace1 family · 41 fixtures0 left readable0 too much0 false alarms
Paddle1 family · 41 fixtures0 left readable0 too much0 false alarms
Honeycomb1 family · 39 fixtures0 left readable0 too much0 false alarms
Axiom2 families · 62 fixtures0 left readable0 too much0 false alarms
Square2 families · 0 fixturesNo fixtures
Xata1 family · 0 fixturesNo fixtures
Sourcegraph1 family · 0 fixturesNo fixtures
Unkey1 family · 0 fixturesNo fixtures
Buildkite1 family · 0 fixturesNo fixtures
Pydantic1 family · 0 fixturesNo fixtures
Mapbox1 family · 0 fixturesNo fixtures
Fly.io1 family · 0 fixturesNo fixtures
Ory1 family · 0 fixturesNo fixtures
Baseten1 family · 0 fixturesNo fixtures
Not provider-specific6 families · 479 fixtures37 left readable0 too much1 false alarms

896 fixtures are global or not tied to one family. They count in no provider or family row.