Skip to content
Benchmarks

redact-secret · Report

API key (rubygems_)

rubygems_ + exactly 48 lowercase hex (57 in all); OIDC-exchanged keys share the generator.

  • RubyGems.org
  • Detectors: rubygems-api-key
  • Run 2026-10-07
  • Mode published · redact-secret 0.1.0-beta.14
  • Dossier verdictReady
  • Dossier evidence levelT1 · Provider-documented
  • Dossier researched2026-09-29
Beta.12 arrival family rubygems-api-key (#528, product redact-secret#1023), contract in benchmarks/lib/beta8/528d.ts from the #1014 handoff rubygems.md. T1 (provider generator, R1). gitleaks 8.30.1 rubygems-api-token and trufflehog 3.97.4 RubyGems are mapped to this family. Since the 4fb7882 re-pin the product detector is in the pinned registry, so the row maps to it.

Research record

From credential-evidence snapshot-2026.10.06.4 · records at 77ce761 · schema 1.8.0. It describes the research on the format, not what any scanner or the product does, and not a support status.
  • Review stateDraft, not reviewed
  • Format revision1 · current
  • ResearchResearched
  • Researched2026-09-29

3 events in the review history: 2 observed, 1 reviewed. Latest: observed on 2026-09-29 by automation, project maintainer. Project-maintained review is not independent validation. The family record at this release.

Format

Provider format research from credential-evidence snapshot-2026.10.06.4 · records at 77ce761 · schema 1.8.0.

What it looks like

Descriptive pattern
^rubygems_[0-9a-f]{48}$

Parts are shown as recorded. Evidence classes belong to the facts below; no class is assigned to a part.

Format facts

Open questions

No open question is recorded for this revision.

Benchmark dossier notes

From the provider dossier, as written. The evidence level above says how well the format is backed; a fact the dossier does not record is not shown.
Shape
rubygems_ + exactly 48 lowercase hex (57 in all).
Basis
T1 under R1: generate_rubygems_key returns "rubygems_#{SecureRandom.hex(24)}". GitHub partner pattern rubygems_api_key with push protection.
Issuance
not attempted; the grammar is T1 from provider sources, so no key is needed.
Contract in core
detector-families.md (row on main; the Beta.12 detector, redact-secret#1023, merged in redact-secret#1039 and is unreleased).

In this benchmark

Fixture rows on the current run. Counts are for redact-secret in published · redact-secret 0.1.0-beta.14 mode.
Fixtures
39
Left readable
0
Redacted too much
0
False alarms
0

39 fixtures: 16 expect a redaction, 23 must stay quiet. See every row

redact-secret fixture counts by evidence level
Evidence levelFixturesLeft readableToo muchFalse alarms
T1Provider-documented16000
T2Tool-corroborated15000
T3Project policy8000

Every scanner on the same fixtures

In run order. Counts are what each scanner recorded on this family's fixtures, whichever rules it has; a scanner with no rule for the family has nothing to report on it.

Counts per scanner on this family's fixtures
ScannerFixturesLeft readableToo muchFalse alarms
flare-redactRuntime library · 1.6.1 · Published npm package · secrets-only (pii, generic_assignment disabled) · JavaScript engineNo rule maps to it391510
gitleaksRepository scanner · 8.30.1 · Directory scan · default rules1 rule targets it39000
redact-secretProduct measured here · 0.1.0-beta.14 · Published npm package · default detectors1 detector mapped39000
trufflehogRepository scanner · 3.97.4 · Filesystem scan · verification disabled1 rule targets it39001

Looks like it, but isn't

Values the dossier records as resembling this credential without being one.
Collisions
rubygems_version and rubygems_mfa_required metadata keys fail the body.

Scanner rules for this family

Mapped by hand (reviewed 2026-09-30) from each scanner's pinned rule file, never from what a scanner found on the fixtures.
Peer scanner rules that target this family
ScannerRuleWhat the rule matches
gitleaks · rules 8.30.1rubygems-api-tokenrubygems_ + 48 hex
trufflehog · rules 3.97.4rubygemsrubygems_ + 48 characters

No rule maps to this family in flare-redact, openredaction.

39 of 39 rows

Fixtures in this family

39 rows, redact-secret's outcome on each. Rows that need a look come first (0), then the rest in corpus order. Choose "Every scanner" to see each scanner's outcome for the same rows.
Fixtures in API key (rubygems_)
FixtureKind and evidenceredact-secret
rubygems-api-key-actions-envrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-authorization-no-schemerubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-bare-proserubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-bearer-headerrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-chat-pasterubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-dotenvrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-exportrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-gem-credentials-yamlrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-gem-push-envrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-json-api-keyrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-json-tokenrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-key-shape-barerubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-key-shape-quotedrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-key-shape-unicode-crlfrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-non-hex-letter-twinrubygems · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-sdk-kwargrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-x-api-key-headerrubygems · documented-format-literalMust redactT1 · Provider-documentedRedacted
rubygems-api-key-actions-secret-referencerubygems · templated-referenceMust not flagT3 · Project policyQuiet
rubygems-api-key-bare-48-hex-encoded-valuerubygems · benign-encoded-valueMust not flagT2 · Tool-corroboratedQuiet
rubygems-api-key-body-47-twinrubygems · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-body-49-twinrubygems · wrong-lengthMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-credentials-placeholder-placeholderrubygems · documentation-placeholderMust not flagT3 · Project policyQuiet
rubygems-api-key-ellipsis-placeholderrubygems · documentation-placeholderMust not flagT3 · Project policyQuiet
rubygems-api-key-env-reference-referencerubygems · templated-referenceMust not flagT3 · Project policyQuiet
rubygems-api-key-gemspec-metadata-public-idrubygems · public-identifierMust not flagT2 · Tool-corroboratedQuiet
rubygems-api-key-hyphen-separator-twinrubygems · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-key-guidance-proserubygems · prose-mentionMust not flagT3 · Project policyQuiet
rubygems-api-key-label-proserubygems · benign-lookalikeMust not flagT3 · Project policyQuiet
rubygems-api-key-leading-glue-twinrubygems · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-lockfile-version-public-idrubygems · public-identifierMust not flagT2 · Tool-corroboratedQuiet
rubygems-api-key-maskrubygems · benign-lookalikeMust not flagT3 · Project policyQuiet
rubygems-api-key-prefix-onlyrubygems · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
rubygems-api-key-referencerubygems · benign-lookalikeMust not flagT3 · Project policyQuiet
rubygems-api-key-short-bodyrubygems · benign-lookalikeMust not flagT2 · Tool-corroboratedQuiet
rubygems-api-key-trailing-letter-twinrubygems · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-trailing-underscore-twinrubygems · boundary-violationMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-truncated-near-missrubygems · format-near-missMust not flagT2 · Tool-corroboratedQuiet
rubygems-api-key-uppercase-hex-byte-twinrubygems · wrong-alphabetMust not flagT2 · Tool-corroborated · twinQuiet
rubygems-api-key-uppercase-prefix-twinrubygems · prefix-near-missMust not flagT2 · Tool-corroborated · twinQuiet

Sources

Researched 2026-09-29.

Documentation and code

  • github.com/rubygems/rubygems.org/blob/d4cfcc961d08cb5f661f2e5dc0081736233b97ec/app/controllers/concerns/api_keyable.rb#L19-L21
  • github.com/redact-secret/redact-secret/blob/4f220ea000b58fa2e0e431ad88dea4eccb393fb0/docs/audits/evidence/1014/rubygems.md

Research log