Model page

FacebookAI/roberta-base pass

No issues found by the checks that have run.

downloads 7.9Mlikes 667license mitarch robertaparams 124.7Mupdated 2024-02-19

chat template: not found · view on Hugging Face ↗

Scan coverageStatic battery2026-08-20Weights battery2026-08-20Behavioral batteryn/adetails
BatteryLooks atStatus
Static batteryMetadata & packagingcomplete 2026-08-20
Weights batteryWeights forensics: no GPU, no downloadcomplete 2026-08-2050,265-token embedding scanned · 0 undertrained
Behavioral batteryLive-inference differentialsn/anot applicable: fill-mask model has no text-generation surface to probe

Ingot runs three batteries against a model. What each one checks →

Findings

Scanned 2026-08-20 · published from a community scan.

info Embedding-norm glitch scan clean

No undertrained tokens found: every non-special token's embedding norm is above 0.3× the vocabulary median (3.692). The glitch-token data-corruption class has no candidate surface in this model.

Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.

Put this result in your workflow

Check every checkpoint before it ships

Use the web app, API, CLI, or CI gate to scan candidate checkpoints and catch model drift before deployment. Public-model scans publish to the open database; paid plans add the volume needed for continuous checks.

Fingerprint

The durable profile of this model: measured weights-and-metadata facts, rebuilt on every scan and battery run. Updated 2026-08-20.

architectureroberta · 12 layers · 768-dim
parameters124.7M
vocabulary50,265 tokens
licensemit
serializationsafetensors pickle
chat templatenone
glitch-token surfaceclean no undertrained tokens
Full measured fingerprint
architecturesRobertaForMaskedLM
librarytransformers
pipelinefill-mask
repo files13 — pickle: pytorch_model.bin
revisione2da8e2f811d
HF snapshot12.2M downloads · 638 likes · updated 2024-02-19 · captured 2026-08-20
embedding tensorroberta.embeddings.word_embeddings.weight · F32 · 50,265×768
embedding normsmedian 3.6916 · mean 3.6454
lineage checkno claimed base model
Battery runs (2)the run trace behind the findings — what each job measured
batterystatusqueueddurationattempts
weightscomplete2026-08-20 18:024s1
weightscomplete2026-08-20 08:104s1

Verdict badge

Ship the verdict in your README — it always shows the latest published analysis:

Ingot verdict: pass

[![Ingot scan](https://ingot.tools/api/v1/models/FacebookAI/roberta-base/badge.svg)](https://ingot.tools/models/FacebookAI/roberta-base)
Gate it in CI