FacebookAI/roberta-base pass
chat template: not in config · view on Hugging Face ↗
Ingot findings
Static battery clean: safetensors weights, license declared, no template/tokenizer drift detected. Deep battery not yet run. Weights battery: embedding-norm scan over 50265 tokens (F32, 768-dim) found 0 undertrained candidates, 0 plain-ASCII. Scanned 2026-08-20 (published from a community scan).
info Embedding-norm glitch scan clean
No undertrained tokens found: every non-special token's embedding norm is above 0.3× the vocabulary median (3.692). The glitch-token data-corruption class has no candidate surface in this model.
How to fixruntime guardweight-level
Keep the affected token strings out of the model's input — the scan-derived runtime guard carries this model's exact blocklist.
- Fetch this model's guard artifact (`/api/v1/guard/<owner>/<model>`): the confirmed corrupting tokens and the low-norm candidate list, derived from the published scan.
- Screen inbound text with it (the `@ingotai/guard` package is a reference implementation) and route flagged records to a different model or human review — verbatim-copy tasks on flagged strings are the failure mode.
- The underlying cause is undertrained embeddings in the weights; a true fix is weight-level (continued pretraining on the affected tokens) — that is not a patch, it's a training job.
Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.
Fingerprint
The durable weights-and-metadata profile of this model, rebuilt on every scan and deep-battery run. Updated 2026-08-20.
| architecture | roberta · 12 layers · 768-dim |
| parameters | 124.7M |
| vocabulary | 50,265 tokens |
| license | mit |
| serialization | safetensors pickle |
| chat template | none |
| glitch-token surface | clean no undertrained tokens |
Full fingerprint
| architectures | RobertaForMaskedLM |
| library | transformers |
| pipeline | fill-mask |
| repo files | 13 — pickle: pytorch_model.bin |
| revision | e2da8e2f811d |
| HF snapshot | 12.2M downloads · 638 likes · updated 2024-02-19 · captured 2026-08-20 |
| embedding tensor | roberta.embeddings.word_embeddings.weight · F32 · 50,265×768 |
| embedding norms | median 3.6916 · mean 3.6454 |
| lineage check | no claimed base model |
Verdict badge
Ship the verdict in your README — it always shows the latest published analysis:
[](https://ingot.tools/models/FacebookAI/roberta-base)