FacebookAI/xlm-roberta-base pass
chat template: not in config · view on Hugging Face ↗
Ingot findings
Static battery clean: safetensors weights, license declared, no template/tokenizer drift detected. Deep battery not yet run. Weights battery: embedding-norm scan over 250002 tokens (F32, 768-dim) found 25 undertrained candidates, 1 plain-ASCII. Scanned 2026-08-20 (published from a community scan).
low Undertrained tokens in vocabulary (non-ASCII tail)
Embedding-norm scan flagged 25 undertrained tokens (norm < 0.3× the vocabulary median), but 1 decode to plain-ASCII strings, so exposure in English-language pipelines is limited. Behavioral confirmation requires the GPU deep battery.
How to fixruntime guardweight-level
Keep the affected token strings out of the model's input — the scan-derived runtime guard carries this model's exact blocklist.
- Fetch this model's guard artifact (`/api/v1/guard/<owner>/<model>`): the confirmed corrupting tokens and the low-norm candidate list, derived from the published scan.
- Screen inbound text with it (the `@ingotai/guard` package is a reference implementation) and route flagged records to a different model or human review — verbatim-copy tasks on flagged strings are the failure mode.
- The underlying cause is undertrained embeddings in the weights; a true fix is weight-level (continued pretraining on the affected tokens) — that is not a patch, it's a training job.
Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.
Fingerprint
The durable weights-and-metadata profile of this model, rebuilt on every scan and deep-battery run. Updated 2026-08-20.
| architecture | xlm-roberta · 12 layers · 768-dim |
| parameters | 278.9M |
| vocabulary | 250,002 tokens |
| license | mit |
| serialization | safetensors pickle |
| chat template | none |
| glitch-token surface | 25 undertrained candidates, 1 plain-ASCII |
Full fingerprint
| architectures | XLMRobertaForMaskedLM |
| library | transformers |
| pipeline | fill-mask |
| repo files | 11 — pickle: pytorch_model.bin |
| revision | e73636d4f797 |
| HF snapshot | 18.2M downloads · 883 likes · updated 2024-02-19 · captured 2026-08-20 |
| embedding tensor | roberta.embeddings.word_embeddings.weight · F32 · 250,002×768 |
| embedding norms | median 5.9082 · mean 5.8657 |
| lineage check | no claimed base model |
| glitch-token samples | "ment" |
Verdict badge
Ship the verdict in your README — it always shows the latest published analysis:
[](https://ingot.tools/models/FacebookAI/xlm-roberta-base)