Model page
EleutherAI/gpt-neo-125m pass
No issues found by the checks that have run.
downloads 508.9klikes 229license mitarch gpt_neoparams 150.4Mupdated 2024-01-31
chat template: not found · view on Hugging Face ↗
Scan coverageStatic battery2026-08-25Weights battery2026-08-25Behavioral batterynot rundetails
| Battery | Looks at | Status |
|---|---|---|
| Static battery | Metadata & packaging | complete 2026-08-25 |
| Weights battery | Weights forensics — no GPU, no download | complete 2026-08-2550,257-token embedding scanned · 0 undertrained |
| Behavioral battery | Live-inference differentials | not run |
Ingot runs three batteries against a model. What each one checks →
Findings
Scanned 2026-08-25 · published from a community scan.
info Embedding-norm glitch scan clean
No undertrained tokens found: every non-special token's embedding norm is above 0.3× the vocabulary median (11.360). The glitch-token data-corruption class has no candidate surface in this model.
Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.
Fingerprint
The durable profile of this model: measured weights-and-metadata facts, rebuilt on every scan and battery run. Updated 2026-08-25.
| architecture | gpt_neo · 12 layers · 768-dim |
| parameters | 150.4M |
| vocabulary | 50,257 tokens |
| license | mit |
| serialization | safetensors pickle |
| chat template | none |
| glitch-token surface | clean no undertrained tokens |
Full measured fingerprint
| architectures | GPTNeoForCausalLM |
| library | transformers |
| pipeline | text-generation |
| repo files | 13 — pickle: pytorch_model.bin |
| revision | 21def0189f57 |
| HF snapshot | 508.9k downloads · 229 likes · updated 2024-01-31 · captured 2026-08-25 |
| embedding tensor | transformer.wte.weight · F32 · 50,257×768 |
| embedding norms | median 11.3604 · mean 11.5013 |
| lineage check | no claimed base model |
Battery runs (1)the run trace behind the findings — what each job measured
| battery | status | queued | duration | attempts |
|---|---|---|---|---|
| weights | complete | 2026-08-25 20:26 | 7s | 1 |
weights run 2026-08-25 — measurements
| probes run | glitch-norm-scan, zero-template-token-scan, lineage-norm-correlation |
| embedding tensor | transformer.wte.weight · F32 · 50,257×768 |
| glitch surface | 0 undertrained, 0 plain-ASCII |
| lineage check | not checked (no claimed base model) |
Verdict badge
Ship the verdict in your README — it always shows the latest published analysis:
[](https://ingot.tools/models/EleutherAI/gpt-neo-125m)