Model page

ibm-research/PowerMoE-3b pass

No issues found by the checks that have run.

downloads 511.5klikes 23license apache-2.0arch granitemoeparams 3374.3Mupdated 2024-09-24

chat template: not found · view on Hugging Face ↗

Scan coverageStatic battery2026-08-22Weights battery2026-08-22Behavioral batterynot rundetails
BatteryLooks atStatus
Static batteryMetadata & packagingcomplete 2026-08-22
Weights batteryWeights forensics: no GPU, no downloadcomplete 2026-08-2249,152-token embedding scanned · 0 undertrained
Behavioral batteryLive-inference differentialsnot run

Ingot runs three batteries against a model. What each one checks →

Findings

Scanned 2026-08-22 · published from a community scan.

info Embedding-norm glitch scan clean

No undertrained tokens found: every non-special token's embedding norm is above 0.3× the vocabulary median (1.434). The glitch-token data-corruption class has no candidate surface in this model.

Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.

Put this result in your workflow

Check every checkpoint before it ships

Use the web app, API, CLI, or CI gate to scan candidate checkpoints and catch model drift before deployment. Public-model scans publish to the open database; paid plans add the volume needed for continuous checks.

Fingerprint

The durable profile of this model: measured weights-and-metadata facts, rebuilt on every scan and battery run. Updated 2026-08-22.

architecturegranitemoe · 32 layers · 1536-dim
parameters3374.3M
vocabulary49,152 tokens
licenseapache-2.0
serializationsafetensors
chat templatenone
glitch-token surfaceclean no undertrained tokens
Full measured fingerprint
architecturesGraniteMoeForCausalLM
librarytransformers
pipelinetext-generation
repo files11
revision13fcb5a98001
HF snapshot1.2M downloads · 22 likes · updated 2024-09-24 · captured 2026-08-21
embedding tensormodel.embed_tokens.weight · F32 · 49,152×1536
embedding normsmedian 1.4339 · mean 1.4234
lineage checkno claimed base model
Battery runs (1)the run trace behind the findings — what each job measured
batterystatusqueueddurationattempts
weightscomplete2026-08-21 07:4313s1
weights run 2026-08-21 — measurements
probes runglitch-norm-scan, lineage-norm-correlation
embedding tensormodel.embed_tokens.weight · F32 · 49,152×1536
glitch surface0 undertrained, 0 plain-ASCII
lineage checknot checked (no claimed base model)

Verdict badge

Ship the verdict in your README — it always shows the latest published analysis:

Ingot verdict: pass

[![Ingot scan](https://ingot.tools/api/v1/models/ibm-research/PowerMoE-3b/badge.svg)](https://ingot.tools/models/ibm-research/PowerMoE-3b)
Gate it in CI