Model page

MERaLiON/MERaLiON-3-10B warn

Loading it runs custom code from the repo; its license differs from its base model's; the weights don't match the model it claims to be based on.

downloads 477likes 8license otherarch meralion3params 9942.6Mupdated 2026-06-17

claims base: openai/whisper-large-v3, google/gemma-2-9b-it · chat template: present · view on Hugging Face ↗

Scan coverageStatic battery2026-08-21Weights battery2026-08-21Behavioral batterynot rundetails
BatteryLooks atStatus
Static batteryMetadata & packagingcomplete 2026-08-21
Weights batteryWeights forensics: no GPU, no downloadcomplete 2026-08-21256,000-token embedding scanned · 0 undertrained · lineage inconsistent
Behavioral batteryLive-inference differentialsnot run

Ingot runs three batteries against a model. What each one checks →

Findings

Scanned 2026-08-21 · published from a community scan.

medium Repo ships executable Python (trust_remote_code)

The repository contains custom code files that run in-process when loaded with trust_remote_code=True. Pin the revision hash and review the code before loading.

How to fix

Review and pin the custom code; never float on `main` with trust_remote_code=True.

  1. Read every `.py` file in the repo before first load — this code runs in your process.
  2. Pin the revision: `from_pretrained(model_id, revision="<commit sha>", trust_remote_code=True)` so a later push can't swap the code under you.
  3. Prefer a version of the architecture already in `transformers` if one exists, which removes the remote-code requirement entirely.

medium License differs from claimed parent (other vs apache-2.0)

This model declares other while its claimed base openai/whisper-large-v3 declares apache-2.0. Verify the re-license is permitted before commercial use.

How to fix

Verify the re-license is actually permitted before relying on it.

  1. Read the parent's license for derivative-work and re-licensing terms — many open-weight licenses (e.g. Llama-family) do not permit arbitrary re-licensing.
  2. If the re-license is not permitted, the parent's terms govern your use regardless of what this repo declares.

info Embedding-norm glitch scan clean

No undertrained tokens found: every non-special token's embedding norm is above 0.3× the vocabulary median (1.696). The glitch-token data-corruption class has no candidate surface in this model.

medium Weights inconsistent with claimed parent openai/whisper-large-v3

This model declares openai/whisper-large-v3 as its base (relation: unspecified), but its token-embedding geometry is incompatible: 3584-dim embeddings vs the parent's 1280-dim. A finetune cannot change embedding width — the lineage label is wrong or misleading. Treat provenance claims on this repo (training data, safety posture, licensing) as unverified.

How to fix

Fix or verify the `base_model` declaration so lineage checks can run.

  1. If you own the repo: correct the `base_model` field in the model card metadata to the real, public parent.
  2. If you don't: identify the true parent (config architecture + weight shapes narrow it fast) and re-scan with that lineage in mind.

Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.

Put this result in your workflow

Check every checkpoint before it ships

Use the web app, API, CLI, or CI gate to scan candidate checkpoints and catch model drift before deployment. Public-model scans publish to the open database; paid plans add the volume needed for continuous checks.

Fingerprint

The durable profile of this model: measured weights-and-metadata facts, rebuilt on every scan and battery run. Updated 2026-08-21.

architecturemeralion3 · 42 layers · 3584-dim
parameters9942.6M
vocabulary256,000 tokens
licenseother
serializationsafetensors custom code
chat templatepresent · sha256:cd00f098978cd500
claimed lineageopenai/whisper-large-v3, google/gemma-2-9b-it
lineage verifiedinconsistent vs openai/whisper-large-v3
glitch-token surfaceclean no undertrained tokens
Full measured fingerprint
architecturesMERaLiON3ForConditionalGeneration
librarytransformers
pipelineautomatic-speech-recognition
repo files19
revision3d5c2f772641
HF snapshot778 downloads · 8 likes · updated 2026-06-17 · captured 2026-08-21
embedding tensortext_decoder.model.embed_tokens.weight · BF16 · 256,000×3584
embedding normsmedian 1.6959 · mean 1.7164
lineage checkinconsistent — cosine undefined over undefined sampled rows vs openai/whisper-large-v3
Battery runs (1)the run trace behind the findings — what each job measured
batterystatusqueueddurationattempts
weightscomplete2026-08-21 05:132m1
weights run 2026-08-21 — measurements
probes runglitch-norm-scan, lineage-norm-correlation
embedding tensortext_decoder.model.embed_tokens.weight · BF16 · 256,000×3584
glitch surface0 undertrained, 0 plain-ASCII
lineage checkinconsistent — cosine undefined over undefined rows vs openai/whisper-large-v3

Verdict badge

Ship the verdict in your README — it always shows the latest published analysis:

Ingot verdict: warn

[![Ingot scan](https://ingot.tools/api/v1/models/MERaLiON/MERaLiON-3-10B/badge.svg)](https://ingot.tools/models/MERaLiON/MERaLiON-3-10B)
Gate it in CI