Model page

mlx-community/Mistral-7B-Instruct-v0.3-mlx-4Bit warn

The chat template was dropped from its base model, which changes behavior.

downloads 472likes 0license apache-2.0arch mistralparams 1132.7Mupdated 2026-07-27

claims base: mistralai/Mistral-7B-Instruct-v0.3 · chat template: present · view on Hugging Face ↗

Scan coverageStatic battery2026-08-21Weights batteryfailedBehavioral batterynot rundetails
BatteryLooks atStatus
Static batteryMetadata & packagingcomplete 2026-08-21
Weights batteryWeights forensics — no GPU, no downloadfailedunsupported embedding dtype U32
Behavioral batteryLive-inference differentialsnot run

Ingot runs three batteries against a model. What each one checks →

Findings

Scanned 2026-08-21 · published from a community scan.

medium Chat template dropped vs parent

mistralai/Mistral-7B-Instruct-v0.3 ships a chat template; this repo does not. Serving stacks will silently fall back to a generic template, changing behavior. (In our 296-model census, 78% of pure quantization re-releases changed or dropped the template.)

How to fixingot patch

Restore the parent's chat template in `tokenizer_config.json` — a pure metadata fix.

  1. Run `ingot patch <owner/model>` — the patch manifest carries the parent's template and applies it to a local copy's `tokenizer_config.json`.
  2. Or fix by hand: copy the `chat_template` value from the parent repo's `tokenizer_config.json` into this model's, and pin your serving stack to that file.
  3. If the drift was intentional (the author retrained on a new template), confirm that in the model card before "fixing" it — restoring the parent template on retrained weights changes behavior too.

Fix it

Some findings are metadata-level and patchable — apply the fixes to your local copy (your weights never leave your machine):

npx @ingotai/scan patch mlx-community/Mistral-7B-Instruct-v0.3-mlx-4Bit

Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.

Fingerprint

The durable profile of this model: measured weights-and-metadata facts, rebuilt on every scan and battery run. Updated 2026-08-21.

architecturemistral · 32 layers · 4096-dim
parameters1132.7M
vocabulary32,768 tokens
licenseapache-2.0
serializationsafetensors
chat templatenone
claimed lineagemistralai/Mistral-7B-Instruct-v0.3
lineage verifiedunverified — weights battery pending
Full measured fingerprint
architecturesMistralForCausalLM
libraryvllm
repo files9
revisione5c4e112aa22
HF snapshot431 downloads · 0 likes · updated 2026-07-27 · captured 2026-08-21

Verdict badge

Ship the verdict in your README — it always shows the latest published analysis:

Ingot verdict: warn

[![Ingot scan](https://ingot.tools/api/v1/models/mlx-community/Mistral-7B-Instruct-v0.3-mlx-4Bit/badge.svg)](https://ingot.tools/models/mlx-community/Mistral-7B-Instruct-v0.3-mlx-4Bit)
Gate it in CI