Model page

aaditya/Llama3-OpenBioLLM-70B warn

Weights only ship in a format that can run code when loaded. Plus 1 minor note.

downloads 954likes 513license llama3arch llamaupdated 2025-01-18

claims base: meta-llama/Meta-Llama-3-70B-Instruct · chat template: present · view on Hugging Face ↗

Scan coverageStatic battery2026-08-25Weights batteryfailedBehavioral batterynot rundetails
BatteryLooks atStatus
Static batteryMetadata & packagingcomplete 2026-08-25
Weights batteryWeights forensics — no GPU, no downloadfailed429 Too Many Requests for https://huggingface.co/api/models/aaditya/Llama3-OpenBioLLM-70B
Behavioral batteryLive-inference differentialsnot run

Ingot runs three batteries against a model. What each one checks →

Findings

Scanned 2026-08-25 · published from a community scan.

medium Pickle-serialized weights, no safetensors

Weights ship only as pickle-based files (pytorch_model-00001-of-00030.bin, pytorch_model-00002-of-00030.bin, pytorch_model-00003-of-00030.bin, …). Loading pickle executes arbitrary code from the file — prefer a safetensors release or load in a sandbox.

How to fix

Convert the weights to safetensors before loading them anywhere that matters.

  1. Do not load the pickle files in-process — pickle deserialization executes arbitrary code from the file.
  2. Convert locally in a sandbox: `pip install safetensors` and use `safetensors.torch.save_file` on a state dict loaded with `torch.load(..., weights_only=True)` (refuses most code-execution payloads), or use Hugging Face's `convert.py` space/script.
  3. Pin the exact revision hash you converted from, and load only your converted safetensors artifact from then on.

low Padding token is the EOS token

The pad token and the (only) EOS token are the same. Fine-tuning frameworks mask pad positions out of the loss, so training on this checkpoint teaches the model to never emit EOS — the Phi-4 / Qwen 2.5 / DeepSeek R1 infinite-generation bug. Safe to serve, hazardous to fine-tune; repoint pad_token at a dedicated token first.

How to fixingot patch

Align the stop-token declarations — a pure metadata fix to `generation_config.json` (and `config.json`).

  1. Identify the token the chat template actually ends assistant turns with (e.g. `<|eot_id|>`, `<end_of_turn>`, `<|im_end|>`) and make sure its id is in `generation_config.json`'s `eos_token_id` list.
  2. Keep `config.json`'s `eos_token_id` consistent with (or a subset of) `generation_config.json`'s — runtimes differ in which file they read.
  3. For the pad-equals-EOS hazard: repoint `pad_token` at a dedicated padding token before fine-tuning; serving is unaffected.
  4. Until the repo is fixed, pass explicit stop tokens to your serving stack (e.g. vLLM `stop_token_ids`, llama.cpp `--override-kv tokenizer.ggml.eos_token_id`).

Fix it

Some findings are metadata-level and patchable — apply the fixes to your local copy (your weights never leave your machine):

npx @ingotai/scan patch aaditya/Llama3-OpenBioLLM-70B

Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.

Fingerprint

The durable profile of this model: measured weights-and-metadata facts, rebuilt on every scan and battery run. Updated 2026-08-25.

architecturellama · 80 layers · 8192-dim
vocabulary128,256 tokens
licensellama3
serializationno safetensors pickle
chat templatepresent · sha256:ba03a121d097859c
claimed lineagemeta-llama/Meta-Llama-3-70B-Instruct
lineage verifiedunverified — weights battery pending
Full measured fingerprint
architecturesLlamaForCausalLM
librarytransformers
pipelinetext-generation
repo files39 — pickle: pytorch_model-00001-of-00030.bin, pytorch_model-00002-of-00030.bin, pytorch_model-00003-of-00030.bin, pytorch_model-00004-of-00030.bin, pytorch_model-00005-of-00030.bin, pytorch_model-00006-of-00030.bin, pytorch_model-00007-of-00030.bin, pytorch_model-00008-of-00030.bin, pytorch_model-00009-of-00030.bin, pytorch_model-00010-of-00030.bin
revision7ad17ef0d218
HF snapshot954 downloads · 513 likes · updated 2025-01-18 · captured 2026-08-25

Verdict badge

Ship the verdict in your README — it always shows the latest published analysis:

Ingot verdict: warn

[![Ingot scan](https://ingot.tools/api/v1/models/aaditya/Llama3-OpenBioLLM-70B/badge.svg)](https://ingot.tools/models/aaditya/Llama3-OpenBioLLM-70B)
Gate it in CI