Model page

funnel-transformer/small warn

Weights only ship in a format that can run code when loaded.

downloads 84.3klikes 6license apache-2.0arch funnelupdated 2024-02-29

chat template: not found · view on Hugging Face ↗

Scan coverageStatic battery2026-08-25Weights battery2026-08-25Behavioral batteryn/adetails
BatteryLooks atStatus
Static batteryMetadata & packagingcomplete 2026-08-25
Weights batteryWeights forensics — no GPU, no downloadcomplete 2026-08-2530,522-token embedding scanned · 0 undertrained · pickle audit clean
Behavioral batteryLive-inference differentialsn/anot applicable — feature-extraction model has no text-generation surface to probe

Ingot runs three batteries against a model. What each one checks →

Findings

Scanned 2026-08-25 · published from a community scan.

medium Pickle-serialized weights, no safetensors

Weights ship only as pickle-based files (pytorch_model.bin). Loading pickle executes arbitrary code from the file — prefer a safetensors release or load in a sandbox.

How to fix

Convert the weights to safetensors before loading them anywhere that matters.

  1. Do not load the pickle files in-process — pickle deserialization executes arbitrary code from the file.
  2. Convert locally in a sandbox: `pip install safetensors` and use `safetensors.torch.save_file` on a state dict loaded with `torch.load(..., weights_only=True)` (refuses most code-execution payloads), or use Hugging Face's `convert.py` space/script.
  3. Pin the exact revision hash you converted from, and load only your converted safetensors artifact from then on.

info Partial coverage — not a generative language model

feature-extraction model — no generation surface, so behavioral (live-inference) checks are not applicable; packaging, license, and weights forensics apply.

info Embedding-norm glitch scan clean

No undertrained tokens found: every non-special token's embedding norm is above 0.3× the vocabulary median (2.418). The glitch-token data-corruption class has no candidate surface in this model.

info Pickle static analysis clean

Opcode-level parse of pytorch_model.bin (no code executed) found only standard serialization globals (3 distinct, all torch/collections/numpy). Pickle remains an executable format — this verifies the current bytes, not future uploads; prefer a safetensors release.

Remediation guidance addresses the documented findings only. It is evidence-driven repair, not a safety certification of the model.

Fingerprint

The durable profile of this model: measured weights-and-metadata facts, rebuilt on every scan and battery run. Updated 2026-08-25.

architecturefunnel · 768-dim
vocabulary30,522 tokens
licenseapache-2.0
serializationno safetensors pickle
chat templatenone
glitch-token surfaceclean no undertrained tokens
Full measured fingerprint
architecturesFunnelModel
librarytransformers
pipelinefeature-extraction
repo files9 — pickle: pytorch_model.bin
revision81e9124473a2
HF snapshot84.3k downloads · 6 likes · updated 2024-02-29 · captured 2026-08-25
pickle auditpytorch_model.bin3 standard global(s) · legacy (pre-1.6) format, head-scan only
embedding tensorembeddings.word_embeddings.weight · F32 · 30,522×768
embedding normsmedian 2.4178 · mean 2.4159
lineage checkno claimed base model
Battery runs (1)the run trace behind the findings — what each job measured
batterystatusqueueddurationattempts
weightscomplete2026-08-25 20:2611s1
weights run 2026-08-25 measurements
probes runglitch-norm-scan, zero-template-token-scan, pickle-static-analysis, lineage-norm-correlation
embedding tensorembeddings.word_embeddings.weight · F32 · 30,522×768
glitch surface0 undertrained, 0 plain-ASCII
lineage checknot checked (no claimed base model)

Verdict badge

Ship the verdict in your README — it always shows the latest published analysis:

Ingot verdict: warn

[![Ingot scan](https://ingot.tools/api/v1/models/funnel-transformer/small/badge.svg)](https://ingot.tools/models/funnel-transformer/small)
Gate it in CI