mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

JetBrains/Mellum2-12B-A2.5B-Thinking, quantized with OptiQ by sahilchachra for Apple Silicon.

community

On disk12.6 GB

Memoryabout 16 GB

Use it

Install

pip install mlx-optiq

Serve it

An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.

optiq serve --model sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

OptiQ Code

The terminal coding agent uses whatever model optiq serve is running.

optiq serve --model sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx
optiq code

OptiQ Lab

optiq lab --model sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

Claude Code

optiq run claude -m sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

Codex

optiq run codex -m sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

OpenCode

optiq run opencode -m sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

Mistral Vibe

optiq run vibe -m sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

Hermes Agent

optiq run hermes -m sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

OpenClaw

optiq run openclaw -m sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

optiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.

mlx-lm, text only

from mlx_lm import load, generate

model, tokenizer = load("sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))

Details

Family	Mellum
Architecture	Mellum
Base model	JetBrains/Mellum2-12B-A2.5B-Thinking
Size on disk	12.6 GB
Memory needed	about 16 GB
Images	no, text only
Downloads	36 in the last month
Updated	2026-06-03
Hugging Face	sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx