mlx-optiq
← Models

MiniCPM5-2B-OptiQ-5bpw

openbmb/MiniCPM5-2B, quantized with OptiQ by sahilchachra for Apple Silicon.

community
On disk1.9 GB
Memoryabout 4 GB

Use it

Install

pip install mlx-optiq

Serve it

An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.

optiq serve --model sahilchachra/MiniCPM5-2B-OptiQ-5bpw

OptiQ Code

The terminal coding agent uses whatever model optiq serve is running.

optiq serve --model sahilchachra/MiniCPM5-2B-OptiQ-5bpw
optiq code

OptiQ Lab

optiq lab --model sahilchachra/MiniCPM5-2B-OptiQ-5bpw

Claude Code

optiq run claude -m sahilchachra/MiniCPM5-2B-OptiQ-5bpw

Codex

optiq run codex -m sahilchachra/MiniCPM5-2B-OptiQ-5bpw

OpenCode

optiq run opencode -m sahilchachra/MiniCPM5-2B-OptiQ-5bpw

Mistral Vibe

optiq run vibe -m sahilchachra/MiniCPM5-2B-OptiQ-5bpw

Hermes Agent

optiq run hermes -m sahilchachra/MiniCPM5-2B-OptiQ-5bpw

OpenClaw

optiq run openclaw -m sahilchachra/MiniCPM5-2B-OptiQ-5bpw

optiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.

mlx-lm, text only

from mlx_lm import load, generate

model, tokenizer = load("sahilchachra/MiniCPM5-2B-OptiQ-5bpw")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))

Details

FamilyMiniCPM · MiniCPM docs
ArchitectureLlama
Base modelopenbmb/MiniCPM5-2B
Size on disk1.9 GB
Memory neededabout 4 GB
Imagesno, text only
Downloads37 in the last month
Updated2026-09-11
Hugging Facesahilchachra/MiniCPM5-2B-OptiQ-5bpw