mlx-optiq
← Models

mini-coder-4b-OptiQ-4bit

ricdomolm/mini-coder-4b, quantized with OptiQ by sjoerdbodbijl for Apple Silicon.

community
On disk3.0 GB
Memoryabout 5 GB
Capability Score45.83

Capability Score breakdown

The six metrics behind this model's Capability Score of 45.83, as reported in the model card. Values are compared with uniform 4-bit.

  • This model
  • Uniform 4-bit
Capability Score breakdown: mini-coder-4b-OptiQ-4bitMMLU: This model 69.9, Uniform 4-bit 68.1; GSM8K: This model 59.6, Uniform 4-bit 48.1; IFEval: This model 36.6, Uniform 4-bit 38.4; BFCL-V3: This model 56.5, Uniform 4-bit 47.5; HumanEval: This model 52.4, Uniform 4-bit 54.3; HashHop: This model 0.0, Uniform 4-bit 0.0MMLU69.968.1GSM8K59.648.1IFEval36.638.4BFCL-V356.547.5HumanEval52.454.3HashHop0.00.0

Use it

Install

pip install mlx-optiq

Serve it

An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.

optiq serve --model sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

OptiQ Code

The terminal coding agent uses whatever model optiq serve is running.

optiq serve --model sjoerdbodbijl/mini-coder-4b-OptiQ-4bit
optiq code

OptiQ Lab

optiq lab --model sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

Claude Code

optiq run claude -m sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

Codex

optiq run codex -m sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

OpenCode

optiq run opencode -m sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

Mistral Vibe

optiq run vibe -m sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

Hermes Agent

optiq run hermes -m sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

OpenClaw

optiq run openclaw -m sjoerdbodbijl/mini-coder-4b-OptiQ-4bit

optiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.

mlx-lm, text only

from mlx_lm import load, generate

model, tokenizer = load("sjoerdbodbijl/mini-coder-4b-OptiQ-4bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))

Details

FamilyQwen · Qwen docs
ArchitectureQwen3
Base modelricdomolm/mini-coder-4b
Size on disk3.0 GB
Memory neededabout 5 GB
Imagesno, text only
Capability Score45.83 (from the model card)
Downloads79 in the last month
Updated2026-10-02
Hugging Facesjoerdbodbijl/mini-coder-4b-OptiQ-4bit