Qwen3.8-27B-MLX-OptiQ-5bit

Qwen/Qwen3.8-27B, quantized with OptiQ by p4ik for Apple Silicon; takes images.

communityvision

On disk20.2 GB

Memoryabout 24 GB

Imagesyes

Use it

Install

pip install mlx-optiq

Serve it

An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.

optiq serve --model p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

OptiQ Code

The terminal coding agent uses whatever model optiq serve is running.

optiq serve --model p4ik/Qwen3.8-27B-MLX-OptiQ-5bit
optiq code

OptiQ Lab

optiq lab --model p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

Claude Code

optiq run claude -m p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

Codex

optiq run codex -m p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

OpenCode

optiq run opencode -m p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

Mistral Vibe

optiq run vibe -m p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

Hermes Agent

optiq run hermes -m p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

OpenClaw

optiq run openclaw -m p4ik/Qwen3.8-27B-MLX-OptiQ-5bit

optiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.

mlx-lm, text only

from mlx_lm import load, generate

model, tokenizer = load("p4ik/Qwen3.8-27B-MLX-OptiQ-5bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))

Details

Family	Qwen · Qwen docs
Architecture	Qwen3.5
Base model	Qwen/Qwen3.8-27B
Size on disk	20.2 GB
Memory needed	about 24 GB
Images	yes, through optiq serve and the Lab
Downloads	121 in the last month
Updated	2026-08-29
Hugging Face	p4ik/Qwen3.8-27B-MLX-OptiQ-5bit