Qwen3.5-4B-OptiQ-4bit
Qwen/Qwen3.5-4B, quantized with OptiQ by machinadeusex for Apple Silicon.
communityOn disk2.9 GB
Memoryabout 5 GB
Use it
Install
pip install mlx-optiqServe it
An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.
optiq serve --model machinadeusex/Qwen3.5-4B-OptiQ-4bitOptiQ Code
The terminal coding agent uses whatever model optiq serve is running.
optiq serve --model machinadeusex/Qwen3.5-4B-OptiQ-4bit
optiq codeOptiQ Lab
optiq lab --model machinadeusex/Qwen3.5-4B-OptiQ-4bitClaude Code
optiq run claude -m machinadeusex/Qwen3.5-4B-OptiQ-4bitCodex
optiq run codex -m machinadeusex/Qwen3.5-4B-OptiQ-4bitOpenCode
optiq run opencode -m machinadeusex/Qwen3.5-4B-OptiQ-4bitMistral Vibe
optiq run vibe -m machinadeusex/Qwen3.5-4B-OptiQ-4bitHermes Agent
optiq run hermes -m machinadeusex/Qwen3.5-4B-OptiQ-4bitOpenClaw
optiq run openclaw -m machinadeusex/Qwen3.5-4B-OptiQ-4bitoptiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.
mlx-lm, text only
from mlx_lm import load, generate
model, tokenizer = load("machinadeusex/Qwen3.5-4B-OptiQ-4bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))Details
| Family | Qwen · Qwen docs |
|---|---|
| Architecture | Qwen3.5 |
| Base model | Qwen/Qwen3.5-4B |
| Size on disk | 2.9 GB |
| Memory needed | about 5 GB |
| Images | no, text only |
| Downloads | 25 in the last month |
| Updated | 2026-03-14 |
| Hugging Face | machinadeusex/Qwen3.5-4B-OptiQ-4bit |