Qwen3-Embedding-0.6B-OptiQ-4bit
Qwen/Qwen3-Embedding-0.6B, quantized with OptiQ by iamthecage for Apple Silicon.
communityOn disk0.5 GB
Memoryabout 2 GB
Use it
Install
pip install mlx-optiqServe it
An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.
optiq serve --model iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitOptiQ Code
The terminal coding agent uses whatever model optiq serve is running.
optiq serve --model iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bit
optiq codeOptiQ Lab
optiq lab --model iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitClaude Code
optiq run claude -m iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitCodex
optiq run codex -m iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitOpenCode
optiq run opencode -m iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitMistral Vibe
optiq run vibe -m iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitHermes Agent
optiq run hermes -m iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitOpenClaw
optiq run openclaw -m iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bitoptiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.
mlx-lm, text only
from mlx_lm import load, generate
model, tokenizer = load("iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))Details
| Family | Qwen · Qwen docs |
|---|---|
| Architecture | Qwen3 |
| Base model | Qwen/Qwen3-Embedding-0.6B |
| Size on disk | 0.5 GB |
| Memory needed | about 2 GB |
| Images | no, text only |
| Downloads | 95 in the last month |
| Updated | 2026-06-22 |
| Hugging Face | iamthecage/Qwen3-Embedding-0.6B-OptiQ-4bit |