← Models

gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit, quantized with OptiQ by code-and-canvas for Apple Silicon.

community

On disk8.9 GB

Memoryabout 12 GB

Use it

Install

pip install mlx-optiq

Serve it

An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.

optiq serve --model code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

OptiQ Code

The terminal coding agent uses whatever model optiq serve is running.

optiq serve --model code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit
optiq code

OptiQ Lab

optiq lab --model code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

Claude Code

optiq run claude -m code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

Codex

optiq run codex -m code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

OpenCode

optiq run opencode -m code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

Mistral Vibe

optiq run vibe -m code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

Hermes Agent

optiq run hermes -m code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

OpenClaw

optiq run openclaw -m code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit

optiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.

mlx-lm, text only

from mlx_lm import load, generate

model, tokenizer = load("code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))

Details

Family	Gemma-4 · Gemma-4 docs
Architecture	Gemma 4
Size on disk	8.9 GB
Memory needed	about 12 GB
Images	no, text only
Downloads	21 in the last month
Updated	2026-07-05
Hugging Face	code-and-canvas/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-MLX-OptiQ-8bit