mlx-optiq
← Models

gemma-4-e2b-it-OptiQ-4bit-decision

mlx-community/gemma-4-e2b-it-OptiQ-4bit, a decision model for Apple Silicon: it answers typed questions at POST /v1/systemone in optiq serve.

decision
On disk5.4 GB
Memoryabout 8 GB
Parent score56.38 gemma-4-e2b-it-OptiQ-4bit

This model reuses the per-layer bit allocation of gemma-4-e2b-it-OptiQ-4bit, whose measured Capability Score is 56.38.

The parent's Capability Score breakdown

This model has no Capability Score of its own. The chart shows the six metrics behind its parent gemma-4-e2b-it-OptiQ-4bit's score of 56.38, taken from the parent's model card and compared with uniform 4-bit.

  • gemma-4-e2b-it-OptiQ-4bit
  • Uniform 4-bit
The parent's Capability Score breakdown: gemma-4-e2b-it-OptiQ-4bitMMLU: gemma-4-e2b-it-OptiQ-4bit 47.5, Uniform 4-bit 45.3; GSM8K: gemma-4-e2b-it-OptiQ-4bit 54.5, Uniform 4-bit 48.0; IFEval: gemma-4-e2b-it-OptiQ-4bit 67.7, Uniform 4-bit 67.3; BFCL-V3: gemma-4-e2b-it-OptiQ-4bit 90.0, Uniform 4-bit 86.0; HumanEval: gemma-4-e2b-it-OptiQ-4bit 64.6, Uniform 4-bit 57.9; HashHop: gemma-4-e2b-it-OptiQ-4bit 14.0, Uniform 4-bit 22.0MMLU47.545.3GSM8K54.548.0IFEval67.767.3BFCL-V390.086.0HumanEval64.657.9HashHop14.022.0

Use it

Install

pip install mlx-optiq

Serve it

optiq serve turns on POST /v1/systemone by itself when the model carries a decision head. Decision models docs.

optiq serve --model mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision

Ask it a question

curl http://127.0.0.1:8080/v1/systemone -d '{
  "state": "Checkout has been failing for every customer for the last hour.",
  "questions": {
    "urgent": {"type": "noul", "instructions": "Is this urgent?"},
    "team": {"type": "choice", "criteria": {"billing": "Payments", "technical": "Outages and errors"}}
  }
}'

From Python

from optiq.decision import DecisionModel

model = DecisionModel.load("mlx-community/gemma-4-e2b-it-OptiQ-4bit-decision")

Details

FamilyDecision models · Decision models docs
ArchitectureGemma 4
Base modelmlx-community/gemma-4-e2b-it-OptiQ-4bit
Size on disk5.4 GB
Memory neededabout 8 GB
Family referenceThis model reuses the per-layer bit allocation of gemma-4-e2b-it-OptiQ-4bit, whose measured Capability Score is 56.38.
Downloads557 in the last month
Updated2026-10-23
Hugging Facemlx-community/gemma-4-e2b-it-OptiQ-4bit-decision