mlx-optiq
← Models

NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16, quantized by OptiQ for Apple Silicon; mixture-of-experts.

MoE
On disk22.1 GB
Memoryabout 27 GB
Capability Score72.32

Capability Score breakdown

The six metrics behind this model's Capability Score of 72.32, as reported in the model card. Values are compared with uniform 4-bit.

  • This model
  • Uniform 4-bit
Capability Score breakdown: NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bitMMLU: This model 76.2, Uniform 4-bit 74.8; GSM8K: This model 81.6, Uniform 4-bit 78.5; IFEval: This model 69.1, Uniform 4-bit 67.5; BFCL-V3: This model 93.0, Uniform 4-bit 92.5; HumanEval: This model 89.0, Uniform 4-bit 86.0; HashHop: This model 25.0, Uniform 4-bit 22.0MMLU76.274.8GSM8K81.678.5IFEval69.167.5BFCL-V393.092.5HumanEval89.086.0HashHop25.022.0

Use it

Install

pip install mlx-optiq

Serve it

An OpenAI- and Anthropic-compatible server on this Mac. Every app below can use it.

optiq serve --model mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

OptiQ Code

The terminal coding agent uses whatever model optiq serve is running.

optiq serve --model mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit
optiq code

OptiQ Lab

optiq lab --model mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

Claude Code

optiq run claude -m mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

Codex

optiq run codex -m mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

OpenCode

optiq run opencode -m mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

Mistral Vibe

optiq run vibe -m mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

Hermes Agent

optiq run hermes -m mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

OpenClaw

optiq run openclaw -m mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit

optiq run starts optiq serve if it is not running, sets the agent up for this session only, and stops the server when the agent exits.

mlx-lm, text only

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))

Details

FamilyNemotron · Nemotron docs
ArchitectureNemotron-H
Base modelnvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
Size on disk22.1 GB
Memory neededabout 27 GB
Imagesno, text only
Capability Score72.32 (from the model card)
Downloads225 in the last month
Updated2026-09-14
Hugging Facemlx-community/NVIDIA-Nemotron-3-Nano-30B-A3B-OptiQ-4bit