Model Arena

Compare two models on the same prompt, side by side, with tokens/sec for each.

Model A runs on the Lab's main API server; model B runs in a second server on port + 1, started on demand. The obvious use is an OptIQ mixed-precision quant against a uniform 4-bit one, or a quant against its bf16 base, answering live in the same window so you can see the quality and speed difference at once.

Pick a model in each column (from your published OptIQ quants or local converts), load them, type one prompt, and hit Compare. Both panes stream their answer and report tokens/sec and the token count. Reasoning models are asked to answer directly (thinking disabled) so the panes show a real answer rather than burning the budget on hidden chain-of-thought.