A side-by-side comparison of every active NRP-managed LLM, how they score against each other on public benchmarks, and then a card per model with strengths, trade-offs, and recommended uses. Click any model name in the matrix or chart to jump to its card; click the HuggingFace link on any card to open the upstream model page.
Status:main generally supported · evaluating testing, may change · deprecated being retired
Capabilities:tool function calling · reasoning thinking mode · multimodal image / video / audio inputs · research active research workload (slower removal)
Benchmarks
How the catalog ranks on Artificial Analysis, an independent evaluator that runs each model itself under one fixed harness. Each bar carries its creator's colour and mark, so the two Qwens and the two Gemmas read as families rather than as four unrelated entries; the key is under the charts. The scores are for the upstream weights — NRP serves the quantizations listed in the matrix above, which can move one a point or two in either direction.
Intelligence
Artificial Analysis Intelligence Index · Higher is better
A composite of ten evaluations spanning reasoning, knowledge, instruction following, long context, and agentic tool use — AA’s single headline number for general capability.
Coding
Terminal-Bench v2.1 · % of tasks resolved · Higher is better
Agentic coding: the model is dropped into a terminal and has to finish a real software task end to end. It is the coding-heaviest component of the Intelligence Index and the closest published proxy for “how well does this model drive a coding agent”.
* Estimated by Artificial Analysis: not every component evaluation was run against that model, and the bar is drawn hatched to say so. Read from Artificial Analysis on August 31, 2026. Reasoning settings move these numbers a long way, so the exact configuration AA measured is named in the table above; in every case it is the reasoning-on default NRP serves. qwen3-embedding is absent because it is an embedding model, and no chat benchmark applies to it.
Benchmarks rank models on the tasks somebody else chose to measure, which is rarely your task. Use the chart to shorten the shortlist, then try the top two or three on your own prompts — a model that loses by four points on an index can still be the right one once context window, latency, GPU cost, and image or audio input are in play.
If your group needs a model marked for active research (so removal is communicated rather than automatic), please reach out via the Nautilus AI/ML channel in Natilus Support. New-model suggestions are also discussed there.
reasoning_effort="low" # or "medium"; "xhigh" is the default
Best for: Frontier-quality text and multimodal reasoning · Agentic coding and long-horizon tool use · Long-context document and repository analysis · Research workflows requiring reproducibility
Strengths
Highest Terminal-Bench v2.1 score in the catalog — 86.1%, ahead of glm-5
Multimodal (image + video) alongside text
1M context (262K native, YaRN-extended) for whole-repo and long-document work
Only 6B of 180B parameters active per token, so throughput stays high for a frontier model
Reasoning depth is tunable per request with reasoning_effort (low, medium, xhigh)
Thinking from earlier turns is preserved by default, which keeps agents consistent and improves prefix-cache reuse
Official FP8 quantization (fine-grained, block size 128) preserves model quality
Trade-offs
Reasoning is on at xhigh by default — the most expensive setting; lower reasoning_effort or disable thinking for simple queries
Very verbose even for a reasoning model, so a request costs more tokens than its parameter count suggests
Preserved thinking grows the prompt over a long conversation; pass preserve_thinking false to keep only the latest turn's reasoning
Experimental preview of the Qwen4 architecture — needs recent vLLM/SGLang builds, and its tool-calling and reasoning parsers are newer than the rest of the catalog's
Reaching the full 1M context needs YaRN scaling; 262K is the native window
Best for: Multimodal tasks (image/video QA, visual analysis) · Efficient general-purpose assistant · Workflows where reasoning is occasional, not constant · Reproducible research (pinnable model)
Strengths
Multimodal (image + video) at a compact 31B size with 4-bit quantization-aware training weights
Reasoning on by default — disable for faster simple queries
Solid tool calling support
Google-quality instruction following
Trade-offs
Lower throughput compared to the model size (dense model)
extra_body={"chat_template_kwargs": {"reasoning_effort": "low"}} # or "high"; "max" is the default
Best for: Whole-repository code understanding · Long-document analysis and summarization · Documents that mix long text with figures, screenshots, or scanned pages · Reasoning tasks that need the full context window
Strengths
1M context — tied with glm-5 for the largest window in the catalog, for whole-codebase and long-document work
Image input alongside that context — screenshots, figures, and scanned pages
MoE routing keeps latency low relative to total parameter count
FP8 weights plus an FP8 KV cache leave room for high concurrency at full context
Strong reasoning and tool calling
Trade-offs
Images only — no video or audio input
Experimental vision checkpoint on an evaluating model; availability and configuration may shift
Thinking is on by default at max effort; lower reasoning_effort, or disable thinking, for simple queries
Long-context requests are memory-hungry; expect slower first-token latency near the limit
Best for: Cost-efficient or high-throughput agentic coding · Long-context code review and refactoring
Strengths
Frontier-level agentic coding at modest GPU cost
Native FP8 weights — no quantization quality degradation
High throughput compared to model size
~200K context window for large codebase work
Trade-offs
Text-only — no vision or audio
No reasoning toggle (reasoning is implicit in the model behavior)
This work was supported in part by National Science Foundation (NSF) awards CNS-1730158, ACI-1540112, ACI-1541349, OAC-1826967, OAC-2112167, CNS-2100237, CNS-2120019.
