Llama 3.1 Nemotron Nano 8b V1 — Retired model
Llama-3.1-Nemotron-Nano-8B-v1 is a compact large language model (LLM) derived from Meta's Llama-3.1-8B-Instruct, specifically optimized for reasoning tasks, conversational interactions, retrieval-augmented generation (RAG), and tool-calling applications. It balances accuracy and efficiency, fitting comfortably onto a single consumer-grade RTX GPU for local deployment. The model supports extended context lengths of up to 128K tokens. Note: you must include `detailed thinking on` in the system prompt to enable reasoning. Please see [Usage Recommendations](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1#quick-start-and-usage-recommendations) for more.
Technical specifications
Frequently Asked Questions
Can I still use the retired Llama 3.1 Nemotron Nano 8b V1 model?
No. Llama 3.1 Nemotron Nano 8b V1 has been retired and is retained here only as a historical reference. See the active alternatives linked on this page.
Relay integrity checks
No integrity-check data is available for this model yet.
BazaarLink Probe verifies endpoints that claim to serve this model and flags behavior that differs from the reference baseline.
View the full integrity report →Related models and links
More from this provider: NVIDIA