hugpadhugpad

abenzerps / Nemotron-3.5-Bolt-E4B-GSQ-RCO-GGUF

Text Generation6.8K14Updated Oct 25, 2026
Hugging Face

Downloads

6.8K

Likes

14

Last updated

Oct 25, 2026

License

openmdw-1.1

Mixed-precision GSQ-RCO GGUF quantizations of nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16, optimized for efficient, high-fidelity local inference in llama.cpp. The model supports a context length of up to 65,536 tokens (64K).

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • text-generation
  • gsq
  • rco
  • llama.cpp
  • quantized

Technical specifications

ParametersNot available
Librarygguf
Languagesen
Base modelnvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16
Licenseopenmdw-1.1