ISTA-DASLab / Qwen3.8-27B-NVFP4-prefiller
Text Generation52235Updated Sep 29, 2026
Downloads
522
Likes
35
Last updated
Sep 29, 2026
License
apache-2.0
Prefill and decode do not have to run the same weights. This repo holds prefillers: NVFP4 transformer blocks that are streamed off the SSD one layer at a time, paired to complement low-bit GGUF for decode.
Tasks & library
- text generation
- gguf
Tags
- gguf
- nvfp4
- quantization
- llama.cpp
- prefill
- text-generation
Technical specifications
ParametersNot available
Librarygguf
LanguagesNot available
Base modelunsloth/Qwen3.8-27B-GGUF
Licenseapache-2.0
