ISTA-DASLab / Qwen3.8-27B-NVFP4-prefiller

Text Generation52235Updated Sep 29, 2026

Downloads

522

Likes

35

Last updated

Sep 29, 2026

License

apache-2.0

Prefill and decode do not have to run the same weights. This repo holds prefillers: NVFP4 transformer blocks that are streamed off the SSD one layer at a time, paired to complement low-bit GGUF for decode.

Tasks & library

  • text generation
  • gguf

Tags

  • gguf
  • nvfp4
  • quantization
  • llama.cpp
  • prefill
  • text-generation

Technical specifications

ParametersNot available
Librarygguf
LanguagesNot available
Licenseapache-2.0