grimjim / kukulemon-32K-7B-GGUF
Text Generation1001Updated Aug 26, 2024
Downloads
100
Likes
1
Last updated
Aug 26, 2024
License
cc-by-nc-4.0
These are GGUF quants of a proof of concept a merge capable of functional 32K context length while being derived from kukulemon-7B. The functioning 32K context window has been folded in via a merger of Mistral 7B v0.2 models. SLERP merge appears to be viable, but DARE-TIES mer…
Tasks & library
- text generation
- transformers
Tags
- transformers
- gguf
- text-generation
Technical specifications
ParametersNot available
Librarytransformers
LanguagesNot available
Base modelgrimjim/kukulemon-32K-7B
Licensecc-by-nc-4.0
