grimjim / kukulemon-32K-7B-GGUF

Text Generation1001Updated Aug 26, 2024

Downloads

100

Likes

1

Last updated

Aug 26, 2024

License

cc-by-nc-4.0

These are GGUF quants of a proof of concept a merge capable of functional 32K context length while being derived from kukulemon-7B. The functioning 32K context window has been folded in via a merger of Mistral 7B v0.2 models. SLERP merge appears to be viable, but DARE-TIES mer…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gguf
  • text-generation

Technical specifications

ParametersNot available
Librarytransformers
LanguagesNot available
Licensecc-by-nc-4.0