TeeZee / Kyllene-34B-v1.1-GGUF

Other2114Updated Jun 28, 2024

Downloads

211

Likes

4

Last updated

Jun 28, 2024

License

apache-2.0

GGUF quants of TeeZee/Kyllene-34B-v1.1, remeber to set your max context length to proper length for your hardware, 4096 is fine. Default context length is 200k so it will eat RAM or VRAM like crazy if left unchecked.

Tags

  • gguf
  • merge
  • conversational

Technical specifications

ParametersNot available
LibraryNot available
LanguagesNot available
Licenseapache-2.0