InferenceIllusionist / Hyperion-1.5-Mistral-7B-iMat-GGUF

Other3090Updated Mar 20, 2024

Downloads

309

Likes

0

Last updated

Mar 20, 2024

License

apache-2.0

New importance matrix quantizations for Hyperion-1.5-Mistral-7B. These i-quants have a better size to perplexity ratio as they were creating using an Importance Matrix file calculated from the fp16 (unquantized) gguf.

Tags

  • gguf
  • conversational
  • iMat

Technical specifications

ParametersNot available
LibraryNot available
LanguagesNot available
Licenseapache-2.0