Infermatic / Miquliz-120b-v2.0-FP8-dynamic
Text Generation120B190Updated Aug 6, 2024
Downloads
19
Likes
0
Last updated
Aug 6, 2024
License
mit
Dynamic FP8 quant of Miquliz 120B v2.0 made with AutoFP8.
Tasks & library
- text generation
- transformers
Tags
- transformers
- llama
- text-generation
- conversational
- fp8
Technical specifications
Parameters120B
Librarytransformers
LanguagesNot available
Licensemit