liminerity / Bitnet-M7-70m
Text Generation77M421Updated Apr 15, 2024
Downloads
42
Likes
1
Last updated
Apr 15, 2024
License
Not available
"""this is my second attempt at converting a model float16 quantized model to 1.5bit. i used my model liminerity/M7-7b for the base model and trained on: abideen/cosmopedia-100k-pretain dataset and used his google colab project to make this"""
Tasks & library
- text generation
- transformers
Tags
- transformers
- mistral
- text-generation
- Mistral
- 1bit
- bitnet
Technical specifications
Parameters77M
Librarytransformers
LanguagesNot available
LicenseNot available
