liminerity / Bitnet-M7-70m

Text Generation77M421Updated Apr 15, 2024

Downloads

42

Likes

1

Last updated

Apr 15, 2024

License

Not available

"""this is my second attempt at converting a model float16 quantized model to 1.5bit. i used my model liminerity/M7-7b for the base model and trained on: abideen/cosmopedia-100k-pretain dataset and used his google colab project to make this"""

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • Mistral
  • 1bit
  • bitnet

Technical specifications

Parameters77M
Librarytransformers
LanguagesNot available
LicenseNot available