hugpadhugpad

ibivibiv / multimaster-7b

Text Generation7.2B510Updated Feb 2, 2024
Hugging Face

Downloads

51

Likes

0

Last updated

Feb 2, 2024

License

apache-2.0

A quick multi-disciplinary fine tune of openchat/openchat-3.5-0106 using an alpaca-style dataset across different disciplines. I used LORA adapters that I then merged back into the main model for ease of use.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • moe
  • moerge
  • conversational

Technical specifications

Parameters7.2B
Librarytransformers
Languagesen
Licenseapache-2.0