AetherResearch / Cerebrum-1.0-8x7b

Text Generation47B10477Updated Mar 21, 2024

Downloads

104

Likes

77

Last updated

Mar 21, 2024

License

apache-2.0

Cerebrum 8x7b is a large language model (LLM) created specifically for reasoning tasks. It is based on the Mixtral 8x7b model. Similar to its smaller version, Cerebrum 7b, it is fine-tuned on a small custom dataset of native chain of thought data and further improved with targ…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • conversational

Technical specifications

Parameters47B
Librarytransformers
LanguagesNot available
Licenseapache-2.0