AetherResearch / Cerebrum-1.0-7b

Text Generation7.2B4151Updated Mar 13, 2024

Downloads

41

Likes

51

Last updated

Mar 13, 2024

License

apache-2.0

Cerebrum 7b is a large language model (LLM) created specifically for reasoning tasks. It is based on the Mistral 7b model, fine-tuned on a small custom dataset of native chain of thought data and further improved with targeted RLHF (tRLHF), a novel technique for sample-efficie…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • conversational

Technical specifications

Parameters7.2B
Librarytransformers
LanguagesNot available
Licenseapache-2.0