AetherResearch / Cerebrum-1.0-7b
Text Generation7.2B4151Updated Mar 13, 2024
Downloads
41
Likes
51
Last updated
Mar 13, 2024
License
apache-2.0
Cerebrum 7b is a large language model (LLM) created specifically for reasoning tasks. It is based on the Mistral 7b model, fine-tuned on a small custom dataset of native chain of thought data and further improved with targeted RLHF (tRLHF), a novel technique for sample-efficie…
Tasks & library
- text generation
- transformers
Tags
- transformers
- mistral
- text-generation
- conversational
Technical specifications
Parameters7.2B
Librarytransformers
LanguagesNot available
Base modelmistralai/Mistral-7B-v0.1
Licenseapache-2.0
