fblgit / una-cybertron-7b-v1-fp16

Text Generation7.2B627Updated Mar 8, 2024

Downloads

62

Likes

7

Last updated

Mar 8, 2024

License

apache-2.0

We strike back, introducing Cybertron 7B v1 a 7B MistralAI based model, best on it's series. Trained on SFT, DPO and UNA (Unified Neural Alignment) on multiple datasets. He scores 64.60+ on HF LeaderTests (without DROP for now).

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • juanako
  • UNA
  • model-index

Technical specifications

Parameters7.2B
Librarytransformers
LanguagesNot available
Licenseapache-2.0