hugpadhugpad

fblgit / UNAversal-8x7B-v1beta

Text Generation47B858Updated Mar 8, 2024
Hugging Face

Downloads

85

Likes

8

Last updated

Mar 8, 2024

License

cc-by-nc-sa-4.0

This is just a beta, a first release so people can start working on franksteins and so. It does achieve high GSM/Math and TQA, so ideally you can merge it with other mixtrals and see what coming out of it Based on mistralai/Mixtral-8x7B-Instruct-v0.1

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • UNA
  • juanako
  • MoE

Technical specifications

Parameters47B
Librarytransformers
Languagesen
Licensecc-by-nc-sa-4.0