hugpadhugpad

DS-Archive / Norobara-ZLoss-8x7B

Text Generation47B245Updated Jan 5, 2024
Hugging Face

Downloads

24

Likes

5

Last updated

Jan 5, 2024

License

Not available

This is an experimental instruct-tuned mistralai/Mixtral-8x7B-v0.1-based model trained using Charles Goddard's ZLoss and Megablocks-based fork of transformers.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • conversational
  • en

Technical specifications

Parameters47B
Librarytransformers
Languagesen
LicenseNot available