SciPhi / SciPhi-Mistral-7B-32k

Text Generation13372Updated Oct 31, 2023

Downloads

133

Likes

72

Last updated

Oct 31, 2023

License

mit

The SciPhi-Mistral-7B-32k is a Large Language Model (LLM) fine-tuned from Mistral-7B-v0.1. This model underwent a fine-tuning process over four epochs using more than 1 billion tokens, which include regular instruction tuning data and synthetic textbooks. The objective of this…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • mistral
  • text-generation

Technical specifications

ParametersNot available
Librarytransformers
LanguagesNot available
Licensemit