hugpadhugpad

grimjim / zephyr-beta-wizardLM-2-merge-7B

Text Generation7.2B231Updated Apr 17, 2024
Hugging Face

Downloads

23

Likes

1

Last updated

Apr 17, 2024

License

apache-2.0

This is a merge of two pre-trained language models created using mergekit. The goal was to explore the impact of merging on reasoning and narrative generation. Given that both fine-tuned models are BF16 precision (despite the precision of the base model Mistral 7B v0.1 being F…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • mergekit
  • merge
  • conversational

Technical specifications

Parameters7.2B
Librarytransformers
LanguagesNot available
Base modellucyknada/microsoft_WizardLM-2-7B
Licenseapache-2.0