CultriX / MergeTrix-7B

Text Generation7.2B614Updated Jan 27, 2024

Downloads

61

Likes

4

Last updated

Jan 27, 2024

License

apache-2.0

In my understanding the Winogrande scores are only slightly influenced by the DPO-Contamination, that has the "side-effect" of increasing the scores on the other benchmarks. Since the effect on the Winogrande scores was subtle in the udkai/Turdus benchmarking results, and this…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mistral
  • text-generation
  • merge
  • mergekit
  • lazymergekit

Technical specifications

Parameters7.2B
Librarytransformers
LanguagesNot available
Base modeludkai/Turdus
Licenseapache-2.0