ResplendentAI / Luna-2x7B-MoE

Text Generation13B14711Updated Mar 31, 2024

Downloads

147

Likes

11

Last updated

Mar 31, 2024

License

apache-2.0

Meet Luna, my one and only personal assistant and roleplaying partner. This MoE serves as her unique basis, both experts scoring above 72 average on the leaderboard, but designed for RP interactions. While running a 2x7B is slower than running a single 7B, I feel that the impr…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • mixtral
  • text-generation
  • not-for-all-audiences
  • en

Technical specifications

Parameters13B
Librarytransformers
Languagesen
Licenseapache-2.0