hugpadhugpad

Columbidae / CavesOfQwen3-exp16-Unhealed

Text Generation31B311Updated Jun 24, 2025
Hugging Face

Downloads

31

Likes

1

Last updated

Jun 24, 2025

License

apache-2.0

This is a copy of KaraKaraWitch/CavesOfQwen3 with the number of active experts turned up to 16. I also transplanted the embeddings from the instruct version of 30B-A3B so the chatml tokens are properly utilized.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • qwen3_moe
  • text-generation
  • mergekit
  • merge
  • conversational

Technical specifications

Parameters31B
Librarytransformers
LanguagesNot available
Base modelQwen/Qwen3-30B-A3B-Base
Licenseapache-2.0