hugpadhugpad

SuperbEmphasis / Velvet-Eclipse-v0.1-4x12B-MoE-EVISCERATED

Other35B190Updated Apr 19, 2025
Hugging Face

Downloads

19

Likes

0

Last updated

Apr 19, 2025

License

apache-2.0

Experimental I am testing Layer Pruning and merging methods on this daily. I recommend giving the full model a try: Velvet-Eclipse-v0.1-4x12B-MoE. @mradermacher imatrix quants seem to work well: https://huggingface.co/mradermacher/Velvet-Eclipse-v0.1-4x12B-MoE-i1-GGUF/blob/mai…

Tags

  • mixtral

Technical specifications

Parameters35B
LibraryNot available
LanguagesNot available
Licenseapache-2.0