hugpadhugpad

Xiaojian9992024 / DaRuukLLM-Refresh-4x1B-v1

Other210Updated Jan 13, 2025
Hugging Face

Downloads

21

Likes

0

Last updated

Jan 13, 2025

License

apache-2.0

DaRuukLLM-Refresh-4x1B-v1 is a Mixure of Experts (MoE) made with the following models using LazyMergekit: Trelis/Llama-3.2-1B-Instruct-MATH-3ep huihui-ai/Llama-3.2-1B-Instruct-abliterated passing2961/Ultron-Summarizer-1B unsloth/Llama-3.2-1B-Instruct

Tags

  • mixtral
  • moe
  • frankenmoe
  • merge
  • mergekit
  • lazymergekit

Technical specifications

ParametersNot available
LibraryNot available
LanguagesNot available
Base modelTrelis/Llama-3.2-1B-Instruct-MATH-3ep
Licenseapache-2.0