hugpadhugpad

rombodawg / Rombos-LLM-V2.5-Qwen-7b

Text Generation7.6B8717Updated Oct 28, 2024
Hugging Face

Downloads

87

Likes

17

Last updated

Oct 28, 2024

License

apache-2.0

Rombos-LLM-V2.5-Qwen-7b is a continues finetuned version of Qwen2.5-7B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base …

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • qwen2
  • text-generation
  • conversational

Technical specifications

Parameters7.6B
Librarytransformers
LanguagesNot available
Base modelQwen/Qwen2.5-7B-Instruct
Licenseapache-2.0