hugpadhugpad

nbeerbower / Dumpling-Qwen2.5-7B-1k-r64-2e-5

Text Generation7.6B730Updated Feb 15, 2025
Hugging Face

Downloads

73

Likes

0

Last updated

Feb 15, 2025

License

apache-2.0

🧪 Part of an Experiment This model is meant to investigate the effects of changing LoRA rank on the same tune. Learning Rate was also increased to 2e-5 from 8e-6 Find v1 here.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • qwen2
  • text-generation
  • conversational

Technical specifications

Parameters7.6B
Librarytransformers
LanguagesNot available
Base modelnbeerbower/EVA-abliterated-Qwen2.5-7B
Licenseapache-2.0