hugpadhugpad

Nekochu / Llama-3.1-8B-German-ORPO

Text Generation8B283Updated Sep 25, 2024
Hugging Face

Downloads

28

Likes

3

Last updated

Sep 25, 2024

License

llama3.1

- Fine-tuning of Llama-3.1-8B on german datasets. Same datasets used in Nekochu/Llama-2-13B-German-ORPO. - I've (alway) kept LoRA QLoRAGerman-ORPO so it can be applied to any LLaMA-3.1-8B fine-tuned model but may affect performance. - Quants: exl2 2.4bpw-h6, 4.25bpw-h6, 8.0bpw…

Tasks & library

  • text generation
  • peft

Tags

  • peft
  • llama
  • llama-factory
  • lora
  • text-generation
  • conversational

Technical specifications

Parameters8B
Librarypeft
Languagesde, en
Base modelmeta-llama/Meta-Llama-3.1-8B-Instruct
Licensellama3.1