hugpadhugpad

Tarek07 / Progenitor-V2.2-LLaMa-70B

Text Generation71B318Updated Mar 30, 2025
Hugging Face

Downloads

31

Likes

8

Last updated

Mar 30, 2025

License

llama3.3

After a lot positive feedback on Progenitor V1.1, I got some advice regarding a couple of settings which I could finetune for hopefully better results. Mainly changing the tokenizer and letting the merge compute at full float32 before scaling down to bfloat16 (shout out to kro…

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • mergekit
  • merge
  • conversational

Technical specifications

Parameters71B
Librarytransformers
LanguagesNot available
Base modelnbeerbower/Llama-3.1-Nemotron-lorablated-70B
Licensellama3.3