hugpadhugpad

lucyknada / chargoddard_llama3-42b-v0-4.0bpw-EXL2

Text Generation154Updated Apr 22, 2024
Hugging Face

Downloads

15

Likes

4

Last updated

Apr 22, 2024

License

other

Meta's Llama 3 70B pruned to 42B parameters using the methodology described in The Unreasonable Ineffectiveness of the Deeper Layers. Post-pruning trained using QLoRA for ~100M tokens from JeanKaddour/minipile.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • pytorch
  • llama
  • text-generation
  • axolotl
  • mergekit

Technical specifications

ParametersNot available
Librarytransformers
Languagesen
Licenseother