hugpadhugpad

pszemraj / pythia-31m-KI_v1-2048-scratch

Text Generation30M830Updated Dec 29, 2025
Hugging Face

Downloads

83

Likes

0

Last updated

Dec 29, 2025

License

apache-2.0

Initialized from random weights based on config of EleutherAI/pythia-31m, 3 epochs bf16 It achieves the following results on the evaluation set: - Loss: 4.6160 - Accuracy: 0.2448

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gpt_neox
  • text-generation
  • generated_from_trainer
  • en

Technical specifications

Parameters30M
Librarytransformers
Languagesen
Licenseapache-2.0