hugpadhugpad

ContextualAI / archangel_kto_pythia12-0b

Text Generation12B310Updated Jan 11, 2024
Hugging Face

Downloads

31

Likes

0

Last updated

Jan 11, 2024

License

apache-2.0

This repo contains the model checkpoints for: - model family <bpythia12-0b</b - optimized with the loss <bKTO</b - aligned using the SHP, Anthropic HH and Open Assistant datasets.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gpt_neox
  • text-generation
  • human feedback
  • rlhf
  • preferences

Technical specifications

Parameters12B
Librarytransformers
Languagesen
Licenseapache-2.0