hugpadhugpad

ContextualAI / archangel_sft-kto_pythia1-4b

Text Generation1.4B420Updated Jan 11, 2024
Hugging Face

Downloads

42

Likes

0

Last updated

Jan 11, 2024

License

apache-2.0

This repo contains the model checkpoints for: - model family <bpythia1-4b</b - optimized with the loss <bSFT+KTO</b - aligned using the SHP, Anthropic HH and Open Assistant datasets.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • gpt_neox
  • text-generation
  • human feedback
  • rlhf
  • preferences

Technical specifications

Parameters1.4B
Librarytransformers
Languagesen
Licenseapache-2.0