ContextualAI / archangel_ppo_llama13b

Text Generation13B280Updated Jan 11, 2024

Downloads

28

Likes

0

Last updated

Jan 11, 2024

License

apache-2.0

This repo contains the model checkpoints for: - model family <bllama13b</b - optimized with the loss <bPPO</b - aligned using the SHP, Anthropic HH and Open Assistant datasets.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • human feedback
  • rlhf
  • preferences

Technical specifications

Parameters13B
Librarytransformers
Languagesen
Licenseapache-2.0