failspy / Llama-3-8B-Instruct-abliterated

Text Generation8B62313Updated May 12, 2024

Downloads

623

Likes

13

Last updated

May 12, 2024

License

llama3

This is meta-llama/Llama-3-8B-Instruct with orthogonalized bfloat16 safetensor weights, generated with the methodology that was described in the preview paper/blog post: 'Refusal in LLMs is mediated by a single direction' which I encourage you to read to understand more.

Tasks & library

  • text generation
  • transformers

Tags

  • transformers
  • llama
  • text-generation
  • conversational

Technical specifications

Parameters8B
Librarytransformers
LanguagesNot available
Licensellama3