turboderp / Llama-3.1-8B-Instruct-exl3

2.00 bits per weight 2.25 bits per weight 2.50 bits per weight 3.00 bits per weight 3.50 bits per weight 4.00 bits per weight 5.00 bits per weight 6.00 bits per weight 8.00 bits per weight