uukuguy / speechless-mistral-dolphin-orca-platypus-samantha-7b

AWQ model(s) for GPU inference. GPTQ models for GPU inference, with multiple quantisation parameter options. 2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference