InferenceIllusionist / WizardLM-2-8x22B-iMat-GGUF

Quantized from fp32 with love. If you're using the latest version of llama.cpp you should no longer need to combine files before loading. Importance matrix calculated using fp16 precision model Calculated in 105 chunks with nctx=512 using groupsmerged.txt See below for imatrix…