nisten / deepseek-coder-v2-inst-cpu-optimized-gguf

[!TIP] The following 4bit version is the one I use myself, it gets 17tps on 64 arm cores. You don't need to consolidate the files anymore, just point llama-cli to the first one and it'll handle the rest fine. Then to run in commandline interactive mode (prompt.txt file is opti…