DeepSeek R1 GGUF files are now available in the Ollama library. Currently, all models, including distilled versions (1.5B, 7B, 8B, 14B, 32B, and 70B) and the 671B DeepSeek R1 model, are offered in Q4_K_M quantization.

https://ollama.com/library/deepseek-r1

Models

1.5B Qwen DeepSeek R1

ollama run deepseek-r1:1.5b

7B Qwen DeepSeek R1

ollama run deepseek-r1:7b

8B Llama DeepSeek R1

ollama run deepseek-r1:8b

14B Qwen DeepSeek R1

ollama run deepseek-r1:14b

32B Qwen DeepSeek R1

ollama run deepseek-r1:32b

70B Llama DeepSeek R1

ollama run deepseek-r1:70b

671B DeepSeek R1

ollama run deepseek-r1:671b