Running AI locally: Ollama in Docker container

Ollama is not "free only" anymore, has paid versions.
But the installer is not digitally signed, and is HUGE, 2 GB.
So Windows 11 rejects it for security reasons.

Download Ollama on Windows

Pricing · Ollama

Ollama can be run in Docker using its official Docker image. 

Running Ollama in a container provides a clean, isolated environment and simplifies deployment across different systems. [1, 2, 3, 4]

CPU-only:

docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama


Nvidia GPU support (Requires NVIDIA Container Toolkit):

docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

AMD GPU support:

docker run -d --device /dev/kfd --device /dev/dri -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama:rocm

ollama/ollama - Docker Image

1.4 GB

ollama/ollama: Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. @GitHub