NVIDIA Docker

Use ollama as example:

Dockerfile

you need nvidia/cuda:12.2.0-base-ubuntu22.04

Loading content…

use this Dockerfile:

docker build -t ollama .
docker create --gpus all -it --name ollama ollama /bin/bash

the file init_ollama.sh

Loading content…

Docker Compose

docker-compose.yml

Loading content…