Ollama lets you run local AI models on the machine itself or expose its API so other computers on the network can use it.
Continue reading “Install Ollama on Ubuntu and allow connections from another machine”
Tag: NVIDIA
Pass an NVIDIA GPU to a VM in Proxmox 9 for local AI
To use an NVIDIA GPU inside a VM, Proxmox must be able to pass the whole card through to the guest by using PCI passthrough.
Continue reading “Pass an NVIDIA GPU to a VM in Proxmox 9 for local AI”
Prepare Ubuntu 22.04, 24.04 and 26.04 with NVIDIA for local AI
If you are going to run AI models locally on Ubuntu 22.04, 24.04 or 26.04, the first step is making sure the system detects the NVIDIA card correctly.
Continue reading “Prepare Ubuntu 22.04, 24.04 and 26.04 with NVIDIA for local AI”