Why is ollama detecting my RTX 5090 as a Vulkan device?
Hi, I am trying to see how fast Qwen 3.8 is on my RTX 5090 but I have a dual GPU setup... and somehow ollama detects the 5090 as a Vulkan instead of cuda device:
PS C:\Users\kxx> nvidia-smi -LGPU 0: NVIDIA GeForce RTX 5060 Ti (UUID: GPU-7117d8ca-25c4-ceab-ffd2-b2714e569a49)GPU 1: NVIDIA GeForce RTX 5090 (UUID: GPU-5e9ba80b-0394-39af-f604-df44b9c13659)PS C:\Users\kxx> $env:CUDA_VISIBLE_DEVICES="1"PS C:\Users\kxx> ollama servetime=2026-08-15T14:16:25.030+02:00 level=INFO source=routes.go:1933 msg="server config" env="map[CUDA_VISIBLE_DEVICES:1 GGML_VK_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: LLAMA_ARG_FIT: LLAMA_ARG_FIT_TARGET: NO_PROXY: OLLAMA_CONTEXT_LENGTH:0 OLLAMA_DEBUG:INFO OLLAMA_DEBUG_LOG_REQUESTS:false OLLAMA_EDITOR: OLLAMA_FLASH_ATTENTION:false OLLAMA_GO_TEMPLATE:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_IGPU_ENABLE: OLLAMA_KEEP_ALIVE:3m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_TRANSFER_STREAMS:4 OLLAMA_MODELS:C:\\Users\\kkeun\\.ollama\\models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NO_CLOUD:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false OLLAMA_VULKAN:true ROCR_VISIBLE_DEVICES:]"time=2026-08-15T14:16:25.058+02:00 level=INFO source=routes.go:1935 msg="Ollama cloud disabled: false"time=2026-08-15T14:16:25.065+02:00 level=INFO source=images.go:912 msg="total blobs: 19"time=2026-08-15T14:16:25.067+02:00 level=INFO source=images.go:919 msg="total unused blobs removed: 0"time=2026-08-15T14:16:25.068+02:00 level=INFO source=routes.go:1990 msg="Listening on [::]:11434 (version 0.32.13)"time=2026-08-15T14:16:25.069+02:00 level=INFO source=runner.go:60 msg="discovering available GPUs..."time=2026-08-15T14:16:25.080+02:00 level=WARN source=runner.go:722 msg="user overrode visible devices" CUDA_VISIBLE_DEVICES=1time=2026-08-15T14:16:25.080+02:00 level=WARN source=runner.go:726 msg="if GPUs are not correctly discovered, unset and try again"time=2026-08-15T14:16:25.255+02:00 level=INFO source=model_list_cache.go:112 msg="model list cache hydration complete" models=5 failures=0 elapsed=186.532mstime=2026-08-15T14:16:25.320+02:00 level=INFO source=model_recommendations.go:177 msg="model recommendations cache sleep scheduled" wait=4h18m42.63498222s consecutive_failures=0
time=2026-08-15T14:16:30.504+02:00 level=INFO source=types.go:32 msg="inference compute" id=1 filter_id=1 library=Vulkan compute=0.0 name=Vulkan1 description="NVIDIA GeForce RTX 5090" libdirs=ollama,vulkan driver=0.0 pci_id=0000:09:00.0 type=discrete total="31.6 GiB" available="30.9 GiB"time=2026-08-15T14:16:30.505+02:00 level=INFO source=types.go:32 msg="inference compute" id=0 filter_id=1 library=CUDA compute=12.0 name=CUDA0 description="NVIDIA GeForce RTX 5060 Ti" libdirs=ollama,cuda_v13 driver=13.3 pci_id=0000:04:00.0 type=discrete total="15.9 GiB" available="14.8 GiB"time=2026-08-15T14:16:30.505+02:00 level=INFO source=routes.go:2040 msg="vram-based default context" total_vram="47.6 GiB" default_num_ctx=262144
The result is that I can't force ollama to use only the RTX 5090 somehow. Anyone knows how to fix this?