Hi all,
Random thought
Anyone remember IRIX? The company that ran it is defunct. Was the code ever released? If not, what's the harm in releasing it at this point? Where could one even get it at this point?
I doubtful there is anything useful that could be ported in the code, but you never know!
Hi all,
I am trying to increase my context size, but it seems to be stuck at 2048. I am starting Ollama with this command:
OLLAMA_CONTEXT_LENGTH=8192 ollama serve
...
time=2026-05-18T13:25:35.321-04:00 level=INFO source=types.go:42 msg="inference compute" id=0 filter_id=0 library=ROCm compute=gfx1102 name=ROCm0 description="AMD Radeon 780M Graphics" libdirs=ollama,rocm driver=70253.21 pci_id=0000:c1:00.0 type=iGPU total="17.6 GiB" available="16.3 GiB"
time=2026-05-18T13:25:35.321-04:00 level=INFO source=routes.go:1860 msg="vram-based default context" total_vram="17.6 GiB" default_num_ctx=4096
Within Ollama, I set the context to 8192 as follows:
❯ ollama run smollm
>>> /set parameter num_ctx 8192
Set parameter 'num_ctx' to '8192'
Still, when I run ollama ps, I see the size stuck at 2048:
❯ ollama ps
NAME ID SIZE PROCESSOR CONTEXT UNTIL
smollm:latest 95f6557a0f0f 1.5 GB 100% GPU 2048 4 minutes from now
Prompts that exceed that size crash. How do I fix this issue?
Hi all,
Question Statement: What limitations or compatibility issues should I look for when purchasing an external chassis and GPU?
I'm new to the eGPU space and would like to run local AI models on my Framework laptop.
Per a lot of testing, my "AMD Ryzen 7 7840U w/ Radeon 780M Graphics" does not have dedicated VRAM - Ollama will run, but very frequently crashes the video.
Are there any limitations on what external chassis will work with my laptop? For example, are only certain devices compatible with certain GPUs and motherboards?
I am looking to run a Tesla P40, which are relatively cheaper devices with 24G VRAM. I do not yet know which exact model I plan to run only because I have not even been able to successfully test them on this onboard GPU, but this will almost certainly be for analyzing large code bases.
Thoughts?
Hi all,
I got Ollamo working on my AMD Radeon 780M Graphics GPU, but every so often it'll crash my display, the screen goes black, and I have to log back into Linux.
Is there a way to prevent/mitigate that? This is an on-board GPU.
Thanks!
Hi all,
I recently got a new motherboard with a AMD Radeon 780M Graphics GPU. I got it working with Ollama, but every so often it causes the display server to crash and I have to log back into Linux.
Anyone ever had an eGPU via USB-C to work with Ollama? Can Framework MBs do this? Are there any "well, it'll work but..." present?
Thanks!