▲ 3 r/digital_ocean
Serverless Inference: Context-Window and Max-Output Tokens
Hi,
i stumbled accros the context-window column of do's serverless inference models. Before the "Context Window" column did not existed, but now there is one and the context-window is sometimes <= max output tokens. Isn't it always Input + Ouput <= Context-Window?
For reference, this is the page https://docs.digitalocean.com/products/inference/details/models/ and i am especially looking at the hosted models (DeepSeek V4 Flash/Pro and the new GLM 5.x). I also checked the wayback amchine (https://web.archive.org/web/20260606024635/https://docs.digitalocean.com/products/inference/details/models/)
Did they reduced the context-window/input? Was it that low before? Or is the context-window just wrongly labeled and should be something else?
u/RefactoringGuy — 9 days ago