Didn’t this happen last year? Dropped of the UTMB start list and then he won OCC? Do we think he’s out or just switching to a shorter race? And Kilian out today too. Is this the end of an era, after their Western States drops too? Kinda feels like it could be…
Hearing cheering and honking in the mid 70s what is going on?
Does anyone have access to the MCP yet? If yes, what are you using for and how has it been working for you so far? If not, what do you plan to try with it/use it for?
This might be common knowledge. But if you use openrouter there are a few things that can really drive up your token usage that you might not consider.
Provider switching kills input caching. Every time openrouter switches you to a different provider even on the same model it wipes your cache and your whole context is reloaded. I have seen it switch providers every few prompts. Once I locked it down to a specific provider per model my cache got much more stable. 99% caching every time.
Multiple agents with the same API key going to the same model and same provider can also reset your cache. Every prompt from a different agent looks like it's from the same source so it's blows away the cache. I give each profile/agent Thier own API key now.
Not all providers cache equally. I noticed when I was routed to certain providers I got almost no cache credit while other caches almost everything.
Given cached input is 90% or more cheaper, making these changes cut my token consumption down dramatically. Now I don't worry about a 150k context length becuase 149,850 of it is cached.