u/founders_keepers

Cool to see providers hitting these top speed numbers, get in the door but actually barely gets 50 tok/s

Hard to get real sense of the speeds under normal usages, what i'm confused is how are these benchmarks meaasured? from Chat:

>Imagine a GPU is like a school bus delivering kids to school. Every time the bus leaves, there's a fixed cost whether it carries 1 kid or 50 kids. A batch size is just how many requests (or tokens) you put on the bus before sending it. If the batch is too small, the GPU spends a lot of time driving half-empty, so it's inefficient and expensive. If the batch is larger, the GPU can process many requests at once, making each one cheaper because they share the work. The downside is that the first request may have to wait for the bus to fill up, increasing latency. So inference systems constantly balance batch size: small batches give faster responses, while larger batches maximize throughput and reduce cost.

So it's mostly hard to measure true speed, Openrouter is much more accurate with higher sample sizes and number of batches.

Either way, excited to see these 200+ tok/s actually works in serverless and for weeks.

Website has been down since 8:00 PM UTC

Keep all discussion about the status here please. Will update as soon as we hear more from the support team.

• img1 Wafer fast on Vercel AI router $10/$3/0.5 - sustained $150tps+
• img2 Vercel AI router - provider comparisons
• img3 Openrouter provider comparisons

it's definitely as good as opus 4.8

mostly coding loops

300+ TPS

used their pass until it got killed. still really fast i'm going to test it out for the next month or so. might as well

So much conversation going on about end of tokenmaxxing.

Just this week in news (not in legaltech):

1. Uber capping token spend to $1500/month per dev
2. Sam Altman admits AI token costs are becoming 'a huge issue'
3. Ramp raises $750M on backs of helping CFOs solve token burn issue
4. Microsoft is canceling most internal Claude Code licenses

Any thoughts by legal professions in this space?

Got this at Marshalls for my standing desk, so pretty high traffic and my dogs favorite day spot = mess collector.

Unfortunately the washing part is kind of a gimmick, the stains are very obvious there and doesn't come out.

This was only $50 for a 6 x 7, and i'm willing to go up to $400. Not sure about Ruggable, I know people who bought them and they're alright for the price but definitely not buy for life material..

Well, good things never last. Wafer pass is no more and they've switched to a per token billing model. Thoughts?

Both plans compared, there are hick ups but overall decent enough to be used as my primary provider, been thinking about cancelling the legacy plan but i'll hold off for just a while longer.

We're giving away two tickets to a FIFA World Cup 2026 group stage match here on r/Ramp!!! Entering takes all of 30 seconds.

How to enter:

1. Join the r/Ramp subreddit
2. Leave a comment on this post!

That's it. One comment per username = one entry. The winner will be selected at random.

Details:

• Entry deadline: May 21, 2026 at 5:00 PM PT
• Winner will be notified via Reddit DM from u/ramplovesyou and must respond within 7 days

No purchase necessary. Open to US residents 21+, excluding NY, FL, and RI. Full terms and conditions.

Extension of my last post about GLM here.

Not there yet in terms of token output per second, but for flat fee of $10/wk you set it on background jobs.

MiniMax-M2.7 live with a 204,800 token context window, built for long-context coding agents and production engineering workflows. Starting at $10/week.

Tracking comparisons for the past few weeks, more full comparison here https://www.reddit.com/r/ZaiGLM/comments/1sz0gv3/glm51_on_wafer_pass_vs_zai/

For open source I'm very bullish on small providers, especially if they're local.

Comparison based on E2E on real usage, so including TTFT. Tokens per second.

For flat fee of $10/week very bullish on small inference providers.