u/dalhaze

We are currently looking for a 3rd roommate for an apartment facing Tompkins square park. This a gem of an apartment at this price given its location, the size and the sunlight that it gets. If you're not familiar, this love area has a lot of charm area is one of the best areas in the city for restaurants and nightlife and general exploring.

The unit is $7850 and would be split nearly equally (the rooms vary in size) depending on what we all feel is fair each of us would pay around $2600.

Our 3rd roommate's situation changed and we are looking for a 3rd roommate so we can apply to this unit ASAP for an October 20 - 25th move in, but can move as late as Oct 31/ Nov 1st. If we don't manage to lock in this unit in time we are looking for one similar or slightly more affordable.

A bit about us:

I'm Dalin, in my early 30s, and work in marketing at a healthcare tech company. I'm usually tinkering with some creative project or getting a little too excited about a questionable idea I had last week. I love dumb jokes, live music, exploring the city, and meeting new people. I'm easygoing, social, and pretty easily talked into trying something new. I also have a very sweet, very fluffy orange cat who's enjoying his retirement years.

Noah is 36 and works a hybrid schedule in tech/government affairs. He's usually out playing volleyball, biking, running, grabbing drinks with friends, or finding new ways to enjoy the city. He's social, active, and rarely short on plans.

We're both fairly tidy without being neurotic about it. We like a lively apartment with good conversation and nonsense, but also independent and appreciate our downtime. We want the place to feel like a home and would love to find someone who's fun, considerate, and doesn't take themselves too seriously.

You can see the unit here: https://streeteasy.com/building/343-east-10-street-new_york/3

Text me if you're interested. Reddit message aren't great for keeping in touch:
801-960-0381

Theres been a lot of talk about quiet quantization of models and what access to guaranteed model quality would look like.

I’ve been trying to sanity check the economics of running large open models, and I’m having trouble making the numbers work.

Take GLM-5.2 as an example. Even in a pretty optimistic scenario, say an FP8 deployment on cheap 8×H200 spot capacity around $12–$14/hr, you still need a lot of throughput to make API pricing work.

Even at a best-case ~$14/hr for 8×H200 FP8, a node doing ~175 output tok/s only produces ~630k output tokens/hr. That works out to ~$22/M output tokens before ops/margin, which is hard to square with ~$4/M API pricing unless throughput is far higher, infra is much cheaper, or the model is more aggressively optimized/quantized.

If the node is only doing a few hundred output tokens/sec, the raw infra cost can easily land well above typical OpenRouter output pricing.

Anything below FP8 is going to see pretty significant reduction in quality of outputs right? And even FP8 is going to see 8-10% reduction in output quality right? (I know quantifying this is a bit silly)

So unless providers are getting dramatically better throughput, much cheaper infra, or subsidizing usage, it seems likely that a lot of routes are using more aggressive quantization than people assume. Maybe that is fine for many use cases, but it feels important to know, especially for agentic work, planning, coding, and long-context tasks where subtle degradation matters.

I’d be interested in pushback from people who know inference economics better than I do. Am I missing something obvious with batching, caching, MTP/speculative decoding, or provider-level optimization?

This also makes me wonder if there is some demand for premium access to specific models where the serving stack is disclosed and the quantization is pinned, even if you only use it for certain high value tasks like planning or difficult agent workflows. I think this will become even more critical as models become even more capable - otherwise access to the best models will be completely gate kept by providers that quantize the frontier.

I mean most of of us seem to suspect that even the best models from closed source providers are degraded at points. You might have to pay 3-5x for a single planning or difficult query or workflow, but at least you'd know exactly what you're getting.

Spacious East Village Room Facing Tompkins Square Park - Fun, Easygoing Roommates - $2600

Openrouter model prices implying heavier quantization?