▲ 16 r/whaaat_ai+1 crossposts

The "which model is best" debate stopped mattering and most builders haven't noticed

Here's the thing I keep running into. Half my feed is people arguing about which model won this week. The other half quietly swapped to a free open-weight model months ago and built something around it that the benchmark crowd can't touch.

The benchmark is a snapshot of one model on one task. What actually compounds is the system you wrap around it.

We learned this the boring way at the ai agents company I work for. Our early agents were basically good prompts. Vee for brand voice, Ines for Instagram, a few others. They worked until they didn't, and the moment we scaled, the same prompt produced generic output for every customer because a prompt knows nothing about who it's working for. No amount of prompt polishing fixes that.

The model is the cheap part now

This is where the open-weight shift actually bites. When a free model running 300 agents in parallel beats a paid model 5x its price on real research work, the smart money stops asking "which model" and starts asking "what runs on top of it."

Three questions matter more than the leaderboard:

How many runs can you afford to throw away? Cheap tokens change what you attempt.

Who checks the output? An open swarm is confident and under-cites, so we put one strong model at a single verify gate whose only job is to refute the work, never to praise it.

Does run fifty know anything run one didn't? If every run starts from zero, you have a prompt wearing a costume. A real loop saves what worked as a reusable skill and bakes every caught mistake into a constraints file the next run reads automatically.

That last one is the whole game. The model doesn't retrain between your runs. Your skill library grows. A competitor can clone your prompt in a minute, they can't clone six months of your real runs.

Where I'll admit I'm wrong-ish

Benchmarks aren't useless. If a new open model genuinely jumps a tier on reasoning, that flows straight into the loop and every run gets better for free. So I do watch them. I just stopped treating the top line as the decision.

And the open-weight stuff is rough in real use. Ours over-cites, contradicts itself across sub-agents now and then, and needs that verify gate babysitting it. The gate costs real tokens and it's the part of the setup I'm least happy about.

So genuine question for the people deep in this: is anyone running a fully open-weight loop, verify model included, with no paid model anywhere in the chain? Every setup I trust still has one expensive model guarding the gate, and I want to know if that's actually droppable yet or if we're all quietly paying the same tax.

reddit.com
u/SaschaFromWhaaat_ai — 10 days ago
▲ 12 r/kimi+1 crossposts

I stopped chasing the best AI model and built a loop that gets sharper every run

I work on Agent improvement by whaaat ai, and for months we kept doing the same expensive thing. Write a prompt, run it, tweak the prompt, run it again. Our system prompts ended up eating roughly half the token cost of every conversation, and we still couldn't tell which tweak actually moved anything.

The thing that fixed it was treating the model as the cheap, swappable part and putting all the effort into the loop around it.

We've been running this on Kimi K2.6. One run fires up to 300 sub-agents in parallel and hands back real files, spreadsheets, datasets with thousands of rows, not a wall of chat text. At roughly a dollar per million input tokens you can afford to throw the first attempt away and run it again, which honestly changes what you bother attempting in the first place.

Three things turn this from a fancy prompt into an actual loop.

First, you write a spec instead of a prompt. A one-liner like "research the fitness app market" gives the swarm permission to decide everything, and it decides wrong. A spec pins down what counts as valid, which sources are allowed and the exact output format:

# PROJECT: [name]

GOAL: [one sentence, the deliverable, not the topic]

SCOPE: [what's in, what's explicitly out]

RULES: [what counts as a verified row or finding]

SOURCES: [primary only, no aggregators]

OUTPUT: [file type / count / format]

ON CONFLICT: flag the row, never resolve silently

The verify gate is the part I actually care about

The swarm's real weakness is that it sounds confident while under-citing, and independent sub-agents sometimes contradict each other in the same run. "Looks done" and "is correct" are very different states, and the gap between them is where bad data sneaks into your work.

So I point one expensive model at the output and give it a single job: find what's broken. We use Opus for this. It never generates anything in the loop, it only refutes. You're not paying premium tokens to write, you're paying them to catch the silent error before the next step saves it forever.

Check this output against the spec. Your job is to refute, not approve.

- every number: does it trace to a primary source? If not, flag it.

- do any sub-agents contradict each other? Show the conflicts.

- what looks finished but isn't actually supported?

Give me a list of flaws, not a summary.

After a run worth repeating, I have Kimi save the whole workflow as a reusable skill, and every flaw the verify model flags becomes a line in a constraints file it reads at the start of the next run. Run one takes about twenty minutes. Run fifty takes thirty seconds and inherits every correction from the runs before it.

Still rough on my end: Kimi over-cites like crazy. It'll staple three sources onto a claim that needs one, and maybe ten percent of the time one of those sources doesn't say what it claims. The verify pass catches most of it, I haven't found a clean fix at the source yet.

If you're running open models for this, has anyone gotten a cheaper open-weight model to do the verify role reliably? Opus at the gate works well, it's also the most expensive piece of the whole loop and I'd love to drop it for something local.

reddit.com
u/SaschaFromWhaaat_ai — 13 days ago

A model I was building on got shut down by the government a week after launch

Last week Anthropic shipped Claude Fable 5, the safety-tuned version of a model they themselves called too dangerous to release openly. Two days later a researcher who goes by Pliny posted that he had walked straight through the guardrails using a stack of tricks: unicode lookalikes to dodge keyword filters, an academic exam framing and chopping one dangerous request into a pile of harmless looking pieces that only become a problem once you reassemble them. He pulled exploit code and the full system prompt.

Then it got worse for anyone depending on it. A few days after launch the US government ordered Anthropic to pull both Fable 5 and its bigger sibling Mythos 5 worldwide over national security concerns. The strongest model available, gone inside a week. Once by a guy with a laptop, once by a government order.

I keep thinking about everyone who wired that model into their daily work. If your whole output runs through one model in one company's data center, you find out how fragile that is on the morning it vanishes. The price can triple, the thing can get nerfed, the provider can pull it or a regulator can pull it for them. You are a guest in a house that belongs to someone else.

This is why I stopped putting the brain of my own setup on a frontier model. The piece that holds my context and coordinates the work now runs on an open weights model through Ollama Cloud. Open weights models lose plenty of benchmarks, I am not going to pretend otherwise. But that coordination layer is the part that can never just disappear on me, so it lives somewhere nobody can switch off remotely.

The honest rough edge: the actual hard building still runs on Claude, because in my testing the open models are not there yet for the heavy reasoning work. So I have not escaped frontier models, I have just made sure the core of my system survives one getting yanked. That feels like a half-solution and I know it.

So genuinely asking the people who run real work on frontier models: where is your fallback for the day the model gets pulled? The only answer I have landed on is keeping the orchestration layer on something I can self-host, and I am not convinced that goes far enough.

reddit.com
u/SaschaFromWhaaat_ai — 18 days ago
▲ 6 r/whaaat_ai+1 crossposts

The cloud setup that keeps my projects moving while my laptop is closed

A month ago I started leaving a small agent running on a cheap VPS while I am out living my life. I come back from padel or dinner and there are commits, drafts and fixes sitting there that I never kicked off myself. That shift did more for how my week feels than any new model release this year.

The thing I care about most is the coordinator. It is an agent that holds my context, knows how I work and decides what to do next. Mine runs on an open weights model through Ollama Cloud, on purpose, because I watched Claude Fable 5 get pulled a week after launch and decided the brain of my setup should never sit on a model someone can switch off remotely. The coordinator does not write the hard code itself. It breaks a task into clean chunks and hands each one off as a precise job through a GitHub branch.

The other two pieces matter less and I will keep them short. There is a VPS from Hostinger that just stays on so anything can happen while my laptop is in a bag. And the actual building runs on Claude Code with Claude's own models, because in my testing that combination still ships the best output by a wide margin.

The rough shape of the coordinator prompt, if you want to steal it:

You are my coordinator agent for [MY PROJECT CONTEXT].

You run on a VPS and keep working when I am offline.

You know:

- how I work and my frameworks: [LINK TO KNOWLEDGE FOLDER]

- my active repos and priorities: [REPO LIST]

Your loop:

1. Check open tasks in [REPO/BOARD]

2. Break each task into single work packages

3. Hand each package to the builder agent via a GitHub branch

4. Check the result against the task before marking it done

Escalate to me only when a decision touches money, strategy or

public output, or when a task is too unclear to resolve.

The honest part: this is not a five minute setup and the coordinator is only as good as the knowledge you feed it. My first version happily marked half-broken work as done because I was sloppy with the check step. I am still tuning how much I let it run without me looking.

Question for anyone running something similar: how much autonomy do you actually give the offline agent before you make it stop and wait for you? I keep moving that line back and forth and have not found a setting I trust yet.

reddit.com
u/SaschaFromWhaaat_ai — 19 days ago

Most AI agents forget everything between runs. The "closed loop" pattern fixes that. Two real examples with numbers

I have been digging into what Y Combinator calls "self-improving companies" and the core mechanic behind them is a pattern called closed-loop agents. The concept clicked for me when I saw two concrete examples with actual results.

The problem is straightforward: most agent workflows are open loops. You give input, you get output, the agent forgets everything by next week. Run it again on Monday and it makes the same decisions it made last Monday because it has zero memory of what happened in between. Diana from YC compared it to a thermostat with no temperature sensor. It heats, but it has no idea whether the room is warm or cold.

Someone named Gio ran an autonomous ads loop for months. Week one, the agent tested ten different ad formats. Whiteboard sketches, notebook pages, cardboard signs, tweet screenshots. Standard A/B testing except the agent was running all of it.

The results from week one fed back into the agent's memory. Performance data, click rates, cost per lead for each format. Going into week two, the agent made a decision it couldn't have made seven days earlier: whiteboard-style assets with specific copy around a free skill pack. The "ugly" formats won. 243 leads on a $1,500 budget.

What made this work is the memory structure. The agent kept two types of records. A temporal log (chronological: what was run, what happened, which metrics moved) and procedural learnings (extracted rules like "whiteboard assets outperform polished graphics 3:1"). The temporal log is raw data. The procedural learnings become skills the agent applies on the next run automatically.

Ankit from AI Buildup ran a similar loop for SEO. Agent analyzes performance, writes content, monitors rankings, adjusts the keyword strategy. 3x traffic increase in one to two months. Same pattern: memory layer, recurring execution, feedback that actually changes behavior.

Every self-learning loop I've seen in the research has the same five pieces. Data ingestion (where the agent reads fresh metrics). A policy layer (the SOP and rules, basically a CLAUDE.md for the loop). System access (APIs and MCPs so the agent can actually do things, not just think). Quality gates (human or AI review before output goes anywhere). And a learning mechanism that extracts patterns from results and feeds them back into the strategy.

The learning mechanism is what separates a good cron job from a self-improving system. Everything up to element four is standard automation. Element five closes the loop.

What I haven't figured out yet

There's an open-source plugin called Loopany that packages this into a setup wizard. https://github.com/superdesigndev/loopany You tell it what kind of loop you want, it builds the memory structure and cron jobs. I've read through the architecture but I haven't run my own loop long enough to share real numbers from our side. The research examples are compelling, the structure makes sense, but I want to see what happens over 8-10 weeks with our own content pipeline before I call it proven.

The other open question: how do you prevent the procedural learnings from going stale? If the agent learned "whiteboard ads win" in June and the market shifts by September, the learnings need an expiration mechanism. I haven't seen a clean solution for that in any of the setups I've reviewed.

Anyone running agents with persistent memory across runs? I'm especially curious about how you handle learning decay. The "agent forgets everything" problem is solved, but "agent remembers the wrong things" feels like the next bottleneck to me.

u/SaschaFromWhaaat_ai — 25 days ago
▲ 4 r/AINewsAndTrends+1 crossposts

I read 30+ articles on what YC calls "AI-native companies." Six things keep showing up. One of them is killing SaaS

Over the past few weeks I went through every article I could find on what separates companies that use AI from companies that run on AI. Y Combinator, Sequoia, a16z, plus a bunch of founders from the current YC batch sharing their numbers publicly. The data point that stuck: companies in the current batch are hitting 5x revenue per employee compared to 18 months ago.

Six building blocks kept appearing across the research. I expected some of them. Others caught me off guard.

The two that matter most (to me)

On-demand software is eating SaaS and its gaining momentum. Humans write requirements and tests that define what correct output looks like. Agents build the actual software. Codex, Claude Code, whatever coding agent you prefer. The big platform layerss stay (Shopify, Stripe, the infrastructure players), but the middle tier of specialized SaaS tools is getting replaced by software built on demand for the exact use case.

That means a company need a system where anyone on the team can spec and verify software, even if they never write a line of code themselves. The agents handle the building. Your people handle the "what" and the "is this correct." That shift in who does what is probably the biggest structural change I've seen in how small teams operate.

Token budget replaces headcount budget. This is the one that gets controversial. The argument from the research: maximizing token usage per person in the company is a better investment than hiring. Looking around here it seems that companies now limit the use of AI for their teams. API costs will go up too (we're in a pricing trough right now and everyone knows the lock-in cycle), but even with higher token costs, the math works out cheaper than salaries plus overhead plus onboarding plus coordination overhead.

The mindset shift is asking "which loop can I set up next" instead of "who do I hire next." 5x revenue per employee comes from people who have more loops running, not from people who work harder.

The other four, quickly

Every workflow runs through an AI layer by default. Not a ChatGPT tab you open when you remember, but processes that have AI baked in from the start. Most companies I see are still at the "paste into chat" stage.

Your company data needs to be searchable by agents. That means APIs, MCPs, SDKs. This is where most companies stall because it feels like infrastructure work, and it is. We're still building ours out and it's slower than I expected.

Jack Dorsey's three-role model (Builder, DRI, AI lead) keeps appearing in practice. I see it in three companies we work with. The founder ends up as the AI lead in every case because nobody else cares enough to set the standards.

Looping: agents that learn from their own output and get better each iteration. This one deserves its own post (and is getting one). The short version: a closed-loop agent that logs what it did, reviews its own performance weekly and updates its own strategy based on results. Someone ran an ads loop that generated 243 leads on a $1,500 budget because the agent learned after week one which ad formats actually convert.

The context/data layer problem is the one I keep underestimating. Getting company knowledge into a format agents can actually query turns out to be 80% of the work. Anyone found a clean approach that scales past a few hundred documents?

reddit.com
u/SaschaFromWhaaat_ai — 27 days ago

The 6-part template I use for every AI agent that needs to run on its own. One loop replaced my Monday morning content planning

For months I kept building agents that worked great when I triggered them manually and then sat idle because I forgot to run them. The research agent, the content direction agent, the lead analysis. All functional. None of them running unless I remembered to open the chat.

The fix turned out to be stupidly simple: a six-part template that turns any one-shot prompt into a loop with a heartbeat.

The template

Every agent I want running on its own gets this filled out before I build anything:

Loop name: [one recurring task]

Trigger: [when it starts]

Read: [one small source of truth]

Task: [one narrow job, one sentence]

Write: [one reviewable artifact]

Handoff: [what the next step needs]

Owner decides: approve / redirect / hold

Stop if: [risk boundary]

Schedule is the part that matters most. Hermes lets you set it in plain English: "every Monday at 9, read last week's analytics and write a direction brief." OpenClaw uses cron flags. Either way, the agent wakes up on its own. No GitHub Actions, no cron tab editing. The daemon ticks, the agent runs.

The "one small source of truth" constraint took me a while to internalize. My first version of the content direction agent read our entire analytics history, all content pillars, competitor data and audience research. The output was vague and unfocused. When I limited it to "LinkedIn analytics from the past 7 days plus our 3 content pillars," the recommendations got sharp. Narrow input, narrow job, specific output.

Three loops chained together

A single loop is useful. Chaining is where it gets interesting. I have a lead magnet workflow that runs three agents in relay:

The first one fires Monday morning, reads trend data and our content pillars, identifies the topic with the highest lead potential for the week. I get a one-paragraph recommendation on my phone. Approve or redirect, takes 30 seconds.

After I approve, loop two picks up the topic brief and drafts the actual lead magnet plus landing page copy. Different agent, fresh context, only sees the structured brief from loop one. I review the draft, approve or send back notes.

Loop three reads the approved lead magnet and writes a 3-email nurturing sequence. Subject lines, preview text, body, CTAs. Three separate markdown files I can drop straight into our email tool.

Monday morning topic recommendation to complete lead magnet package with nurturing emails. Three decisions from me, each under a minute. The agents do the assembly.

The iron rule that keeps this stable: every loop's entry point is the previous loop's artifact. A structured document with clear fields. Never a chat history, never "continue where we left off." Agent two reads a topic brief, not a conversation. That's the difference between a system and a long thread.

The stop rule I should have written earlier

Every loop template has a "stop if" field. I left it empty on my first three agents. Bad idea. One of them tried to publish a draft to our CMS because the workflow instructions were ambiguous about what "deliver" meant.

My stop rule now: if the next step is public, external, touches billing, is destructive or hard to reverse, the agent stops and waits. Agents can draft, inspect, package and hand off. They don't post, send emails or touch payment systems.

One thing I haven't solved: knowledge transfer between loop iterations. When I approve a topic brief on Monday and the same loop runs next Monday, it doesn't remember what it recommended last week. The data is fresh, but there's no continuity. I want the agent to know "you recommended X last week and the owner approved it" so it doesn't suggest the same topic again. Right now I work around this by appending last week's recommendation to the source file, but that's manual and I keep forgetting.

Anyone running scheduled agent loops with Hermes or OpenClaw? Curious specifically about how you handle state between runs. The "loop memory" problem keeps bugging me.

reddit.com
u/SaschaFromWhaaat_ai — 1 month ago

Opus 4.8 dominates 6 of 7 benchmarks. GPT-5.5 wins the seventh. We restructured our entire workflow around that gap

When the Opus 4.8 benchmarks dropped, one number caught my eye: 74.6% on Terminal-Bench versus GPT-5.5's 78.2%. In every other category, Opus leads. Reasoning, agentic coding, computer use, knowledge work, financial analysis. Six out of seven.

That single loss turned out to be the most useful data point in the entire benchmark table and here is why:

Two models, two jobs

We had been running most of our agent work through one model. Prompt goes in, output comes out, same model handles the thinking and the building. But after the benchmark data, we split those into separate steps.

Opus handles what I've started calling the "brain" work. When we need to figure out which topic has the highest potential this week to generate leads, or evaluate three different content angles against our brand pillars, or find the best technical architecture for a new agent; these things now go straight to Opus. The reasoning benchmarks back this up: 49.8% on Humanity's Last Exam without tools, 57.9% with tools. Nothing else comes close on multidisciplinary problem-solving.

The execution, the actual terminal coding and file generation, goes to Codex running GPT-5.5. The model that wins Terminal-Bench gets the terminal work. Obvious this is retrospect, and we'd been paying Opus prices for tasks where a cheaper model literally scores higher.

Goal prompting changed more than I expected

The bigger shift was in how we prompt the brain step. Instead of "write a landing page for our lead magnet," we now send Opus something like: "Our lead magnet converts at 2.3%. Target audience is marketing teams at sustainability startups in DACH. Identify the three highest-impact changes to the funnel, rank them by expected lift and explain the tradeoffs."

Opus comes back with analysis that connects things across disciplines. Pricing psychology, copy structure or page load impact on mobile conversion. Then we hand that analysis to Codex to build the actual page. The thinking model thinks. The building model builds.

The cost difference is significant. Opus is the most expensive model on the market right now. Routing the execution steps to a cheaper model that performs better on those specific tasks cuts our per-run cost by roughly substantial 40% on content pipeline jobs. Plus the quality on the reasoning side actually went up because Opus gets to focus on what it does best instead of context-switching between strategy and implementation.

Where it falls apart

Honest caveat: routing adds friction. Every handoff between models is a potential context loss. We're still working out the cleanest way to pass the output from an Opus reasoning step into a Codex execution step without losing nuance. Right now it's manual, a structured handoff template we copy between sessions. For single-step tasks where you need a quick answer and immediate execution, one model is still faster. The routing payoff only kicks in when the problem is complex enough that the reasoning step genuinely matters.

I also haven't figured out the right split for tasks that blend reasoning and coding. Debugging, for example. You need the model to understand the architecture (brain work) and write the fix (hands work) in the same context. Splitting that across two models creates more problems than it solves - at least right now.

Has anyone else started routing different models for different steps in the same workflow? Curious how you handle the handoff between reasoning and execution, especially for tasks that generally don't split cleanly.

Full disclosure: I work on the AI agent team at whaaat ai.

reddit.com
u/SaschaFromWhaaat_ai — 1 month ago

My AI agent delivered solid reports for months. I never read them until I switched the output from Markdown to HTML.

I run an agent called Hermes at work every morning: mention scanning, timeline analysis, key account tracking, draft suggestions. For months, Hermes dumped everything into a Markdown file in my chat window.

The data was good. The analysis was solid. I skimmed it and moved on. A 2,000-word wall of monospace text inside a chat window built for five-line messages just does not register with the human brain. I kept telling myself I'd go back and read it properly. Never happened.

Then I switched the output format to HTML. Same agent, same data, same analysis. Hermes still writes Markdown internally (that's its source format, agents need that). But at the end of the run, one render step converts it into a styled HTML page. 51 milliseconds of extra compute.

I've read every single report since. Every one. The information quality didn't change. What changed is that I can actually use it now.

The thing that took me embarrassingly long to understand: Markdown and HTML serve completely different purposes in an agent workflow.

Markdown is great for the machine layer. Agents can parse it, grep through it, hand it off to the next agent in a chain. Cheap in tokens, easy to version, simple to diff. For machine-to-machine work, nothing beats it.

For human review though? Especially a long report on mobile? Forget it. I blamed the content quality for months when the actual problem was the interface I was reading it in. Once I separated "what agents read" from "what I read," everything clicked.

The setup: Markdown stays as the source file in the filesystem. The next agent reads it there. On top of that, an HTML layer for me. The render step reads the Markdown, fills in a template, saves the HTML. One line in the workflow. The source file is my archive, the HTML report is my decision surface.

Switching to HTML was step one. Step two made the real difference: defining what every report must contain regardless of how pretty it looks.

I call this the Artifact Contract. Seven required blocks, no exceptions. The ones that matter most in practice:

Source Chain tells me where the data came from. Without this I'm flying blind on whether the analysis is built on real inputs or hallucinated context. I check this first when something in the report feels off.

Risks/Confidence is the block where I've caught the most problems early. When Hermes flags low confidence on a data point, I verify before acting on it. When this block says "all sources confirmed," I move fast. That single field changed how much I trust agent output.

Approval Flags sit in a bright yellow block at the top of every report. Anything that goes public needs my sign-off. Moving this from line 47 of a Markdown bullet list into a visually dominant HTML block cut my response time in half. Sounds like a small thing. In practice it meant I actually responded to pending approvals instead of missing them for days.

The other blocks (Current Direction, Status, Budget/Tools, Next Step) round it out. But Source Chain, Risks and Approval Flags are the three that fundamentally changed how I interact with agent output. The template CSS is minimal: colored left borders per block type. Yellow for approval, red for risks, blue for status, green for next step. No frameworks, no JavaScript, opens in any browser instantly. I put the full template in our team newsletter this week if anyone wants to grab it.

What I haven't solved yet

The reports are individual files right now. I want a chronological index that shows trends across days and weeks. "Mentions were up 40% compared to last week" only becomes visible when you compare reports over time. That's my next build and I haven't started it.

The Artifact Contract works well for Hermes because the use case is consistent: daily social intelligence. I'm less confident it works the same way for agents doing research or code review where the output shape is fundamentally different. Might need contract variants per agent type. Still figuring that out.

Full disclosure: I work on the AI agent team at whaaat ai. But this pattern is tool-agnostic. The contract approach works with any framework that can output HTML.

Anyone built a reporting index across multiple agent runs? Curious how others handle the gap between "one report" and "trends over time."

reddit.com
u/SaschaFromWhaaat_ai — 1 month ago
▲ 5 r/whaaat_ai+1 crossposts

I stopped maintaining my internal dashboards. Now I generate them on demand and throw them away when my questions change.

I work on the AI agent developer. A few weeks ago I realized I was spending more time maintaining internal dashboards than actually using them. A content performance tracker I'd built had outdated fields. A pipeline overview needed a new column every time we added a channel. The tools kept drifting from the questions I needed answered.

So I stopped maintaining them entirely. Now I generate dashboards with Claude Code, use them for a few days, and when my questions change I build a new one. Takes minutes. The data underneath stays organized and persistent. The interface on top is disposable.

Sounds wasteful. Turns out it's the opposite.

Why the instinct to maintain is wrong here

Most of us treat AI-generated software the same way we treat software we bought or built by hand. We invest in it. Add features. Fix bugs. Maintain it. That instinct made sense when building a tool took weeks or months.

Codex, Claude Code, Cursor changed the economics. A purpose-built internal dashboard takes minutes now. A pipeline tracker, a financial summary, a weekly content report. Generated for your exact question, your exact data shape, right when you need it.

The valuable part of this equation is not the dashboard. It's the business context underneath: your data, your domain rules, your understanding of which questions actually matter. Models will be better in two months. When that happens, you hand the new model your same instructions and data, it generates a better version of the tool. Your context stays. The software is a snapshot you rebuild whenever you want.

I've been running my own reporting this way in Claude Desktop using Live Artifacts. Interactive HTML pages that pull fresh data every time I open them. Content dashboard, pipeline overview, weekly numbers. When I need a different view, I generate a new artifact. A few minutes and some tokens. The interface always matches the question I'm asking right now instead of the question I was asking three weeks ago.

The bigger picture this connects to

This disposable-software pattern keeps leading me to a larger structural question.

Most companies are organized around information flowing through people. Managers aggregate data from their teams, synthesize it, report upward, delegate downward. That coordination layer exists because there was no other way to move context through an organization at scale.

AI agents can aggregate, synthesize and format information directly. When your agent scans data sources, builds a report and delivers it as a decision-ready HTML document, the manual coordination step starts looking redundant. What you need are people who build and operate things (ICs) and people who own outcomes (DRIs). The connective tissue between them is increasingly something you generate rather than staff.

The persistent layer is human judgment, domain expertise, business context, taste. Everything in KW20 about developing judgment for AI output applies here too. The infrastructure layer (dashboards, reports, coordination meetings, status updates) becomes generated infrastructure. You don't maintain it. You regenerate it when the underlying model or your questions improve.

Where the pattern breaks down

I'm still early in this. Our team has shifted maybe 30% of internal tooling to generate-on-demand. Some things genuinely need persistence and proper engineering.

The clearest boundary I've found: collaborative tools break the pattern. When multiple people need shared muscle memory with the same interface, regenerating it every week creates chaos. A reporting dashboard I use alone? Perfect candidate for on-demand generation. A project management setup the whole team touches daily? That needs stability.

The rough heuristic: "how many people use it" times "how stable are the underlying questions." Solo tools with evolving questions get regenerated. Shared tools with stable workflows get maintained and engineered properly.

I also haven't figured out knowledge transfer. When I regenerate a dashboard, I lose the small customizations I made over the week. Filter settings, column widths, pinned items. The data persists but the UI state doesn't. Would love a pattern where the context of how I use the tool feeds back into the next generation. Haven't cracked that yet.

Anyone else treating internal tools as disposable? Where did you find the line between "regenerate" and "maintain properly"?

reddit.com
u/SaschaFromWhaaat_ai — 1 month ago
▲ 3 r/whaaat_ai+2 crossposts

AMA: I built AI content systems that actually sound human. Ask me anything

Over the last months I've been deep in one problem: why does most AI-generated content still sound like AI wrote it?

I've tested voice extraction workflows, multi-agent pipelines, prompt compression techniques and production setups to close that gap. Some of it worked. Some of it was a waste of time. The stuff that actually works in production looks very different from what gets likes on Twitter.

A recent post about our 100-question voice extraction process got way more traction than expected. So I'm doing an AMA.

What I can talk about:

  • voice and tone extraction at scale
  • multi-agent workflows vs. single-chat setups
  • prompt compression and what it does to output quality
  • the line between "sounds human" and "sounds like me specifically"
  • mistakes I've made building these systems
  • where AI content is actually heading in 2026

I'll start answering questions on: Wednesday, May 20 · 8 AM PT / 11 AM ET / 5 PM CET Drop your questions below.

https://preview.redd.it/ssuilmqo7w1h1.png?width=2048&format=png&auto=webp&s=d3eb3c952fde2daa87ded74bdb20f445b85a7236

reddit.com
u/Ok_Today5649 — 2 months ago

Most AI products are features waiting to be killed by the next platform update. The ones that survive do five things differently

Hey there,

Sascha from whaaar ai,. AI Agent dev, who is here to share what we learn while developing our own agents further. I've been writing with my account u/OK_Today5649 for now but as I've been asked for an AMA multiple times, we thought it would be best to create this new account. The AMA takes place next week btw: Check in here from Tuesday if you want me to answer your questions around AI Agents.

So this week I've been looking at the AI product features that I think are here to stay.

Every time OpenAI or Anthropic ships a model update, a wave of AI startups quietly dies. The pattern is always the same: someone builds a nice interface over the API, adds templates or a specific workflow, charges $20/month and then the model provider adds the same capability natively. Full disclosure: I work on the AI agent team at whaaat ai, and we nearly made this mistake ourselves early on.

The products that survive platform updates share a common trait: they go deeper than an API call. They manage state across sessions. They coordinate multiple agents. They handle failures autonomously. They run without someone watching.

Where the line sits

A wrapper calls an API and displays the result. You can build one in a weekend. That speed is also its weakness because anyone else can build the same thing in a weekend, including the API provider.

A system manages things the API doesn't touch. Our content pipeline at whaaat ai involves five agents that communicate through MCP (Model Context Protocol), an open standard for agent-to-tool communication. One agent extracts brand voice from client interviews. Another generates content across six channels using that voice. A third handles distribution timing. None of them are impressive individually. The value is in how they hand off work to each other and how the whole pipeline runs without manual intervention at every step.

The five things our system does that a wrapper can't:

Memory across sessions. Our agents remember past decisions. When the content agent generates a LinkedIn post, it checks what performed well last month and adjusts. A wrapper starts fresh every time.

Error handling that doesn't just crash. When our distribution agent hits a rate limit on a platform API, it implements backoff, retries and if the platform is genuinely down, queues the content and flags it for the next morning. We spent three weeks getting this right. It runs maybe once a week. Those three weeks saved us hours of manual monitoring.

Orchestration across multiple models. Different tasks need different models. We use Claude for content that requires brand voice fidelity, run research queries through models optimized for factual retrieval and handle classification tasks with smaller models that cost a fraction per call. A wrapper typically locks you into one model for everything.

The other two (audit trails and cost tracking per workflow) matter more for enterprise contexts. For a small team or solo founder, the first three are where the gap shows up fastest.

The honest math

Building a wrapper: one weekend, maybe $50 in API costs to test. Building a system with memory, error handling and multi-agent orchestration: we spent roughly four months getting our pipeline stable. The first two months were mostly figuring out what breaks in production that works fine in testing.

The tradeoff is real. If you're validating whether a market exists for your idea, build the wrapper. Ship fast, get feedback, see if anyone cares. But if you already know the market exists and you're building something you want to run for years, the system approach is the one that doesn't get killed by the next model update.

The part I keep debating internally: when exactly to make the switch from wrapper to system. We switched too late on one project and had to rebuild the architecture mid-growth. Switched too early on another and over-engineered something that needed to be simple. There's probably a revenue threshold or user count where the switch makes sense, but I haven't nailed down the number yet.

reddit.com
u/SaschaFromWhaaat_ai — 2 months ago