We tested AI-written landing page copy against a human rewrite. The human version converted better.
Sharing a small experiment because I keep seeing "just have AI write your landing page" advice and wanted real numbers, not vibes. Setup: early-stage B2B SaaS, one main landing page, steady-ish traffic from a couple of channels so a split test was doable. Our original page copy was generated by a landing page AI tool when we were rushing to launch. The experiment: we ran the existing AI-generated version against a rewrite I did by hand. Same design, same layout, same offer. Only the words changed. The rewrite was based on actual phrases from our last ~20 customer interviews, so the headline named the specific pain instead of saying "streamline your workflow." Ran it for about three weeks to get enough conversions to not fool ourselves. Rough results: - AI version: signup conversion sat around 2%. - Human rewrite: closer to 3.5%. Not a massive absolute jump, but that's roughly a 70% lift on the same traffic, which is meaningful when you're paying for it. What I think actually happened: the AI copy was grammatically perfect and completely generic. It could've described any of ten competitors. The rewrite was clunkier but said the exact thing a specific buyer was thinking. My honest takeaway isn't "AI copy is useless." It's fine for a first draft or a skeleton. But the conversion lift lived in customer language the model had no way to know. Anyone else A/B'd generated vs hand-written copy? Curious if the gap holds at higher traffic or if it's just a small-sample thing for us.