So... do you like 3.7 flash? Would love to know your thoughts :P
TL;DR: 3.7 Flash is amazing for coding, instruction following, less sycophantic than 3.1 Pro, better at abstract reasoning/creativity than previous Flash models (yes, even better than 3 Flash), and great with long contexts.
Tho you should use 3.1 pro or other models for implementation plan, not 3.7 flash. It's not the best.
The harness is a bit bad, use MCP's like playwright and what not then make a rule for it to use appropriate MCP's all the time for the appropriate task.
What is it bad at?
Well, it's not particularly bad at anything (except conversationally), at least compared to previous Flash models and some SOTA models. But compared to 3.1 Pro, here are its limitations: it's a little worse at pure logic. 3.1 pro is better for pure reasoning/creativity and quite poor conversationally, even compared to standard Flash models.
It's not like the model can't do anything else (I tried some creative writing to test its flexibility), but its default style is agonizing. It uses way too many diagrams that don't render properly in AI Studio. Even if I explicitly tell it not to do that, it doesn't know how to stop because it fails to distinguish what gets marked as "code."
No matter what prompt or instruction you use, it just doesn't seem to work—unless I'm missing something, in which case I'd love to be corrected! :D
On 3.8 Flash rumors:
If you've heard rumors that 3.8 Flash is coming out soon... it's likely true. It could drop next month, but take unofficial "claims" with a grain of salt. I trust leakers like Leo and Lentils to an extent, but they often inject too much personal bias with phrases like "Google is cooked."
That said, Leo has been much more objective lately, likely because of the conversation I had with him in discord. Shi could make me cry. Why do I expect 3.8 next month anyway? Sundar stated they're targeting monthly (or near-monthly) releases, so expecting a new iteration soon is pretty reasonable!