Why does adding more context just produce generic garbage?
I'll give you 5-6 sentences of context, tell you exactly what I want, and still get the same bland safe response I would have gotten from a one line prompt. Looks like adding detail gets ignored or summarized away. Is this a system prompt/model alignment issue or is there a way to structure longer context that actually forces the model to stick to the instructions? Curious how you guys approach this when you want specific non generic output