u/shortassmanlet

Source

>Trying to force a specific style with rules. Rules are useful for biasing the model. They are not useful for forcing it. A line like "responses tend to be detailed and descriptive" or "prefers a formal tone" will nudge the output in that direction reliably. A line like "ALWAYS USE FLOWERY LANGUAGE. RESPONSES MUST BE AT LEAST THREE PARAGRAPHS. INCLUDE METAPHORS. NEVER USE THE WORD 'OZONE'" is trying to dictate, and it fights the model. It works for a turn or two, then attention dilutes and the model quietly drifts back to its training distribution. If you want a flowery character, write the description and example_messages in flowery prose, and let the rules just nudge in that direction. For things rules cannot really shape (response length, randomness, repetition), reach for generation parameters from Day 2 (temperature, top-p, repetition penalty, max tokens) instead. Those actually control behaviour at the sampling level. Rules set the bias, examples set the style, parameters set the shape. Everything else is a fight the card will lose.

I was creating a new preset and I came across this post.... Could someone please explain whether the wording and style of prompts actually affect how an LLM interprets and follows instructions? Should I phrase the rules in an advisory tone when creating my preset?

Thank you.

Source

>Trying to force a specific style with rules. Rules are useful for biasing the model. They are not useful for forcing it. A line like "responses tend to be detailed and descriptive" or "prefers a formal tone" will nudge the output in that direction reliably. A line like "ALWAYS USE FLOWERY LANGUAGE. RESPONSES MUST BE AT LEAST THREE PARAGRAPHS. INCLUDE METAPHORS. NEVER USE THE WORD 'OZONE'" is trying to dictate, and it fights the model. It works for a turn or two, then attention dilutes and the model quietly drifts back to its training distribution.

I was trying to create a bot and I came across this post.... Could someone please tell me if this person is right or wrong? Thank you!