Hi everyone 👻❤️
I’m building Ashley 🌹👻 an AI desktop companion with memory, voice, personality, an avatar, and optional PC actions like opening apps or helping control the desktop.
Some users want to customize her personality/prompt, and I really want to add that.
My worry is that Ashley’s prompt also controls important behavior: tool calls, action formatting, memory, safety, and when she should or should not touch the PC. 😢
If I let users edit too much, they might accidentally break the action system because if users give her a personality that encourages the LLM not to follow actions, then Ashley would no longer be able to execute her actions properly. 😋
For people building agents or tool-using LLM apps:
How would you solve this problem?
I want users to make Ashley feel more personal, but I also need to protect the parts of the prompt that make her actions, memory, and tool calls work reliably.
What kind of architecture would you use for this?
I’d love advice. I want users to make Ashley feel personal without making her unreliable ❤️