u/Windsaw

I have recently tried to make use of the Thunder AI feature to apply tags to my emails.
I connected it to Ollama and tried half a dozen different models: llama3.2, phi4-mini, mistral, qwen3.6 and several others.
I don't think the default prompt is very useful, but it sometimes yields reasonable results. But often the model doesn't follow the directive to create clean JSON and I get tags with comments in them or junk like that.
I spent a couple of hours trying to modify my prompt, especially by dumbing it down. At the end I just asked of the email-Address contains "Amazon" it should tag it with Amazon. It didn't even succeed to do that reliably.

If anybody has found a somewhat reliable combination of Ollama model with a prompt I would be very grateful as a base for further tries.

Hello,
I have installed the ThunderAI plugin and connected it with Ollama.
I currently use llama3.2 for quick stuff and qwen3.6 if time is not an issue.
In order to do efficient filtering I could really use the tagging feature with AI. However, so far all attempts to seriously use it have failed.
The default prompt works and seems to always give reasonable results. However, they are not what I need. My goal are specific instructions with a clear set of predefined tags.
It seems that the results are always pretty random.

This is a basic, dumbed-down prompt that I made but still doesn't work.

Generate a JSON array of tags depending on the conditions listed below. Ignore upper and lowercase for the content.

Only assign the following tags: "Private1", "Private2"
If the {%author%} contains "john" then assign the tag "Private1", otherwise do not.
If the {%author%} contains "mary" then assign the tag "Private2", otherwise do not.

Generate a response in JSON format only. The output should be only a JSON array of tags without any additional comment or text. Here is an example of the JSON format to be used:
{
"tags": ["tag1", "tag2", "tag3", "tag4", "tag5"]
}

I randomly returns Private1, Private2 or even both.
If I fake that prompt into the CLI of the model, it almost always returns correct results.

Am I missing something obvious?
I have not found any ThunderAI tagging prompts on the internet to compare mine with.
Is there a way to debug it? If I could get the AI's reasoning in Thunderbird, it could give me hints.
Also: If anybody could recommend me a specific Ollama model for this task, I would be grateful.