Need help with creating an n8n orchestration layer for my personal agents.
Context:
So I have been tinkering with hermes and am starting to make a personal suite of hermes agents running on ollama that tailors to everything in my personal life. I am using RabbitMQ to faciliatate communication between my main bot that I chat with and handles agent orchestration. PostgreSQL to serve as a database that stores all of these tasks and ranks them by urgency so those get done first.
I am also using obsidian which already has all of my notes and qdrant which uses semantic layering so it can find deeper connections as context for all of my agents.
The Main Problems:
I currently have n8n and ngrok running on a single docker-compose file on my main server, however I have multiple services I want to take full advantage of, so I will be keeping my heavy database apps attatched to a single specified server and using compose to spin them up there while letting my agents roam and find where they can "fit in" I'm thinking of using kubernetes to manage these individual agent containers because I have very limited hardware resources. Is there a way to use Kompose to make some containers stay on a specified device, and allow others to roam, like a certain YAML attribute?
Another thing I wanna do is create a parallel agent workflow and a linear agent workflow to work through my tasks. I'm thinking of using n8n for this to query the kubernetes api server to see if it can fit an agent with its current resources(overly simplified, but kinda what I want to do). If it can multiple agents are spawned in. However if it cannot it will only be allowed to use a single agent to work through a task. Ollama is my main limiting factor because I don't even have a solid GPU and I can't spawn multiple ollama services so all my agents even if they work in parallel might have to use only one singular or maybe 2 spread out ollama services.