Copilot Studio with 80,000+ rows in an on-premises SQL database — how do you query the full dataset reliably?
I’m building a Copilot Studio agent that needs to answer questions using a local/on-premises SQL database containing more than 80,000 records.
In my current setup, I can only retrieve 2,048 records in one go. The concern is that the agent answers based on that subset, even when the relevant records could be elsewhere in the database.
Users should be able to ask questions in natural language, and the agent needs to filter across the full dataset to return an accurate answer. For example:
What is the oldest record for a particular machine?
Which records mention a specific fault or maintenance activity?
How many matching records are there within a given date range?
I don’t necessarily need to send all 80,000+ rows to the agent. I need the filtering, sorting, and counting to consider the entire database before returning the relevant results.
What’s the recommended approach for this in Copilot Studio?