▲ 1 r/SQLServer
SSMS GitHub Copilot QA
While using GitHub Copilot in SSMS, I came across a few questions.
First, when a user prompt is submitted, does the local SSMS client send the system prompt + task list together with the user prompt to the LLM server?
Or are the system prompt and task list added separately on the LLM server side during processing?
Second, where exactly is my query sent from SSMS?
Is it sent to the Azure cloud?
Or is there a separate GitHub server involved?
Additionally, if the query is sent to a cloud-based server, are the LLMs hosted and running on that server?
Or does that server call the APIs of each LLM model separately?
Lastly, when using Foundry Local, is there a way to check the maximum token limit for each model?
u/Old-Essay-5019 — 4 days ago