u/duane-barry-944

What's the best way to incorporate LLMs into a python server?
▲ 0 r/Python

What's the best way to incorporate LLMs into a python server?

Curious to learn how folks are incorporating an LLM into services. subprocess.run seems janky....what's the pythonic way?

Edit: I'd like to be able to interact with my server via a REPL-like loop. Goal: interact with my server remotely, control my zigbee network, etc.

u/duane-barry-944 — 12 days ago