u/Zaphod_The_Nothingth

Inference speed on Proxmox

Inference speed on Proxmox

Hi all,

I've been running Frigate 0.15 and 0.16 for maybe 12 months now, on a spare PC, with a PCIe Coral TPU. Prior to getting the TPU, I was seeing inference speeds in the 100-120ms range. With the TPU, it's about 5.5ms.

Recently I've been starting to migrate all my stuff into Proxmox. I used the script from community-scripts.org to create a new Frigate LXC container and copied over my config. The new one being 0.17. I figured I'd run it without TPU initially just to make sure it works. However, this instance, without any TPU, is giving me inference speeds of about 8ms.

What's going on there? Is 0.17 just that much better, or have I screwed something up? Do I even need a Coral TPU any more?

u/Zaphod_The_Nothingth — 6 days ago