I need to validate thsi idea i ll love your feedback in the comments
I’m validating an idea for an open-source, local-first AI daemon called UmbraOS.
We all saw the privacy nightmare that was Windows Recall. Apps like Rewind or Limitless try to fix it, but they either charge a heavy monthly subscription or siphon your data to central servers.
UmbraOS is an architecture designed to give you a 100% private digital twin/second brain that runs locally on your machine, syncs P2P with your phone, and offloads heavy reasoning to the cloud safely and at zero cost.
🛠️ How it Works & Key Architecture Points:
Proactive "Blind-Spot" Privacy: Traditional screen-loggers capture everything and censor it later. UmbraOS inspects active OS window titles and foreground processes at 2Hz. If it detects a blacklisted app (WhatsApp, Signal, banking tabs, password managers, browser incognito windows), the loop immediately short-circuits. The frame is never captured in memory or saved to disk.
Zero-VRAM Hybrid Cloud Pipeline: Instead of hogging your GPU with heavy local LLMs or sending raw video to Big Tech, Umbra OS processes inputs locally. It uses lightweight, local OCR (EasyOCR) and local embedding models (all-MiniLM-L6-v2) to index text into a local vector database (Qdrant).
Intelligent Cloud Bursting: For complex reasoning, it packages only relevant text snippets from your local DB and hits free/low-cost cloud frontier APIs (like GLM-5.2 or DeepSeek via OpenRouter). To bypass free-tier rate limits, it uses local SQLite-backed batching and exponential backoff retry queues.
P2P Cross-Device Sync (No Central Servers): Your PC acts as your private server. It exposes a local FastAPI bridge. When your phone is on the same Wi-Fi (or connected remotely via a secure P2P mesh VPN like Tailscale), it securely syncs the vector brain. You can query your desktop's history from your phone completely offline.
Active Agent Capabilities: It doesn't just watch; it executes. By translating voice commands from your phone via local Whisper, it can trigger system scripts on your PC, interact with your local file system, or use official APIs to send emails/messages. It even uses Wake-on-LAN/WAN protocols to "wake up" your sleeping PC from your phone while you are out.