Built an open-source Android client for local Ollama servers to talk to your LLM (AI Local) (Focused on Privacy). Looking for architectural and concept feedback!
I wanted a way to interact with my local LLM from my phone without compromising my privacy or sending my data to external cloud servers. Since I couldn't find a lightweight, open-source solution that fit my needs, I decided to build one using Android Studio (with a bit of help from Gemini for drafting the UI).
The Concept: An Android client that connects directly to your local Ollama instance via IP. Your data never leaves your local network.
Tech Stack & Features:
- Built entirely with Kotlin / Jetpack Compose
- Connects to any local Ollama server (Ollama API)
- 100% Offline / Local network focus (No telemetry, no third-party trackers)
What I'm looking for: Since this is a privacy-first project, I want to make sure the implementation is as solid as possible. I'm looking for feedback on:
- The Architecture: How to better handle local network requests and streaming responses efficiently in Android.
- The UX: What features would you expect from a local AI mobile client?
- Security: Best practices to ensure local connection security (e.g., handling network security configs for local IPs).
You can check out the source code and the project here: https://github.com/GaM1ngN0tDev/NoiosoAI
Would love to hear your thoughts, critique, or suggestions!