Building an open-source AI that turns YouTube videos knowledge
Building an open-source AI that turns YouTube videos into structured knowledge (Looking for feedback & contributors)
Hey everyone,
I’ve been working on a side project over the past few weeks and wanted to share it to get some feedback.
It started as a simple YouTube transcription API, but I realized transcripts alone aren’t that useful. My goal now is to turn YouTube videos into structured knowledge that people can actually use.
Current features:
- ✅ YouTube audio extraction
- ✅ Metadata extraction
- ✅ Faster-Whisper (local) transcription
- ✅ Google Gemini support
- ✅ FastAPI REST API
- ✅ Swagger/OpenAPI docs
The next features I’m working on are:
Developer Mode
- Extract libraries, APIs, commands, GitHub repos, folder structure, common errors, and solutions.
Founder Mode
- Extract business ideas, target users, pricing, competitors, risks, and opportunities.
Tutorial Mode
- Convert videos into step-by-step guides with prerequisites and dependencies.
Research Mode
- Compare multiple YouTube videos and generate:
- Consensus
- Contradictions
- Best practices
- Sources
- Key takeaways
The project is completely free and open source. I’m building it because I wanted something that goes beyond “summarize this video.”
If you’re interested in Python, AI, FastAPI, prompt engineering, or just think this sounds useful, I’d love your ideas or contributions.
I’m especially looking for feedback on:
- What feature would make you actually use this?
- What am I missing?
- Is there a better direction I should explore?
Thanks! 🙂 Dm Me and Build it together