Everyday 0.6.0: subtitle your phone!
APK | Overview | Installation
Changelog | Source code | Privacy Policy
Here is the next update of the Everyday app!
1. Subtitling
This is another stepping stone on the path of introducing a healthy dose of AI features in Everyday. Here we have the first bona fide AI tool in the form of a subtitling engine. The first time you use it, once you toggle it on the glasses, the engine (sherpa-onnx) is installed on your phone. It's an efficient speech-to-text (stt) engine that easily reaches real time velocity on most Android phones. It is not perfect but it is helpful, and it runs entirely locally.
When there is ambient noise, or if you have a hearing disability, this will directly provide you with the audio content of whatever you are listening on your phone, in your field of view. In order to keep the focus on a minimum viable product (also known as MVP), this feature was implemented only in english, and so far, does not use microphone input (having that option is among my planned features).
Podcasts are the main usecase that comes to mind, but nothing prevents from using it for transcription when you use the phone, for example! Battery consumption definitely accelerates, but it remains usable. My estimate is that you can have about 45 minutes of continuous subtitling usage without recharging.
2. Navigability improvements
As the number of widgets and other features increases, ease of navigation becomes an important concern and I have worked on it for this update. I have added saving / loading layouts as a QoL feature. I have reworked the main context menu to be easier to navigate within the glasses screen real estate. I have introduced alignment guides when numerous widgets are on display, as well as allowed the context menu to show up when clicking on widget border areas when they are crowding. I have also reworked the address bar of the browser widget and made it possible to use the phone clipboard, making it very intuitive for example to copy the link of a video on the phone and paste it in the glasses browser, opening it here immediately. Taken together, I find that these improvements make the use of the app much smoother.
3. Google Calendar: admin housekeeping.
I have registered the signed release APK of the phone app on Google Cloud platform, enabling Google Authentication. I have submitted the app for review on the Cloud Platform and set up the Privacy Policy which you can access here. Your Google Calendar data are only sent from the phone to the glasses and are not used for anything else than the display in the Google Calendar Widget. The app does not expose your personal data.
As the app moves from release to release, AI agents are getting increasingly better at being your personal assistant. Now, if I need some reminder, I simply ask Codex to look up my gmail or relevant website (eg for trash dates) and to update my calendar. The AI is becoming my administrative assistant and using the google calendar widget in the glasses as the place where to send dated reminders. It is very helpful. For example, I was the only one in my street noticing a change in the trash dates because Codex set up reminders the right way and it was showing up every time I was glancing at my glasses dashboard 😂.
Yes, there are empty yoghurt pots in the demo video. Kids are living in this house 😅! The videos are not edited and meant to show how it looks like to incorporate augmented reality in daily life because, well this is where I am now.