Three weeks of building later: COS Glasses now has a Mac app, speaker ID, and a real memory. Plus GotCOS is giving away a pair of G2s.
▲ 69 r/agenticAI+9 crossposts

Three weeks of building later: COS Glasses now has a Mac app, speaker ID, and a real memory. Plus GotCOS is giving away a pair of G2s.

Last month I posted about wiring the G2 into the AI coding agents already sitting on my Mac, so the glasses answer like they know what I do all day instead of like a search box. That post went way better than I expected, and honestly the DMs have been the best part of it. (Original post here if you want the architecture and the SDK gotchas.)

Three weeks later it's basically different software, and about 250 people have set it up so far. Here's where it's at. The giveaway details are near the bottom.

GotCOS has a Mac app now

https://preview.redd.it/lckrpa72mdjh1.png?width=3000&format=png&auto=webp&s=036926f0eea43240c8a91d7924e4aba7a364c6f5

Version one was a terminal command and a lot of faith. Now there's COS Control, a menu bar app that runs the server for you, shows you what's actually running, updates without breaking itself, and can repair common install or update failures. After setup, you shouldn't need the terminal for normal use.

It opens on an Activity view, which I did not expect to use nearly as much as I do. Six windows into what your COS is already holding: Messages, Speakers, Meetings, Memories, Threads, and your agent Sessions. You stop guessing what it caught. Every meeting, every answer, every voice it's learned is sitting there in a list you can open.

It knows who talked

https://preview.redd.it/jmdhc872mdjh1.png?width=3200&format=png&auto=webp&s=84b2813ff735406f1c9d67b1bd1b79ffaaa3e8e6

This one surprised me. Meetings get transcribed locally, and now voices carry across them, so somebody you talked to three weeks ago shows up by name in today's call instead of as "Speaker 1" all over again.

It was hard, and I built the review tools before I trusted the accuracy at all. Below a confidence floor the panel just says "unidentified" rather than guessing, because a confident wrong name is worse than no name. You can play the audio back, confirm a voice, or tell it "nope, wrong person" and it'll retract whatever training that mistake created. With a microphone strapped to your face in a real room, that correction loop is doing most of the work.

Everything else that shipped

https://preview.redd.it/hjiqq772mdjh1.png?width=3200&format=png&auto=webp&s=afd31d109162e34168db1630855fae697282a1f7

  • Meetings show up faster. A saved meeting used to wait on the full high-quality pass before it landed anywhere. Now it appears right away, then the higher-quality pass fills in the rest.
  • Transcription got faster when nothing else is going on. The post-meeting polish grabs the GPU when nothing live is competing for it, and hands it back the second a meeting starts. Roughly 6x faster per word than the CPU path.
  • Live text on the lens while you're still talking, swapped for the real transcript once it commits.
  • Video uploads resume now instead of dying on a bad connection.
  • Photos on the lens at 288x144, plus answer images you can pull up on the G2.
  • Jobs still live on the Mac, so you can close Even Hub or drop off Wi-Fi and the answer is waiting when you get back.

Cursor works now, and there's no second bill

Not just Claude Code and Codex anymore. Cursor works too, so you can put Grok or Composer behind the glasses. You pick the model per question from the lens and swap mid-conversation if one isn't getting it. Three agent CLIs, whichever one you're already paying for.

Which gets to the thing people keep assuming wrong. GotCOS doesn't add a separate API bill. It signs in through the CLI you already use, so it runs on the Claude Code, Codex, or Cursor account you already have, subject to that provider's plan and limits. Nothing to paste, nothing metering you per token.

Whatever can run entirely on your machine already does. Transcription is local by default through whisper.cpp, so meeting audio never leaves the Mac, and spoken replies can be local too. Cloud transcription is there as a fallback but it's off until you turn it on, and just configuring a key won't upload anything on its own. To be precise, since this crowd will ask: the reasoning still goes to whichever provider you signed into, on your existing plan. What's local is the transcription, the speech, and the files. Meetings, memories, and transcripts sit on your disk as plain files you can open, grep, back up, or delete.

It works inside the Hub, not around it

Saying this plainly since there are a few different approaches floating around this sub. It's a marketplace app. You install it from the Even Hub like anything else. Nothing to flash, nothing to unlock, no warranty to worry about. I build inside the Even Hub SDK sandbox and code around whatever it hands me.

That's a tradeoff and I'm not claiming it's the better one. The custom firmware folks get past walls I have to engineer around, and I've picked things up from their work. But if you want your glasses doing more without modifying the glasses, this is the path.

What you end up with is a workflow that stays on hardware you already own. Ask a question, read it on the lens. Talk, and watch the transcript appear while you're still talking. Point the server at a folder and the agent works through the files in it, including whatever your Mac already syncs down from iCloud Drive. A meeting you just recorded becomes a file the agent can read a minute later, so you can ask about it without exporting anything anywhere.

Two people this owes something to

u/ICE_MF_Mike ran my server through his own Claude setup after the last post and came back with an actual security review. Shell injection in a title generator, file permissions, network defaults, a Telegram switch that should have been opt-in. He was right about all of it, and all of it is patched and shipped. Best thing that's happened to this project.

u/True-Benefit-4856 is the only reason there's a desktop app. The companion started as their idea and turned out to be the one change that made this usable for anyone who doesn't want to live in a terminal.

If you read the source and find something, I want to hear it. It's MIT, it's on npm, and it runs on your machine, so read it before you run it.

The giveaway: a pair of G2s

https://www.gotcos.com/challenge/

I've got a second pair sitting here and I'd rather they go to somebody who'll do something interesting with them than sit in a drawer.

To enter: comment with what you'd build or how you'd use it. Not a wishlist. The actual use case, the workflow, the thing you can't do today and want to. Feature ideas for COS Glasses count, and so does a completely different application of the hardware.

How I'll pick: I read all of them and pick the one I most want to see exist. Best idea wins, upvotes don't decide it, though I'll definitely read the ones you upvote.

Deadline: October 1.

Fine print: used pair, good condition, mine to give. Open worldwide, and the winner covers shipping from the US plus any customs or duties on their end. I'd rather send these to the right person in another country than limit it to one. You don't need to be running COS Glasses to enter, and running it doesn't help your odds. If your idea wins and it's something I can build, I'd rather build it with you than for you.

Setup

You need at least one of Claude Code, Codex CLI, or Cursor installed and signed in. Whichever you already have is fine. It works standalone, and if you're already running a bigger COS setup, point the server at that folder and the glasses inherit all of it.

I keep calling this a side project and it keeps being the thing I use every single day. Recording a customer call and asking what I missed. Logging an idea halfway through a walk without pulling my phone out.

If you try it and it breaks, tell me and I'll get you running. Building against this SDK yourself? Happy to compare notes on any of the traps. And if you've got an idea for what this should do next, drop it in the comments, because there's a pair of glasses in it for one of you.

u/One_Variety_3939 — 6 days ago
▲ 81 r/DisplayGlasses+10 crossposts

I wired the G2 to the coding agents already on my Mac (Claude Code + Codex) so it actually knows my work. Full writeup, gotchas, and it is on the Hub

Every assistant on the Hub can answer a question. I wanted one that answers like it knows my job: my meetings, the people I work with, what I asked it yesterday. Even AI does not do that out of the box, so I spent a couple of weeks building one that does.

Different bet than a hosted memory brain. Instead of shipping your notes to a cloud, the answer engine is the AI coding agents already installed on your Mac. Claude Code or Codex CLI do the actual thinking, on your own login, and a small open source server on your Mac bridges them to the glasses. Nothing runs on the glasses (their app is just a WebView, as some of you found out the hard way). Nothing runs in my cloud, because there is no cloud.

It is called COS Glasses (COS as in chief of staff), on the Hub now, search “COS Glasses”.

What it actually does on the G2

  • Ask by voice or tap, read the answer on the lens. Long answers scroll clean with the ring.
  • A real job queue. Fire up to five prompts, watch live activity, and a reply that finishes while you are reading something else does not yank you out of it. Every answer gets a number you can reopen later.
  • Photos on the lens. Send a phone photo with your question, and view images from replies right on the G2 at 288x144. Scroll a photo message to a cover card, tap to view.
  • Meetings. Start one from the glasses, talk, and the transcript is a plain file on your Mac when you are done. Local Whisper by default, no per minute fees.
  • Your history, on the lens. Scroll back through past answers with the ring, each with its number.

The parts I am actually proud of

The boring reliability stuff is where the real work went, because glasses connectivity is brutal:

  • Jobs survive the network. Once your Mac accepts a prompt, the job belongs to the Mac, not the phone connection. Close Even Hub, lose Wi-Fi, change networks, swap Tailscale, and the answer is still waiting for you when you come back. There is an “updates while you were away” digest for anything that finished while you were not looking.
  • Meetings are local-first. Every audio chunk is written to a durable log before upload. A dead spot in coverage does not lose the tail. Storage is checked before the mic even starts, so it never pretends a recording is safe when it is not.
  • Live transcription on the lens while you talk. Long voice prompts show their transcript in the body as you speak, not after.
  • It fails honestly. A blank model reply never gets marked done or projected into history, it stays as a retryable row. An out of date server tells you to update instead of silently breaking.

The honest constraints

  • Mac plus iPhone plus G2 today. The server is Node, one command, and stays on your machine.
  • You bring your own Claude or Codex plan. The glasses ride the same subscription you already pay for. No new subscription, no API keys pasted into anyone’s relay.

Setup

It works standalone out of the box. If you already run the larger COS from the starter kit, point the server at that folder and the glasses inherit the whole brain: meetings, people, tasks, files.

The ask

Started as a side project, now it is the thing I use every day: recording customer calls and asking it to piece together what I missed, logging ideas on a walk, pulling up an answer from three days ago by its number. If you try it, I want the rough edges. Post here or DM and I will get you running. If you are building your own thing against this SDK, happy to compare notes on any of the traps above.

u/One_Variety_3939 — 1 month ago