u/quitebuttery

Built for CLAD - Memory Palace

Github: https://github.com/flarb/MemoryPalace

For this week's theme I built a Memory Palace lens with CLAD. People use this technique to memorize large lists of things, such as competing in the World Memory Challenge (look it up, it's nuts! https://www.worldmemorychampionships.com/ )

A Memory Palace is a technique where you 'place' a memory in a specific location. It doesn't have to a room, it can be the armrest of a chair, a wastebasket, etc. and you associate something to remember with it, including a mental image of mnemonic or something to help.

I built a Lens that helps with this. You create a memory palace linked to a spatial anchor. You walk around your environment and create memories by choosing a surface and speaking them—organizing memories by location. The basic memory is just a gem with a text label based on what you said and an image of the area you placed the memory on. However you can enhance these memories by replacing the gem with a GenAI created 2D image or 3D mesh using what you said as prompt. These gems are all saved in order so you can walk the palace later.

In Explore mode you can load up the palace and walk along the lines from loci to loci to see what the memories are. This is a good way to memorize them ahead of testing yourself.

To test yourself, use Train mode. Here the labels / images / and meshes for each gem are hidden. You walk the line from loci to loci and try to remember what you stored in that gem. Then you can reveal the memory and select whether you remembered it or not. At the end you get a score based on your recall.

Anyway this was a fun use of CLAD--I even figured how to get Claude to edit a nice trailer together with title cards, graphics, and everything. Pretty sweet!

u/quitebuttery — 4 days ago

SPECS Developer Account Required

I'm trying to build with CLAD but when I look at the SPK Configuration panel it gives me an error message that says "SPECS Developer Account Required" -- I'm in the Spectacles program, does this not carry over to SPECS? I did click the dev enrollment on the SPECS site awhile back and got the confirmation email--does something need to be flipped on Snap's end to give my Spectacles account SPECS developer status?

reddit.com
u/quitebuttery — 9 days ago

BrushAR

https://github.com/flarb/BrushAR

Ok--I saw so many cool BLE demos lately and wanted to mess around with BLE myself. The only relevant Bluetooth devices I could think of that I might have access to are smart Sonicare tooth brushes. So I bought a kids brush and a 9300 -- two models that don't require bonding and thus work with the Spectacles.

So--this is sort of an attempt to gamify brushing your teeth, as well as taking the typical smart toothbrush app into AR.

Pardon the bad video--but I had to zoom in a lot to see the tiny face anchored interface plus threw some stabilization on it.

The basic flow is:

* Load up the lens

* Wake up your toothbrush so Spectacles can see it

* Change the mode / settings to what you want to use for brushing

* Once the brush is found, stand in front of the mirror until your face is detected

* Power on the brush and start

From there you'll see a HUD bound to your face which gives the current progress and status of your brushing session. With the kids brush, you see a simplified HUD. The time elapsed, time left, and 4 squares representing the quadrants of your mouth. The quadrant fills with green until you finish brushing it and the Sonicare vibrates to tell you to move on to the next quadrant, accompanied by virtual sparkles augmenting your increasingly clean teeth. When all 4 quadrants are done, you get a brush complete message with celebratory fanfare.

With the 9300 brush it's more advanced. When you start brushing you see 6 sections instead of 4. You also see a pressure gauge on the right which turns red if you are using too much pressure (this is bad for your gums). On the left you see the intensity setting you have the brush set to. The same rules apply, move on to the indicated section once you get the signal. This brush as a bunch of modes, so the actual timing and which section you move to is governed by the mode.

The app tracks your streak--brushing once in the morning and once at night. It saves your streak as a score and uploads it to a leaderboard. You can compare your streaks with your friends or global scores.

A couple of notes for Snap:

* BLE needs to not be 'experimental'. It's time to drop all these silly restrictions on Lenses and make a proper permission system. I have some actual real Lenses clients are interested in building with me, but they're gated by the fact that you can't ship a BLE lens.

* I need to be able to use the camera with BLE. If I could do that I could optically track the brush. But you can't access the camera and BLE at the same time according to the documentation

* You need to support bonded devices. I used the 9300 brush which cost over $200 but is discontinued, because all the newer ones are bonded and that's not supported on Spectacles.

Hopefully these issues are addressed on SPECS!

u/quitebuttery — 10 days ago

Fingerboard World AR Finishing Touches

So I've been adding some stuff to Fingerboard world. This is in the current build that's up here: https://www.spectacles.com/lens/ca61f1237b0f4d7d87ec5c0189a45f93?type=SNAPCODE&metadata=01

But I'm about to upload a polish pass. The finger tracking is just very tricky and fiddly--not to mention plane detection can have issues (but I think it might be my table surface is kind of featureless). I'm hoping I can get this working better on the actual SPECS.

Stuff that's in the newest version

* Animated tutorials for every trick

* Skate shop, buy new boards with currency gained from playing

* Leaderboards (can we get rid of the permission dialog every time you share a score??)

* VFX sparks on grinds

* Daily challenges with streak leaderboard

* Options menu (toggle hand occlusion, music)

Working on some last minute fixes.

u/quitebuttery — 19 days ago

Can SnapOS / Supabase projects also be accessed via mobile?

I want to create a SPECS app which also has a companion mobile app that shares data. Can the mobile app connect to the Same Supabase project in Snap Cloud? I hope so as this would make the development of this sort of app exceedingly easy.

I'm not sure if Snap Cloud can be treated like a traditional Supabase project?

reddit.com
u/quitebuttery — 22 days ago

Fingerboard World

Ok here's a super early attempt to do a fingerboarding lens on Spectacles. I had this idea for awhile and wanted to give it a quick try this month. I'm working on trying to make it work better with the sometimes iffy hand tracking. But this actually kind of works. I'm polishing it up a bit before the final submission date. But you do have to sort of 'play along' with the limitations of the hand tracking. I'm working on making it more fault tolerant--seems to wig out a bit (seen at the end of this clip). Some of the tricks are gesture based instead of actually just using hand motion. Also, the VFX are broken--working on some rail grind sparks.

Features leaderboards and a full tutorial mode with animated guides to learn the tricks. Collect stars to unlock new board styles.

Here's the lens: https://www.spectacles.com/lens/ca61f1237b0f4d7d87ec5c0189a45f93?type=SNAPCODE&metadata=01

I have no idea why it's got restricted distribution.

u/quitebuttery — 1 month ago

Dead Specs? Will not turn on.

I'm trying to decipher the riddle of the white LED. They were working fine, I put them down for about 20 minutes, then went to go use them and they were dead. I figured they weren't charged, so I plugged them in a bit. I still can't power them on.

There are signs of life, however.

While plugged in, I'm seeing a solid white light.

If I try to do the full reset by holding both buttons down for 20 seconds, the white light will blink for a bit but then go dark.

No amount of holding down the right button will power it on, no amount of holding down the left button will go into pairing mode.

Here's hoping the SPECS have a battery indicator of some kind on the device itself.

reddit.com
u/quitebuttery — 2 months ago

Is there some kind of Spectacles USB driver for Windows?

I'm having trouble connecting Specs to my Windows PC again. I used to have one magic cable that would work--but now I can't find that specific cable and I have like 5 zillion USB3 cables and despite the fact that I hear the connect sound--Lens Studio cannot connect to the device via USB (WiFi is hopeless, it never worked on my Windows machine).

When I do plug in the Specs via USB I get an error popup about an "Unknown USB Device" being plugged in. Is there some kind of USB driver I need to install on Windows to get Lens Studio to consistently see the specs when plugged in?

reddit.com
u/quitebuttery — 2 months ago