u/GreasyGato

My goal was to Make a hands free thermal vision device that lets users see heat in real time.

I used the ar prisim off a Lilygo T-Glass V2, a M5StickS3, and a AMG8833 thermal sensor 8x8.
(You could use a better sensor for better range and resolution) but these are cheap.

I was having trouble with finding good documentation for Lilygo’s T-Glass. The only way i could find exposed pins was by disabling the rtc and micro soldering to the chip (sda IO09 and scl IO08 where exposed here). Or doing the same with the microphone. If anyone has tinkered with the T-Glass please weigh in. Cause i have a bunch of ideas.

The Firmware:

The firmware uses M5Unified and M5GFX for the StickS3 display and buttons, Wire for I²C communication, Preferences for saving settings, and Adafruit AMG88xx with Adafruit BusIO for reading the AMG8833 thermal sensor. It reads the sensor’s 8×8 temperature grid at up to 10 FPS, cleans the data with noise filtering and bad-pixel correction, estimates the background temperature to hide non-heat areas as black, then uses bicubic and temporal interpolation to create a smoother 126x126 thermal image (the Size of the prisim) at a higher apparent frame rate with three selectable heat-only color themes.

The next version will use a M5AtomS3r. Since i dont need the extra screen space and will be easier to make it adjustable on the glasses frame due to its small profile too. Plus the prisim will fit almost perfectly on the screen!!!

My goal was to Make a hands free thermal vision device that lets users see heat in real time.

I used the ar prisim off a Lilygo T-Glass V2, a M5StickS3, and a AMG8833 thermal sensor 8x8.
(You could use a better sensor for better range and resolution) but these are cheap.

I was having trouble with finding good documentation for Lilygo’s T-Glass. The only way i could find exposed pins was by disabling the rtc and micro soldering to the chip (sda IO09 and scl IO08 where exposed here). Or doing the same with the microphone. If anyone has tinkered with the T-Glass please weigh in. Cause i have a bunch of ideas.

The Firmware:

The firmware uses M5Unified and M5GFX for the StickS3 display and buttons, Wire for I²C communication, Preferences for saving settings, and Adafruit AMG88xx with Adafruit BusIO for reading the AMG8833 thermal sensor. It reads the sensor’s 8×8 temperature grid at up to 10 FPS, cleans the data with noise filtering and bad-pixel correction, estimates the background temperature to hide non-heat areas as black, then uses bicubic and temporal interpolation to create a smoother 126x126 thermal image (the Size of the prisim) at a higher apparent frame rate with three selectable heat-only color themes.

The next version will use a M5AtomS3r. Since i dont need the extra screen space and will be easier to make it adjustable on the glasses frame due to its small profile too. Plus the prisim will fit almost perfectly on the screen!!!

Almost none of my projects utilize audio.

So i dove in and created a 8 bit live groovebox with a 8 note step sequence. I didn’t want to use an external DAC. I wanted to just be able to connect a mono speaker to the CYD and just play.

The obvious difficulty being a mono speaker can only output one audio signal at a time, so playing multiple sounds means the ESP32 must mix those sounds together into a single waveform before sending it to the speaker.

There are a few tricks to make it seem like the sounds are playing at the same time.

- Rapidly switch between notes faster than the ear can distinguish. At 100–200 Hz update rates, it sounds like a chord rather than individual notes.

- Instead of two oscillators, generate one waveform containing harmonics. (fundamental + octave + fifth)

- Percussion Masking: Drums are very short sounds. 10-20ms. Briefly interrupt the synth for drum hits. Gives the illusion that drums and melody play at same time.

- 3 individual tracking ids: showing distance

- Heat Trail

- Heading indicator

- Correct distances according to spec. sheet

This library

https://github.com/javier-fg/Arduino\_RD-03D

Was very helpful. Thank you

Using the Ai-Thinker RD-03D 24GHz millimeter-wave radar module with a CYD esp32 2.8”

The RD-03D can simultaneously track up to 3 moving targets, providing real-time position (X/Y coordinates), speed, and distance information for each target. It is primarily intended for indoor use to track moving human targets.

This radar can be used to setup automations for zone interactions. Or giving the ability for a camera to track movement. Or have a fan connected to a servo to follow you. Or interactive led lights that track/follow you and light up in relation to distance.

I have about 5 different doppler mmwave radars.

And before jumpping into the deep end or $$$

This model rocks for 13$

Bought this old ipod dock from goodwill yesturday.

Of course it didn’t come with a ir remote. (But it did come with 8 nasty AA batterys with the forbiden salt on them.) So i spent a good 30min spamming a bunch of NEC code

16 and 8 bit. My codes where NEC 8 bit.

(Configuring that in esphome was a blast. 🙄)

So When spamming ir codes one would prompt a resonse, i paused and recorded.

(There was zero! Ir support for my logitec model.)

But i bruteforced enough codes to be happy with.

I even have a webcam facing the ipod so you can see the screen in the home assistant dashboard ahah

Besides getting a 30 pin breakout board to controll the ipod. This seemed to be the clearest way. :/ lol

Ill post yaml file if anyone wants.

Finally after my year long journey into embedded systems. Im finally running HA (homeassistant)

Which basically consolidates your iot/smart home products and unifies them into a singular dashboard. All customizable and offline if desired.

This is an example on a wave share 2.06 esp32 S3 acting as a voice satellite. Which controls my home automations.

Using whisper and Piper for local tts and stt.

This is a demo of using the voice assistant add on and having it control my led matrix lights.

Side note.. hard pass on yaml files though.

They suck.

I’ve used quite a bit TOF sensors and this waveshare 50meter module is outstanding. Im communicating over UART. The documentation and example sketch really helped.

This is a soft mount. I’ll solder the wires together and 3d print a mount for the S3 and sensor.

If anyone has used this module im curious if the repetative shock from shooting the bow would damage the sensor at all?