u/HyroVitalyProtago

First test of gesture detection with the Myo (following https://www.reddit.com/r/Spectacles/comments/1sgvk6d/myo_on_spectacles/ ) inspired by https://dl.acm.org/doi/epdf/10.1145/3729494 - demo on quick audio player control during walking.

There is actually no deep learning, but just KNN classification on simple gestures (wrist swipe, closed hand). So detection is far from perfect, but it will be easy to get better results with more work!

Hard to show in the video as the idea is to be able to do the gesture outside of the field of view. Also, I always show the menu for demo purpose, but the final UX would be more about only displaying it when needed with an invoke gesture.

I don't have a lot of time to work on it lately, but it's still on the TODO list.

Hello there!

I know that QR Code detection will be available later on specs, but for those who are waiting and want to try it out right now, here is a tiny example project that require no server or remote api, all computations are done on spectacles.

Here I do realtime detection during the one-handed crop like gesture. Then, when the QR Code is detected, the url is displayed and the website is opened in the webview. Remember also that there are constraints around size and constrast on the qr code, so don't forget to adjust luminosity on computer screen and display it big enough.

I will very probably add other examples in this project, like loading images or 3d models directly, or establishing secure connection between two devices.

Let me know in comments what would be the most interesting use case you think of ;)

https://github.com/HyroVitalyProtago/CropQR