I programmed a chess-playing robot arm
Not so long ago, after design and SolidWorks modeling and manufacturing was done by my team, I programmed this robot and made it play chess!
The IP camera (above the chessboard) captures the board and streams to the computer (under the table) to run inference. I used two CNN models, they both run on every square of the board. One detects the presence/color of a piece while the other determines its position on the square.
Everything is open source: https://github.com/SirajHabsaia/RobotArm
Contains firmware, gui, training scripts, links to assets/data...
I coded the firmware mostly manually but used AI for the rest especially the gui.
Happy to receive feedback.