Get the latest tech news
Hand Tracking for Mouse Input (2023)
The other day I saw the launch of Apple Vision Pro, the whole thing was very interesting, but one thing that caught my attention was the finger input. It seems very intuitive, by using the finger pinching as sort of like a cursor or mouse input. I figured I want to try it out, so I took it upon myself to create it.
I setup a simple WebSocket server in python which will accept a JSON string message containing the x and y coordinate to move the mouse to. At this point, the project should’ve been finished, but I took some time to watch YouTube video related to hand tracking input. In this project, I did what I set out to make, which is to create a cursor or mouse input like the one from the Apple Vision Pro, plus the Meta Quest headset.
Or read this on Hacker News