Get the latest tech news
Single RGB camera turns your palm into a keyboard for mixed reality interaction
Interactions in mixed reality are a challenge. Nobody wants to hold bulky controllers and type by clicking on big virtual keys one at a time. But people also don’t want to carry around dedicated physical keyboard devices just to type every now and then. That’s why a team of computer scientists from China’s Tsinghua University […]
That’s why a team of computer scientists from China’s Tsinghua University developed interaction technology called Palmpad that enables typing with just a single RGB camera and an Arduino. The Tsinghua University team solved the first problem with sophisticated video frame processing techniques, such as motion extraction, and with a convolutional neural network (CNN) trained for this purpose. Wherever the user’s fingertip is at that moment is the point registered as a “click.” The team reported a touch recognition accuracy of 97.0%, which makes Palmpad quite reliable.
Or read this on Hacker News
