Guanghan Zhao and colleagues at Japan’s Tohoku University have designed a system to project a usable touchscreen onto real-world surfaces. The key is allowing a camera to detect blanching, the phenomenon of a fingertip turning white when pressure is applied to it.
The goal was to develop a usable touchscreen projection system that didn’t require a special controller or use any kind of augmented reality. When fingertip blanching is detected by the camera, it triggers AI algorithms to determine the placement of the finger on the projected touch panel, allowing the appropriate “button” to be selected. This method also allows users to rest their other fingers against the touch panel without any accidental triggers.
“This research means that ordinary surfaces all around us – walls, desks, or partitions – can be used as a touch input area,” says Zhao. “Moreover, this method doesn’t require special sensors, markers, or additional devices. Anyone can use it easily.”
