Zhao et al.
When you press your fingertip against a hard surface and it turns white, that effect can now be used by scientists to create augmented reality (AR) touch panels on real-world surfaces like walls and desks.
To begin with, there are already ways to project touch panels and keyboards so they appear to float in front of AR headset users.
Limitations of Current AR Input Methods
However, using these systems usually requires special controllers or sensor-equipped gloves. They can also be uncomfortable over time, as users must keep their arms raised, and they lack the satisfying tactile feedback of physically touching a surface.
Developed by Guanghan Zhao and his team at Tohoku University in Japan, the system uses a headset’s built-in camera to detect blanching—the whitening effect that happens when a fingertip presses against a hard surface.
AI-Powered Detection and Interaction
Once the system identifies this effect, AI algorithms determine when and where the fingertip contacts the virtual touch panel on the surface.. The AR system can then respond based on that input.
“This research shows that everyday surfaces like walls, desks, or partitions can serve as touch input areas,” Zhao explains. “It also doesn’t require special sensors, markers, or extra devices, making it simple for anyone to use.”
The team presented their findings last month in South Korea at the 33rd IEEE Conference on Virtual Reality and 3D User Interfaces.
Read the original article on:newatlas
Read more:Robot valet technology in parking lots threatens traditional jobs