Multi-toe interaction

Direct touch surfaces that are orders of magnitude larger than tabletops by integrating high-resolution multi-touch sensing into back-projected floors.

The key factor of the shown design is that it is based on frustrated total internal reflection sensing. FTIR allows it to identify and track users based on their sole patterns. The floor recognizes foot postures, distinguishes users who interact from people walking by, and enables high-precision interaction. In addition, the floor can approximate users' head positions based on the pressure profile in the soles and it extracts enough details from soles to allow users to play first person shooters by balancing their feet.