Hand and User Detection with Multiple Users on Large Displays

  • Michel Pahud | Microsoft Research

This video shows a demonstration of a research prototype that distinguishes hand and user on a large display with two users working side by side. The hand and user detection is done using a wearable (Microsoft Band for this research prototype) that seamlessly streams ID and motion sensor data to the large display. The prototype is looking for a spike on the motion sensor correlated with a finger touch on the large display to figure out which hand and user is touching the display. This opens up user experiences were each user have their own menu with preferences, access to documents and images on their non-dominant hand and can seamlessly carry their menu from one device to another. This is a research prototype to test the experience, but there are many ways to make this experience secure in the future.

Watch Next