Microsoft PixelSense is the most revolutionary technology that can not only recognize touch but also real objects. It is basically a combination of software and hardware that provides a natural user interface for better interaction with the device.

Microsoft PixelSense was initially released as Microsoft Surface. Microsoft provided both the hardware and the software. The current version of PixelSense is Samsung SUR40 for Microsoft PixelSense, which is a partner product of Microsoft and Samsung.

The technology is designed especially for companies that find themselves with a lot of public interaction. It allows companies to offer their customers a better shopping experience. Customers can interact with products through direct touch interactions and by placing objects on the screen. The system is capable of identifying objects of different sizes, shapes and patterns. Based on the identified object, the system invokes a command to the processing unit.

The biggest advantage of PixelSense is that it does not require the use of traditional input devices like mouse, keyboard and camera, etc. It is designed to accommodate multiple users at the same time. It can detect up to 52 keys simultaneously, taking device use to the next level, well ahead of the limitations of single-user devices.

How does it work?

Microsoft PixelSense is able to identify fingers, hands, and objects placed on the display device. Allows vision-based interaction without the need for a camera. Each individual pixel of the device is capable of identifying activities such as touch and objects placed on the screen and transmitting the received input to the processing unit. The processing unit interprets the received input very quickly and outputs the desired output faster than the blink of an eye. According to the official Microsoft PixelSense site, this technology works in the following steps:

• The display device identifies a contact, be it touch or an object.
• An IR light source located on the back provides light that passes through optical sheets, LCD and protective glass and finally hits contact
• IR rays are reflected from the contact and identified by the integrated sensors
• Sensors convert infrared signals into electrical signals
• A large number of these pixels work together to create an image of what is placed on the screen.
• The image is analyzed using image processing techniques.
• The output is sent to the PC. Includes corrected sensor image and various types of contact (fingers / smudges / labels)