One of the key characteristics shared by both digital devices and physical objects is their physical appearance such as colors, dimensions, textures, etc. This motivated us to use visual information to connect devices, objects and people. Our goal was to make this interaction seamless by developing a technology that feels like a natural extension of the body and behavior. For example, a person might be able to point at a device and make a virtual connection to it, point at an object to extract/copy relevant information, point at another person to share digital contents, etc. To this end, we develop SmartFinger with the aim of creating a seamless ‘channel’ between digital devices and physical surrounding. It is an always available and intuitive interface for ‘grasping’ and semantically analyzing visual content from physical objects as well as sharing media between digital devices.