Abstract: In one implementation, a computer-implemented method includes accessing, by a computing device, a real-time three dimensional (“3D”) image of at least a portion of a user who is standing in front a surface; identifying, by the computing device, coordinates in 3D space for at least one appendage of the user from the 3D image; determining, by the computing device, a position of the at least one appendage of the user over the surface based on the coordinates of the at least one appendage in 3D space; determining whether the position of the appendage is within one or more active areas of the surface; and based on the determination of whether the appendage is within the one or more active areas of the surface, updating a visual image that is being projected onto the surface by a projector that is located above the surface.

Abstract: In one implementation, a computer-implemented method includes accessing, by a computing device, a real-time three dimensional (“3D”) image of at least a portion of a user who is standing in front a surface; identifying, by the computing device, coordinates in 3D space for at least one appendage of the user from the 3D image; determining, by the computing device, a position of the at least one appendage of the user over the surface based on the coordinates of the at least one appendage in 3D space; determining whether the position of the appendage is within one or more active areas of the surface; and based on the determination of whether the appendage is within the one or more active areas of the surface, updating a visual image that is being projected onto the surface by a projector that is located above the surface.