Abstract: A method is provided that includes receiving, from a camera, a plurality of images representing a portion of a face containing a mouth. One or more images of the plurality of images depict a tongue extended out of the mouth. The method also includes determining, based on the plurality of images, an amount of time for which the tongue has been extended out of the mouth. The method additionally includes determining, based on the amount of time, a tongue length for a digital representation of the tongue. The digital representation of the tongue forms part of a digital representation of the face. The method further includes adjusting the digital representation of the face to have the digital representation of the tongue extend out of the mouth with the determined tongue length. The method yet further includes providing instructions to display the adjusted digital representation of the face.

Abstract: Embodiments relate to detecting a user's facial expressions in real-time using a head-mounted display unit that includes a 2D camera (e.g., infrared camera) that capture a user's eye region, and a depth camera or another 2D camera that captures the user's lower facial features including lips, chin and cheek. The images captured by the first and second camera are processed to extract parameters associated with facial expressions. The parameters can be sent or processed so that the user's digital representation including the facial expression can be obtained.