Abstract: Touch detection includes obtaining image data for a finger and a target surface, and determining a touch region in the image data on which the fingertip makes contact with the target surface. A pointing direction of the finger in the image data is determined, and a target region is estimated on the target surface based on the touch region and the pointing direction, wherein the touch region comprises a portion of the target surface that extends from the touch region in a direction of the pointing direction.

Abstract: In some embodiments, a computer system displays a representation of a user associated with an external computer system and the representation includes a visual indication of a portion of a body of the user that is generated based on indirect information of a state of the portion of the body of the user. In some embodiments, a computer system displays one or more portions of a representation of a user with different appearances based on whether the computer system receives information that the one or more portions of the representation are positioned with predefined regions of a physical environment in which the user is located.

Abstract: Touch detection includes obtaining image data for a finger and a target surface, and determining a touch region in the image data on which the fingertip makes contact with the target surface. A pointing direction of the finger in the image data is determined, and a target region is estimated on the target surface based on the touch region and the pointing direction, wherein the touch region comprises a portion of the target surface that extends from the touch region in a direction of the pointing direction.