Abstract: Systems and methods for gesture recognition based on depth information from a camera include, at an electronic device having a camera system, capturing a video frame and depth information associated with the video frame, identifying a foreground portion of the video frame based on the depth information, and determining whether the foreground portion matches a predefined gesture in a database. In accordance with a determination that the foreground portion matches a predefined gesture in the database, the device determines whether one or more subsequent video frames matches the one or more predefined gestures to produce a recognized gesture.

Abstract: An electronic device having a display, memory, and an image sensor captures image data from the image sensor. The device receives a selection of a background image from a user of the electronic device. The background image 100is not based on image data from the image sensor. The device displays a view on the display or view-fmder. The view is based on the captured image data and the selected background image. The device receives first user input at the electronic device. The displayed view is updated by modifying the background image in accordance with the first user input while maintaining the display of the captured image data. The device stores the view as image data in the memory.

Abstract: At an electronic device coupled to a display, a communication interface, and a first image sensor, first image data is captured from the first image sensor. Second image data is received over the communication interface from a first remote device. The display displays a portion of the second image data with a portion of the first image data. The displayed portion of the second image data obscures some of the first image data.

Abstract: Systems and methods are directed to augmented reality (AR) environments where AR objects, such as intelligent virtual objects, interactively respond to ambient environmental changes. Image data are captured from one or more sensors, augmented reality environments are generated based on the image data, environmental parameters are detected from one or more environmental sensors, and views of the generated AR environment are displayed. Some views include the AR object existing therein, for instance when the detected environmental parameters satisfy certain criteria. Other views do not include the AR object while such criteria are not met.

Abstract: Systems and methods for gesture recognition based on depth information from a camera include, at an electronic device having a camera system, capturing a video frame and depth information associated with the video frame, identifying a foreground portion of the video frame based on the depth information, and determining whether the foreground portion matches a predefined gesture in a database. In accordance with a determination that the foreground portion matches a predefined gesture in the database, the device determines whether one or more subsequent video frames matches the one or more predefined gestures to produce a recognized gesture.

Abstract: At an electronic device coupled to a display, a communication interface, and a first image sensor, first image data is captured from the first image sensor. Second image data is received over the communication interface from a first remote device. The display displays a portion of the second image data with a portion of the first image data. The displayed portion of the second image data obscures some of the first image data.

Abstract: At an electronic device having a display, a first sensor, and a second sensor different than the first sensor, a view is displayed on the display. The view includes an interface object at a first location. A first gesture is detected based on first data from the first sensor, wherein the first gesture identifies the interface object. A second gesture is detected based on second data from the second sensor. A second location is determined for the interface object based on the second gesture. The display of the interface object is updated from the first location to the second location in the view.

Abstract: At an electronic device having a display and one or more image sensors, a view of an augmented reality (AR) environment is displayed, wherein the AR environment includes a background based on captured image data from the one or more image sensors and a first virtual object at a first location and the view includes display of the first virtual object. Movement data indicating movement of a remote user is received. A property is determined of the first virtual object in the AR environment based on the received data. The display of the view is updated based on the determined property.

Abstract: At an electronic device having a display, a first sensor, and a second sensor different than the first sensor, a view is displayed on the display. The view includes an interface object at a first location. A first gesture is detected based on first data from the first sensor, wherein the first gesture identifies the interface object. A second gesture is detected based on second data from the second sensor. A second location is determined for the interface object based on the second gesture. The display of the interface object is updated from the first location to the second location in the view.