Abstract: In some embodiments, an electronic device optionally identifies a person's face, and optionally performs an action in accordance with the identification. In some embodiments, an electronic device optionally determines a gaze location in a user interface, and optionally performs an action in accordance with the determination. In some embodiments, an electronic device optionally designates a user as being present at a sound-playback device in accordance with a determination that sound-detection criteria and verification criteria have been satisfied. In some embodiments, an electronic device optionally determines whether a person is further or closer than a threshold distance from a display device, and optionally provides a first or second user interface for display on the display device in accordance with the determination. In some embodiments, an electronic device optionally modifies the playing of media content in accordance with a determination that one or more presence criteria are not satisfied.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: An electronic device with a display, a touch-sensitive surface and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a respective control icon with simulated three-dimensional characteristics and a cursor over the respective control icon. The device detects, on the touch-sensitive surface, a stationary press input that includes an increase in intensity of a contact that corresponds to the cursor. In response to detecting the stationary press input, the device changes an appearance of the respective control icon in accordance with the simulated three-dimensional characteristics of the control icon and moves the cursor laterally on the display in accordance with the change in appearance of the respective control icon.

Abstract: A method is performed at a computing system with a first housing that includes a primary display and a second housing at least partially containing (i) a physical keyboard and a touch-sensitive secondary display (“TSSD”) that is distinct from the primary display. The method includes: displaying, on the primary display, a first user interface for an application and displaying, on the TSSD, a first set of affordances corresponding to a first portion of the application. The method further includes: detecting a swipe gesture on the TSSD. If the swipe gesture was performed in a first direction, the method includes: displaying a second set of affordances corresponding to the first portion on the TSSD. If the swipe gesture was performed in a second direction substantially perpendicular to the first direction, the method includes: displaying a third set of affordances corresponding to a second portion of the application on the TSSD.

Abstract: An electronic device has multiple cameras and displays a digital viewfinder user interface for previewing visual information provided by the cameras. The multiple cameras may have different properties such as focal lengths. When a single digital viewfinder is provided, the user interface allows zooming over a zoom range that includes the respective zoom ranges of both cameras. The zoom setting to determine which camera provides visual information to the viewfinder and which camera is used to capture visual information. The user interface also allows the simultaneous display of content provided by different cameras at the same time. When two digital viewfinders are provided, the user interface allows zooming, freezing, and panning of one digital viewfinder independently of the other. The device allows storing of a composite images and/or videos using both digital viewfinders and corresponding cameras.

Abstract: The present disclosure generally relates to displaying and editing image with depth information. Image data associated with an image includes depth information associated with a subject. In response to a request to display the image, a first modified image is displayed. Displaying the first modified image includes displaying, based on the depth information, a first level of simulated lighting on a first portion of the subject and a second level of simulated lighting on a second portion of the subject. After displaying the first modified image, a second modified image is displayed. Displaying the second modified image includes displaying, based on the depth information, a third level of simulated lighting on the first portion of the subject and a fourth level of simulated lighting on the second portion of the subject.

Abstract: The computing system includes a primary display, memory, and a housing at least partially containing a physical in put mechanism and a touch screen adjacent to the physical input mechanism: displays, on the primary display, a first user interface, the first user interface comprising one or more user interface elements; and identifies an active user interface element among the one or more user interface elements that is in focus on the primary display. In accordance with a determination that the active user interface element that is in focus on the primary display is associated with an application executed by the computing system, the computing system displays a second user interface on the touch screen, including: (A) a first set of corresponding to the application; and (B) at least one system-level affordance corresponding a system-level functionality.

Abstract: An electronic device displays selectable user interface elements, detects a touch input on a first user interface element, and in response to detecting a first portion of the touch input, which reaches a first intensity threshold, changes an appearance of the first selectable user interface element to indicate that the input has been detected. The device then detects a second portion of the touch input, including an increase in intensity of the touch input followed by a decrease in intensity, and in response to detecting the second portion of the touch input: displays or forgoes displaying a representation of content corresponding to the first user interface element, including a plurality of selectable controls for interacting with the content, depending on whether the intensity of the touch input increases above the second intensity threshold during the second portion of the touch input.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: In some embodiments, a multifunction device with a display and a touch-sensitive surface creates a plurality of workspace views. A respective workspace view is configured to contain content assigned by a user to the respective workspace view. The content includes application windows. The device displays a first workspace view in the plurality of workspace views on the display without displaying other workspace views in the plurality of workspace views and detects a first multifinger gesture on the touch-sensitive surface. In response to detecting the first multifinger gesture on the touch-sensitive surface, the device replaces display of the first workspace view with concurrent display of the plurality of workspace views.

Abstract: An electronic device, with a touch-sensitive surface and a display, includes one or more sensors to detect intensity of contacts with the touch-sensitive surface. The device displays, on the display, a first control for controlling a first operation. The device detects, on the touch-sensitive surface, a first input that corresponds to the first control; and in response to detecting the first input: in accordance with a determination that the first input meets first control-activation criteria but does not include a contact with a maximum intensity above a respective intensity threshold, the device performs the first operation; and in accordance with a determination that the first input includes a contact with an intensity above the respective intensity threshold, the device displays a second control for performing a second operation associated with the first operation.

Abstract: While a device is in an unlocked state, a sequence of one or more activations of a button of the device are detected, where a first activation of the button is detected while a respective application user interface is displayed on the display. In response to detecting the sequence of one or more activations of the button: if the sequence of activations of the button meet first criteria, display of the respective application user interface is replaced with display of a different user interface while maintaining the device in the unlocked state; and if the sequence of activations of the button meet second criteria, the device switches from the unlocked state to a locked state, where the first criteria are differentiated from the second criteria based on a number and/or timing of activations of button in the sequence of activations of the button.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In one example process, a speech input is received from a user. In response to determining that the speech input corresponds to a user intent of obtaining information associated with a user experience of the user, one or more parameters referencing a user experience of the user are identified. Metadata associated with the referenced user experience is obtained from an experiential data structure. Based on the metadata, one or more media items associated with the referenced are retrieved based on the metadata. The one or more media items associated with the referenced user experience are output together.

Abstract: An electronic device, while displaying a user interface of a first software application, detects a first input, including a contact that does not satisfy a first threshold and is detected at a location associated with region of the user interface associated with at least a first operation. In response to the first input, if a first tactile output setting is active for the first input, the device performs the first operation without generating a tactile output, and if a second tactile output setting is active for the first input, the device forgoes performing the first operation. In response to a second input that includes a contact that satisfies the first intensity threshold and is detected at a location associated with the region of the user interface, if the second tactile output setting is active for the second input, the device performs the first operation and generates a tactile output.

Abstract: A computing device having a touch-sensitive surface and a display, detects a stylus input on the touch-sensitive surface while displaying a user interface. A first operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface while the stylus is detected on the touch-sensitive surface. A second operation different from the first operation is performed in the user interface in accordance with a determination that the stylus input includes rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface. A third operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface and rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface.

Abstract: The present disclosure generally relates to using avatars and image data for enhanced user interactions. In some examples, user status dependent avatars are generated and displayed with a message associated with the user status. In some examples, a device captures image information to scan an object to create a 3D model of the object. The device determines an algorithm for the 3D model based on the capture image information and provides visual feedback on additional image data that is needed for the algorithm to build the 3D model. In some examples, an application's operation on a device is restricted based on whether an authorized user is identified as using the device based on captured image data. In some examples, depth data is used to combine two sets of image data.

Abstract: An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface: detects, on the touch-sensitive surface, a gesture that includes an increase of intensity of a contact above a respective intensity threshold. In response to detecting the gesture: in accordance with a determination that the gesture includes a first number of contacts, the device generates a tactile output on the touch-sensitive surface; and in accordance with a determination that the gesture includes a second number of contacts different from the first number, the device forgoes generating the tactile output on the touch-sensitive surface.

Abstract: An electronic device displays a user interface of a first software application that includes one or more draggable objects and one or more control objects; and, detects a contact on a touch-sensitive surface at a first location while a focus selector is displayed over a first draggable object and a movement of the contact across the touch-sensitive surface to a second location that corresponds to a first control object. In accordance with a determination that the contact at the first location satisfies object selection criteria, the device moves the first draggable object to the first control object in accordance with the movement of the contact across the touch-sensitive surface to the first control object. In accordance with a determination that the contact at the second location satisfies first intensity criteria, the device performs a first predetermined operation that corresponds to activation of the first control object.

Abstract: An electronic device with a touch-sensitive display and one or more sensors to detect signals from a stylus associated with the device: displays a user interface on the touch-sensitive display; while displaying the user interface on the touch-sensitive display, detects the stylus moving towards the touch-sensitive display, without the stylus making contact with the touch-sensitive display; determines whether the detected stylus movement towards the touch-sensitive display satisfies one or more stylus movement criteria; in accordance with a determination that the detected stylus movement satisfies the one or more stylus movement criteria, displays a menu overlaid on the user interface, the menu including a plurality of selectable menu options; detects selection of a first menu option in the plurality of selectable menu options; and, in response to detecting selection of the first menu option: performs an operation that corresponds to the first menu option, and ceases to display the menu.

Abstract: An electronic device displays a home screen and detects a first input on a first application launch icon; in response to detecting the first input, replaces the home screen with a first user interface; while displaying the first user interface, detects a second input by a second contact that includes movement across the display in a first direction; and in response to detecting the second input: if the second input meets dock-display criteria (e.g., includes movement of the second contact that is above a first movement threshold), displays a user interface object overlaid on a portion of the first user interface; and in accordance with a determination that the second input meets home-display criteria (e.g., includes movement of the second contact that is above a second movement threshold that is greater than the first movement threshold), replaces display of the first user interface with display of the home screen.