Abstract: An electronic device, with a touch-sensitive surface and a display, includes one or more sensors to detect intensity of contacts with the touch-sensitive surface. The device detects a contact on the touch-sensitive surface while a focus selector corresponding to the contact is at a respective location on the display associated with additional information not initially displayed on the display. While the focus selector is at the respective location, upon determining that the contact has an intensity above a respective intensity threshold before a predefined delay time has elapsed with the focus selector at the respective location, the device displays the additional information associated with the respective location without waiting until the predefined delay time has elapsed; and upon determining that the contact has an intensity below the respective intensity threshold, the device waits until the predefined delay time has elapsed to display the additional information associated with the respective location.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In one example process, a speech input is received from a user. In response to determining that the speech input corresponds to a user intent of obtaining information associated with a user experience of the user, one or more parameters referencing a user experience of the user are identified. Metadata associated with the referenced user experience is obtained from an experiential data structure. Based on the metadata, one or more media items associated with the referenced are retrieved based on the metadata. The one or more media items associated with the referenced user experience are output together.

Abstract: In some embodiments, an electronic device receives handwritten inputs in text entry fields and converts the handwritten inputs into font-based text. In some embodiments, an electronic device selects and deletes text based on inputs from a stylus. In some embodiments, an electronic device inserts text into pre-existing text based on inputs from a stylus. In some embodiments, an electronic device manages the timing of converting handwritten inputs into font-based text. In some embodiments, an electronic device presents a handwritten entry menu. In some embodiments, an electronic device controls the characteristic of handwritten inputs based on selections on the handwritten entry menu. In some embodiments, an electronic device presents autocomplete suggestions. In some embodiments, an electronic device converts handwritten input to font-based text. In some embodiments, an electronic device displays options in a content entry palette.

Abstract: Electronic devices may use touch pads that have touch sensor arrays, force sensors, and actuators for providing tactile feedback. A touch pad may be mounted in a computer housing. The touch pad may have a rectangular planar touch pad member that has a glass layer covered with ink and contains a capacitive touch sensor array. Force sensors may be mounted under each of the four corners of the rectangular planar touch pad member. The force sensors may be used to measure how much force is applied to the surface of the planar touch pad member by a user. Processed force sensor signals may indicate the presence of button activity such as press and release events. In response to detected button activity or other activity in the device, actuator drive signals may be generated for controlling the actuator. The user may supply settings to adjust signal processing and tactile feedback parameters.

Abstract: An electronic device displays a user interface that includes a plurality of controls for adjusting parameters of a user interface element, including a first control and a second control for adjusting a first parameter and a second parameter of the user interface element, respectively. In response to receiving a single input directed to the first control, the device updates an appearance of the first control to indicate that the first control is navigating through a plurality of values of the first parameter, generates a plurality of tactile outputs corresponding to updates in the appearance of the first control; and changes a value of the first parameter for the user interface element based on the single input. In response to receiving a single input directed to the first control, a similar set of operations are performed with respect to the second parameter of the user interface element.

Abstract: An electronic device has multiple cameras and displays a digital viewfinder user interface for previewing visual information provided by the cameras. The multiple cameras may have different properties such as focal lengths. When a single digital viewfinder is provided, the user interface allows zooming over a zoom range that includes the respective zoom ranges of both cameras. The zoom setting to determine which camera provides visual information to the viewfinder and which camera is used to capture visual information. The user interface also allows the simultaneous display of content provided by different cameras at the same time. When two digital viewfinders are provided, the user interface allows zooming, freezing, and panning of one digital viewfinder independently of the other. The device allows storing of a composite images and/or videos using both digital viewfinders and corresponding cameras.

Abstract: An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a user interface object having a plurality of activation states; detects a contact on the touch-sensitive surface; and detects an increase of intensity of the contact from a first intensity to a second intensity. In response to detecting the increase in intensity, the device: changes activation states M times, and generates a tactile output on the touch-sensitive surface corresponding to each change in activation state. The device detects a decrease of intensity of the contact from the second intensity to the first intensity; and in response to detecting the decrease in intensity, the device: changes activation states N times, and generates a tactile output on the touch-sensitive surface corresponding to each change in activation state, where N is different from M.

Abstract: An electronic device with a touch-sensitive display displays an electronic calendar and detects a hand-drawn input on the touch-sensitive display. The hand-drawn input extends over a vertical portion, less than all, of an area corresponding to a first day in the calendar. In response to detecting the hand-drawn input, the device displays, over the vertical portion of the first day, one or more graphics that correspond to the hand-drawn input. While displaying the graphics, the device detects an input that corresponds to a request to create an event in the electronic calendar. In response, the device creates, in the first day in the electronic calendar, an event with a start time and an end time, wherein the start time and the end time of the event are in accordance with the first day that the hand drawn input extends over.

Abstract: An electronic device with a touch-sensitive surface and a display, displays a user interface that includes a plurality of representations of content, including a respective representation of content corresponding to respective content associated with a respective application, wherein the respective representation of content is different from the respective content associated with the respective application. In response to detecting a gesture that includes a contact on the respective representation of the content on the touch-sensitive surface, the device displays the respective content in the application user interface of the respective application if the gesture meets criteria for displaying an application user interface for the respective application associated with the respective representation of content.

Abstract: In some embodiments, an electronic device optionally identifies a person's face, and optionally performs an action in accordance with the identification. In some embodiments, an electronic device optionally determines a gaze location in a user interface, and optionally performs an action in accordance with the determination. In some embodiments, an electronic device optionally designates a user as being present at a sound-playback device in accordance with a determination that sound-detection criteria and verification criteria have been satisfied. In some embodiments, an electronic device optionally determines whether a person is further or closer than a threshold distance from a display device, and optionally provides a first or second user interface for display on the display device in accordance with the determination. In some embodiments, an electronic device optionally modifies the playing of media content in accordance with a determination that one or more presence criteria are not satisfied.

Abstract: A method is performed at a computing system that includes a first housing with a primary display and a second housing at least partially containing a physical keyboard and a touch-sensitive secondary display. The method includes: displaying, on the primary display, a first user interface for an application executed by the computing system. The method also includes: displaying, on the touch-sensitive secondary display, a second user interface, the second user interface comprising a set of one or more affordances corresponding to the application. The method further includes: detecting a notification and, in response to detecting the notification, concurrently displaying, in the second user interface, the set of one or more affordances corresponding to the application and at least a portion of the detected notification on the touch-sensitive secondary display. In some embodiments, the detected notification is not displayed on the primary display.

Abstract: A method is performed at a computing system with a first housing that includes a primary display and a second housing at least partially containing (i) a physical keyboard and a touch-sensitive secondary display (“TSSD”) that is distinct from the primary display. The method includes: displaying, on the primary display, a first user interface for an application and displaying, on the TSSD, a first set of affordances corresponding to a first portion of the application. The method further includes: detecting a swipe gesture on the TSSD. If the swipe gesture was performed in a first direction, the method includes: displaying a second set of affordances corresponding to the first portion on the TSSD. If the swipe gesture was performed in a second direction substantially perpendicular to the first direction, the method includes: displaying a third set of affordances corresponding to a second portion of the application on the TSSD.

Abstract: An electronic device displays, on a display, a user interface that includes one or more user interface objects. The device detects a first input on the touch-sensitive surface at a location that corresponds to a first user interface object of the one or more user interface objects. Detecting the first input includes detecting a change in intensity of the first input on the touch-sensitive surface from a first intensity to a second intensity, different from the first intensity. In response to detecting the first input, the device obtains a change in a value of a respective simulated physical property that changes in response to changes in intensity of the first input on the touch-sensitive surface, and updates an appearance of the user interface by progressing a first animation between a first state and a second state based on the change in the value of the respective simulated physical property.

Abstract: A method includes: displaying a user interface including an instant messaging conversation between a first person and a second person, the instant messaging conversation displaying content balloons with instant messages exchanged between the first and second person. The method also includes: in accordance with a determination that the second person is typing the instant message, displaying a typed-message-preparation indicator in the user interface of a communication application. The method further includes: in accordance with a determination that the second person is drawing the instant message, displaying a drawn-message-preparation indicator in the user interface of the communication application.

Abstract: In some embodiments, an electronic device optionally identifies a person's face, and optionally performs an action in accordance with the identification. In some embodiments, an electronic device optionally determines a gaze location in a user interface, and optionally performs an action in accordance with the determination. In some embodiments, an electronic device optionally designates a user as being present at a sound-playback device in accordance with a determination that sound-detection criteria and verification criteria have been satisfied. In some embodiments, an electronic device optionally determines whether a person is further or closer than a threshold distance from a display device, and optionally provides a first or second user interface for display on the display device in accordance with the determination. In some embodiments, an electronic device optionally modifies the playing of media content in accordance with a determination that one or more presence criteria are not satisfied.

Abstract: The present disclosure generally relates to interacting with an electronic device without touching a display screen or other physical input mechanisms. In some examples, the electronic device performs an operation in response to a positioning of a user's hand and/or an orientation of the electronic device.

Abstract: An electronic device with a display, a touch-sensitive surface and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a respective control icon with simulated three-dimensional characteristics and a cursor over the respective control icon. The device detects, on the touch-sensitive surface, a stationary press input that includes an increase in intensity of a contact that corresponds to the cursor. In response to detecting the stationary press input, the device changes an appearance of the respective control icon in accordance with the simulated three-dimensional characteristics of the control icon and moves the cursor laterally on the display in accordance with the change in appearance of the respective control icon.

Abstract: An electronic device has multiple cameras and displays a digital viewfinder user interface for previewing visual information provided by the cameras. The multiple cameras may have different properties such as focal lengths. When a single digital viewfinder is provided, the user interface allows zooming over a zoom range that includes the respective zoom ranges of both cameras. The zoom setting to determine which camera provides visual information to the viewfinder and which camera is used to capture visual information. The user interface also allows the simultaneous display of content provided by different cameras at the same time. When two digital viewfinders are provided, the user interface allows zooming, freezing, and panning of one digital viewfinder independently of the other. The device allows storing of a composite images and/or videos using both digital viewfinders and corresponding cameras.

Abstract: A method is performed at a computing system with a first housing that includes a primary display and a second housing at least partially containing (i) a physical keyboard and a touch-sensitive secondary display (“TSSD”) that is distinct from the primary display. The method includes: displaying, on the primary display, a first user interface for an application and displaying, on the TSSD, a first set of affordances corresponding to a first portion of the application. The method further includes: detecting a swipe gesture on the TSSD. If the swipe gesture was performed in a first direction, the method includes: displaying a second set of affordances corresponding to the first portion on the TSSD. If the swipe gesture was performed in a second direction substantially perpendicular to the first direction, the method includes: displaying a third set of affordances corresponding to a second portion of the application on the TSSD.

Abstract: The present disclosure generally relates to displaying and editing image with depth information. Image data associated with an image includes depth information associated with a subject. In response to a request to display the image, a first modified image is displayed. Displaying the first modified image includes displaying, based on the depth information, a first level of simulated lighting on a first portion of the subject and a second level of simulated lighting on a second portion of the subject. After displaying the first modified image, a second modified image is displayed. Displaying the second modified image includes displaying, based on the depth information, a third level of simulated lighting on the first portion of the subject and a fourth level of simulated lighting on the second portion of the subject.