Abstract: An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts, detects a contact, determines a location and intensity of the contact on the touch-sensitive surface, and displays a response, the response being based at least in part on an input-output mapping of intensity to response at the contact location. The input-output mapping including a first input-output relationship between intensity and response over a first range of intensity values, a second input-output relationship between intensity and response over a second range of intensity values, and a transitional intensity value where the first range of intensity values meets or overlaps the second range of intensity values. At the transitional intensity value, the first input-output relationship has a first rate of change, the second input-output relationship has a second rate of change, and the first rate is substantially the same as the second rate.

Abstract: An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts displaying a lower-level user interface that is part of a user interface hierarchy, where the hierarchy includes at least three levels, including the lower-level user interface, an intermediate-level user interface and a higher-level user interface. The device also, while displaying the lower-level user interface, detects an input on a portion of the device that is associated with user interface hierarchy navigation and, in response to detecting the input, in accordance with a determination that the input meets first transition criteria, the device replaces display of the lower-level user interface with display of the intermediate-level user interface and in accordance with a determination that the input meets second transition criteria, the device replaces display of the lower-level user interface with display of the higher-level user interface.

Abstract: An electronic device with a display, touch-sensitive surface and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a first user interface object and detects first movement of the contact that corresponds to movement of a focus selector toward the first user interface object. In response to detecting the first movement, the device moves the focus selector to the first user interface object; and determines an intensity of the contact. After detecting the first movement, the device detects second movement of the contact. In response to detecting the second movement of the contact, when the contact meets selection criteria based on an intensity of the contact, the device moves the focus selector and the first user interface object; and when the contact does not meet the selection criteria, the device moves the focus selector without moving the first user interface object.

Abstract: The present disclosure generally relates to using avatars and image data for enhanced user interactions. In some examples, user status dependent avatars are generated and displayed with a message associated with the user status. In some examples, a device captures image information to scan an object to create a 3D model of the object. The device determines an algorithm for the 3D model based on the capture image information and provides visual feedback on additional image data that is needed for the algorithm to build the 3D model. In some examples, an application's operation on a device is restricted based on whether an authorized user is identified as using the device based on captured image data.

Abstract: An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a user interface object having a plurality of activation states; detects a contact on the touch-sensitive surface; and detects an increase of intensity of the contact from a first intensity to a second intensity. In response to detecting the increase in intensity, the device: changes activation states M times, and generates a tactile output on the touch-sensitive surface corresponding to each change in activation state. The device detects a decrease of intensity of the contact from the second intensity to the first intensity; and in response to detecting the decrease in intensity, the device: changes activation states N times, and generates a tactile output on the touch-sensitive surface corresponding to each change in activation state, where N is different from M.

Abstract: An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts, detects a contact, determines a location and intensity of the contact on the touch-sensitive surface, and displays a response, the response being based at least in part on an input-output mapping of intensity to response at the contact location. The input-output mapping including a first input-output relationship between intensity and response over a first range of intensity values, a second input-output relationship between intensity and response over a second range of intensity values, and a transitional intensity value where the first range of intensity values meets or overlaps the second range of intensity values. At the transitional intensity value, the first input-output relationship has a first rate of change, the second input-output relationship has a second rate of change, and the first rate is substantially the same as the second rate.

Abstract: Signal processing for a touch and hover sensing display device is disclosed. A touch and hover sensing display device can include a sensing panel for sensing a touch or hover event, a display for displaying graphical information to select based on the touch or hover event, and a control system for processing a signal indicative of the touch or hover event. The control system can process the signal to determine to which display location a hovering object is pointing according to a profile of the object's shape. In addition or alternatively, the control system can process the signal to differentiate between a close small object and a distant large object so as to subsequently perform intended actions of the device based, at least in part, on the object distance and/or area (or size). The display can be positioned at a desirable distance from the panel so as to reduce interference from the display to the panel and avoid adverse effects on the signal.

Abstract: Compensation for sensors in a touch and hover sensing device is disclosed. Compensation can be for sensor resistance and/or sensor sensitivity variation that can adversely affect touch and hover measurements at the sensors. To compensate for sensor resistance, the device can gang adjacent sensors together so as to reduce the overall resistance of the sensors. In addition or alternatively, the device can drive the sensors with voltages from multiple directions so as to reduce the effects of the sensors' resistance. To compensate for sensor sensitivity variation (generally at issue for hover measurements), the device can apply a gain factor to the measurements, where the gain factor is a function of the sensor location, so as to reduce the sensitivity variation at different sensor locations on the device.

Abstract: Electronic devices may use touch pads that have touch sensor arrays, force sensors, and actuators for providing tactile feedback. A touch pad may be mounted in a computer housing. The touch pad may have a rectangular planar touch pad member that has a glass layer covered with ink and contains a capacitive touch sensor array. Force sensors may be mounted under each of the four corners of the rectangular planar touch pad member. The force sensors may be used to measure how much force is applied to the surface of the planar touch pad member by a user. Processed force sensor signals may indicate the presence of button activity such as press and release events. In response to detected button activity or other activity in the device, actuator drive signals may be generated for controlling the actuator. The user may supply settings to adjust signal processing and tactile feedback parameters.

Abstract: An electronic device, with a touch-sensitive surface and a display, includes one or more sensors to detect intensity of contacts with the touch-sensitive surface. The device detects a contact on the touch-sensitive surface while a focus selector corresponding to the contact is at a respective location on the display associated with additional information not initially displayed on the display. While the focus selector is at the respective location, upon determining that the contact has an intensity above a respective intensity threshold before a predefined delay time has elapsed with the focus selector at the respective location, the device displays the additional information associated with the respective location without waiting until the predefined delay time has elapsed; and upon determining that the contact has an intensity below the respective intensity threshold, the device waits until the predefined delay time has elapsed to display the additional information associated with the respective location.

Abstract: In some embodiments, an electronic device optionally identifies a person's face, and optionally performs an action in accordance with the identification. In some embodiments, an electronic device optionally determines a gaze location in a user interface, and optionally performs an action in accordance with the determination. In some embodiments, an electronic device optionally designates a user as being present at a sound-playback device in accordance with a determination that sound-detection criteria and verification criteria have been satisfied. In some embodiments, an electronic device optionally determines whether a person is further or closer than a threshold distance from a display device, and optionally provides a first or second user interface for display on the display device in accordance with the determination. In some embodiments, an electronic device optionally modifies the playing of media content in accordance with a determination that one or more presence criteria are not satisfied.

Abstract: An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts, detects a contact, determines a location and intensity of the contact on the touch-sensitive surface, and displays a response, the response being based at least in part on an input-output mapping of intensity to response at the contact location. The input-output mapping including a first input-output relationship between intensity and response over a first range of intensity values, a second input-output relationship between intensity and response over a second range of intensity values, and a transitional intensity value where the first range of intensity values meets or overlaps the second range of intensity values. At the transitional intensity value, the first input-output relationship has a first rate of change, the second input-output relationship has a second rate of change, and the first rate is substantially the same as the second rate.

Abstract: In some embodiments, an electronic device optionally identifies a person's face, and optionally performs an action in accordance with the identification. In some embodiments, an electronic device optionally determines a gaze location in a user interface, and optionally performs an action in accordance with the determination. In some embodiments, an electronic device optionally designates a user as being present at a sound-playback device in accordance with a determination that sound-detection criteria and verification criteria have been satisfied. In some embodiments, an electronic device optionally determines whether a person is further or closer than a threshold distance from a display device, and optionally provides a first or second user interface for display on the display device in accordance with the determination. In some embodiments, an electronic device optionally modifies the playing of media content in accordance with a determination that one or more presence criteria are not satisfied.

Abstract: In some embodiments, an electronic device with a touch screen display: detects a single finger contact on the touch screen display; creates a touch area that corresponds to the single finger contact; determines a representative point within the touch area; determines if the touch area overlaps an object displayed on the touch screen display, which includes determining if one or more portions of the touch area other than the representative point overlap the object; connects the object with the touch area if the touch area overlaps the object, where connecting maintains the overlap of the object and the touch area; after connecting the object with the touch area, detects movement of the single finger contact; determines movement of the touch area that corresponds to movement of the single finger contact; and moves the object connected with the touch area in accordance with the determined movement of the touch area.

Abstract: A computing device having a touch-sensitive surface and a display, detects a stylus input on the touch-sensitive surface while displaying a user interface. A first operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface while the stylus is detected on the touch-sensitive surface. A second operation different from the first operation is performed in the user interface in accordance with a determination that the stylus input includes rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface. A third operation is performed in the user interface in accordance with a determination that the stylus input includes movement of the stylus across the touch-sensitive surface and rotation of the stylus around an axis of the stylus while the stylus is detected on the touch-sensitive surface.

Abstract: An electronic device with a touch-sensitive display and one or more sensors to detect signals from a stylus associated with the device: while the electronic device is in a locked state: displays a lock screen user interface on the touch-sensitive display; while displaying the lock screen user interface, detects a first input from the stylus to draw on the touch-sensitive display; in response to detecting the first input, displays, over the lock screen user interface, one or more marks of a drawing that correspond to the first input; while displaying, on the lock screen user interface, the one or more marks of the drawing: detects a second input from the stylus to display a drawing application in a restricted mode; and, in response to detecting the second input, executes the drawing application in the restricted mode and displays the one or more marks of the drawing in the drawing application.

Abstract: An electronic device displays a user interface in a first display state. The device detects a first portion of a gesture on a touch-sensitive surface, including detecting intensity of a respective contact of the gesture. In response to detecting the first portion of the gesture, the device displays an intermediate display state between the first display state and a second display state. In response to detecting the end of the gesture: if intensity of the respective contact had reached a predefined intensity threshold prior to the end of the gesture, the device displays the second display state; otherwise, the device redisplays the first display state. After displaying an animated transition between a first display state and a second state, the device, optionally, detects an increase of the contact intensity. In response, the device displays a continuation of the animation in accordance with the increasing intensity of the respective contact.

Abstract: A computing device can have a touchscreen user interface operable by different input tools, such as a finger or a stylus. The computing device can dynamically and automatically alter elements of a graphical user interface depending on the type of input tool in use. For example, a stylus can have sensors that detect touch and/or motion, and based on the sensor data, the stylus or the computing device can determine whether the stylus is currently being held in a hand. When the stylus is being held, the interface can be rendered with elements adapted for stylus input, and when the stylus is not being held, the interface can be rendered with elements adapted for finger input.

Abstract: An electronic device with a touch-sensitive display and one or more sensors to detect signals from a stylus associated with the device: detects a positional state of the stylus, the positional state of the stylus corresponding to a distance, a tilt, and/or an orientation of the stylus relative to the touch-sensitive display; determines a location on the touch-sensitive display that corresponds to the detected positional state of the stylus; displays, in accordance with the positional state of the stylus, an indication on the touch-sensitive display of the determined location prior to the stylus touching the touch-sensitive display; detects a change in the distance, the tilt, and/or the orientation of the stylus, prior to the stylus touching the touch-sensitive display; and in response to detecting the change, updates the displayed indication on the touch-sensitive display.

Abstract: An electronic device displays a user interface in a first display state. The device detects a first portion of a gesture on a touch-sensitive surface, including detecting intensity of a respective contact of the gesture. In response to detecting the first portion of the gesture, the device displays an intermediate display state between the first display state and a second display state. In response to detecting the end of the gesture: if intensity of the respective contact had reached a predefined intensity threshold prior to the end of the gesture, the device displays the second display state; otherwise, the device redisplays the first display state. After displaying an animated transition between a first display state and a second state, the device, optionally, detects an increase of the contact intensity. In response, the device displays a continuation of the animation in accordance with the increasing intensity of the respective contact.