Abstract: Aspects of the subject technology provide for intention-based user interface control for electronic devices. For example, an electronic device may utilize multiple indirect engagement indicators performed by a user of the electronic device, to confirm which of several displayed user interfaces with which the user intends to engage. Once the electronic device determines which of the multiple user interfaces the user intends to engage with, the electronic device may provide a user input to the application or other process underlying that user interface. The user input may be based, in whole or in part, one or more of the multiple indirect engagement indicators.

Abstract: Various implementations disclosed herein more accurately or efficiently determine to which of multiple potential virtual objects user input should be directed in a 3D graphical environment. In some implementations, this involves using a rule that accounts for the types of the virtual objects to which a particular event may correspond. For example, a direction of intent may be identified and a rule used to determine to which of multiple potential virtual objects to associate an event.

Abstract: Aspects of the subject technology provide for constrained access to scene information by applications running on an electronic device. A system process of an electronic device may assign a region of a physical environment to an application. A user interface of the application may be displayed in the assigned region. The system process may provide scene information and/or user information to the application only when the scene information and/or user information occurs and/or originates within the assigned region, in one or more implementations.

Abstract: Aspects of the subject technology provide for intention-based user interface control for electronic devices. For example, an electronic device may utilize multiple indirect engagement indicators performed by a user of the electronic device, to confirm which of several displayed user interfaces with which the user intends to engage. Once the electronic device determines which of the multiple user interfaces the user intends to engage with, the electronic device may provide a user input to the application or other process underlying that user interface. The user input may be based, in whole or in part, one or more of the multiple indirect engagement indicators.

Abstract: Aspects of the subject technology provide for various user interface modes for a user interface of an application. The user interface modes may include one or more bounded modes, a single application mode such as an exclusive mode, and/or one or more full screen modes. In one or more implementations, access to various types of information by the application may be constrained based on the user interface mode of the user interface.

Abstract: A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for display. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device.

Abstract: A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for displaying in a three-dimensional display mode. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device in the three-dimensional display mode.

Abstract: An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a first user interface of a first software application, detects an input on the touch-sensitive surface while displaying the first user interface, and, in response to detecting the input while displaying the first user interface, performs a first operation in accordance with a determination that the input satisfies intensity input criteria including that the input satisfies a first intensity threshold and the input remains on the touch-sensitive surface for a first predefined time period, and performs a second operation in accordance with a determination that the input satisfies tap criteria including that the input ceases to remain on the touch-sensitive surface during the first predefined time period.

Abstract: A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for displaying in a three-dimensional display mode. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device in the three-dimensional display mode.

Abstract: The subject technology provides rendering an image in a first view including a plurality of tiles, each tile comprising image data corresponding to a portion of the image. The subject technology, responsive to detecting an initiation of touch input corresponding to the image, copies the image data from the plurality of tiles to a graphical canvas. The subject technology displays the image data in the graphical canvas in a second view, the graphical canvas being overlaid over at least a portion of the rendered image. The subject technology receives input stroke data corresponding to the second view, the input stroke data being continuous with the touch input. The subject technology responsive to detecting that the touch input has ended, copies the input stroke data to the plurality of tiles of the first view. Further, The subject technology displays the input stroke data and the image in the plurality of tiles of the first view.

Abstract: A device implementing a system for rendering animated user input strokes includes at least one processor configured to retrieve a user-specified mapping of physical characteristics of input strokes to ink parameters, and to receive input stroke data, the input stroke data including metadata corresponding to physical characteristics of the input stroke data. The at least one processor is configured to generate, based on the user-specified mapping, a set of ink parameters from the metadata corresponding to the physical characteristics of the input stroke data, and to render, using at least a portion of the generated set of ink parameters, a stroke based on the input stroke data.

Abstract: A device implementing a system for rendering animated user input strokes includes at least one processor configured to receive input stroke data. The at least one processor is configured to render, in a first rendering stage within a frame rendering period, a first portion of the input stroke data. The at least one processor is configured to render, in a second rendering stage within the frame rendering period, a second portion of the input stroke data, the second rendering stage being after, and temporally separate from, the first rendering stage.

Abstract: An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts: displays a first user interface that includes objects of a first type and objects of a second type; detects a first portion of a first input that includes an increase in characteristic intensity of a first contact above an intensity threshold while a focus selector is over a respective user interface object; in response, displays supplemental information associated with the respective user interface object; while displaying the supplemental information, detects an end of the first input; and, in response: if the respective user interface object is the first type of object, ceases to display the supplemental information; and, if the respective user interface object is the second type of object, maintains display of the supplemental information after detecting the end of the first input.

Abstract: An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a first user interface of a first software application, detects an input on the touch-sensitive surface while displaying the first user interface, and, in response to detecting the input while displaying the first user interface, performs a first operation in accordance with a determination that the input satisfies intensity input criteria including that the input satisfies a first intensity threshold, and performs a second operation in accordance with a determination that the input satisfies pan criteria including that the input has moved across the touch-sensitive surface by at least a predefined distance.

Abstract: An electronic device displays, on a display, a user interface. While displaying the user interface, the device detects an input on the touch-sensitive surface; and, in response to detecting the input while displaying the first user interface, and while detecting the input, in accordance with a determination that the input satisfies an activation intensity threshold, performs a first operation. The activation intensity threshold includes a first intensity threshold component that decreases from a first intensity value over time.

Abstract: The subject technology provides rendering an image in a first view including a plurality of tiles, each tile comprising image data corresponding to a portion of the image. The subject technology, responsive to detecting an initiation of touch input corresponding to the image, copies the image data from the plurality of tiles to a graphical canvas. The subject technology displays the image data in the graphical canvas in a second view, the graphical canvas being overlaid over at least a portion of the rendered image. The subject technology receives input stroke data corresponding to the second view, the input stroke data being continuous with the touch input. The subject technology responsive to detecting that the touch input has ended, copies the input stroke data to the plurality of tiles of the first view. Further, The subject technology displays the input stroke data and the image in the plurality of tiles of the first view.

Abstract: A device implementing a system for rendering animated user input strokes includes at least one processor configured to retrieve a user-specified mapping of physical characteristics of input strokes to ink parameters, and to receive input stroke data, the input stroke data including metadata corresponding to physical characteristics of the input stroke data. The at least one processor is configured to generate, based on the user-specified mapping, a set of ink parameters from the metadata corresponding to the physical characteristics of the input stroke data, and to render, using at least a portion of the generated set of ink parameters, a stroke based on the input stroke data.

Abstract: A device implementing a system for rendering animated user input strokes includes at least one processor configured to receive input stroke data. The at least one processor is configured to render, in a first rendering stage within a frame rendering period, a first portion of the input stroke data. The at least one processor is configured to render, in a second rendering stage within the frame rendering period, a second portion of the input stroke data, the second rendering stage being after, and temporally separate from, the first rendering stage.

Abstract: An electronic device displays, on a display, a user interface. While displaying the user interface, the device detects an input on the touch-sensitive surface; and, in response to detecting the input while displaying the first user interface, and while detecting the input, in accordance with a determination that the input satisfies first timing criteria and first intensity input criteria, performs a first operation. The first timing criteria require that the input remain on the touch-sensitive surface while a first time period elapses. The first intensity input criteria require that the input satisfy a first intensity threshold at an end of or subsequent to the first time period.

Abstract: An electronic device with a touch-sensitive surface, a display, and one or more tactile output generators for generating tactile outputs displays a user interface that includes a first item. While displaying the user interface, the device detects a first portion of an input by a first contact on the touch-sensitive surface, and detects a first movement of the first contact on the touch-sensitive surface. The device further, in response to detecting the first portion of the input that includes the first movement of the first contact, in accordance with a determination that the first movement of the first contact meets first movement-threshold criteria that are a precondition for performing a first operation, generates a first tactile output, and in accordance with a determination that the first movement of the first contact does not meet the first movement-threshold criteria for the first operation, forgoes generation of the first tactile output.