Abstract: Embodiments described herein provide for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; display logic to receive a request to display the one or more frames of data, the request including a requested presentation time in which the one or more frames of data are to be displayed; and a display engine to present the one or more frames of data to the display device for display at a target presentation time, the target presentation time derived from the requested presentation time, wherein the display engine is to adjust a refresh rate of the display device based on the target presentation time of the one or more frames of data.

Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

Abstract: Embodiments provide for a method of generating and displaying data on a display device, the method comprising receiving an input to interact with an image presented via the display; generating a sequence of frames having an animation frame rate independent of a current refresh rate of the display device; presenting configuration data to the display engine at a display time based on the requested presentation time; and dynamically refreshing the display device based on the display time to display the sequence of frames.

Abstract: Disclosed herein is a technique for implementing a secure lock screen on a computing device. The secure lock screen is configured to permit particular applications to display their content—such as main user interfaces (UIs)—while maintaining a desired overall level of security on the computing device. Graphics contexts, which represent drawing destinations associated with the applications, are tagged with entitlement information that indicates whether or not each graphics context should be displayed on the computing device when the computing device is in a locked-mode. Specifically, an application manager tags each application that is initialized, where the tagging is based on a level of entitlement possessed by the application. In turn, a rendering server that manages the graphics contexts can identify the tagged entitlement information and display or suppress the content of the applications in accordance with their entitlements.

Abstract: Improved techniques of managing graphical user interface (GUI) objects based on portal layers (or simply portals) are described. A portal refers to a logical reference to a GUI object specified by an application that enables an operating system to access and process the specified GUI object without affecting any of the rules/assumptions required by the application for the specified GUI object. Portals can assist with reducing computational resources required for rendering by assisting with reducing or eliminating the use of snapshots for rendering. One embodiment includes generating a layer tree; identifying a first sub-tree of the layer tree as portal content; establishing a portal as a reference to the portal content in a second sub-tree of the layer tree; generating a render tree based on the layer tree; rendering the render tree to create an image; and presenting the image on a display.

Abstract: Disclosed herein is a technique for implementing a secure lock screen on a computing device. The secure lock screen is configured to permit particular applications to display their content—such as main user interfaces (UIs)—while maintaining a desired overall level of security on the computing device. Graphics contexts, which represent drawing destinations associated with the applications, are tagged with entitlement information that indicates whether or not each graphics context should be displayed on the computing device when the computing device is in a locked-mode. Specifically, an application manager tags each application that is initialized, where the tagging is based on a level of entitlement possessed by the application. In turn, a rendering server that manages the graphics contexts can identify the tagged entitlement information and display or suppress the content of the applications in accordance with their entitlements.

Abstract: Prior art attempts to manage authority designation in GUI-based computer systems have set up various “handshaking” schemes between a graphics management system, such as a window server, and the various processes that are attempting to offer and accept access to each other. However, these schemes have certain limitations. In particular, when windows are used as the “fundamental basis” for implementing authority designation, events that should treat all content within a window identically can't do so because, even though all content in the window may appear to be “owned” by the window, there may be some other process that is actually rendering the content to some portion of the window. Thus, described herein are systems and methods to manage authority designation and event handling within “hierarchical” GUIs using “handshaking” schemes that are secure, sub-window granular, and that generalize recursively when applied to the various graphical layers used to construct the windows.

Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

Abstract: Systems, methods, and computer readable media for selectively placing an application into a reduced-priority rendering mode during system user interface (UI) operations are described. Techniques disclosed herein transition an executing (foreground) application from a synchronous render mode (having a first render priority) to an asynchronous render mode (having a second, lower, render priority) when the system moves from supporting execution of the application into displaying a system UI. In this new state, the application's UI display element (e.g., an icon or reduced size viewing window) may continue to be updated (e.g., in accordance with the lower render priority) but does not interfere with the system UI's responsiveness.

Abstract: Improved techniques of managing graphical user interface (GUI) objects based on portal layers (or simply portals) are described. A portal refers to a logical reference to a GUI object specified by an application that enables an operating system to access and process the specified GUI object without affecting any of the rules/assumptions required by the application for the specified GUI object. Portals can assist with reducing computational resources required for rendering by assisting with reducing or eliminating the use of snapshots for rendering. One embodiment includes generating a layer tree; identifying a first sub-tree of the layer tree as portal content; establishing a portal as a reference to the portal content in a second sub-tree of the layer tree; generating a render tree based on the layer tree; rendering the render tree to create an image; and presenting the image on a display.

Abstract: Embodiments provide for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; a display engine to present the one or more frames of data to the display device for display; display logic to receive a request to display the one or more frames of data and generate one or more display events for the display engine based on the request, wherein the request includes a first hint to indicate a complexity of the one or more frames of data and the one or more display events includes a second hint derived from the first hint; and a performance controller to adjust one or more performance related parameters for the display system based on the second hint.

Abstract: Embodiments provide for a method of generating and displaying data on a display device, the method comprising receiving an input to interact with an image presented via the display; generating a sequence of frames having an animation frame rate independent of a current refresh rate of the display device; presenting configuration data to the display engine at a display time based on the requested presentation time; and dynamically refreshing the display device based on the display time to display the sequence of frames.

Abstract: Embodiments described herein provide for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; display logic to receive a request to display the one or more frames of data, the request including a requested presentation time in which the one or more frames of data are to be displayed; and a display engine to present the one or more frames of data to the display device for display at a target presentation time, the target presentation time derived from the requested presentation time, wherein the display engine is to adjust a refresh rate of the display device based on the target presentation time of the one or more frames of data.

Abstract: One embodiment provides for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; a window manager to submit a request to display the one or more frames of data; a display engine to present the one or more frames of data to the display device for display; and display logic to receive the request to display the one or more frames of data and generate one or more display events for the display engine based on the request to display the one or more frames of data, wherein the display logic is to manage a set of statistics associated with the request.

Abstract: Prior art attempts to manage authority designation in GUI-based computer systems have set up various “handshaking” schemes between a graphics management system, such as a window server, and the various processes that are attempting to offer and accept access to each other. However, these schemes have certain limitations. In particular, when windows are used as the “fundamental basis” for implementing authority designation, events that should treat all content within a window identically can't do so because, even though all content in the window may appear to be “owned” by the window, there may be some other process that is actually rendering the content to some portion of the window. Thus, described herein are systems and methods to manage authority designation and event handling within “hierarchical” GUIs using “handshaking” schemes that are secure, sub-window granular, and that generalize recursively when applied to the various graphical layers used to construct the windows.

Abstract: Prior art attempts to manage authority designation in GUI-based computer systems have set up various “handshaking” schemes between a graphics management system, such as a window server, and the various processes that are attempting to offer and accept access to each other. However, these schemes have certain limitations. In particular, when windows are used as the “fundamental basis” for implementing authority designation, events that should treat all content within a window identically can't do so because, even though all content in the window may appear to be “owned” by the window, there may be some other process that is actually rendering the content to some portion of the window. Thus, described herein are systems and methods to manage authority designation and event handling within “hierarchical” GUIs using “handshaking” schemes that are secure, sub-window granular, and that generalize recursively when applied to the various graphical layers used to construct the windows.

Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

Abstract: This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both “relative” gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and “absolute” gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

Abstract: Systems, methods, and computer readable media to reduce latency in a graphics processing pipeline of an electronic device having a touch-sensitive input device and a display are described herein. In one embodiment, the method includes obtaining a temporal sequence of multi-touch scan data, processing the multi-touch scan data, determining an “optimal” time to deliver the processed multi-touch scan data to the relevant application(s) running on the device for processing, animating the resultant graphical changes that are determined by the application(s) based on the multi-touch input, and rendering the determined graphical changes to a frame buffer.

Abstract: Prior art attempts to manage authority designation in GUI-based computer systems have set up various “handshaking” schemes between a graphics management system, such as a window server, and the various processes that are attempting to offer and accept access to each other. However, these schemes have certain limitations. In particular, when windows are used as the “fundamental basis” for implementing authority designation, events that should treat all content within a window identically can't do so because, even though all content in the window may appear to be “owned” by the window, there may be some other process that is actually rendering the content to some portion of the window. Thus, described herein are systems and methods to manage authority designation and event handling within “hierarchical” GUIs using “handshaking” schemes that are secure, sub-window granular, and that generalize recursively when applied to the various graphical layers used to construct the windows.