Abstract: An augmented reality (AR) platform supports concurrent operation of multiple AR applications developed by third-party software developers. The AR platform may include an application programming interface (API) that third-party software developers can use to integrate features of the AR platform into the overall user experience of their AR applications. The AR platform includes a feature set having a variety of AR-specific features that interact with and are accessible to the AR applications or AR layers that define a collection of AR content.

Abstract: A near-touch interface is provided that utilizes stereo cameras and a series of targeted structured light tessellations, emanating from the screen as a light source and incident on objects in the field-of-view. After radial distortion from a series of wide-angle lenses is mitigated, a surface-based spatio-temporal stereo algorithm is utilized to estimate initial depth values. Once these values are calculated, a subsequent refinement step may be applied in which light source tessellations are used to flash a structure onto targeted components of the scene, where initial near-interaction disparity values have been calculated. The combination of a spherical stereo algorithm, and smoothing with structured light source tessellations, provides for a very reliable and fast near-field depth engine, and resolves issues that are associated with depth estimates for embedded solutions of this approach.

Abstract: Systems, methods, and computer readable media to promote a graphics context when rendering a digital image content with dynamic ranges and/or color gamut outside the current graphics context. Various embodiments render digital image content based on a graphics context that corresponds to an initial image rendering format. During the rendering process a determination is made that indicates the quality of the digital image content exceeds the graphics context's initial capabilities. The various embodiments can select an updated image rendering format based on the quality of the digital image and expand the graphic context's capabilties to correspond with the updated image rendering format.

Abstract: An information output system is provided which allows a user to recognize information appropriately while reducing or eliminating inconvenience given to the user. A content output system includes a content output controller 213 which selects output candidate content on the basis of the movement mode of the user and the content position, causes an output unit 25 to output supplementary information on the output candidate content when the relative positional relationship between the user and the output candidate content satisfies a predetermined first condition, and causes the output unit 25 to output the output candidate content when the relative positional relationship between the user and the output candidate content satisfies a predetermined second condition.

Abstract: A system and method to interconnect heterogeneous compute resources using graph based execution flow for image and video processing is disclosed. The system includes a mix of compute engines (SIMDs, fixed-function pipelines and hardware kernels) which work on pipelined streams of data based on programming instructions and/or configuration data. The nodes act as proxies for compute engines in graph and message based routing system to establish graph based flow control mechanism between these nodes. A message based routing mechanism to assign tasks to heterogeneous compute engines and receive their status in time-multiplexed manner thus allowing compute engines to be reused. A configuration method that allows hardware compute engines are uniquely configured based on graph node thus allows reusability and programming or selecting heterogeneous compute system for physical implementation using simple standard definition file generation method.

Abstract: Systems and methods for container access to graphics processing unit (GPU) resources are disclosed herein. In some embodiments, a computing system may include a physical GPU and kernel-mode driver circuitry, to communicatively couple with the physical GPU to create a plurality of emulated GPUs and a corresponding plurality of device nodes. Each device node may be associated with a single corresponding user-side container to enable communication between the user-side container and the corresponding emulated GPU. Other embodiments may be disclosed and/or claimed.

Abstract: Various approaches to performing ray-triangle intersection tests for single triangles or clusters of triangles are presented. In some example implementations, the triangles are organized in tetrahedral clusters, and the ray-triangle intersection tests use plane data for sets of planes of the tetrahedral clusters. A triangle can be represented as three bounding planes. Further, in some example implementations, the same three bounding planes of a tetrahedral cluster can be used to represent one, two, or three triangles that define faces of that tetrahedral cluster. With this configuration, overall memory costs are reduced when the same plane data is used to represent multiple triangles, and operations to check for ray-triangle intersections are still computationally efficient.

Abstract: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.

Abstract: Systems, apparatuses and methods may provide for technology that activates a first context on a graphics processor and detects a context switch condition with respect to the first context. Additionally, a second context may be activated, in response to the context switch condition, on the graphics processor while the first context is active on the graphics processor. In one example, activating the second context includes adding a group identifier to a plurality of threads corresponding to the second context and launching the plurality of threads with the group identifier on the graphics processor.

Abstract: This disclosure describes techniques that facilitate generating or modifying a template application that provides an application user with interactive experience within a Virtual Reality (VR) environment, an Augmented Reality (AR) environment, or a combination of both (i.e. MR environment). Moreover, this disclosure describes an XR collaboration system that permits an XR author to generate or modify an XR template that is presented to an application user via XR environment-enabled client device. Specifically, an XR author may use the XR collaboration application to add, change, or remove markers within an XR template along with associated virtual content. Further, the XR author may configure appearance criteria associated with markers to control the criteria and sequential order that markers may appear within an XR environment. Similarly, activation criteria may control the appearance and sequential order of virtual content that is associated with markers within the XR environment.

Abstract: A system and method for enhancing the rendering of one or more objects based on payment and account options. The system includes a computer infrastructure configured to control enhancement rendering of an object in a virtual universe by providing at least one augmentation attribute to a tag of the object. The method includes providing enhancement rendering of an object in a virtual universe by augmenting the object based on a status of a user viewing the object.

Abstract: A makeup simulation assistance apparatus includes: a simulation image generator that generates a simulation image obtained by superimposing, on a facial image picked up by an image pickup unit that picks up an image of a face of a user as the facial image, a makeup image showing a state of makeup as being applied to a facial component of the face; a simulation image output unit that outputs the generated simulation image; an interest degree sensor that senses an interest degree of the user for the makeup image, based on a facial image picked up by the image pickup unit when the simulation image is output; and an interest degree information output unit that outputs interest degree information indicative of the sensed interest degree.

Abstract: Systems and techniques are described for interaction plane rotation for manipulation of three-dimensional objects. A three-dimensional object can be displayed as a two-dimensional representation of the object, represented on an interaction plane and intersected by an object view vector that represents a point of view of the object through a viewing plane. An angle between the object view vector and the interaction plane is calculated and compared to a threshold value. A determination is made that the calculated angle is less than the threshold value, and a rotation magnitude that defines an amount of rotation of the interaction plane relative to a constant vector is calculated. The interaction plane is rotated relative to the constant vector in a rotation direction by the rotation magnitude. The rotated interaction plane can then be used to determine an intended relative movement between the object view vector and the three-dimensional object.

Abstract: An image processing device includes: a sub-image generation section, the sub-image generation section configured to generate a third sub-image by providing a peripheral image including at least a first region that is a transparent region around a first sub-image and to perform a filtering process on the entire or a part of a second sub-image including the first sub-image and the peripheral image; and a composition section configured to composite together a frame image and the third sub-image.

Abstract: Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.

Abstract: Eye tracking system incorporates and/or uses one or more silicon photomultiplier (SiPM) sensor and an infrared module of a microelectromechanical (MEMs)-based scanner. The infrared module emits a beam of photons, where at least some of the photons are directed towards a user's eye while the eye tracking system is being used. The SiPM sensor(s) capture a reflection that emanates off of the user's eye.

Abstract: A display method of a transparent display apparatus is provided. The display method includes sensing illumination around the transparent display apparatus; determining threshold lightness using the sensed illumination; correcting image data by changing lightness and chroma of colors which are brighter than the determined threshold lightness by a first method and changing at least one of lightness and chroma of colors which are the determined threshold lightness or less by a second method; and displaying the corrected image data on the transparent display apparatus.

Abstract: Multiple simultaneous representations are achieved through the capture essential geometry and topology in a master graph. Object information is captured in metadata associated with elements of this graph. An algorithm builds multiple domain specific representations based on the master graph and metadata. The summary of model objects is created based on metadata. Through this abstraction, desired representations (in this case for design and for manufacturing) may be generated and presented simultaneously with associativity.

Abstract: Methods for presenting symbolic expressions such as mathematical, scientific, or chemical expressions, formulas, or equations are performed by a computing device. One method includes: displaying a first portion of a symbolic expression within a first area of a display screen; while in a first state in which the first area is selected for aural presentation, aurally presenting first information related to the first portion of the symbolic expression; while in the first state, detecting particular user input; in response to detecting the particular user input, performing the steps of: transitioning from the first state to a second state in which a second area, of the display, is selected for aural presentation; determining second information associated with a second portion, of the symbolic expression, that is displayed within the second area; in response to determining the second information, aurally presenting the second information.

Abstract: A computing device receives, via a communication network, map data including (i) a description of geometries of map features and (ii) a first description of visual characteristics defined separately and independently of the description of the geometries. The computing device applies the visual characteristics to the geometries to render a first digital map. The computing device then receives, via the communication network, a second description of visual characteristics for application to the geometries previously provided to the computing device as part of the map data, and applies the second visual characteristics to the previously received geometries of the plurality of map features to render a second digital map.