Abstract: Aspects comprise systems implementing 3-D graphics processing functionality in a multiprocessing system. Control flow structures are used in scheduling instances of computation in the multiporcessing system, where different points in the control flow structure serve as points where deferral of some instances of computation can be performed in favor of scheduling other instances of computation. In some examples, the control flow structure identifies particular tasks, such as intersection testing of a particular portion of an acceleration structure, and a particular element of shading code. In some examples, the aspects are used in 3-D graphics processing systems that can perform ray tracing based rendering.

Abstract: In one implementation, a method of generating an affordance linked to an SR representation of an item is performed in a device including one or more processors, a non-transitory memory, and one or more displays. The method includes identifying an item; generating an affordance-item pair that corresponds to the item; detecting an input selecting the affordance-item pair; and displaying, on the one or more displays, a simulated reality (SR) environment that includes an SR representation of the item in response to detecting the user input selecting the affordance-item pair. In some implementations, the method includes obtaining an image data frame that includes the item.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality-based makeup. The program and method provide for receiving a request to present augmented reality content in association with an image captured by a device camera, the image depicting a user's face; accessing an augmented reality content item applying makeup to the face, the augmented reality content configured to generate a mesh for tracking plural regions of the face and to present available makeup products with respect to the plural regions; presenting the augmented reality content item in association with the face depicted in the image; receiving user input selecting a region of the plural regions; determining a set of available makeup products corresponding to the selected region; and updating presentation of the augmented reality content item based on the set of available makeup products.

Abstract: First content may be obtained in response to identifying a first physical element of a first object type. The first content may be associated with the first object type. Second content may be obtained in response to identifying a second physical element of a second object type. The second content may be associated with the second object type. The second physical element may be detected as being within a threshold distance of the first physical element. Third content may be generated based on a combination of the first content and the second content. The third content may be associated with a third object type that is different from the first object type and the second object type. The third content may be displayed on the display.

Abstract: Implementations of the subject technology provide for image composition for extended reality systems. Image composition may include combining virtual content from virtual images with physical content from images captured by one or more cameras. The virtual content and the physical content can be combined to form a composite image using depth information for the virtual content and the physical content. An adjustment mask may be generated to indicate edges or boundaries between virtual and physical content at which artifact correction for the composite image can be performed.

Abstract: A display apparatus includes a processing portion. The display apparatus is configured to display physical quantity related to a state of a machine apparatus. The processing portion is configured to display an image in which a plurality of pieces of partial time-series data extracted from time-series data related to the physical quantity are arranged in a state where time information is provided in the image, the time information being related to time in which the plurality of pieces of partial time-series data has been acquired.

Abstract: While displaying a view of a virtual environment that does not include a visual representation of a first portion of a physical object present in a physical environment in which a user is located, a computer system detects movement of the user in the physical environment. In accordance with a determination that the user is within a threshold distance of the first portion of the physical object which has an extent that is potentially visible to the user based on a field of view of the user for the virtual environment, the computer system changes an appearance of the view of the virtual environment in a manner that indicates a physical characteristic of the first portion of the physical object, without indicating a second portion of the physical object that is potentially visible to the user based on the field of view of the user.

Abstract: Methods, systems, and techniques are disclosed to determine a pixel count of an object of interest in a multidimensional digital environment, based on the texture of the multidimensional object considered as an object of interest. In one embodiment, a technique to determine a percentage of an object of interest displayed in a viewport is disclosed. The technique includes rendering using a shader function the object of interest with a first color, rendering, using the shader function, the remainder of a scene displayed on the viewport with a second color, and determining a pixel count of pixels rendered with the first color to determine the percentage of an object of interest displayed on the viewport.

Abstract: Using various embodiments, methods and systems to determine viewability metrics of a multidimensional object in a multidimensional digital environment are described. In one embodiment, a system is configured to render a viewport of a multidimensional digital environment displayed on a graphical user interface to determine a screen coverage metric of an object of interest on the viewport. Thereafter, the system is configured to render the viewport of the multidimensional digital environment displayed on the graphical user interface to determine a metric of visibility of the object of interest on the viewport.

Abstract: An electronic sports playbook and video annotation system includes a device with a memory coupled to a processor that stores instructions that, when executed by the processor, cause the processor to generate sports playbook content based on coordinate or image data. The processor is configured to detect an object (e.g., a player, etc.) on a surface (e.g., court image, or play image such as a static play drawing or video recording frame), detect a drawing of a path relating to the object (e.g., by user input device or with image processing, machine learning, or other heuristic techniques, etc.), and determine an action (e.g., a pass, a dribbling, a cut, a screen, a handoff, etc.) associated with the object based on at least an attribute of the object (e.g., does the player have the ball?, etc.) and detected path relating to the object.

Abstract: Embodiments of the present disclosure disclose image processing methods and apparatuses, image devices, and storage media. The image processing method includes: obtaining an image; obtaining the feature of the limb of the body based on the image, where the limb includes the upper limb and/or the lower limb; determining first-type movement information of the limb based on the feature; and controlling the movement of the limb of a controlled model according to the first-type movement information.

Abstract: Systems and methods for generating a graphically animated audience are disclosed. Biometric data is captured via a sensor during display of content via a first device. The biometric data is stored in association with metadata for the content, and is mapped to a graphical representation. Based on the mapping of the biometric data to the graphical representation and the metadata, a graphical animation is generated for display in synchronization with displaying of the content via a second device.

Abstract: Provided is an information providing method in which a terminal apparatus including an imaging unit and a display unit displays, on the display unit, an image of a vehicle interior captured by the imaging unit. A plurality of devices are installed in the vehicle interior and classified into a plurality of types. The information providing method includes an image acquisition step of acquiring the image of the vehicle interior captured by the imaging unit, and a display step of displaying the image on the display unit, and in a case where at least one of the plurality of devices is included in the image, displaying a graphic corresponding to the device in a superimposed manner on the device and also displaying information indicating a type to which the device belongs.

Abstract: In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.

Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.

Abstract: A method includes receiving an image of a product, obtaining content relevant to using the product, and displaying the content in an augmented reality view of the product by overlaying the content on the image of the product on a display device.

Abstract: In one implementation, a method of displaying overlapping objects is performed at a device including an optical see-through display, one or more processors, and a non-transitory memory. The method includes obtaining a request to display a first object in front of a second object. The method includes modifying a transparency of the first object in a region corresponding to an overlap between the first object and the second object. The method includes displaying the first object in front of the second object while maintaining visibility of the second object through the overlap between the first object and the second object based on the modified transparency.

Abstract: A first obtaining unit obtains two images obtained by capturing images of an inspection target object under different capturing environments with different illumination conditions inputted by a user. A second obtaining unit obtains area information that specifies two types of areas set by the user regarding an area in each image. The two types of areas include a reference area serving as a reference for comparison between the areas and a comparison target area serving as a target of comparison. A converting unit generates color conversion parameters for carrying out color conversion such that a color value of the reference area in one image coincides with a color value of the reference area in the other image. A deriving unit derives a color difference between the reference area and the comparison target area regarding each of the two images.

Abstract: A context processing unit receives an environmental signal from a registration unit of a motor vehicle. The environmental signal describes an item of information, independent of a movement direction of the motor vehicle, regarding an event in an environment of the motor vehicle. The event establishes a predetermined thematic context of media content of an output file. The predetermined media content of the output file is changed in dependence on the thematic context of the media content, so that a virtual environment described by the changed media content takes into consideration the information of the event in the environment of the motor vehicle with respect to context. The output file with the changed media content is transmitted to a display unit of an output device which outputs the output file.

Abstract: An aspect is a system and method that includes determining virtual try-on display adjustment information responsive to receiving one or more digital images taken upon application of a calibration cosmetics product, generating virtual try-on display parameters for modifying a digital try-on experience based at least in part on the virtual try-on display adjustment information, and generating one or more instances of a modified virtual try-on experience on a user interface based on the virtual try-on display parameters.