Abstract: An information processing device according to the present technology includes a transmission processing unit that performs processing for transmitting device state information relating to a selected item to an external device of a request source, in response to a request for the device state information relating to the selected item that has been made by the external device, by using code information indicating the selected item, the selected item being an item that has been selected by a user for the device state information indicating a state of a device.

Abstract: A display module comprises light-emitting elements coupled to one or more mounting structures and grouped Into a pixels in a pixel array on a display face to display textual, graphical, or video Information, with each pixel comprising a grouping of one or more light-emitting elements. A face cover Is mounted to the mounting structure and is positioned in front of at least a portion of the display face. The face cover comprises a plurality of moguls arranged in a mogul array with each mogul positioned in front of and proximate to a corresponding one of the pixels so that the mogul covers at least a portion of the corresponding pixel, and one or more light-emitting openings in each mogul, each positioned relative to one or more corresponding light-emitting element of the pixel to permit light emitted from the corresponding one or more light-emitting elements to pass through the mogul.

Abstract: Neutral avatars are neutral with reference physical characteristics of the corresponding user, such as weight, ethnicity, gender, or even identity. Thus, neutral avatars may be desirable to use in various copresence environments where the user desires to maintain privacy with reference to the above-noted characteristics. Neutral avatars may be configured to convey, in real-time, actions and behaviors of the corresponding user without using literal forms of the user's actions and behaviors.

Abstract: Generating an expressive avatar includes obtaining an expressive image of a face, and determining at least one target levels of detail for a representation of the face. A trained convolutional neural network model is applied to the expressive image of the face to obtain a mesh representation of the face at each of the at least one target levels of detail, wherein each convolution in the trained convolutional neural network model provides a unique level of detail, and an avatar is generated based on the mesh representation of the face at least of the at least one target levels of detail.

Abstract: Provided is an information processing device that includes a first self-position estimation unit that performs a first self-position estimation on the basis of an environment image whose subjects are surroundings of the information processing device. The information processing device further includes a second self-position estimation unit that performs a second self-position estimation on the basis of a detection plane detected from the environment image and object information generated in advance and related to a shielding AR object having a planar shape to correct a display position of a non-shielding AR object according to a result of the first self-position estimation on the basis of a result of the second self-position estimation.

Abstract: Methods and tessellation modules for tessellating a patch to generate tessellated geometry data representing the tessellated patch. Received geometry data representing a patch is processed to identify tessellation factors of the patch. Based on the identified tessellation factors of the patch, tessellation instances to be used in tessellating the patch are determined. The tessellation instances are allocated amongst a plurality of tessellation pipelines that operate in parallel, wherein a respective set of one or more of the tessellation instances is allocated to each of the tessellation pipelines, and wherein each of the tessellation pipelines generates tessellated geometry data associated with the respective allocated set of one or more of the tessellation instances.

Abstract: Computing an image depicting a face having an expression with wrinkles is described. A 3D polygon mesh model of a face has a non-neutral expression. A tension map is computed from the 3D polygon mesh model. A neutral texture, a compressed wrinkle texture and an expanded wrinkle texture are computed or obtained from a library. The neutral texture comprises a map of the first face with a neutral expression. The compressed wrinkle texture is a map of the first face formed by aggregating maps of the first face with different expressions using the tension map, and the expanded wrinkle texture comprises a map of the first face formed by aggregating maps of the first face with different expressions using the tension map. A graphics engine may be used to apply the wrinkle textures to the 3D model according to the tension map; and render the image from the 3D model.

Abstract: Various implementations disclosed herein include devices, systems, and methods that tracks an electronic device by fusing tracking algorithms. In some implementations, instructions stored on a computer-readable medium are executable to cause obtaining pairs of first position data corresponding to a position of the electronic device in a first coordinate system obtained using a first technique and second position data in a second coordinate system obtained using a second technique. In some implementations, transformations for the respective pairs are determined that provide a positional relationship between the first coordinate system and the second coordinate system. In some implementations, a subset of the pairs is identified based on the transformations, and a combined transformation is determined based on the subset of the transformations. In some implementations, content is provided on an electronic device based on the combined transformation.

Abstract: User interface systems for sterile fields and other working environments are disclosed herein. In some embodiments, a user interface system can include a projector that projects a graphical user interface onto a data board or other substrate disposed within a working environment. The system can also include a camera or other sensor that detects user interaction with the data board or substrate. Detected user interactions can be processed or interpreted by a controller that interfaces with equipment disposed outside of the working environment, thereby allowing user interaction with such equipment from within the working environment. The data board can be an inexpensive, disposable, single-use component of the system that can be easily sterilized or another component suitably prepared for use in a sterile field.

Abstract: A method of coloring a target image includes generating at least one target mask including a part of the target image by using a first artificial neural network, which has been trained; generating at least one reference mask that corresponds to the at least one target mask and includes at least part of a reference image, by using the first artificial neural network; generating at least one colored target mask by coloring the at least one target mask in reference to the color of the at least one reference mask; and generating a colored target image from the target image, the at least one target mask, and the at least one colored target mask by using a second artificial neural network, which has been trained.

Abstract: An exemplary method includes processing, by a virtual avatar processing system, a plurality of video conference recordings generated by a video conference platform to select user image information associated with a plurality of users that participated in video conference sessions represented in the plurality of video conference recordings. The exemplary method further includes generating, based on the user image information, a template model that is generic to a plurality of users, selecting, from the user image information and based on predefined selection criteria, video frames that depict a user included in the plurality of users, and generating a virtual avatar model of the user by applying the selected video frames to the template model. A visual representation of the virtual avatar model may be configured to be used in future video conference sessions in place of a live video image of the user.

Abstract: Apparatus and method for stack access throttling for synchronous ray tracing. For example, one embodiment of an apparatus comprises: ray tracing acceleration hardware to manage active ray tracing stack allocations to ensure that a size of the active ray tracing stack allocations remains within a threshold; and an execution unit to execute a thread to explicitly request a new ray tracing stack allocation from the ray tracing acceleration hardware, the ray tracing acceleration hardware to permit the new ray tracing stack allocation if the size of the active ray tracing stack allocations will remain within the threshold after permitting the new ray tracing stack allocation.

Abstract: Systems and methods are described for improved sharing of an experience between users. A first image captured using a first user device is received by control circuitry. A second image captured using a second user device is received by the control circuitry. Control circuitry determines a first set of elements of the first image. Control circuitry determines a second set of elements of the second image. Control circuitry determines whether at least one element of the first set of elements corresponds to at least one element of the second set of elements. Control circuitry determines that a transient element is present in the first set of elements and is not present in the second set of elements. Control circuitry generates for display the transient element on the second user device.

Abstract: A computer-implemented method includes executing an initial version of computer game software, the executing step including rendering computer game video images for display; displaying the video images using a head mountable display (HMD); detecting user operation of one or more user controls to perform colour grading adjustments; applying the colour grading adjustments to the video images rendered by the rendering step; and generating colour grading data to be associated with a revised version of the computer game software; in which the executing step and the applying step are performed by different respective data processing apparatus.

Abstract: Novel viewpoints may be rendered using arrays of camera images with synthesized viewpoints. Different viewpoints of a scene may be captured via image sensors. Depth information may be determined for the captured viewpoints. An array of images may be generated that includes synthetic viewpoints generated from the captured viewpoints and depth information. A request to render a novel viewpoint may be received. Then novel viewpoint may be rendered using the array of images with synthetic viewpoints.

Abstract: A method of image retargeting is provided. The method includes obtaining a source image, obtaining a target size for a retargeted image based on the source image, generating a two-dimensional importance map for the source image, generating, based on the two-dimensional importance map and the target size, a warping mesh having a distortion metric below a threshold value, determining whether a size of the warping mesh corresponds to the target size, and based on the size of the warping mesh being determined to correspond to the target size, rendering the retargeted image by applying the warping mesh to the source image.

Abstract: Apparatus and method for efficient BVH construction. For example, one embodiment of an apparatus comprises: a memory to store graphics data for a scene including a plurality of primitives in a scene at a first precision; a geometry quantizer to read vertices of the primitives at the first precision and to adaptively quantize the vertices of the primitives to a second precision associated with a first local coordinate grid of a first BVH node positioned within a global coordinate grid, the second precision lower than the first precision; a BVH builder to determine coordinates of child nodes of the first BVH node by performing non-spatial-split binning or spatial-split binning for the first BVH node using primitives associated with the first BVH node, the BVH builder to determine final coordinates for the child nodes based, at least in part, on an evaluation of surface areas of different bounding boxes generated for each of the child node.

Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.

Abstract: There is provided an image display apparatus that makes it possible to automatically orient a front face of a three-dimensional object represented by a three-dimensional image to a user. There are provided: a display unit that displays the three-dimensional image, by which the three-dimensional object appears to exist in a space partitioned by members configuring an outer surface, to be visually recognizable from a plurality of circumferential directions; a direction estimation section that estimates a direction in which a user exists as seen from the display unit; and a display control section that orients a front face of the three-dimensional object displayed by the display unit in the direction in which the user exists estimated by the direction estimation section.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing video communications with dynamic virtual backgrounds within a communication platform. Based on the contextual information of a meeting, the system selects a virtual background to be used for the meeting. During, a video meeting, the system generates for display, on one or more client devices, a composite video depicting the imagery of the user overlaid on imagery of the selected virtual background.