Abstract: Embodiments of the disclosure provide a color correction method and a color correction device. The method includes: obtaining native gamma information and native color point information of a display; obtaining target gamma information and target color point information of a target color space; obtaining a gamma correction parameter associated with the display based on the native gamma information and the target gamma information; determining a first pseudo gamma parameter based on the target gamma information; determining a second pseudo gamma parameter based on an inverse gamma operation of the target gamma information; determining a pseudo color space conversion matrix based on the native color point information and the target color point information; and updating a 3D lookup table of the display based on the first pseudo gamma parameter, the pseudo color space conversion matrix, and the second pseudo gamma parameter in sequence.

Abstract: The present application discloses a method and apparatus for displaying a virtual landscape picture, a storage medium, and an electronic device. The method includes acquiring a plurality of landscape layer types comprised in the target landscape area to be displayed and determining a type weight corresponding to each landscape layer type in the plurality of landscape layer types; screening at least one target landscape layer type with a corresponding type weight which satisfies a condition from the plurality of landscape layer types, and acquiring an index value of a landscape layer corresponding to each of the screened at least one target landscape layer type; and sequentially storing the index value in each image color channel of the landscape layer index map to obtain the landscape layer index map corresponding to the target landscape area to be displayed.

Abstract: Aspects of this disclosure provide techniques for generating a viseme and corresponding intensity pair. In some embodiments, the method includes generating, by a server, a viseme and corresponding intensity pair based at least on one of a clean vocal track or corresponding transcription. The method may include generating, by the server, a compressed audio file based at least on one of the viseme, the corresponding intensity, music, or visual offset. The method may further include generating, by the server or a client end application, a buffer of raw pulse-code modulated (PCM) data based on decoding at least a part of the compressed audio file, where the viseme is scheduled to align with a corresponding phoneme.

Abstract: Certain aspects of the present disclosure provide techniques for determining a pose of a three-dimensional deformable object. Embodiments include providing one or more inputs to a machine learning model based on a computer-generated three-dimensional deformable object that has a known pose. Embodiments include determining, based on one or more outputs from the machine learning model in response to the one or more inputs, a two-dimensional signature of the computer-generated three-dimensional deformable object. Embodiments include associating the two-dimensional signature with the known pose of the computer-generated three-dimensional deformable object. Embodiments include determining a respective pose of an actual three-dimensional deformable object based on an image of the actual three-dimensional deformable object and the associating.

Abstract: A system for improving a discovery process for a virtual environment, the system comprising an environment discovery unit operable to perform a discovery process comprising navigation of the virtual environment and identification of one or more aspects of the virtual environment, a performance analysis unit operable to evaluate the effectiveness of the discovery process, and a discovery update unit operable to modify future operation of the environment discovery unit in dependence upon the evaluation.

Abstract: An electronic device and method are disclosed. The electronic device includes a first and second camera, display, memory and processor. The processor implements the method, including acquiring image data of an external environment via the first camera, detecting a plurality of objects included in the image data, identifying a first object corresponding to the detected gaze among the detected plurality of objects, configuring a first precision for spatial mapping of the identified first object and a second precision of at least one other object from among the detected plurality of objects, wherein the first precision is higher than the second precision, executing 3D spatial mapping on the image data using the first precision for the identified first object and the second precision for the at least one other object, and displaying a 3D space generated based on the image data and the spatial mapping.

Abstract: Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and a table of eyelid motion identifiers and corresponding actions performable on the object in the extended reality environment is stored in memory. An eyelid motion is detected by using a sensor, and the detected eyelid motion is matched to one of the stored eyelid motion identifiers. An updated version of the extended reality environment, based on the action that corresponds to the matched eyelid motion, is generated for display, in response to matching the detected eyelid motion to one of the stored eyelid motion identifiers.

Abstract: An information processing apparatus includes at least one memory storing instructions and at least one processor that, upon execution of the instructions, is configured to operate as an instruction acquisition unit configured to acquire an instruction with respect to a virtual object in a mixed reality space from a user who is one of a plurality of users in the mixed reality space, a mode determination unit configured to determine, based on the acquired instruction, a display mode of the virtual object for another user in the mixed reality space, a viewpoint determination unit configured to determine, based on the determined display mode, a viewpoint with respect to the virtual object in the mixed reality space, and an image generation unit configured to generate an image of the mixed reality space including the virtual object viewed from the determined viewpoint.

Abstract: A method for creating a texture from input images, thereby removing representations of objects from the texture, the method comprising performing semantic segmentation in a plurality of digital input images with a plurality of semantic classes, at least one of the semantic classes relating to a target object class; identifying, in at least a first input image, one or more possible instances of representations of objects belonging to the target object class, each possible instance being constituted by a plurality of contiguous instance pixels of the image pixels; determining whether the instance pixels are target pixels, target pixels being pixels constituting a representation of an object belonging to the target object class; and replacing target pixels in the texture with replacement pixels derived from one or more of the plurality of digital input images.

Abstract: A system and method are disclosed for identifying a user based on the classification of user movement data. An identity verification system receives a sequence of motion data characterizing movements performed by a target user. The sequence of motion data is received as a point cloud of the motion data. The point cloud is input a machine-learned model trained based on manually labeled point clusters of a training set of motion data that each represent a movement. The machine-learned model identifies a movement represented by the point cloud of the motion data and assigns a label describing the movement the point cloud. The system generates a labeled representation of the sequence of motion data comprising the label identifying a portion of the sequence of motion data corresponding to the identified movement.

Abstract: A mechanism that makes it possible to efficiently specify an important region of a moving image including a dynamic content. An information processor including a control unit that recognizes a motion of an operator with respect to an operation target in a moving image and specifies an important region of the operation target in the moving image on a basis of an operation position of the operator.

Abstract: In a display system configured to display images at multiple depth planes, images perceived to be substantially full color or multi-colored may be formed using component color images that are distributed in unequal numbers across a plurality of depth planes. The distribution of component color images across the depth planes may vary based on color. In some embodiments, a display system includes a stack of waveguides that each output light of a particular color, with some colors having fewer numbers of associated waveguides than other colors. The stack of waveguides may include multiple pluralities of different numbers of waveguides, each plurality configured to produce an image by outputting light corresponding to a particular color. A display controller can introduce blur and/or change pixel size for images to be presented for at least one depth plane, based on the contents of images.

Abstract: A method comprises: accessing animation graphics files and a mask graphics file; generating first binary sequences corresponding to the animation graphics files, and generating a second binary sequence corresponding to the mask graphics file; and outputting the first binary sequences and the second binary sequence to hardware controlling an array of electrical components.

Abstract: The present invention relates to a computer-implemented medical method, a computer program and a medical system (1) for providing, in a medical environment, an AR-overlay that is projected into the field of view provided by an AR-device (4) as a function of the characteristics of a user's (5) view with respect to an observed object (6).

Abstract: Provided herein are exemplary embodiments directed to a method for creating digital media, including the placing the digital media in a computer graphics environment, the computer graphics environment further comprising visually perceptible elements appearing as real objects placed in a real world setting, and viewing the digital media when at the real world setting. Various exemplary systems include an augmented reality and virtual reality server connected to a network, and a client device connected to the network, the client device having an augmented reality and virtual reality application. Further exemplary systems include a body or motion sensor connected to the client device and/or an augmented reality and virtual reality interface connected to the client device.

Abstract: A system may provide for searching terrain data of real-world locations based on input representing a terrain for a game world. The system may receive terrain inquiry data including height data for terrain of a game world, generate an inquiry descriptor based on the terrain inquiry data at least in part by applying a plurality of filters to the terrain inquiry data, the inquiry descriptor including a plurality of inquiry descriptor values corresponding to the plurality of filter and determine, based on the inquiry descriptor and respective sample descriptors of one or more terrain samples corresponding to terrain of real-world locations, one or more matching terrain samples.

Abstract: A method and system for computing one or more outputs of a neural network having a plurality of layers is provided. The method and system can include determining a plurality of sub-computations from total computations of the neural network to execute in parallel wherein the computations to execute in parallel involve computations from multiple layers. The method and system also can also include avoiding repeating overlapped computations and/or multiple memory reads and writes during execution.

Abstract: A computer-implemented method for clinical workspace simulation includes capturing a real-world environment by an imaging device of an augmented reality headset and generating a composite view by rendering a first virtual object relative to a surgical table in the real-world environment. Captured real-world environment and the rendered first virtual object are combined in the composite view, which is displayed on a display of the augmented reality headset worn by a user.

Abstract: Embodiments of the present invention provide a system for processing and integrating real-time environment instances into virtual reality live streams. The system is configured for determining that a user is accessing a virtual environment, capturing real-time environment instance associated with the virtual environment via one or more capturing devices, creating a neutral environment template based on processing the real-time environment instance, embedding one or more preferential objects associated with the user into the neutral environment template to generate a preferred environment template, and instantaneously integrating the preferred environment template into a virtual reality live stream associated with the virtual environment in real-time.

Abstract: A surgical system is disclosed comprising a processor and a memory storing instructions executable by the processor to receive imaging data from a surgical visualization system, identify a critical structure within a patient based on the imaging data received from the surgical visualization system, transmit a margin signal based on the identified critical structure, measure a size of an anatomical structure of the patient based on the imaging data, identify information about a surgical instrument of a plurality of surgical instruments, customize an operational parameter of a surgical instrument of the plurality of surgical instruments, and provide electrosurgical energy to electrosurgical instruments of the plurality of surgical instrument. A display is configured to display a digital representation of the critical structure on the display. The display is configured to display a resection margin around the critical structure. The resection margin is generated based on the margin signal.