Abstract: The present invention relates to a method of streaming interactive computer graphics from a server to a client device. The method includes the steps of: intercepting graphics instructions transmitted from an application destined for a graphical processing unit (GPU) at the server; processing the graphics instructions to generate graphics data at the server; generating index information for, at least, some of the graphics data at the server; transmitting the index information in place of the graphics data to a client device; extracting corresponding graphics data stored at the client device utilizing the index information; and rendering computer graphics at a graphical processing unit (GPU) at the client device using the corresponding graphics data. A system for streaming interactive computer graphics is also disclosed.

Abstract: A computer-implemented method for tracking laboratory resources is disclosed. The laboratory resource comprises an identification feature. The method comprises an identification step comprising detecting the laboratory resource in the laboratory with an imaging sensor of an augmented reality device and identifying the laboratory resource with an identification unit of the augmented reality device by receiving identification information from the identification feature, a data retrieving step comprising retrieving information about the identified laboratory resource from a data server via a communication interface of the augmented reality device, and a tracking step comprising generating and displaying augmented reality information on a display device of the augmented reality device.

Abstract: Methods and devices for manipulating an image are described. The method comprises receiving image data, the image data including a first image obtained from a first camera and a second image obtained from a second camera, the first camera and the second camera being oriented in a common direction; identifying one or more boundaries of an object in the image data by analyzing the first image and the second image; and displaying a manipulated image based on the image data, wherein the manipulated image includes manipulation of at least a portion of the first image based on boundaries of the object.

Abstract: An information processing apparatus includes a processor and a memory connected to or incorporated in the processor. The processor acquires reference imaging device information corresponding to a position, an imaging direction, and an angle of view of a reference imaging device, and generates the virtual viewpoint image by using the reference imaging device information as a reference, on a condition that an instruction to start generating a virtual viewpoint image based on a plurality of images obtained by imaging an imaging region with a plurality of imaging devices is given.

Abstract: One embodiment provides a parallel processor comprising a hardware scheduler to schedule pipeline commands for compute operations to one or more of multiple types of compute units, a plurality of processing resources including a first sparse compute unit configured for input at a first level of sparsity and hybrid memory circuitry including a memory controller, a memory interface, and a second sparse compute unit configured for input at a second level of sparsity that is greater than the first level of sparsity.

Abstract: Embodiments are disclosed for a machine learning-based chroma keying process. The method may include receiving an input including an image depicting a chroma key scene and a color value corresponding to a background color of the image. The method may further include generating a preprocessed image by concatenating the image and the color value. The method may further include providing the preprocessed image to a trained neural network. The method may further include generating, using the trained neural network, an alpha matte representation of the image based on the preprocessed image.

Abstract: Incompatible graphics frameworks present a barrier to emulating applications of one operating system (guest OS) upon a computer system employing a different operating system (host OS) such as occurs with virtual machines. Accordingly, in order to address limitations of emulating guest OS graphic pipelines upon the host OS the inventors have established methodologies for cross-platform graphics pipeline emulation, thus enabling efficient implementations of cross-platform virtualization solutions, through the establishment of emulation keys to support generic and specific graphics pipelines together with caching sets of graphical pipelines for subsequent retrieval and execution.

Abstract: In certain embodiments, double-vision-related vision defects determinations or modifications may be facilitated. In some embodiments, a stimulus may be to be presented at a first time at a position on a first display for a deviating eye of a user (e.g., without a stimulus being presented on a second display of for a reference eye of the user) to cause the deviating eye to fixate on the position on the first display. A deviation measurement for the deviating eye may be determined based on an amount of movement of the deviating eye occurring upon the presentation on the first display for the deviating eye at the first time. In some embodiments, a modification profile associated with the user may be determined based on the deviation measurement, where the modification profile includes one or more modification parameters to be applied to modify an image for the user.

Abstract: A user may create an avatar and/or animated sequence illustrating a particular object or living being performing a certain activity, using images of portions of the object or living being extracted from a still image or set of still images of the object or living being.

Abstract: A user may create an avatar and/or animated sequence illustrating a particular object or living being performing a certain activity, using images of portions of the object or living being extracted from a still image or set of still images of the object or living being.

Abstract: Systems and methods are provided for dynamically adjusting a personal boundary of an avatar in an XR environment. The system identifies a first avatar in an extended reality (XR) environment based on rule data stored in a storage. In response to the system detecting that the first avatar has entered a portion of the XR environment at a communicable distance from a second avatar, the system does the following steps. The system determines an offensiveness rating of the first avatar. The system retrieves, from the storage, an offensiveness tolerance of the second avatar. The system compares the offensiveness rating of the first avatar and offensiveness tolerance of the second avatar. In response to determining, based on the comparing, that the offensiveness rating of the first avatar exceeds the offensiveness tolerance of the second avatar, the system automatically censors one or more messages from the first avatar to the second avatar.

Abstract: In some implementations, a computing device can simulate a virtual parallax to create three dimensional effects. For example, the computing device can obtain an image captured at a particular location. The captured two-dimensional image can be applied as texture to a three-dimensional model of the capture location. To give the two-dimensional image a three-dimensional look and feel, the computing device can simulate moving the camera used to capture the two-dimensional image to different locations around the image capture location to generate different perspectives of the textured three-dimensional model as if captured by multiple different cameras. Thus, a virtual parallax can be introduced into the generated imagery for the capture location. When presented to the user on a display of the computing device, the generated imagery may have a three-dimensional look and feel even though generated from a single two-dimensional image.

Abstract: A method of operating a surgical control system comprises generating an image of a surgical environment from a viewpoint of an imaging tool. The image includes a field of view. The method further comprises displaying the image on a display system configured to be mounted to a head of a user. The method further comprises detecting a movement of the head of the user and determining if the movement of the user's head is within a boundary corresponding to the field of view. The method further comprises, if the movement of the user's head is determined to be within the boundary: generating a changed image of the surgical environment from a changed viewpoint of the imaging tool; and displaying the changed image on the display system. The changed image includes a changed field of view corresponding to the detected movement of the user's head.

Abstract: A method is described for processing commands for a client computing device using a remote graphics processing unit server. The method includes receiving, by a display driver of the client computing device, a command from an application operating on the client computing device and compressing, by the display driver, the command to generate a compressed command. Compressing the command includes determining whether a resource associated with the command is available in a cache of the remote graphics processing unit server and replacing the resource with a reference to the resource, when the resource is available. The display driver transmits the compressed command to the remote graphics processing unit server for processing by a remote graphics processing unit (GPU) and receives data generated by the remote GPU based on processing the compressed command.

Abstract: A method comprising receiving a plurality of images of a scene captured by at least one drone; identifying features within the plurality of images; identifying similar images of the plurality of images based on the features identified within the plurality of images; comparing the similar images based on the features identified within the similar images to determine a proportion of features shared by the similar images; selecting a subset of the plurality of images that have a proportion of shared features that meets a predetermined range; generating a first 3D model of the scene from the subset of images using a first 3D model building algorithm; generating a second 3D model of the scene from the subset of images using a second 3D model building algorithm; computing errors for the first and second 3D models; and selecting as the model of the scene the first or second 3D model.

Abstract: Provided is an image processing method. The image processing method includes: acquiring first parameter information of a first display device; acquiring a first image currently displayed by a second display device; generating to-be-displayed content of the first display device based on the first parameter information and the first image; and displaying the to-be-displayed content by the first display device in a full screen fashion.

Abstract: Method for generating media content items on demand starts with a processor receiving an animation file including a first metadata based on an animation input. The animation file is associated with a media content identification. The processor generates puppets associated with frames in the animation file using the first metadata. The processor causes a puppet matching interface to be displayed on a client device. The puppet matching interface includes one of the puppets in a first pose. The processor receives a puppet posing input associated with a second pose from the client device. The processor causes the one of the puppets to be displayed in the second pose in the puppet matching interface by the client device. The processor can also generate a second metadata based on the puppet posing input. Other embodiments are disclosed herein.

Abstract: A computer-automated separation rules compliance method is disclosed. Separation rules that establish separation distance requirements between objects in a three-dimensional (3D) virtual environment are defined. Sample locations associated with at least some of the objects in the 3D virtual environment are specified. One or more of proximity and/or collision analysis is performed on the sample locations to determine separation distances between the objects. The determined separation distances are compared to the separation distance requirements. Objects in the 3D virtual environment that violate the separation rules based on said comparing are identified.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for fast incremental shared constants. In aspects, a CPU may determine/update shared constant data for a first draw call of a plurality of draw calls. The shared constant data, which may correspond to at least one shader, may be updated based on a draw call update for the first draw call. The CPU may communicate the updated shared constant data for the first draw call to a GPU. The GPU may receive, in at least one register, the updated shared constant data from the CPU and configure the at least one register based on the updated shared constant data corresponding to the draw call update of the first draw call of the plurality of draw calls.

Abstract: The technology disclosed relates to user interfaces for controlling augmented reality environments. Real and virtual objects can be seamlessly integrated to form an augmented reality by tracking motion of one or more real objects within view of a wearable sensor system using a combination a RGB (red, green, and blue) and IR (infrared) pixels of one or more cameras. It also relates to enabling multi-user collaboration and interaction in an immersive virtual environment. In particular, it relates to capturing different sceneries of a shared real world space from the perspective of multiple users. The technology disclosed further relates to sharing content between wearable sensor systems. In particular, it relates to capturing images and video streams from the perspective of a first user of a wearable sensor system and sending an augmented version of the captured images and video stream to a second user of the wearable sensor system.