Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to perform a first portion of an image rendering process to generate intermediate graphics data and send the intermediate graphics data to the second computing device. The second GPU is configured to perform a second portion of the image rendering process to render an image from the intermediate graphics data. The first computing device may be a video game console, and the second computing device may be a virtual reality (VR) headset that warps the rendered image to produce a stereoscopic image pair.

Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to determine graphics primitives of a computer graphics scene that are visible from a camera viewpoint, generate a primitive atlas that includes data representing the graphics primitives that are visible from the camera viewpoint, and shade the visible graphics primitives in the primitive atlas to produce a shaded primitive atlas. The second GPU is configured to render an image using the shaded primitive atlas.

Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to perform a first portion of an image rendering process to generate intermediate graphics data and send the intermediate graphics data to the second computing device. The second GPU is configured to perform a second portion of the image rendering process to render an image from the intermediate graphics data. The first computing device may be a video game console, and the second computing device may be a virtual reality (VR) headset that warps the rendered image to produce a stereoscopic image pair.

Abstract: A method for defining a sensor model includes determining a probability of obtaining a measurement from multiple potential causes in a field of view of a sensor modeled based on a stochastic map. The stochastic map includes a mean occupancy level for each voxel in the stochastic map and a variance of the mean occupancy level for each pixel. The method also includes determining a probability of obtaining an image based on the determined probability of obtaining the measurement. The method further includes planning an action for a robot, comprising the sensor, based on the probability of obtaining the image.

Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Abstract: A method, an apparatus, and a computer-readable medium for wireless communication are provided. In one aspect, an example method may include determining to control a bit rate of a content encoder. The method may include generating a first number of shaded texture atlases for use in rendering a second number of frames by a second device based on the determination to control the bit rate of the content encoder. Each respective shaded texture atlas may include a respective plurality of shaded primitives. The method may include encoding, by the content encoder of the first device, a first shaded texture atlas of the first number of shaded texture atlases. The method may include transmitting, by the first device, the encoded first shaded texture atlas to the second device.

Abstract: A method, an apparatus, and a computer-readable medium for wireless communication are provided. In one aspect, an example method may include determining to control a bit rate of a content encoder. The method may include generating a first number of shaded texture atlases for use in rendering a second number of frames by a second device based on the determination to control the bit rate of the content encoder. Each respective shaded texture atlas may include a respective plurality of shaded primitives. The method may include encoding, by the content encoder of the first device, a first shaded texture atlas of the first number of shaded texture atlases. The method may include transmitting, by the first device, the encoded first shaded texture atlas to the second device.

Abstract: A mobile device determines a vision based pose using images captured by a camera and determines a sensor based pose using data from inertial sensors, such as accelerometers and gyroscopes. The vision based pose and sensor based pose are used separately in a visualization application, which displays separate graphics for the different poses. For example, the visualization application may be used to calibrate the inertial sensors, where the visualization application displays a graphic based on the vision based pose and a graphic based on the sensor based pose and prompts a user to move the mobile device in a specific direction with the displayed graphics to accelerate convergence of the calibration of the inertial sensors. Alternatively, the visualization application may be a motion based game or a photography application that displays separate graphics using the vision based pose and the sensor based pose.

Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to perform a first portion of an image rendering process to generate intermediate graphics data and send the intermediate graphics data to the second computing device. The second GPU is configured to perform a second portion of the image rendering process to render an image from the intermediate graphics data. The first computing device may be a video game console, and the second computing device may be a virtual reality (VR) headset that warps the rendered image to produce a stereoscopic image pair.

Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to determine graphics primitives of a computer graphics scene that are visible from a camera viewpoint, generate a primitive atlas that includes data representing the graphics primitives that are visible from the camera viewpoint, and shade the visible graphics primitives in the primitive atlas to produce a shaded primitive atlas. The second GPU is configured to render an image using the shaded primitive atlas.

Abstract: An example system includes a first computing device comprising a first graphics processing unit (GPU) implemented in circuitry, and a second computing device comprising a second GPU implemented in circuitry. The first GPU is configured to perform a first portion of an image rendering process to generate intermediate graphics data and send the intermediate graphics data to the second computing device. The second GPU is configured to perform a second portion of the image rendering process to render an image from the intermediate graphics data. The first computing device may be a video game console, and the second computing device may be a virtual reality (VR) headset that warps the rendered image to produce a stereoscopic image pair.

Abstract: Embodiments of the invention disclose methods, apparatuses, systems, and computer-readable media for taking and sharing pictures of objects of interest at an event or an occasion. A device implementing embodiments of the invention may enable a user to select objects of interest from a view displayed by a display unit coupled to the device. The device may also have pre-programmed objects including objects that the device detects. In addition, the device may detect people using the users' social networks by retrieving images from social networks like Facebook® and LinkedIn®.

Abstract: A method substantially simultaneously plans a path and maps an environment by a robot. The method determines a mean of an occupancy level for a location in a map. The method also includes determining a probability distribution function (PDF) of the occupancy level. The method further includes calculating a cost function based on the PDF. Finally, the method includes simultaneously planning the path and mapping the environment based on the cost function.

Abstract: Embodiments of the invention disclose methods, apparatuses, systems, and computer-readable media for taking and sharing pictures of objects of interest at an event or an occasion. A device implementing embodiments of the invention may enable a user to select objects of interest from a view displayed by a display unit coupled to the device. The device may also have pre-programmed objects including objects that the device detects. In addition, the device may detect people using the users' social networks by retrieving images from social networks like Facebook® and LinkedIn®.

Abstract: A master device images an object device and uses the image to identify the object device. The master device determines whether the object device is cable of being interfaced with based on the image and registers with the object device for interfacing. The master device then automatically interfaces with the identified object device. The master device may receive broadcast data from the object device including information about the visual appearance of the object device and use the broadcast data in the identification of the object device. The master device may retrieve data related to the object device and display the related data, which may be display the data over the displayed image of the object device. The master device may provide an interface to control the object device or be used to pass data to the object device.

Abstract: A mobile platform efficiently processes image data, using distributed processing in which latency sensitive operations are performed on the mobile platform, while latency insensitive, but computationally intensive operations are performed on a remote server. The mobile platform acquires image data, and determines whether there is a trigger event to transmit the image data to the server. The trigger event may be a change in the image data relative to previously acquired image data, e.g., a scene change in an image. When a change is present, the image data may be transmitted to the server for processing. The server processes the image data and returns information related to the image data, such as identification of an object in an image or a reference image or model. The mobile platform may then perform reference based tracking using the identified object or reference image or model.

Abstract: Disclosed are a system, apparatus, and method for depth and color camera image synchronization. Depth and color camera input images are received or otherwise obtained unsynchronized and without associated creation timestamps. An image of one type is compared with an image of a different type to determine a match for synchronization. Matches may be determined according to edge detection or depth coordinate detection. When a match is determined a synchronized pair is formed for processing within an augmented reality output. Optionally the synchronized pair may be transformed to improve the match between the image pair.

Abstract: Systems and methods are provided for alternating projection of content and capturing an image. The method includes steps of projecting, by a projection device, content at a first rate, projecting, by the projection device, a capture frame at a second rate, and capturing, by an image capture device, an image including the capture frame at the second rate, wherein capturing the image comprises capturing the image when the capture frame is projected. Systems and methods provided herein may provide increased tracking accuracy by a projecting a capture frame that does not obscure features in the image.