Abstract: An image generation system and method for displaying an Augmented Reality “AR” image of a real-world environment having one of more objects located therein and one or more AR objects each corresponding to a respective object, the system comprising: a display on which the image of the real-world environment and the AR objects are displayed; a processing and control module configured to: receive, from one or more sensors, data relating to the real-world environment and objects therein; create the one or more AR objects from the objects by determining additional information relating to the object which is represented by at least one of symbols, annotations and fonts to be attached to the AR object to act as a displayed component: displaying the AR image comprising the real-world image and one or more AR objects; wherein the AR objects once created are stored for future retrieval based on a unique identifier for the AR object which remains active as long as the object is of interest.

Abstract: A device may include a processor configured to determine a first position of a physical camera in a physical environment, transmit the first position to a second device, obtain metadata of the physical camera, and cause a modification of a virtual camera of the second device based on the metadata. The processor is also configured to obtain, from the second device, at least one virtual image frame captured by the virtual camera placed at a second position in a computer-generated environment, and to obtain, from the physical camera, at least one image frame captured from the physical environment. The processor is also configured to generate a composite image frame including at least a portion of at least one virtual image frame composited with at least a portion of the at least one image frame, and display the composite image frame.

Abstract: Systems and methods are disclosed for generating edit captions based on layout representations. The system may access one or more reference layout representations associated with one or more reference images and a target layout representation associated with a target image. The system may compare the one or more reference layout representations with the target layout representation to determine semantic differences or correspondences. The system may identify one or more differences between the one or more reference images and the target image, the differences including modifications to objects, spatial relationships, or contextual features. The system may generate one or more edit captions based on the identified differences.

Abstract: A method of rendering 3D content in a mixed reality environment is disclosed. A volume camera is defined within first virtual environment. The volume camera is configured to capture a 3D volume of space. The defining includes setting parameters for a position or an orientation to be captured by the volume camera. A volume view transform is applied to the volume camera to establish a perspective of the volume camera within the 3D volume of space. The volume view transform is configured to define the position or the orientation relative to the 3D content in the 3D volume of space. Selected 3D content is processed within the 3D volume of space based on a configuration of the volume camera. The selected 3D content is rendered into a second virtual environment based on the configuration. The rendering includes adapting to a perspective of a user within the second virtual environment.

Abstract: A method, apparatus, and a non-transitory computer-readable medium storing program code for anti-aliasing images may be provided. The method may include obtaining a first edge pixel of an image in a high-dynamic range (HDR) space and determining a first scaling factor based on a local brightness environment of the first edge pixel. The method may also include determining a color ratio corresponding with the first edge pixel and scaling the color ratio to obtain a first color ratio. Then the first color value is obtained based on a color value of the first edge pixel, a color value of a target pixel, and the first color ratio, wherein the target pixel has a large color value difference from the first edge pixel among a plurality of surrounding pixels of the first edge pixel; and updating the first color value to the color value of the first edge pixel.

Abstract: A computer-implemented method includes receiving an image of an area, identifying an item in the area, determining an intended color of the item according to a predefined color code, analyzing the image for determining if the intended color of the item is diminished on and/or absent from the item, and outputting a mixed reality (MR) image of the area in which the intended color is overlayed on the item in response to determining that the intended color of the item is diminished and/or absent.

Abstract: An example device for presenting split-rendered media data includes a memory configured to store media data; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: send pose information representing a predicted pose of a user at a first future time to a split rendering server; receive an at least partially rendered image for the first future time and data associating the pose information with the at least partially rendered image from the split rendering server; and at a second future time, present a rendered image based on the partially rendered image.

Abstract: A see-through display method and a see-through display system are disclosed. The method includes the following steps. A user image is captured toward the front side of a display through a first image sensor, and a scene image is captured toward the rear side of the display through a second image sensor. User position information associated with the three-dimensional reference coordinate system is obtained according to the user image. Scene position information associated with the three-dimensional reference coordinate system is obtained according to the scene image. A viewing frustum is determined based on the user position information and a physical size of the display. A projection matrix of the viewing frustum is used to generate a display frame projected on the display plane of the display according to the scene position information. The display frame is output through the display to show the scene behind the display.

Abstract: A collaborative map building method is described in which if it is determined, for example, by a SLAM network edge, that a portion of a map corresponding to a target area of a first region is incomplete, a request to a device is transmitted to move toward the target area. The map is updated based on the scan performed by the device in the target area. Also described is a virtual image guide embodiment in which upon determining that a map of a target area of the first region is incomplete, a virtual guide image is generated on a device to appear at a target location. The user of the device is guided to the target area by the virtual image.

Abstract: An information processing apparatus includes: an acquirer configured to acquire state information regarding a state of an avatar in a virtual space, the avatar corresponding to a first user; and a display controller configured to: cause a display used by a second user to display a first character as the avatar based on the state information satisfying a first condition regarding the state; and cause the display to display a second character as the avatar based on the state information satisfying a second condition regarding the state without satisfying the first condition, the second character being determined based on a relationship between the first user and the second user.

Abstract: A video playing method and apparatus, an electronic device, a storage medium, a computer program product, and a computer program. A live-action shooting image is acquired, a display position of a target image in the live-action shooting image is detected and determined, a target video associated with the target image is acquired, and the target video is played at the display position in the live-action shooting image, so that the production cycle and costs required when presenting information using an augmented reality display technique can be reduced; in addition, more presentation channels are provided for users to present video information, so that the users can have enhanced interactive experience and visual experience.

Abstract: There is provided an information processing apparatus and method capable of suppressing a reduction in the quality of 3D data due to encoding and decoding. By dividing a mesh representing an object having a three-dimensional structure into patches, pair information indicating a pair constituted by a single vertex of the mesh or a plurality of vertices of a patch generated from a plurality of vertices at the same position is generated, and the generated pair information is encoded. The present disclosure may be applied to, for example, an information processing apparatus, an electronic device, an information processing method, a program or the like.

Abstract: In some implementations, a computing device can present augmented reality (AR) labels in an AR video stream. For example, the computing device can obtain route information for a route requested by a user and can determine locations along the route for placing candidate AR labels. The computing device can determine the precise location of the computing device using camera depth information obtained in response to the user scanning the local real-world environment with a camera of the computing device. The computing device can select an AR label and/or label placement location for presentation in an AR video stream based on various criteria, including the distance between the candidate AR labels and the precise location of the computing device, priorities assigned to each candidate AR label, and/or whether a clear line of sight exists between the precise location of the computing device and the candidate AR label location.

Abstract: The present disclosure provides a display method and apparatus and an electronic device. The method includes: acquiring a virtual image, configuration information of the virtual image, and environment information of a current environment; wherein the virtual image comprises at least one virtual object and virtual feature point information of the at least one virtual object in an extended reality space coordinate system, and the environment information comprises point cloud information of at least one real object; determining a position relation between the real object and the virtual object, based on the virtual feature point information of the virtual object in the extended reality space coordinate system and the point cloud information; rendering the virtual object in accordance with one or more of the position relation, the configuration information, and the environment information, to determine a rendered image; and displaying the rendered image.

Abstract: An amusement park system includes a modular attraction system having a ride vehicle having seats to accommodate passengers, an on-board system integrated with the ride vehicle and having on-board game systems connected via a network. Each on-board game system is configured to provide an augmented reality (AR) experience, or a virtual reality (VR) experience, or both, via a respective visual experience generator device. The AR experience, or the VR experience, or both, is provided within a game shared between the on-board game systems. The on-board game systems are integrated into the ride vehicle, and are connected via the network to one another in a manner that allows for ready removal of all or a portion of one of the on-board game systems without affecting operation of the remaining on-board game systems.

Abstract: Various implementations disclosed herein include devices, systems, and methods for displaying a visual indicator for capturing images. In some implementations, a device includes a display, an environmental sensor, a non-transitory memory, and one or more processors coupled with the display, the environmental sensor and the non-transitory memory. In various implementations, a method includes obtaining a request to capture a sequence of images depicting a subject. The sequence of images is to be captured while an image sensor is being moved along a path with a predefined shape. The method includes determining a dimension of the path. The method includes overlaying, on a pass-through of the physical environment, a virtual indicator that indicates the path with the dimension and the predefined shape. The virtual indicator guides a user of the device along the path while capturing the sequence of the images with the image sensor.

Abstract: Embodiments of the present disclosure are directed to artificially intelligent player avatars in a virtual casino. Generally speaking, various types of information related to a player can be collected and aggregated across a number of different real world and virtual reality sources. This aggregated data can be used to generate a player model. Similarly, information can be collected about one or more electronic games and this information can be used to generate a game model for each game. An avatar can then be generated and presented in a virtual reality gaming venue, e.g., a virtual casino. This avatar can then interact with the play based on the player model and the game model.

Abstract: In some implementations, a device may obtain scan data associated with an object, where the scan data includes a three-dimensional representation of a surface of the object. The device may identify one or more damaged regions of the object based on the scan data. The device may align the scan data with model data associated with a three-dimensional model representative of the object. The device may generate virtual content including: an object representation that includes an overlay of the three-dimensional representation of the surface of the object on the three-dimensional model representative of the object, based on alignment of the scan data with the model data; and one or more content items indicating locations of the one or more damaged regions with respect to the object representation. The device may cause presentation of the virtual content in a user interface of a user device.

Abstract: This disclosure and exemplary embodiments described herein provide methods and systems for multimodal procedural guidance content creation and conversion, however, it is to be understood that the scope of this disclosure is not limited to such application. One of the implementations described herein is related to the generation of content/instruction set that can be viewed in different modalities, including but not limited to mixed reality, VR, and audio text, however it is to be understood that the scope of this disclosure is not limited to such application.

Abstract: One or more of at least one processor of a wearable device is configured to obtain an external image indicating at least a part of real environment around the wearable device using a camera, while displaying a three-dimensional image through a display. One or more of the at least one processor is configured to store the external image in a first command buffer distinct from a display buffer corresponding to the display in a memory. One or more of the at least one processor is configured to adjust an order among the first command buffer, the second command buffer and the third command buffer, using depth information corresponding to the first command buffer, a second command buffer corresponding to the three-dimensional image, and a third command buffer corresponding to a virtual object. This disclosure may be related to a metaverse service to enhance interconnectivity between a real object and a virtual object.