Abstract: Disclosed is a motion generation device for generating motion based on input information including a text and an operation method thereof, and the motion generation device may include a memory configured to store at least one instruction; and at least one processor configured to execute the at least one instruction stored in the memory, wherein the at least one processor is configured to: obtain the input information including the text representing a movement of a character, extract feature information from the obtained input information, generate motion data for the movement of the character using the extracted feature information, obtain correction motion data by post-processing the generated motion data, and generate motion animation of the character based on the obtained correction motion data.

Abstract: Disclosed herein are a video fusion method, apparatus, electronic device and storage medium. The video fusion method comprises: receiving a foreground video frame to be fused in a foreground video stream to be fused and a background video frame to be fused in a background video stream to be fused; determining a fusion parameter corresponding to the background video frame to be fused; according to a target foreground processing method corresponding to the foreground video frame to be fused and the fusion parameter, determining a target object to be fused corresponding to the foreground video frame to be fused; according to the target object to be fused and the background video frame to be fused, determining the target fused video frame to be displayed at a target terminal.

Abstract: The invention provides, in some aspects, a system for rendering images, the system having one or more client digital data processors and a server digital data processor in communications coupling with the one or more client digital data processors, the server digital data processor having one or more graphics processing units. The system additionally comprises a render server module executing on the server digital data processor and in communications coupling with the graphics processing units, where the render server module issues a command in response to a request from a first client digital data processor.

Abstract: An information processing apparatus according to the present invention includes a processor, and a memory storing a program which, when executed by the processor, causes the information processing apparatus to acquire information regarding a personal space of a second user displayed in a three-dimensional space viewed by a first user, acquire information regarding a distance from the first user to a display position of the second user in the three-dimensional space, and determine whether to display the second user at the display position so that the first user does not enter the personal space, on a basis of the personal space and the distance.

Abstract: A handheld controller for an artificial-reality system may include a top cover having a surface surrounded by a perimeter. The surface has a digit-occluded region on which a digit of a user of the handheld controller can be placed and a different region separated from the digit-occluded region. A first illumination source is disposed within the digit-occluded region at a first position along the perimeter of the top cover. The first position is visible to a camera of the artificial-reality system while the handheld controller has one of a first set of orientations. A second illumination source is disposed within the digit-occluded region at a second position along the perimeter of the top cover while the handheld controller has one of a second set of orientations. A third illumination source is disposed within the different region at a third position away and distinct from the perimeter on the surface.

Abstract: According to systems and techniques disclosed herein, a method for generating a navigable three-dimensional image of a tissue sample may include receiving a plurality of whole slide images (WSI) associated with the tissue sample. The method may further include providing the plurality of whole slide images to a machine-learning model. The machine-learning model may have been trained to identify one or more positional features within the plurality of whole slide images and output a plurality of relative positional relationships corresponding to each of the plurality of whole slide images. The method may further include generating the navigable three-dimensional image of the tissue sample based on the plurality of relative positional relationships. The method may further include generating an interactive display incorporating the navigable three-dimensional image. The method may further include providing, to a user interface, the interactive display.

Abstract: An image generation system and method for displaying an Augmented Reality “AR” image of a real-world environment having one of more objects located therein and one or more AR objects each corresponding to a respective object, the system comprising: a display on which the image of the real-world environment and the AR objects are displayed; a processing and control module configured to: receive, from one or more sensors, data relating to the real-world environment and objects therein; create the one or more AR objects from the objects by determining additional information relating to the object which is represented by at least one of symbols, annotations and fonts to be attached to the AR object to act as a displayed component: displaying the AR image comprising the real-world image and one or more AR objects; wherein the AR objects once created are stored for future retrieval based on a unique identifier for the AR object which remains active as long as the object is of interest.

Abstract: A device may include a processor configured to determine a first position of a physical camera in a physical environment, transmit the first position to a second device, obtain metadata of the physical camera, and cause a modification of a virtual camera of the second device based on the metadata. The processor is also configured to obtain, from the second device, at least one virtual image frame captured by the virtual camera placed at a second position in a computer-generated environment, and to obtain, from the physical camera, at least one image frame captured from the physical environment. The processor is also configured to generate a composite image frame including at least a portion of at least one virtual image frame composited with at least a portion of the at least one image frame, and display the composite image frame.

Abstract: Systems and methods are disclosed for generating edit captions based on layout representations. The system may access one or more reference layout representations associated with one or more reference images and a target layout representation associated with a target image. The system may compare the one or more reference layout representations with the target layout representation to determine semantic differences or correspondences. The system may identify one or more differences between the one or more reference images and the target image, the differences including modifications to objects, spatial relationships, or contextual features. The system may generate one or more edit captions based on the identified differences.

Abstract: A method of rendering 3D content in a mixed reality environment is disclosed. A volume camera is defined within first virtual environment. The volume camera is configured to capture a 3D volume of space. The defining includes setting parameters for a position or an orientation to be captured by the volume camera. A volume view transform is applied to the volume camera to establish a perspective of the volume camera within the 3D volume of space. The volume view transform is configured to define the position or the orientation relative to the 3D content in the 3D volume of space. Selected 3D content is processed within the 3D volume of space based on a configuration of the volume camera. The selected 3D content is rendered into a second virtual environment based on the configuration. The rendering includes adapting to a perspective of a user within the second virtual environment.

Abstract: A method, apparatus, and a non-transitory computer-readable medium storing program code for anti-aliasing images may be provided. The method may include obtaining a first edge pixel of an image in a high-dynamic range (HDR) space and determining a first scaling factor based on a local brightness environment of the first edge pixel. The method may also include determining a color ratio corresponding with the first edge pixel and scaling the color ratio to obtain a first color ratio. Then the first color value is obtained based on a color value of the first edge pixel, a color value of a target pixel, and the first color ratio, wherein the target pixel has a large color value difference from the first edge pixel among a plurality of surrounding pixels of the first edge pixel; and updating the first color value to the color value of the first edge pixel.

Abstract: A computer-implemented method includes receiving an image of an area, identifying an item in the area, determining an intended color of the item according to a predefined color code, analyzing the image for determining if the intended color of the item is diminished on and/or absent from the item, and outputting a mixed reality (MR) image of the area in which the intended color is overlayed on the item in response to determining that the intended color of the item is diminished and/or absent.

Abstract: An example device for presenting split-rendered media data includes a memory configured to store media data; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: send pose information representing a predicted pose of a user at a first future time to a split rendering server; receive an at least partially rendered image for the first future time and data associating the pose information with the at least partially rendered image from the split rendering server; and at a second future time, present a rendered image based on the partially rendered image.

Abstract: A see-through display method and a see-through display system are disclosed. The method includes the following steps. A user image is captured toward the front side of a display through a first image sensor, and a scene image is captured toward the rear side of the display through a second image sensor. User position information associated with the three-dimensional reference coordinate system is obtained according to the user image. Scene position information associated with the three-dimensional reference coordinate system is obtained according to the scene image. A viewing frustum is determined based on the user position information and a physical size of the display. A projection matrix of the viewing frustum is used to generate a display frame projected on the display plane of the display according to the scene position information. The display frame is output through the display to show the scene behind the display.

Abstract: A collaborative map building method is described in which if it is determined, for example, by a SLAM network edge, that a portion of a map corresponding to a target area of a first region is incomplete, a request to a device is transmitted to move toward the target area. The map is updated based on the scan performed by the device in the target area. Also described is a virtual image guide embodiment in which upon determining that a map of a target area of the first region is incomplete, a virtual guide image is generated on a device to appear at a target location. The user of the device is guided to the target area by the virtual image.

Abstract: An information processing apparatus includes: an acquirer configured to acquire state information regarding a state of an avatar in a virtual space, the avatar corresponding to a first user; and a display controller configured to: cause a display used by a second user to display a first character as the avatar based on the state information satisfying a first condition regarding the state; and cause the display to display a second character as the avatar based on the state information satisfying a second condition regarding the state without satisfying the first condition, the second character being determined based on a relationship between the first user and the second user.

Abstract: A video playing method and apparatus, an electronic device, a storage medium, a computer program product, and a computer program. A live-action shooting image is acquired, a display position of a target image in the live-action shooting image is detected and determined, a target video associated with the target image is acquired, and the target video is played at the display position in the live-action shooting image, so that the production cycle and costs required when presenting information using an augmented reality display technique can be reduced; in addition, more presentation channels are provided for users to present video information, so that the users can have enhanced interactive experience and visual experience.

Abstract: There is provided an information processing apparatus and method capable of suppressing a reduction in the quality of 3D data due to encoding and decoding. By dividing a mesh representing an object having a three-dimensional structure into patches, pair information indicating a pair constituted by a single vertex of the mesh or a plurality of vertices of a patch generated from a plurality of vertices at the same position is generated, and the generated pair information is encoded. The present disclosure may be applied to, for example, an information processing apparatus, an electronic device, an information processing method, a program or the like.

Abstract: The present disclosure provides a display method and apparatus and an electronic device. The method includes: acquiring a virtual image, configuration information of the virtual image, and environment information of a current environment; wherein the virtual image comprises at least one virtual object and virtual feature point information of the at least one virtual object in an extended reality space coordinate system, and the environment information comprises point cloud information of at least one real object; determining a position relation between the real object and the virtual object, based on the virtual feature point information of the virtual object in the extended reality space coordinate system and the point cloud information; rendering the virtual object in accordance with one or more of the position relation, the configuration information, and the environment information, to determine a rendered image; and displaying the rendered image.

Abstract: In some implementations, a computing device can present augmented reality (AR) labels in an AR video stream. For example, the computing device can obtain route information for a route requested by a user and can determine locations along the route for placing candidate AR labels. The computing device can determine the precise location of the computing device using camera depth information obtained in response to the user scanning the local real-world environment with a camera of the computing device. The computing device can select an AR label and/or label placement location for presentation in an AR video stream based on various criteria, including the distance between the candidate AR labels and the precise location of the computing device, priorities assigned to each candidate AR label, and/or whether a clear line of sight exists between the precise location of the computing device and the candidate AR label location.