Abstract: An electronic device is provided. The electronic device may comprise at least one processor, a tracking sensor, a communication circuit, and a display. The at least one processor may obtain first tracking information for a movement of a user through the tracking sensor. The at least one processor may receive, from an external electronic device through the communication circuit, image property information to request a rendering. The at least one processor may identify a tracking property of a first image based on the image property information. The at least one processor may determine a rendering start timing for the first image having the tracking property based on a rendering processing time. The at least one processor may transmit, to the external electronic device through the communication circuit, a message including the image property information of the first image and the first tracking information, based on the rendering start timing for the first image.

Abstract: In various examples, a generative model is used to synthesize datasets for use in training a downstream machine learning model to perform an associated task. The synthesized datasets may be generated by sampling a scene graph from a scene grammar—such as a probabilistic grammar— and applying the scene graph to the generative model to compute updated scene graphs more representative of object attribute distributions of real-world datasets. The downstream machine learning model may be validated against a real-world validation dataset, and the performance of the model on the real-world validation dataset may be used as an additional factor in further training or fine-tuning the generative model for generating the synthesized datasets specific to the task of the downstream machine learning model.

Abstract: An example device for processing extended reality (XR) data includes a processors configured to: parse entry point data of an XR scene to extract information about one or more required virtual objects for the XR scene, the required virtual objects including a number of dynamic virtual objects equal to or greater than one, each of the dynamic virtual objects including at least one dynamic media component for which media data is to be retrieved; initialize a number of streaming sessions equal to or greater than the number of dynamic virtual objects using the entry point data; configure quality of service (QoS) and charging information for the streaming sessions; retrieve media data for the dynamic virtual objects via the streaming sessions; and send the retrieved media data to a rendering unit to render the XR scene to include the retrieved media data at corresponding locations within the XR scene.

Abstract: Methods and apparatus to control appearance of views in free viewpoint media are disclosed. An apparatus includes at least one memory; instructions; and processor circuitry to execute the instructions to: determine a first point in three-dimensional space relative to a plurality of real-world cameras, the first point corresponding to a region of interest in a real-world scene to be captured by the real-world cameras; determine, independent of the first point, a second point in the three-dimensional space; and determine parameters for a virtual camera based on both the first point and the second point, the parameters to enable generation of a virtual image from a perspective of the virtual camera based on a modification of a real-world image captured by one of the real-world cameras.

Abstract: An augmented reality system and method, comprising: a memory configured to store 3D medical scans comprising an image of a tumor and an angiogram; an output port configured to present a signal for presentation of an augmented reality display to a user; at least one camera, configured to capture images of a physiological object from a perspective; at least one processor, configured to: implement a first neural network trained to automatically segment the tumor; implement a second neural network to segment vasculature in proximity to the tumor; implement a third neural network to recognize a physiological object in the captured images; and generate an augmented reality display of the physiological object, tumor and vasculature based on the captured images, the segmented tumor and the segmented vasculature, compensated for changes in the perspective.

Abstract: An electronic device is provided. The electronic device includes a display, a camera, a memory, and at least one processor operatively connected to the display, the camera, and the memory, and based on an image obtained via the camera, the at least one processor may display, in the display, an augmented reality scene including at least one bookmarking object, may receive a user input for the augmented reality scene, and in response to the user input, store bookmarking data including at least one of information associated with the augmented reality scene or information associated with the at least one bookmarking object in the memory.

Abstract: The present disclosure provides a method for creating a 3D model of a reference surface. The method includes capturing, using a capture device, a plurality of data points on the reference surface, determining a position and an orientation of the capture device related to the capture of the plurality of data points, creating a 3D data representation of the reference surface based on the plurality of data points, creating a location tracking data representation of the reference surface based the plurality of data points on the reference surface and the position and the orientation of the capture device, and creating the 3D model of the reference surface based on the 3D data representation and the location tracking data representation of the reference surface.

Abstract: Systems and method for installing an alarming system at a cell site includes installing an alarm controller at a cell site; installing an alarm block at the cell site; coupling the alarm controller to the alarm block by way of a plurality of cables; coupling the alarm block to a plurality of components of the cell site by way of a plurality of cables, wherein the alarm block establishes a connection between the alarm controller and the components; causing one or more cameras to capture a 360 degree view of the cell site; and providing a close-out package, wherein the close-out package provides verification of the alarm controller installation. Various embodiments include utilizing three dimensional (3D) modeling to perform virtual site surveys for verifying the installation of the alarming system.

Abstract: Disclosed herein are an image morphing adaption method and apparatus. The method includes, during a rotation process of a display device, processing, by rotating and then clipping, an image to be displayed at at least one morphing adaption processing time, and displaying the processed image at the at least one morphing adaption processing time. A rotation angle of the image is substantially equal to a rotation angle of the display device at the corresponding time, a rotation direction of the image is opposite to a rotation direction of the display device, the morphing adaption processing time is determined based on a preset morphing adaption processing frequency, and the morphing adaption processing frequency is determined by down-conversion based on a current screen refresh frequency. According to such a method, images displayed by the display device during the rotation process substantially match the view angle of users, improving a viewing experience.

Abstract: Exemplary systems and methods for creating spatial contents in a mixed reality environment are disclosed. In an example, a location associated with a first user in a coordinate space is determined. A persistent virtual content is generated. The persistent virtual content is associated with the first user's associated location. The first user's associated location is determined and is associated with the persistent virtual content. A location of a second user at a second time in the coordinate space is determined. The persistent virtual content is presented to the second user via a display at a location in the coordinate space corresponding to the first user's associated location.

Abstract: Systems and method for installing an alarming system at a cell site includes installing an alarm controller at a cell site; coupling a first end of a cable to an input of the alarm controller and a second end of the cable to a component of the cell site, wherein the alarm controller is adapted to provide alarming associated with the component; causing one or more cameras to capture a 360 degree view of the cell site; and providing a close-out package, wherein the close-out package provides verification of the alarm controller installation. Various embodiments include utilizing three dimensional (3D) modeling to perform virtual site surveys for verifying the installation of the alarming system.

Abstract: A prop attachment method and apparatus, a device, and a storage medium are provided. The method comprises: obtaining mesh data of a target object mesh and mesh data of a basic object mesh; determining deformation of the target object mesh with respect to the basic object mesh on the basis of mesh data of the basic object mesh and mesh data of the target object mesh; on the basis of a triangle correspondence between a first prop mesh and the basic object mesh, the deformation information, and mesh data of the first prop mesh, controlling the first prop mesh to perform deformation transfer, to obtain mesh data of a second prop mesh; and on the basis of mesh data of the second prop mesh and mesh data of the target object mesh, displaying a target object attached with a second prop corresponding to the second prop mesh.

Abstract: An information processing device that generates a fluid discharge path for discharging fluid into a machine to move chips, includes: a detecting unit for detecting a first input signal for a first position on an image of the machine and a second input signal for a second position on the image of the machine; and a display control unit for performing control to display (i) the first position, (ii) the second position, and (iii) a discharge path connecting the first position with the second position to be superimposed on image data of the machine.

Abstract: Approaches presented herein provide for the generation of visual content, including different types of content representations from different sources, rendered to include consistent scene illumination for the various representations. A first render pass can produce a first image including only proxies of implicit representations (e.g., NeRF objects) under scene illumination. A second render pass can produce a second image that includes a representation of the explicit scene objects, as well as the proxies of the implicit representations, under the scene illumination, which produces secondary lighting effects. The first and second images are compared to determine irradiance ratio data for the various pixel locations. A third render pass can produce a third image that includes the implicit representations, which can have relighting performed according to the irradiance ratio data to include the secondary lighting effects.

Abstract: A system and method for presentation of computer vision (e.g., augmented reality, virtual reality) using user data and a user code is disclosed. A client device can detect an image feature (e.g., scannable code) in one or more images. The image feature is determined to be linked to a user account. User data from the user account can then be used to generate one or more augmented reality display elements that can be anchored to the image feature in the one or more images.

Abstract: An information processing apparatus as one aspect of the present invention detects a predetermined behavior of a person, specifies first tracking information of a first person for which the predetermined behavior has been detected and second tracking information of a second person for which it is estimated that replacement has occurred during movement of the first person, generates third tracking information based on the first tracking information and the second tracking information, and determines whether or not the first person satisfies a predetermined condition based on a detection result of the predetermined behavior corresponding to the third tracking information.

Abstract: Traditional head-mounted display experiences require a hand controller (e.g. thumbstick, touchpad, gamepad, keyboard, etc.) to manipulate audio controls. The invention is a hands-free, body-based navigation technology that puts the participant's body in direct control of movement through sonic space. Participants lean towards a sound source to make it louder and lean away to make it quieter. In some embodiments, the more a participant leans, the faster the volume changes. Because the interactions were designed to respond to natural bearing and balancing instincts, movement coordination is intuitive and easy to learn.

Abstract: A history and cultural 3D virtual museum that has a user-friendly software based interactive platform that is accessible worldwide on-line via the Internet or comparable remote access network systems and includes a variety of images of an outside image of the museum and walks the visitor from outdoors through the entrance into the museum, includes a plurality of floors and sections which display a myriad of objects, pictures and artifacts along with audio and visual descriptions of the items much like an actual “in-person” museum, provides guided tours, monitors on every floor with search engines, touch tone screen and museum library and includes an interactive children's section, theatre room, book store, research section, library, book store and green space.

Abstract: There is provided a multichip ray tracing device. The multichip ray tracing device includes a plurality of memory units; an acceleration structure division processing unit that divides an acceleration structure (AS) into a plurality of divided acceleration structures and stores each of the plurality of divided acceleration structures in a corresponding memory unit among the plurality of memory units; and a plurality of ray tracing core units connected to the plurality of memory units. Each of the plurality of ray tracing core units performs an internal ray tracing (Internal RT) operation for a corresponding divided acceleration structure and transmits corresponding ray information to a corresponding ray tracing core unit to perform an external ray tracing (External RT) operation when attempting to access a data node that is not in the corresponding divided acceleration structure in the process of the internal ray tracing operation.

Abstract: Systems and methods for planning and assisting orthopaedic surgical procedures include a computing device and a robotic surgical device. The computing device defines a surgical coordinate system relative to a bone of a patient and captures a plurality of point positions in the surgical coordinate system. The plurality of point positions includes a first point position representing a location on a soft tissue surface covering a portion of the patient's bone. The computing device identifies an estimated soft tissue thickness value for each of the plurality of point positions and registers a three-dimensional model of the patient's bone in the surgical coordinate system based on the plurality of point positions and the estimated soft tissue thickness values. The computer system may control the robotic surgical device according to the registered bone model.