Abstract: A method includes, receiving: (i) a selected three-dimensional (3D) section that has been ablated in a patient organ in accordance with a specified contour, and (ii) a dataset, which is indicative of a set of lesions formed during ablation of the selected 3D section. The selected 3D section is transformed into a two-dimensional (2D) map, and checking, on the 2D map, whether the set of lesions covers the specified contour.

Abstract: An electronic device and method are disclosed. The electronic device includes a display an extended screen area that is exposed or stowed, according to a change in a state of the display of the electronic device, communication circuitry configured to transceive a signal to or using an angle-of-arrival (AOA) antenna disposed within the extended screen area, a memory, and a processor. The processor implements the method, including: determining a position of the electronic device relative to an external electronic device, using the communication circuitry, executing a sharing operation with the external electronic device, identifying whether the display of the electronic device is disposed in a first state or a second state, based on detecting that the display is disposed in the first state, perform a first positioning operation for the external electronic device, and displaying a sharing interface according to the first positioning operation on the display.

Abstract: An artificial intelligence device is configured to: when a spoken sentence of a three-dimensional agency is generated, extract a keyword of the spoken sentence; acquire related content associated with the keyword of the spoken sentence to detect positions of an object and text in the related content; when an object and text corresponding to the keyword of the spoken sentence exist in the related content, map the positions of the object and the text corresponding to the keyword of the spoken sentence to three-dimensional coordinates; output the related content to a surrounding space of the three-dimensional agency; and control the operation of the three-dimensional agency so that the three-dimensional agency performs an utterance operation corresponding to the spoken sentence and an indication operation of indicating three-dimensional coordinates at which the object and the text of the related content are located.

Abstract: An illustrative model construction system may access object image data representative of one or more images depicting an object having a plurality of labeled keypoint features. Based on the object image dataset, the model construction system may generate a training target dataset including a plurality of training target images. Each training target image may be generated by selecting a background image distinct from the object image data, manipulating a depiction of the object represented within the object image data, and overlaying the manipulated depiction of the object onto the selected background image with the labeled keypoint features. Based on this training target dataset, the model construction system may train a machine learning model to recognize and estimate a pose of the object when the object is depicted in input images analyzed using the trained machine learning model. Corresponding methods and systems are also disclosed.

Abstract: A virtual reality (VR) system comprising a head-mounted display (HMD) and handheld controller set is enhanced to provide a more realistic end user VR experience, e.g., for boxing or other interactive training. In this approach, and in lieu of simply establishing a boundary area for the VR experience, the user also maps a position of a real-world object into a reference frame of the VR environment. This mapping is facilitated using the handheld controller itself, e.g., as positioned in a backwards-facing manner on the user's forearm. The real-world object is then simulated in the 3D VR environment as rendered by the VR HMD, and the user interacts with the real-world object (or its simulation) to provide a more enjoyable and useful interactive experience.

Abstract: The present disclosure relates generally to systems and methods for synchronized presentation of a guided viewing. In one embodiment, a method may include accessing virtual tour data associated with a property, the virtual tour data including a plurality of images representing views within the property; receiving, from a first display device, a first video signal captured using a camera associated with the first display device; receiving, from the first display device, an indication of a navigation input reflecting a navigation through the plurality of images; and causing a guided viewing interface to be displayed on a second display device. The guided viewing interface may include a virtual tour element for displaying the plurality of images, the virtual tour element being updated to reflect the navigation input; and a video element for displaying the first video signal.

Abstract: A virtual role-based multimodal interaction method, apparatus and system, a storage medium, and a terminal, where the method includes: acquiring input information, where the input information includes one or more data types; inputting the input information into a perception layer to enable the perception layer to recognize and process the input information according to a data type of the input information to obtain a recognition result; inputting the recognition result into a logic decision-making layer to enable the logic decision-making layer to process the recognition result and generate a drive instruction corresponding to the recognition result; acquiring multimodal virtual content according to the drive instruction, wherein the multimodal virtual content includes at least a virtual role; and outputting the acquired multimodal virtual content.

Abstract: A computing device performs a first operation before a first commit deadline, resulting in a first frame being rendered and displayed in a first cycle. A second operation is performed, before a second commit deadline, resulting in a second frame being rendered and displayed in a second cycle. A time remaining to a third commit deadline is determined, using the current time. A third operation is predicted, performable before a third commit deadline. An additional operation is predicted, performable for a future cycle. A total processing time for the third and additional operations is determined, being less than the remaining time. The third and additional operations are performed for use in a future cycle. The result of the third operation is used to render a third frame for the third cycle. The result of the additional operation is used to render an additional frame before a future render deadline.

Abstract: An electronic device includes: a sensor module, a display module comprising a main display and a sub-display, a memory configured to store computer-executable instructions, and a processor configured to execute the instructions by accessing the memory, wherein the instructions, when executed by the processor, cause the processor to: identify at least one real object displayed through the main display, select one real object from among the identified at least one real object as a target object, control the sensor module to measure ambient illuminance of the electronic device, determine a visibility level of the electronic device based on the ambient illuminance of the electronic device, and display at least one augmented reality (AR) content corresponding to the selected target object on at least one of the main display or the sub-display based on the determined visibility level.

Abstract: The present disclosure provides a system for modifying a virtual reality (VR) space, which generates a mutual movable space between an augmented reality (AR) host's reference space and a VR client's space, the system including an acquisition unit that acquires a size of the AR host's reference space, a processing unit that estimates a relative translation gain threshold by adjusting the client's walking speed for each axis of the VR space according to the size of the reference space, and a generation unit that generates the mutual movable space in which movement is possible in mixed reality (MR) with a relative translation gain based on the relative translation gain threshold.

Abstract: According to one embodiment of the present disclosure, there is disclosed a method of reconstructing images of the inside of the body that is performed by a computing device including at least one processor. The method includes: obtaining basic data including the pose information of an end of an endoscopic scope and a captured image of the inside of the body; and generating a three-dimensional (3D) final image of the inside of the body by reconstructing the basic data using feature points including the image information of the surface of the inside of the body for the basic data.

Abstract: A technique for performing ray tracing operations is provided. The technique includes determining error bounds for a rotation operation for a ray; selecting a technique for determining whether the ray intersects a bounding box based on the error bounds; and determining whether the ray hits the bounding box based on the selected technique.

Abstract: Three-dimensional object representation and re-rendering systems and methods for producing a 3D representation of an object from 2D images including the object that enables object-centric rendering. A modular approach is used that optimizes a Neural Radiance Field (NeRF) model to estimate object geometry and refine camera parameters and, then, infer surface material properties and per-image lighting conditions that fit the 2D images.

Abstract: An audiovisual rendering apparatus comprises a receiver (201) receiving audiovisual items and a receiver (209) receives metadata comprising input poses provided with reference to an input coordinate system and rendering category indications indicating a rendering category. A receiver (213) receives user head movement data and a mapper (211) maps the input poses to rendering poses in a rendering coordinate system in response to the user head movement data. A renderer (203) renders the audiovisual items using the rendering poses. Each rendering category is linked with a different coordinate system transform from a real world coordinate system to a category coordinate system, at least one of which is variable with respect to the real world coordinate system and the rendering coordinate system.

Abstract: Example methods for generating an animated character in dance poses to music may include generating, by at least one processor, a music input signal based on an acoustic signal associated with the music, and receiving, by the at least one processor, a model output signal from an encoding neural network. A current generated pose data is generated using a decoding neural network, the current generated pose data being based on previous generated pose data of a previous generated pose, the music input signal, and the model output signal. An animated character is generated based on a current generated pose data; and the animated character caused to be displayed by a display device.

Abstract: Environmental imaging and graphical mapping systems and methods are disclosed herein for tracking cleaning activity in a physical environment is disclosed. A sensor captures environmental image(s) depicting at least a portion of a target area in the physical environment. A graphical mapping of the target area is generated. The graphical mapping region(s) define the target area. A position value is detected that corresponds to a physical position of a cleaning implement within the target area. The graphical mapping is updated to indicate that a region has a clean status. A graphical user interface (GUI) displays a graphical mapping of the target area that visually indicates that the region has the clean status.

Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.

Abstract: A wireless tag communication device includes an antenna, a communication control circuit, a camera, a sensor, and a processor. The antenna has directivity. The communication control circuit communicates with a wireless tag via the antenna. The camera captures an image in which a direction in which the directivity of the antenna is maximized coincides with a capturing direction. The sensor detects brightness in a first image captured by the camera. The processor calculates a detection position of a wireless tag as a search target in the first image and displays on a display the first image and a second image in which the first image is masked with a mask density according to a sensor value detected by the sensor in an area other than an explicit area with the detection position of the wireless tag as a base point.

Abstract: An information processing apparatus divides a plurality of objects into objects of interest and objects of non-interest, and generates a projection image of the objects of non-interest integrated into one image and a projection image of the objects of interest. The information processing apparatus composes the projection image of the objects of interest and the projection image of the objects of non-interest, and displays a resultant composed image on a display device.

Abstract: A method of generating or modifying poses in an animation of a character are disclosed. Variable numbers and types of supplied inputs are combined into a single input. The variable numbers and types of supplied inputs correspond to one or more effector constraints for one or more joints of the character. The single input is transformed into a pose embedding. The pose embedding includes a machine-learned representation of the single input. The pose embedding is expanded into a pose representation output. The pose representation output includes local rotation data and global position data for the one or more joints of the character.