Abstract: Disclosed herein are visualization systems, methods, devices and database configurations related to the real-time depiction, in 2 D and 3 D on monitor panels as well as via 3 D holographic visualization, of the internal workings of patient surgery, such as patient intervention site posture as well as the positioning, in some cases real time positioning, of an object foreign to the patient.

Abstract: A method for generating a more accurate mesh that represents a 3D printed part based on a model includes slicing the model into layers and identifying an infill-wall boundary and an exterior-interior boundary of each layer of the model. Layers of the model may be identified as critical by iterative comparison with adjacent layers. An interior voxel mesh may be constructed based on common two-dimensional reference grids imposed on the critical layers. The interior voxel mesh may be augmented to an augmented mesh and then extended to a protomesh. The protomesh may be extruded to construct the final mesh, which may be analyzed by finite element analysis. The part may be 3D printed based on the layers output by the slicing operation.

Abstract: A system and method for 3D reconstruction with plane and surface reconstruction, scene parsing, depth reconstruction with depth fusion from different sources. The system includes display and a processor to perform the method for 3D reconstruction with plane and surface reconstruction. The method includes dividing a scene of an image frame into one or more plane regions and one or more surface regions. The method also includes generating reconstructed planes by performing plane reconstruction based on the one or more plane regions. The method also includes generating reconstructed surfaces by performing surface reconstruction based on the one or more surface regions. The method further includes creating the 3D scene reconstruction by integrating the reconstructed planes and the reconstructed surfaces.

Abstract: A virtual surgical robot being built from kinematic data is rendered to a display. A user input is received to effect a movement or a configuration of the virtual surgical robot. The kinematic data is modified based on evaluation of the movement or the configuration of the virtual surgical robot.

Abstract: An environment-transforming system transforms a user's environmental information in ways that allow the user to better perceive her environment. For example, the system transforms some aspects of a visual scene into a sound space for a visually impaired user. Once the user learns to interpret the sound space, she avoids walking into an object because a sound cue tells her that the object is in her near environment and roughly where it is. Various types of transformations are possible depending upon the user's needs and preferences. As all people are different, each user has a personalized profile that directs the transformation process. More generally, the environment to be transformed may include aspects of artificial or enhanced reality. The transformed environmental information can be presented to the user in a number of ways, such as in haptic feedback, as directional audio, through oral stimulation, or through modified visual display.

Abstract: Various methods are provided for generating motion vectors in the context of 3D computer-generated images. An example method includes generating, for each pixel of one or more objects to be rendered in a current frame, a 1-phase motion vector (MV1) and a 0-phase motion vector (MV0), each MV1 and MV0 having an associated depth value, to thereby form an MV1 texture and an MV0 texture; converting the MV1 texture to a set of MV1 blocks and converting the MV0 texture to a set of MV0 blocks; and outputting the set of MV1 blocks and the set of MV0 blocks for image processing.

Abstract: The invention discloses an imaging device using feature compensation, such a device comprises a vision detecting module, a voice detecting module, a partial-feature database and a three-dimensional (3D) imaging module. The vision detecting module may be configured to 3D mesh information of at least one object based on an imaging signal of the object. The voice detecting module may be configured to detect at least one specific voice of the object and generates a corresponding identification (ID) information. The partial-feature database may be configured to store compensating mesh information of the partial-features of the object. The 3D imaging module may be configured to combine the 3D mesh information of the object with the compensating mesh information, and thereby forms an 3D image. Furthermore, correspondingly, the invention also discloses an imaging method using feature compensation.

Abstract: Provided are a method and device for providing interactive virtual reality content capable of increasing user immersion by naturally connecting an idle image to a branched image. The method includes providing an idle image including options, wherein an actor in the idle image performs a standby operation, while the actor performs the standby operation, receiving a user selection for an option, providing a connection image, and providing a corresponding branched image according to the selection of the user, wherein a portion of the actor in the connection image is processed by computer graphics, and the actor performs a connection operation so that a first posture of the actor at a time point at which the selection is received is smoothly connected to a second posture of the actor at a start time point of the branched image.

Abstract: A system for modeling a roof of a structure comprising a first database, a second database and a processor in communication with the first database and the second database. The processor selects one or more images and the respective metadata thereof from the first database based on a received a geospatial region of interest. The processor generates two-dimensional line segment geometries in pixel space based on two-dimensional outputs generated by a neural network in pixel space of at least one roof structure present in the selected one or more images. The processor classifies the generated two-dimensional line segment geometries into at least one contour graph based on three-dimensional data received from the second database and generates a three-dimensional representation of the at least one roof structure based on the at least one contour graph and the received three-dimensional data.

Abstract: Disclosed is an electronic device including a memory and a processor electrically connected with the memory. The memory stores instructions that, when executed, cause the processor to control the electronic device to: obtain information about a maximum value of brightness of image content based on metadata of the image content, to perform tone mapping on at least one or more frames corresponding to a preview image of the image content based on the information about the maximum value of the brightness, and to output the preview image based on the at least one or more frames on which the tone mapping is performed, on a display device.

Abstract: Extended reality (XR) software application programs establish remote collaboration sessions in which a host device and one or more remote devices can interact. When initiating a remote collaboration session, an XR application in a host device determines a collaboration area. The collaboration area corresponds to a portion of a real-world environment that is shared by the host device with the one or more remote devices. In some embodiments, the collaboration area can be determined automatically and/or based on user input. The XR application causes sensors associated with the host device to scan the collaboration area. Then, the XR application transmits, to the one or more remote devices, a three-dimensional representation of the collaboration area for rendering in one or more remote XR environments.

Abstract: Systems and methods are provided for generating digital clothing on custom digital avatars. The method includes generating 3-dimensional (3D) representations of one or more garments, wherein the 3D representations of the one or more garments include physical attributes of one or more garment materials, enabling the 3D representations to move and lay on the custom digital avatars in a realistic manner. The method further includes inputting one or more data points for a user, wherein the one or more data points include body measurements of the user, generating, using a processor, a custom digital avatar for the user, wherein the custom digital avatar is configured to approximately conform to the one or more data points, selecting, using a graphical user interface, one or more garments having an accompanying 3D representation; and digitally displaying, using the graphical user interface, the selected one or more garments on the custom digital avatar.

Abstract: In particular embodiments, a computing system may divide at least a portion of a physical space surrounding a user into a plurality of three-dimensional (3D) regions, wherein each of the 3D regions is associated with an area of a plurality of areas in a plane. The system may generate estimated locations of features of objects in the portion of the physical space. Based on the estimated locations, the system may determine an occupancy state of each of the plurality of 3D regions. Then based on the occupancy states of the plurality of 3D regions, the system may determine that one or more of the plurality of areas have respective airspaces that are likely unoccupied by objects.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for variable rate tessellation. A graphics processor may receive data for geometry processing of a plurality of patches in a draw call. The graphics processor may reduce a tessellation factor of each of the plurality of patches based on a property of each of the plurality of patches. The reduced tessellation factor may correspond to a TRF. The property may correspond to a shading rate or a number of visible pixels. The graphics processor may apply the TRF for each of the plurality of patches. The graphics processor may render each of the plurality of patches based on the applied TRF for each of the plurality of patches.

Abstract: In various embodiments, a gradient modeling application automatically generates designs of three-dimensional (3D) objects. The gradient modeling application generates a set of points based on a resolution and a perimeter. The gradient modeling application computes a set of displacement values based on the set of points, a first two-dimensional (2D) border, and a first displacement parameter that is associated with the first 2D border. Based on the set of displacement values, the gradient modeling application generates a 3D object design.

Abstract: One variation of a method for video conferencing includes, at a first device associated with a first user: capturing a first video feed; representing constellations of facial landmarks, detected in the first video feed, in a first feed of facial landmark containers; and transmitting the first feed of facial landmark containers to a second device. The method further includes, at the second device associated with a second user: accessing a first face model representing facial characteristics of the first user; accessing a synthetic face generator; transforming the first feed of facial landmark containers and the first face model into a first feed of synthetic face images according to the synthetic face generator; and rendering the first feed of synthetic face images.

Abstract: Embodiments described herein include systems and methods for providing a management interface for controlling multiple households. The management interface may be provided as an application on a mobile device or as an Internet webpage. An example implementation involves a device displaying representations of: a plurality of households; an indication of a selected household; one or more zones within the selected household; and a representation of media being played by a selected zone of the one or more zones. While displaying the representations, the device receives, from a server, data indicating updated information associated with the plurality of households; and, in response, updates the graphical display to display at least an updated representation of media being played by the selected zone.

Abstract: A low radiation, intra-operative method using two-dimensional imaging to register the positions of surgical implants relative to their pre-operative planned positions. Intraoperatively, a pair of two-dimensional fluoroscope images in different planes or a single three-dimensional image is acquired and compared to a set of three-dimensional pre-operative images, to allow registration of the implant region anatomy. A second set of intraoperative fluoroscope images is acquired of the surgical area with implants in place. The second set of images is compared with the first set of intraoperative images to ascertain alignment of the implants. Registration between first and second intraoperative image sets is accomplished using the implants themselves as fiducial markers, and the process repeated until an acceptable configuration of the implants is obtained. The method is particularly advantageous for spinal surgery.

Abstract: A medical image might be generated for a patient image using a convolutional neural network trained on prior patient pre-procedure and post-procedure 2D images. A method might generate 3D models from pre-procedure 2D images and from post-procedure 2 images, and train the convolutional neural network with training images being the 3D models, to generate at least one 3D model of the present patient from the 2D image of the present patient, apply the 3D model of the present patient to the convolutional neural network in an inference stage, and apply patient-specific parameters derived from the proposed surgical procedure as a second input to the convolutional neural network in the inference stage to generate an inferred post-surgery 3D model of the present patient given the patient-specific parameters.

Abstract: A graphics processing system is configured to render primitives using a rendering space that is sub-divided into sections, wherein the graphics processing system includes assessment logic configured to make an assessment regarding the presence of primitive edges in a section, and determination logic configured to determine an anti-aliasing setting for the section based on the assessment.