Abstract: Example image processing systems and methods are described. In one implementation, a recording device captures images and measurements from an inertial measurement unit (IMU). A rendering system generates encoded video data based on the captured images and measurements from the IMU, where the encoded video data includes at least one region that stores supplemental data. The encoded video data is then rendered for viewing by a user proximate a display device.

Abstract: Disclosed is a computer-implemented method of overlaying a representation of a medical instrument over a two-dimensional medical image. It finds at least one feature point along a detection line which is defined relative to the medical instrument in the medical image, calculates a geometrical quantity based on this feature point and adds the geometrical quantity to the two-dimensional medical image.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media that recommend editing presets based on editing intent. For instance, in one or more embodiments, the disclosed systems receive, from a client device, a user query corresponding to a digital image to be edited. The disclosed systems extract, from the user query, an editing intent for editing the digital image. Further, the disclosed systems determine an editing preset that corresponds to the editing intent based on an editing state of an edited digital image associated with the editing preset. The disclosed systems generate a recommendation for the editing preset for provision to the client device.

Abstract: A system and a method for generating a combined 3D model (95) of a sample comprising a sample imaging system (1) configured to generate a first 3D model (25) of the sample, a slice imaging system (2) configured to generate a second 3D model (615) of the sample, and a combiner engine (90) configured to generate a combined 3D model (95) based on the first 3D model and the second 3D model of the sample.

Abstract: Methods, computer program products, and/or systems are provided that perform the following operations: obtaining source display content; identifying one or more objectionable portions included in the source display content; modifying the one or more objectionable portions included in the source display content to filter content in the one or more objectionable portions; generating a filtered display content, wherein the filtered display content includes the one or more modified objectionable portions and one or more non-objectionable portions of the source display content; and providing the filtered display content for rendering of a shared presentation.

Abstract: A computer-implemented method can include generating centerlines of a patient's cardiovascular network, determining geometric features of the cardiovascular network based on the centerlines and a three-dimensional (3D) computer model of the cardiovascular network, constructing a lumped parameter network (LPN) of resistors corresponding to the cardiovascular network, and solving a system of equations corresponding to flow and pressure for the LPN model.

Abstract: A method for mapping a three-dimensional (3D) point cloud model based on deep learning includes: extracting features of image data by using a convolutional neural network; extracting features of point cloud data by using a PointNet point cloud processing network, and constructing a 3D model of the point cloud data by using a triangular mesh; aligning the 3D model and an image spatially and temporally; performing projection mapping on the aligned 3D model and image, and superimposing location information in the point cloud data onto texture information of the image to obtain a first fused image; fusing the features of the point cloud data and the features of the image data to obtain a second fused image with a fused feature; and superimposing the first fused image onto the second fused image, and obtaining a superimposition weight by using the convolutional neural network, to generate a mapped 3D model.

Abstract: A method includes: displaying an interaction interface of an application, and when a preset operation performed by a user on the interaction interface is detected, decoding to-be-displayed image data of the application into bitmap data, and encapsulating the bitmap data into texture data; storing the texture data in a memory partition accessible to a graphics processing unit GPU; triggering the GPU to read the texture data and perform drawing processing to obtain rendered data; and triggering a display to display an image based on the rendered data.

Abstract: A computer-based system for generating customized character figures and customized stories. The system utilizes input data and transforms the data to display interactive character figures in an immersive digital form or in a physical form and generates a corresponding story to which the user can relate.

Abstract: An asset management system providing a 3D virtual workspace to track, manage, and view assets of a business. The 3D virtual space is configured to provide a remote system and method to manage the assets. The asset management system also includes an AI system configured to aid the system by providing suggestions and automated decision making in the management system.

Abstract: A floorplan modelling method and system. The floorplan modelling method includes receiving 2D images of each corner of an interior space from a camera, generating a corresponding camera position and camera orientation in a 3D coordinate system in the interior space for each 2D image, generating a depth map for each 2D image to estimate depth for each pixel, generating a corresponding edge map for each 2D image, and generating a 3D point cloud for each 2D image using the corresponding depth map and parameters of the camera. The floorplan modelling method includes transforming the 3D point clouds with the corresponding edge map into a 2D space in the 3D coordinate system of the camera, regularizing the 3D point clouds into 2D boundary lines, and generating a 2D plan of the interior space from the boundary lines.

Abstract: Methods and systems for rendering augmented reality display data to locations of a physical presentation environment based on a presentation configuration are provided. A physical presentation environment configuration may be accessed that includes locations of a physical presentation environment for mapping augmented reality display data. The augmented reality display data may include a plurality of augmented reality objects that are rendered for display. Presentation attributes of the augmented reality display data may be used in conjunction with the presentation configuration for mapping and rendering the augmented reality display data. The rendered augmented reality display data may be dynamically interactive, and may be generated based on previous presentation configurations, mapping preferences, mapping limitations, and/or other factors.

Abstract: A system or method according to at least one embodiment of the present disclosure includes receiving a preoperative image of a patient in a first posture; receiving an intraoperative image of the patient in a second posture; comparing the preoperative image of the patient in the first posture with the intraoperative image of the patient in the second posture; and determining, based on comparing the preoperative image of the patient in the first posture with the intraoperative image of the patient in the second posture, a difference between the first posture and the second posture, the adequate surgical changes are imparted to the second posture to achieve satisfactory surgical outcome.

Abstract: A method of forming a pixel-aligned volumetric avatar includes receiving multiple two-dimensional images having at least two or more fields of view of a subject. The method also includes extracting multiple image features from the two-dimensional images using a set of learnable weights, projecting the image features along a direction between a three-dimensional model of the subject and a selected observation point for a viewer, and providing, to the viewer, an image of the three-dimensional model of the subject. A system and a non-transitory, computer readable medium storing instructions to perform the above method, are also provided.

Abstract: A method of generating a 3D video, a method of training a neural network model, an electronic device, and a storage medium, which relate to a field of image processing, and in particular to technical fields of computer vision, augmented/virtual reality and deep learning. The method includes: determining, based on an input speech feature, a principal component analysis (PCA) coefficient by using a first network, wherein the PCA coefficient is used to generate the 3D video; correcting the PCA coefficient by using a second network; generating a lip movement information based on the corrected PCA coefficient and a PCA parameter for a neural network model, wherein the neural network model includes the first network and the second network; and applying the lip movement information to a pre-constructed 3D basic avatar model to obtain a 3D video with a lip movement effect.

Abstract: The present invention provides an optical device for augmented reality having a ghost image blocking function. The optical device includes: an optical means configured to transmit at least part of real object image light, which is image light output from a real object, therethrough toward the pupil of an eye of a user; a first reflective unit disposed inside the optical means, and configured to transfer augmented reality image light, which is image light corresponding to an image for augmented reality output from an image output unit, to a second reflective unit; and the second reflective unit disposed inside the optical means, and configured to transfer the augmented reality image light to the pupil of the eye of the user by reflecting the augmented reality image light to the pupil of the eye of the user, thereby providing the image for augmented reality to the user.

Abstract: An apparatus for viewing in a structure with objects having a first participant and at least a second participant. The apparatus includes a first VR headset to be worn by the first participant. The apparatus includes a second VR headset to be worn by the second participant. Each participant sees every other participant in the structure as every other participant physically appears in real time in a simulated world displayed about them by the respective VR headset each participant is wearing. Each participant sees the simulated world from their own correct perspective in the structure. Each participant able to interact with the simulated world and simultaneously with desired physical objects in the structure and sees the desired physical objects as they physically appear in real time in the structure. A method for a first participant and at least a second participant viewing in a structure with objects.

Abstract: A computer-implemented method of modelling a common structure component, the method comprising, in a modelling computer system: receiving a plurality of captured frames, each frame comprising a set of 3D structure points, in which at least a portion of a common structure component is captured; computing a first reference position within at least one first frame of the plurality of frames; selectively extracting first 3D structure points of the first frame based on the first reference position computed for the first frame; computing a second reference position within a second frame of the plurality of frames; selectively extracting second 3D structure points of the second frame based on the second reference position computed for the second frame; and aggregating the first 3D structure points and the second 3D structure points, thereby generating an aggregate 3D model of the common structure component based on the first and second reference positions.

Abstract: In various examples, shader bindings may be recorded in a shader binding table that includes shader records. Geometry of a 3D scene may be instantiated using object instances, and each may be associated with a respective set of the shader records using a location identifier of the set of shader records in memory. The set of shader records may represent shader bindings for an object instance under various predefined conditions. One or more of these predefined conditions may be implicit in the way the shader records are arranged in memory (e.g., indexed by ray type, by sub-geometry, etc.). For example, a section selector value (e.g., a section index) may be computed to locate and select a shader record based at least in part on a result of a ray tracing query (e.g., what sub-geometry was hit, what ray type was traced, etc.).

Abstract: The present application discloses a warp execution method used for SPs of an SM of a GPU and an associated GPU. The SPs share a scratchpad memory, and the warp execution method includes: when the predetermined time point for warp-loading is reached, checking a first indicator to obtain a size of a space with the status of blank in the scratchpad memory, to determining whether to load the warp, wherein the first indicator is used to indicate a starting position of a space with the status of data-in-use and an ending position of the space with the status of blank; and when the predetermined time point for computing is reached, checking a second indicator and a third indicator to obtain a size of a space with the status of data-not-in-use in the scratchpad memory, to determining whether to compute the warp.