Abstract: Systems and methods are provided for determining an analytic measure of a patient population. A knowledge database comprising structured patient data for a patient population is maintained. The structured patient data is generated by processing unstructured medical imaging data for the patient population using one or more machine learning algorithms. An analytic measure of the patient population is determined based on the structured patient data of the knowledge database. The analytic measure of the patient population is output.

Abstract: For interactive rendering in medical imaging, physically-based volume rendering of a volume of a patient may better assist physicians in diagnosis, prognosis, and/or planning. To provide for more rapid interaction, direct volume rendering is used during interaction. The rendering then transitions to physically-based rendering when there is no interaction. For smoothing the transition and/or preserving cohesive perceptual details, images from the different types of rendering may be blended in the transition and/or during interaction.

Abstract: An artificial intelligence agent is machine trained and used to provide physically-based rendering settings. By using deep learning and/or other machine training, settings of multiple rendering parameters may be provided for consistent imaging even in physically-based rendering.

Abstract: Systems and methods are provided for generating a two-dimensional image for identification of medical imaging data. An image processor acquires the medical imaging data and determines a category of the medical imaging data. A machine-learnt network identifies as a function of the category, a plurality of settings of rendering parameters that highlight one or more features the medical imaging data. The image processor renders the two-dimensional identifier image from the medical imaging data using the plurality of settings of rendering parameters and stores the medical imaging data with the two-dimensional identifier image.

Abstract: Generating anatomically specific movie driven medical image review is provided. Scan data is received representing an anatomy of a patient. A movie generation preset selection associated with the scan data is received. Anatomical landmarks within the scan data are detected. A movie of the patient is generated based on the scan data, the movie generation preset, and the anatomical landmarks.

Abstract: A method of rendering one or more material properties of a surface of an object includes acquiring a medical data set as a three-dimensional representation of a three-dimensional object. A surface structure corresponding to the surface of the three-dimensional object is determined based on the medical dataset. A plurality of rendering locations are derived based on the determined surface structure. The method includes rendering, by a physically-based volumetric renderer and from the medical dataset, one or more material properties of the surface of the object at each of the plurality of rendering locations. The one or more rendered material properties are stored per rendering location. Also disclosed is apparatus for performing the method.

Abstract: For interactive viewing in medical imaging, pre-rendering is used to provide greater quality of the rendered images with a given computational power. For interactivity in viewing direction, two or more views are rendered for each location and provided as video to the viewer. The viewer selects a viewing direction interactively, and an image at the selected view direction is formed from the previously rendered images of the videos for the two or more views. In an alternative or additional approach, a video graph is created with videos of different segments of the graph. The videos are sequences of images representing change in location, camera parameters (e.g., zooming), and/or rendering settings. Once provided to the user, interactivity is provided by selection of the appropriate node of the video graph. The user may interactively select different locations and/or rendering settings available in the video graph, allowing interaction while benefiting from quality provided by pre-rendered video.

Abstract: An embodiment suggests a method for visualizing an image data set, in particular a medical image data set, wherein the visualized data set displays a three dimensional arrangement having at least a first object and a second object. The method includes assigning a first set of parameter to the first object; assigning a second set of parameters to the second object; dividing the medical image data set into a first sub-region and a second sub-region; and providing a visualisation of the three dimensional arrangement by a volume rendering method, in particular by a ray-casting method or a photorealistic volumetric path tracing, the first set of parameter being applied to the first sub-region for visualizing the first object and the second set of parameter being applied to the second sub-region for visualizing the second object.

Abstract: Systems and methods are provided rendering a three-dimensional volume. Scan data representing an anatomical object of a patient is acquired. A boundary of the object is identified in the scan data. A first lightmap is positioned inside the boundary of the object. A second lightmap is positioned outside the boundary of the object. The three-dimensional volume of the object is rendered from the scan data with lighting based on the first lightmap and second lightmap.

Abstract: Interior scan and exterior photos are jointly visualized in medical imaging. One or more cameras are mounted to the internal medical scanner, allowing a photograph to be taken while or in temporal proximity to when the internal region of the patient is scanned. An image associating the exterior photographs with the interior region of the patient is presented to assist in diagnosis. Due to the spatial and temporal proximity, the image may be a visualization formed by combining the photograph and interior scan data.

Abstract: For three-dimensional rendering, a machine-learnt model is trained to generate representation vectors for rendered images formed with different rendering parameter settings. The distances between representation vectors of the images to a reference are used to select the rendered image and corresponding rendering parameters that provides a consistency with the reference. In an additional or different embodiment, optimized pseudo-random sequences are used for physically-based rendering. The random number generator seed is selected to improve the convergence speed of the renderer and to provide higher quality images, such as providing images more rapidly for training compared to using non-optimized seed selection.

Abstract: Physically-based volume rendering produces pixels. By assigning depths to the pixels, a 3D point cloud is generated. For more rapid rendering, such as due to user interaction, the 3D point cloud rendering is a proxy to physically-based volume rendering. The rendering parameters for the desired image may be determined using the proxy, and then physically-based volume rendering is performed to obtain the desired image.

Abstract: Physically-based volume rendering generates a lightfield. The locations of scattering modeled in physically-based rendering are used to assign depths for the lightfield. The previously assigned depths and previously rendered lightfield are used for lightfield rendering, which may be performed more rapidly than the physically-based volume rendering.

Abstract: A computer-implemented method of reducing 4D Digital Subtracted Angiography (DSA) reconstruction artifacts using a computational fluid dynamics (CFD) simulation includes a computer receiving first DSA time sequence data comprising a representation of a plurality of vessels and segmenting a vessel of interest from the first DSA time sequence data. The computer uses the CFD simulation to simulate fluid dynamics across the vessel of interest to yield a flow field and determines a plurality of simulated time activity curve parameters for each voxel inside the vessel of interest using the flow field. Then, the computer applies a reconstruction process to second DSA time sequence data to yield a DSA volume. This reconstruction process is constrained by the plurality of simulated time activity curve parameters for each voxel inside the vessel of interest.

Abstract: Methods, apparatuses, and systems are provided for live capturing of light map image sequences for image-based lighting of medical data. Patient volume scan data for a target area is received over time by a processor. Lighting environment data for the target area is captured over time by a camera. The camera transmits the lighting environment data to the processor over time. The processor lights the patient volume scan data with the lighting environment data into lighted volume data over time. The processor renders an image of the lighted volume data over time.

Abstract: In rendering in medical imaging, the MIP and VRT modes are emulated using physically-based rendering, such as Monte Carlo ray tracing. By weighting the rendering based on user or other input, where along a continuum of MIP to VRT to render is selected. A sequence of different images may be rendered with different settings at different points on the continuum using the same window level, classification, or other parameters.

Abstract: Apparatuses and methods for rendering and compositing two-dimensional images for remote visualization using a multi-pass rendering technique are provided. A server computer renders a three-dimensional volume separately from one or more three-dimensional graphical objects to be embedded in the rendered image of the volume. The server compresses and transmits the separately rendered images to a client computer. The client computer decompresses the rendered images and generates a composite image using the rendered images. If a user manipulates, adds or deletes an embedded object, the client computer generates a new composite image using the previously rendered volume image. In the case of a new or manipulated embedded graphical object, the server only renders the manipulated or new object.

Abstract: A computer-implemented method for performing window-leveling of volumetric ray tracing includes a computer system retrieving a quad-tree data structure organizing a plurality of light paths associated with a volume rendered using a transfer function and one or more window level values. The computer system also receives a user selection of at least one of a new transfer function or new window level values. The volume is rendered by the computer system with the new transfer function or the new window level values using the quad-tree data structure. Then, the computer system synthesizes an image by adding contributions from all of the plurality of light paths according to the quad-tree data structure.

Abstract: An artificial intelligence agent is machine trained and used to provide physically-based rendering settings. By using deep learning and/or other machine training, settings of multiple rendering parameters may be provided for consistent imaging even in physically-based rendering.

Abstract: The present embodiments relate to cinematic volume renderings and volumetric Monte-Carlo path tracing. The present embodiments include systems and methods for integrating semantic information into cinematic volume renderings. Scan data of a volume is captured by a scanner and transmitted to a server or workstation for rendering. The scan data is received by a server or workstation. The server or workstation extracts semantic information and/or applies semantic processing to the scan data. A cinematic volume rendering is generated from the scan data and the extracted semantic information.