Abstract: For interactive viewing in medical imaging, pre-rendering is used to provide greater quality of the rendered images with a given computational power. For interactivity in viewing direction, two or more views are rendered for each location and provided as video to the viewer. The viewer selects a viewing direction interactively, and an image at the selected view direction is formed from the previously rendered images of the videos for the two or more views. In an alternative or additional approach, a video graph is created with videos of different segments of the graph. The videos are sequences of images representing change in location, camera parameters (e.g., zooming), and/or rendering settings. Once provided to the user, interactivity is provided by selection of the appropriate node of the video graph. The user may interactively select different locations and/or rendering settings available in the video graph, allowing interaction while benefiting from quality provided by pre-rendered video.

Abstract: The present embodiments relate to multi-resolution lightfield representations and lightfield renderings. By way of introduction, the present embodiments include apparatuses and methods for generating multi-resolution lightfield representations used to generate lightfield renderings that provide end users with zoom functionality without distorting the rendering. Image data sets of a volume are captured at different resolutions for each camera position, and the image data sets are stored as multi-resolution image pyramids. The multi-resolution image pyramids represent the lightfield at different resolutions, and image data sets at a particular resolution are selected and used for generating a volume rendering at a zoom level chosen for the lightfield rendering.

Abstract: The present embodiments relate to multi-resolution lightfield representations and lightfield renderings. By way of introduction, the present embodiments include apparatuses and methods for generating multi-resolution lightfield representations used to generate lightfield renderings that provide end users with zoom functionality without distorting the rendering. Image data sets of a volume are captured at different resolutions for each camera position, and the image data sets are stored as multi-resolution image pyramids. The multi-resolution image pyramids represent the lightfield at different resolutions, and image data sets at a particular resolution are selected and used for generating a volume rendering at a zoom level chosen for the lightfield rendering.

Abstract: For personalized modeling with regular integration from a sensor, a wearable sensor and/or sensor outside of the medical facility or environment provides health-related data on a regular, periodic, or continuous basis (e.g., every few minutes or hours). Rather than using that data alone, the data is used to update a previously created personalized model of anatomy of the patient. After updating a parameter value for the personalized model, the updated model is used to output more complex health-related information than provided by the sensors.

Abstract: A computer-implemented method for providing a see-through visualization of a patient includes receiving an image dataset representative of anatomical features of the patient acquired using a medical image scanner and acquiring a body surface model of the patient using an RGB-D sensor. The body surface model is aligned with the image dataset in a canonical/common coordinate system to yield an aligned body surface model. A relative pose of a mobile device is determined with respect to the RGB-D sensor and a pose dependent visualization of the patient is created by rendering the image dataset at a viewpoint corresponding to the relative pose of the mobile device. Then, the pose dependent visualization of the patient may be presented on the mobile device.

Abstract: A computer-implemented method for providing a see-through visualization of a patient includes receiving an image dataset representative of anatomical features of the patient acquired using a medical image scanner and acquiring a body surface model of the patient using an RGB-D sensor. The body surface model is aligned with the image dataset in a canonical/common coordinate system to yield an aligned body surface model. A relative pose of a mobile device is determined with respect to the RGB-D sensor and a pose dependent visualization of the patient is created by rendering the image dataset at a viewpoint corresponding to the relative pose of the mobile device. Then, the pose dependent visualization of the patient may be presented on the mobile device.

Abstract: For interactive viewing in medical imaging, pre-rendering is used to provide greater quality of the rendered images with a given computational power. For interactivity in viewing direction, two or more views are rendered for each location and provided as video to the viewer. The viewer selects a viewing direction interactively, and an image at the selected view direction is formed from the previously rendered images of the videos for the two or more views. In an alternative or additional approach, a video graph is created with videos of different segments of the graph. The videos are sequences of images representing change in location, camera parameters (e.g., zooming), and/or rendering settings. Once provided to the user, interactivity is provided by selection of the appropriate node of the video graph. The user may interactively select different locations and/or rendering settings available in the video graph, allowing interaction while benefiting from quality provided by pre-rendered video.

Abstract: A method for Monte Carlo volume rendering in accordance with the present teachings includes: (a) tracing a plurality of light rays into a scene containing volumetric data, the light rays configured for simulating global illumination; (b) randomizing the scattering location and direction of the plurality of light rays through the volume, wherein a common sequence of random numbers is used in order for the scattering direction of each of the plurality of randomized scattered light rays to be substantially parallel; (c) computing at least one trilinearly interpolated and shaded sample along each of the plurality of randomized scattered light rays based on stored volumetric data, wherein at least a portion of the stored volumetric data used in at least a portion of the computing is configured for coherent access; and (d) rendering the volume with global illumination based on a plurality of iterations of the tracing, the randomizing, and the computing. Systems for Monte Carlo volume rendering are described.

Abstract: Apparatuses and methods for rendering and compositing two-dimensional images for remote visualization using a multi-pass rendering technique are provided. A server computer renders a three-dimensional volume separately from one or more three-dimensional graphical objects to be embedded in the rendered image of the volume. The server compresses and transmits the separately rendered images to a client computer. The client computer decompresses the rendered images and generates a composite image using the rendered images. If a user manipulates, adds or deletes an embedded object, the client computer generates a new composite image using the previously rendered volume image. In the case of a new or manipulated embedded graphical object, the server only renders the manipulated or new object.

Abstract: A method for Monte Carlo volume rendering in accordance with the present teachings includes: (a) tracing a plurality of light rays into a scene containing volumetric data, the light rays configured for simulating global illumination; (b) randomizing the scattering location and direction of the plurality of light rays through the volume, wherein a common sequence of random numbers is used in order for the scattering direction of each of the plurality of randomized scattered light rays to be substantially parallel; (c) computing at least one trilinearly interpolated and shaded sample along each of the plurality of randomized scattered light rays based on stored volumetric data, wherein at least a portion of the stored volumetric data used in at least a portion of the computing is configured for coherent access; and (d) rendering the volume with global illumination based on a plurality of iterations of the tracing, the randomizing, and the computing. Systems for Monte Carlo volume rendering are described.