Abstract: A computer system for permitting user interaction with a three-dimensional computer model defines an initial correspondence between the computer model and a real world workspace. An editing volume of the workspace is also defined, and a stereoscopic image of the section of the computer model within the editing volume is displayed. Using a first input device a user can translate and/or rotate the model, and rotate the editing volume, so as to bring different portions of the model into the editing volume, and thus into the user's view. The user operates a second input device to indicate changes to be made to the model. The first and second input devices can be operated with the user's respective hands. Since only the portion of the model within the editing volume need be displayed, the processing and display requirements are reduced, in comparison to displaying the entire model.

Abstract: A system and method for displaying 3D data are presented. The method involves subdividing a 3D display region into two or more display subregions, and assigning a set of display rules to each display subregion. Visible portions of a 3D data set in each display subregion are displayed according to the rules assigned to that display subregion. In an exemplary embodiment of the present invention the boundaries of the display regions, the display rules for each display subregion, and the 3D data sets assigned to be displayed in each display subregion can be set by a user, and are interactively modifiable by a user during the display. In exemplary embodiments of the invention the same 3D data can be displayed in each display subregion, albeit using different display rules. Alternatively, in other exemplary embodiments of the present invention, a different 3D data set can be displayed in each display subregion.

Abstract: In exemplary embodiments of the present invention a 3D visualization system can be ported to a laptop or desktop PC, or other standard 2D computing environment, which uses a mouse and keyboard as user interfaces. Using the methods of exemplary embodiments of the present invention, a cursor or icon can be drawn at a contextually appropriate depth, thus preserving 3D interactivity and visualization while only having available 2D control. In exemplary embodiments of the present invention, a spatially correct depth can be automatically found for, and assigned to, the various cursors and icons associated with various 3D tools, control panels and other manipulations. In exemplary embodiments of the present invention this can preserve the three-dimensional experience of interacting with a 3D data set even though the 2D interface used to select objects and manipulate them cannot directly provide a third dimensional co-ordinate.

Abstract: A method of rendering a graphics image in which rendering is only carried out in a region to be changed is disclosed. In a preferred form the image includes a plurality of objects and the method comprises the steps of: determining if each object has changed so that the object is required to be displayed differently in a subsequent frame; determining a bounding region of each changed object in the subsequent frame; determining a bounding region of each changed object in a frame prior to the subsequent frame; and combining the bounding regions to form an aggregate region and rendering the image only within the aggregate region.

Abstract: Exemplary systems and methods are provided by which multiple persons in remote physical locations can collaboratively interactively visualize a 3D data set substantially simultaneously. In exemplary embodiments of the present invention, there can be, for example, a main workstation and one or more remote workstations connected via a data network. A given main workstation can be, for example, an augmented reality surgical navigation system, or a 3D visualization system, and each workstation can have the same 3D data set loaded. Additionally, a given workstation can combine real-time imagining with previously obtained 3D data, such as, for example, real-time or pre-recorded video, or information such as that provided by a managed 3D ultrasound visualization system.

Abstract: Methods and systems for rendering high quality 4D ultrasound images in real time, without the use of expensive graphics hardware, without resampling, but also without lowering the resolution of acquired image planes, are presented. In exemplary embodiments according to the present invention, 2D ultrasound image acquisitions with known three dimensional (3D) positions can be mapped directly into corresponding 2D planes. The images can then be blended from back to front towards a user's viewpoint to form a 3D projection. The resulting 3D images can be updated in substantially real time to display the acquired volumes in 4D.

Abstract: A system and method for the imaging management of a 3D space where various substantially real-time scan images have been acquired is presented. In exemplary embodiments according to the present invention, a user can visualize images of a portion of a body or object obtained from a substantially real-time scanner not just as 2D images, but as positionally and orientationally located slices within a particular 3D space. In such exemplary embodiments a user can convert such slices into volumes whenever needed, and can process the images or volumes using known image processing and/or volume rendering techniques. Alternatively, a user can acquire ultrasound images in 3D using the techniques of UltraSonar or 4D Ultrasound.

Abstract: A virtual control system for substantially real-time imaging machines, such as, for example, ultrasound, is presented. In exemplary embodiments of the present invention, a virtual control system comprises a physical interface communicably connected to a scanner/imager, such as, for example, an ultrasound machine. The scanner/imager has, or is communicably connected to, a processor that controls the display of, and user interaction with, a virtual control interface. In operation, a user can interact with the virtual control interface by physically interacting with the physical interface. In exemplary embodiments according to the present invention the physical interface can comprise a handheld tool and a stationary tablet-like device. In exemplary embodiments according to the present invention the control system can further include a 3D tracking device that can track both an ultrasound probe as well as a handheld physical interface tool.

Abstract: Various methods and a system for the display of a luminal organ are presented. In exemplary embodiments according to the present invention numerous two dimensional images of a body portion containing a luminal organ are obtained from scan process. This data is converted to a volume and rendered to a user in various visualizations according to defined parameters. In exemplary embodiments according to the present invention, a user's viewpoint is placed outside the luminal organ, and a user can move the organ along any of its longitudinal topological features (for example, its centerline, but it could also be a line along the outer wall). In order to explore such an organ as a whole, from the outside of the organ, a tube-like structure can be displayed transparently/semi-transparently and stereoscopically.

Abstract: A computer system for permitting user interaction with a three-dimensional computer model defines an initial correspondence between the computer model and a real world workspace. An editing volume of the workspace is also defined, and a stereoscopic image of the section of the computer model within the editing volume is displayed. Using a first input device a user can translate and/or rotate the model, and rotate the editing volume, so as to bring different portions of the model into the editing volume, and thus into the user's view. The user operates a second input device to indicate changes to be made to the model. The first and second input devices can be operated with the user's respective hands. Since only the portion of the model within the editing volume need be displayed, the processing and display requirements are reduced, in comparison to displaying the entire model.

Abstract: A virtual reality display apparatus is disclosed which includes a display (100) arranged to display an image (130) viewable in three dimensions in an image space and, spaced from the image space, a three-dimensional work space (240), operation of a tool (230) within the work space being viewable in the image space.

Abstract: A system and method of presentation of 3D data sets in a 3D display is presented. In exemplary embodiments according to the present invention the method involves displaying data in an overview mode wherein localization markers can be set and manipulated, and in a local mode wherein data surrounding a localization marker can be rendered using different display parameters. In exemplary embodiments according to the present invention the mode in which data is displayed can be selected by a user. In preferred exemplary embodiments according to the present invention the method can be implemented recursively, such that within local mode sub-localization markers can be set and manipulated, and data can be displayed in a sub-local mode wherein data surrounding a sub-localization marker can be rendered using display parameters which can be different from both those of an overview display mode and those of a local display mode.

Abstract: A system and method for displaying 3D data are presented. The method involves subdividing a 3D display region into two or more display subregions, and assigning a set of display rules to each display subregion. Visible portions of a 3D data set in each display subregion are displayed according to the rules assigned to that display subregion. In an exemplary embodiment of the present invention the boundaries of the display regions, the display rules for each display subregion, and the 3D data sets assigned to be displayed in each display subregion can be set by a user, and are interactively modifiable by a user during the display. In exemplary embodiments of the invention the same 3D data can be displayed in each display subregion, albeit using different display rules. Alternatively, in other exemplary embodiments of the present invention, a different 3D data set can be displayed in each display subregion.

Abstract: A system and method for controlling the scaling of a 3D computer model in a 3D display system include activating a zoom mode, selecting a model zoom point and setting a zoom scale factor are presented. In exemplary embodiments according to the present invention, a system, in response to the selected model zoom point and the set scale factor, can implements a zoom operation and automatically move a model zoom point from its original position towards an optimum viewing point. In exemplary embodiments according to the present invention, upon a user's activating a zoom mode, selecting a model zoom point and setting a zoom scale factor, a system can simultaneously move a model zoom point to an optimum viewing point. In preferred exemplary embodiments according to the present invention, a system can automatically identify a model zoom point by applying defined rules to visible points of a displayed model that lie in a central viewing area.

Abstract: A method of rendering a graphics image in which rendering is only carried out in a region to be changed is disclosed.