Abstract: An augmented reality-assisted method for performing surgery comprises: disposing a position sensing element at a facial positioning point of a patient before craniotomy to obtain skull space and intracranial space information for defining a coordinate space; obtaining a brain anatomical image for constructing a three-dimensional graphic, the graphic comprising a graphic positioning point and a feature associated with a gyrus feature; defining a relative positional relationship between the graphic and the space, aligning the facial positioning point with the graphic positioning point; using a probe to obtain a spatial position of the gyrus feature after craniotomy, using the gyrus feature as a calibration reference point; generating a displacement and rotation parameter based on a coordinate difference of the feature relative to the reference point; adjusting a position and/or an angle of the graphic on a display according to the parameter, and the display displaying the calibrated three-dimensional graphic.

Abstract: An augmented reality-assisted method for performing surgery comprises: disposing a position sensing element at a facial positioning point of a patient before craniotomy to obtain skull space and intracranial space information for defining a coordinate space; obtaining a brain anatomical image for constructing a three-dimensional graphic, the graphic comprising a graphic positioning point and a feature associated with a gyrus feature; defining a relative positional relationship between the graphic and the space, aligning the facial positioning point with the graphic positioning point; using a probe to obtain a spatial position of the gyrus feature after craniotomy, using the gyrus feature as a calibration reference point; generating a displacement and rotation parameter based on a coordinate difference of the feature relative to the reference point; adjusting a position and/or an angle of the graphic on a display according to the parameter, and the display displaying the calibrated three-dimensional graphic.

Abstract: A stereoscopic visualization system using shape from shading algorithm is an image conversion device connected between a monoscopic endoscope and a 3D monitor. The system applies the algorithm which generates a depth map for a 2D image of video frames. The algorithm first calculates a direction of a light source for the 2D image. Based upon the information of light distribution and shading for the 2D image, the depth map is generated. The depth map is used to calculate another view of the original 2D image by depth image based rendering algorithm in generation of stereoscopic images. After the new view is rendered, the stereoscopic visualization system also needs to convert the display format of the stereoscopic images for different kinds of 3D displays. Based on this method, it can replace the whole monoscopic endoscope with a stereo-endoscope system and no modification is required for the monoscopic endoscope.

Abstract: A fusion-imaging method for radiofrequency ablation is provided, including: obtaining preoperative volume image of an individual; reconstructing a virtual three-dimensional model of a target area of the individual according to the preoperative volume image; creating a global reference frame by a tracking device and registering the virtual three-dimensional model to the global reference frame; obtaining an ultrasound image of the target area by using an ultrasonic probe and tracking the ultrasonic probe by the tracking device in order to register the ultrasonic image to the global reference frame; capturing a virtual corresponding image corresponding to a portion of the virtual three-dimensional model along a plane of the ultrasonic image; and overlapping the ultrasonic image and the virtual corresponding image and simultaneously displaying the overlapping image and a virtual radiofrequency ablation probe model.

Abstract: The present invention provides a medical image processing method, which comprises following steps of: receiving a three-dimensional model image file and at least one medical record data by a medical image processing device; creating a three-dimensional medical file based on the three-dimensional model image file and the at least one medical record data, wherein the three-dimensional medical file conforms to a digital imaging and communications in medicine standard; transmitting the three-dimensional medical file to a medical picture archiving and communication system; retrieving the three-dimensional medical file from the medical picture archiving and communication system by a three-dimensional medical image browsing device which is a non-workstation computer device loaded with a viewer software; and displaying the three-dimensional medical file.

Abstract: An augmented reality method for an endoscope includes constructing a first virtual three-dimensional model by using the volume image; setting a reference frame of a position tracking device as a global reference frame; obtaining a second virtual three-dimensional model of the subject by using laser scanning; calculating a first transformation between the first virtual three-dimensional model and the second virtual three-dimensional model by the iterative closest point algorithm, and applying the first transformation to the first virtual three-dimensional model to generate a third virtual three-dimensional model; tracking the first tracker by the position tracking device to provide an endoscopic virtual position; imaging a virtual image corresponding to an endoscopic image imaged by the endoscope based on the endoscopic virtual position and the third virtual three-dimensional model, and superimposing the endoscopic image with the virtual image to display a superimposed image.

Abstract: A fusion-imaging method for radiofrequency ablation is provided, including: obtaining preoperative volume image of an individual; reconstructing a virtual three-dimensional model of a target area of the individual according to the preoperative volume image; creating a global reference frame by a tracking device and registering the virtual three-dimensional model to the global reference frame; obtaining an ultrasound image of the target area by using an ultrasonic probe and tracking the ultrasonic probe by the tracking device in order to register the ultrasonic image to the global reference frame; capturing a virtual corresponding image corresponding to a portion of the virtual three-dimensional model along a plane of the ultrasonic image; and overlapping the ultrasonic image and the virtual corresponding image and simultaneously displaying the overlapping image and a virtual radiofrequency ablation probe model.

Abstract: Disclosed is an image registration and an augmented reality system and an augmented reality method thereof which is suitable for solving the problem of spatial localization of the temporomandibular joint (TMJ) in arthroscopic surgery. The system comprises a three-dimensional scanning model building device, a stereoscopic image photographing device, a projection device and an arithmetic unit. The three-dimensional scanning model was constructed by preoperative or intraoperative imaging of the patient, and the surface three-dimensional model constructed by the stereoscopic image photographing device was spatially aligned to remove the surface (skin layer) of the three-dimensional image to display the TMJ image. Through the calibration of the stereoscopic image photographing device and the projection device, accurate, three-dimensional TMJ image location information is projected onto the patient's body to achieve the purpose.

Abstract: A stereoscopic visualization system using shape from shading algorithm is an image conversion device connected between a monoscopic endoscope and a 3D monitor. The system applies the algorithm which generates a depth map for a 2D image of video frames. The algorithm first calculates a direction of a light source for the 2D image. Based upon the information of light distribution and shading for the 2D image, the depth map is generated. The depth map is used to calculate another view of the original 2D image by depth image based rendering algorithm in generation of stereoscopic images. After the new view is rendered, the stereoscopic visualization system also needs to convert the display format of the stereoscopic images for different kinds of 3D displays. Based on this method, it can replace the whole monoscopic endoscope with a stereo-endoscope system and no modification is required for the monoscopic endoscope.

Abstract: Disclosed is an image registration and an augmented reality system and an augmented reality method thereof which is suitable for solving the problem of spatial localization of the temporomandibular joint (TMJ) in arthroscopic surgery. The system comprises a three-dimensional scanning model building device, a stereoscopic image photographing device, a projection device and an arithmetic unit. The three-dimensional scanning model was constructed by preoperative or intraoperative imaging of the patient, and the surface three-dimensional model constructed by the stereoscopic image photographing device was spatially aligned to remove the surface (skin layer) of the three-dimensional image to display the TMJ image. Through the calibration of the stereoscopic image photographing device and the projection device, accurate, three-dimensional TMJ image location information is projected onto the patient's body to achieve the purpose.

Abstract: A stereo display system using shape from shading algorithm is an image conversion device connected between a monoscopic endoscope and a 3D monitor. The system applies the algorithm which generates a depth map for a 2D image of video frames. The algorithm first calculates a direction of a light source for the 2D image and based upon the information of light distribution and shading for the 2D image to generate the depth map. The depth map is used to calculate another view of the original 2D image by depth image based rendering algorithm in generation of stereoscopic images. After the new view is rendered, the stereo display system also needs to convert the display format of the stereoscopic images for different kinds of 3D displays. Base on this method, it is necessary to replace the whole monoscopic endoscope with a stereo-endoscope system and no modification is required for the monoscopic endoscope.

Abstract: A stereoscopic vision system includes a monoscopic endoscope, an external adapter lens, and a camera calibration and stereoscopic processing unit. The external adapter lens has two tubes formed therein for forming two optical paths and is mounted on the endoscope for a CCD of the endoscope to receive parallax image pairs of an observed object. Each parallax image pair has a left image and a right image thereon. The camera calibration and stereoscopic processing unit receives the parallax image pairs, and calibrates two camera systems formed by the adapter lens and the endoscope and processes the parallax image pairs generated from the calibration to generate stereoscopic images to be displayed on a display. The simple and inexpensive two-tube external adapter lens directly mounted on any type of monoscopic endoscope without modifying the monoscopic endoscope and one-time camera calibration ensures cost effectiveness and operational convenience.

Abstract: A pincers including a fixed component, a movable component and a locating mechanism. The fixed component is formed with an elliptic moving recess. A moving member is synchronously moved when a pushing rod of the movable component moves within a slide slot formed in the moving recess. The locating mechanism serves to restrict the moving of the moving member and restrict the moving of the pushing rod so as to fix the distance between the fixed jaw and movable jaw and pitchlessly adjust the pincers.

Abstract: A ratchet wrench including a handle and at least one fitting wheel rotatably mounted at one end of the handle. A middle section of outer side of the fitting wheel is formed with multiple annularly arranged teeth. A spiral rod is rotatably connected with two pivot sections of the handle near the fitting wheel. The spiral rod meshes with the teeth of the fitting wheel. One end of the spiral rod abuts against an intermediate member for reducing frictional force between the spiral rod and one of the pivot sections. The other end of the spiral rod is engaged with the other of the pivot sections. The spiral rod can cooperate with the teeth of the fitting wheel by any angle so that the handle of the ratchet wrench can be rotated by any angle without limitation of pitch.