Abstract: A stereoscopic visualization system using shape from shading algorithm is an image conversion device connected between a monoscopic endoscope and a 3D monitor. The system applies the algorithm which generates a depth map for a 2D image of video frames. The algorithm first calculates a direction of a light source for the 2D image. Based upon the information of light distribution and shading for the 2D image, the depth map is generated. The depth map is used to calculate another view of the original 2D image by depth image based rendering algorithm in generation of stereoscopic images. After the new view is rendered, the stereoscopic visualization system also needs to convert the display format of the stereoscopic images for different kinds of 3D displays. Based on this method, it can replace the whole monoscopic endoscope with a stereo-endoscope system and no modification is required for the monoscopic endoscope.

Abstract: A fusion-imaging method for radiofrequency ablation is provided, including: obtaining preoperative volume image of an individual; reconstructing a virtual three-dimensional model of a target area of the individual according to the preoperative volume image; creating a global reference frame by a tracking device and registering the virtual three-dimensional model to the global reference frame; obtaining an ultrasound image of the target area by using an ultrasonic probe and tracking the ultrasonic probe by the tracking device in order to register the ultrasonic image to the global reference frame; capturing a virtual corresponding image corresponding to a portion of the virtual three-dimensional model along a plane of the ultrasonic image; and overlapping the ultrasonic image and the virtual corresponding image and simultaneously displaying the overlapping image and a virtual radiofrequency ablation probe model.

Abstract: An implantable capsule includes a capsule, an adsorption hole, a pH detector, two impedance sensors and a pose sensor. The capsule includes a first shell, a second shell and the first shell and the second shell defines an accommodating space. The adsorption hole is disposed at the first shell and attaches to the tube wall of the esophagus by the external force. The pH detector is disposed at the second shell to measure the pH value of the esophageal fluid. Two impedance sensors are disposed at the first shell and the second shell. The two impedance sensors measure the impedance of the esophageal fluid to determine the fluid direction of the esophageal fluid. The pose sensor is disposed at the second shell to determine the patient pose. By this configuration, lightweight and wireless gastroesophageal monitoring device and the long-time measurement of pH of the esophageal fluid may be achieved.

Abstract: An augmented reality method for an endoscope includes constructing a first virtual three-dimensional model by using the volume image; setting a reference frame of a position tracking device as a global reference frame; obtaining a second virtual three-dimensional model of the subject by using laser scanning; calculating a first transformation between the first virtual three-dimensional model and the second virtual three-dimensional model by the iterative closest point algorithm, and applying the first transformation to the first virtual three-dimensional model to generate a third virtual three-dimensional model; tracking the first tracker by the position tracking device to provide an endoscopic virtual position; imaging a virtual image corresponding to an endoscopic image imaged by the endoscope based on the endoscopic virtual position and the third virtual three-dimensional model, and superimposing the endoscopic image with the virtual image to display a superimposed image.

Abstract: A fusion-imaging method for radiofrequency ablation is provided, including: obtaining preoperative volume image of an individual; reconstructing a virtual three-dimensional model of a target area of the individual according to the preoperative volume image; creating a global reference frame by a tracking device and registering the virtual three-dimensional model to the global reference frame; obtaining an ultrasound image of the target area by using an ultrasonic probe and tracking the ultrasonic probe by the tracking device in order to register the ultrasonic image to the global reference frame; capturing a virtual corresponding image corresponding to a portion of the virtual three-dimensional model along a plane of the ultrasonic image; and overlapping the ultrasonic image and the virtual corresponding image and simultaneously displaying the overlapping image and a virtual radiofrequency ablation probe model.

Abstract: Disclosed is a minimally invasive instrument with instant force feedback function, including a minimally invasive device, a sensing device, a computing device, and a warning device. The minimally invasive device may have an invasive portion, which may enter the human body to perform surgical operations. The sensing device is provided on the invasive portion of the minimally invasive device and may include a flexible conductive film, a plurality of bionic films and a plurality of liquid beads. The plurality of bionic films may be provided on a flexible conductive film. Each of the plurality of liquid beads may be covered by each of the plurality of bionic films. The computing device may be electrically connected to the flexible conductive film. The warning device may receive a warning signal and generate a warning message.

Abstract: Disclosed is an image registration and an augmented reality system and an augmented reality method thereof which is suitable for solving the problem of spatial localization of the temporomandibular joint (TMJ) in arthroscopic surgery. The system comprises a three-dimensional scanning model building device, a stereoscopic image photographing device, a projection device and an arithmetic unit. The three-dimensional scanning model was constructed by preoperative or intraoperative imaging of the patient, and the surface three-dimensional model constructed by the stereoscopic image photographing device was spatially aligned to remove the surface (skin layer) of the three-dimensional image to display the TMJ image. Through the calibration of the stereoscopic image photographing device and the projection device, accurate, three-dimensional TMJ image location information is projected onto the patient's body to achieve the purpose.

Abstract: A stereoscopic visualization system using shape from shading algorithm is an image conversion device connected between a monoscopic endoscope and a 3D monitor. The system applies the algorithm which generates a depth map for a 2D image of video frames. The algorithm first calculates a direction of a light source for the 2D image. Based upon the information of light distribution and shading for the 2D image, the depth map is generated. The depth map is used to calculate another view of the original 2D image by depth image based rendering algorithm in generation of stereoscopic images. After the new view is rendered, the stereoscopic visualization system also needs to convert the display format of the stereoscopic images for different kinds of 3D displays. Based on this method, it can replace the whole monoscopic endoscope with a stereo-endoscope system and no modification is required for the monoscopic endoscope.

Abstract: Disclosed is a minimally invasive instrument with instant force feedback function, including a minimally invasive device, a sensing device, a computing device, and a warning device. The minimally invasive device may have an invasive portion, which may enter the human body to perform surgical operations. The sensing device is provided on the invasive portion of the minimally invasive device and may include a flexible conductive film, a plurality of bionic films and a plurality of liquid beads. The plurality of bionic films may be provided on a flexible conductive film. Each of the plurality of liquid beads may be covered by each of the plurality of bionic films. The computing device may be electrically connected to the flexible conductive film. The warning device may receive a warning signal and generate a warning message.

Abstract: A lightweight 3D stereoscopic surgical microscope has a body, a robot set, an image set, and an operating set. The body has a wheel seat, a housing mounted on the wheel seat, and a host computer mounted in the housing. The robot set is connected to the body and has a base mounted on the housing, a transversal lever mounted on the base, a lifting arm connected to the transversal lever, and a rotating arm connected to the lifting arm. The image set is connected to the robot set and has an outer casing connected to the rotating arm, at least one objective lens mounted in the outer casing, a main display screen mounted on the outer casing, an auxiliary display screen mounted beside the body. The operating set is connected to the robot set, is connected to the body and the image set and has two operating bars.

Abstract: Disclosed is an image registration and an augmented reality system and an augmented reality method thereof which is suitable for solving the problem of spatial localization of the temporomandibular joint (TMJ) in arthroscopic surgery. The system comprises a three-dimensional scanning model building device, a stereoscopic image photographing device, a projection device and an arithmetic unit. The three-dimensional scanning model was constructed by preoperative or intraoperative imaging of the patient, and the surface three-dimensional model constructed by the stereoscopic image photographing device was spatially aligned to remove the surface (skin layer) of the three-dimensional image to display the TMJ image. Through the calibration of the stereoscopic image photographing device and the projection device, accurate, three-dimensional TMJ image location information is projected onto the patient's body to achieve the purpose.

Abstract: A 3D stereo image display device for a surgical microscope is provided. The surgical microscope comprises a main body, a mechanical arm, and an operation assembly. The 3D stereo image display device has a shell, at least one objective lens, an image processing circuit and a screen. The at least one objective lens is mounted in the shell. The image processing circuit is mounted in the shell and is electrically connected to the at least one objective lens. The host computer has an image processor for converting images captured by the at least one objective lens into 3D stereo images. The screen is mounted on an outer surface of the shell and is electrically connected to the image processing circuit for displaying the 3D stereo images. Thus, the 3D stereo image display device is provided to prevent tiredness and improve applicability and convenience.

Abstract: An adjustable dual-lens device for 3D stereoscopic surgical microscopes has an outer casing, an image set, and an adjusting set. The image set is mounted in the outer casing and has two lenses. The lenses are pivotally mounted in the outer casing at a spaced interval. The adjusting set is mounted in the outer casing and has two adjusting units. Each adjusting unit has a driving motor, a cam, and a limiting element. The driving motor is mounted in the outer casing adjacent to one of the lenses and has a driving shaft. The cam is eccentrically mounted around the driving shaft and is pressed against the lens that is adjacent to the driving motor. The limiting element is connected to the outer casing and the corresponding lens to enable the corresponding lens to press against the cam.

Abstract: A surgical instrument with pressure sensing and vision feedback functions has an instrument body and a piezochromic device. The instrument body includes a work piece with a visible surface. The piezochromic device is disposed on the visible surface of the work piece of the instrument body and performs color change when the piezochromic device senses pressure. Therefore, when a doctor performs surgery using the surgical instrument, the doctor can directly see the piezochromic device. When the piezochromic device contacts other surgical instruments or presses organs or tissues within a patient's body, the piezochromic device will change color when the piezochromic device senses the pressure enabling the doctor to adjust the surgical instrument accordingly.

Abstract: An adjustable light source device for a stereoscopic surgical microscope has a circuit board and multiple light sources. The circuit board is mounted in an outer casing of the stereoscopic surgical microscope and is electrically connected to a host computer of the stereoscopic surgical microscope. The light sources are electrically mounted on the circuit board at spaced intervals around two objective lenses of the stereoscopic surgical microscope and extend out of the outer casing. Each one of the light sources has a wavelength different from wavelengths of the other light sources and is controlled to emit light by an operating set of the stereoscopic surgical microscope via a program processing interface of the host computer sending signals to the circuit board. The adjustable light source device can emit lights with different wavelengths to enable the stereoscopic surgical microscope to capture clearer images for various surgical divisions.

Abstract: An adjustable dual-lens device for 3D stereoscopic surgical microscopes has an outer casing, an image set, and an adjusting set. The image set is mounted in the outer casing and has two lenses. The lenses are pivotally mounted in the outer casing at a spaced interval. The adjusting set is mounted in the outer casing and has two adjusting units. Each adjusting unit has a driving motor, a cam, and a limiting element. The driving motor is mounted in the outer casing adjacent to one of the lenses and has a driving shaft. The cam is eccentrically mounted around the driving shaft and is pressed against the lens that is adjacent to the driving motor. The limiting element is connected to the outer casing and the corresponding lens to enable the corresponding lens to press against the cam.

Abstract: A lightweight 3D stereoscopic surgical microscope has a body, a robot set, an image set, and an operating set. The body has a wheel seat, a housing mounted on the wheel seat, and a host computer mounted in the housing. The robot set is connected to the body and has a base mounted on the housing, a transversal lever mounted on the base, a lifting arm connected to the transversal lever, and a rotating arm connected to the lifting arm. The image set is connected to the robot set and has an outer casing connected to the rotating arm, at least one objective lens mounted in the outer casing, a main display screen mounted on the outer casing, an auxiliary display screen mounted beside the body. The operating set is connected to the robot set, is connected to the body and the image set and has two operating bars.

Abstract: A stereo display system using shape from shading algorithm is an image conversion device connected between a monoscopic endoscope and a 3D monitor. The system applies the algorithm which generates a depth map for a 2D image of video frames. The algorithm first calculates a direction of a light source for the 2D image and based upon the information of light distribution and shading for the 2D image to generate the depth map. The depth map is used to calculate another view of the original 2D image by depth image based rendering algorithm in generation of stereoscopic images. After the new view is rendered, the stereo display system also needs to convert the display format of the stereoscopic images for different kinds of 3D displays. Base on this method, it is necessary to replace the whole monoscopic endoscope with a stereo-endoscope system and no modification is required for the monoscopic endoscope.

Abstract: A stereoscopic vision system includes a monoscopic endoscope, an external adapter lens, and a camera calibration and stereoscopic processing unit. The external adapter lens has two tubes formed therein for forming two optical paths and is mounted on the endoscope for a CCD of the endoscope to receive parallax image pairs of an observed object. Each parallax image pair has a left image and a right image thereon. The camera calibration and stereoscopic processing unit receives the parallax image pairs, and calibrates two camera systems formed by the adapter lens and the endoscope and processes the parallax image pairs generated from the calibration to generate stereoscopic images to be displayed on a display. The simple and inexpensive two-tube external adapter lens directly mounted on any type of monoscopic endoscope without modifying the monoscopic endoscope and one-time camera calibration ensures cost effectiveness and operational convenience.

Abstract: Methods for generating stereoscopic views from monoscopic endoscope images and systems using the same are provided. First, monoscopic images are obtained by capturing images of organs in an operating field via an endoscope. A background depth map of the operating field is obtained for each image. An instrument depth map corresponding to an instrument is obtained for each image, wherein the instrument is inserted in a patient's body cavity. The background depth maps and the instrument depth maps are merged to generate an integrated depth map for each image. Stereoscopic views are generated according to the monoscopic images and the integrated depth maps.