Endoscope Patents (Class 348/45)
  • Patent number: 11967048
    Abstract: Provided are methods, performed by an electronic device, for processing an image. The method includes obtaining a first image by photographing a subject. The method further includes obtaining a depth image including information related to a distance from the electronic device to the subject. The method further includes determining whether light reflection exists in the first image. The method further includes obtaining depth information indicating the distance from the electronic device to the subject. The method further includes obtaining a second image by photographing the subject in an activated state of a flash. The method further includes performing pre-processing for matching the first image, the second image, and the depth image. The method further includes obtaining the image from which the light reflection has been removed using at least one of the pre-processed first image, the pre-processed second image, or the pre-processed depth image.
    Type: Grant
    Filed: June 3, 2022
    Date of Patent: April 23, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sakib Reza, Arup Kumar Sarker, Redwanul Haque Sourave
  • Patent number: 11954897
    Abstract: An endoscope processor device generates first video signals. A recognition processing processor device generates second video signals by reflecting a result of recognition processing based on the first video signals. A display displays any one of the second video signals or the first video signals switched from the second video signals on the basis of first video switching signals from the recognition processing processor device. The display displays that a result display of the recognition processing is being stopped in a case where the result display of the recognition processing by the second video signals is stopped.
    Type: Grant
    Filed: October 6, 2022
    Date of Patent: April 9, 2024
    Assignee: FUJIFILM Corporation
    Inventor: Shumpei Kamon
  • Patent number: 11915512
    Abstract: A three-dimensional sensing system includes a plurality of scanners each emitting a light signal to a scene to be sensed and receiving a reflected light signal, according to which depth information is obtained. Only one scanner executes transmitting corresponding light signal and receiving corresponding reflected light signal at a time.
    Type: Grant
    Filed: October 14, 2021
    Date of Patent: February 27, 2024
    Assignee: Himax Technologies Limited
    Inventors: Ching-Wen Wang, Cheng-Che Tsai, Ting-Sheng Hsu, Min-Chian Wu
  • Patent number: 11911116
    Abstract: A system includes a console assembly, a trocar assembly operably coupled to the console assembly, a camera assembly operably coupled to the console assembly having a stereoscopic camera assembly, and at least one rotational positional sensor configured to detect rotation of the stereoscopic camera assembly about at least one of a pitch axis or a yaw axis. The console assembly includes a first actuator and a first actuator pulley operable coupled to the first actuator. The trocar assembly includes a trocar having an inner and outer diameter, and a seal sub-assembly comprising at least one seal and the seal sub-assembly operably coupled to the trocar. The camera assembly includes a camera support tube having a distal and a proximal end, the stereoscopic camera operably coupled to the distal end of the support tube and a first and second camera module having a first and second optical axis.
    Type: Grant
    Filed: July 28, 2022
    Date of Patent: February 27, 2024
    Assignee: Vicarious Surgical Inc.
    Inventors: Eric Kline, Sammy Khalifa, Marshall Wentworth, Eric Van Albert
  • Patent number: 11864764
    Abstract: The invention provides systems, devices, and methods for the delivery, deployment, and positioning of magnetic compression devices at a desired site so as to improve the accuracy of anastomoses creation between tissues, organs, or the like.
    Type: Grant
    Filed: February 16, 2023
    Date of Patent: January 9, 2024
    Assignee: G.I. Windows, Inc.
    Inventors: Brian P. Tinkham, Dane T. Seddon, Natan Zundel, Jiping C. Wang, Shani Mann
  • Patent number: 11850103
    Abstract: A surgical electronic microscope device (10) includes a microscope unit (110) and a support unit (120) that supports the microscope unit (110). The microscope unit (110) images an operative site of a patient (330) on an operating table (340), and outputs an image signal. The support unit (120) includes a prop unit (290c). The prop unit (290c) supports a second arm (290b) rotatably around an axis (05). The second arm (290b) supports a first arm (290a) rotatably around an axis (04). The first arm (290a) supports the microscope unit (110). Pivoting the second arm (290b) on the axis (05) while keeping the first arm (290a) substantially level makes it possible to change a height of the microscope unit (110). A length (V) of the second arm (290b) is greater than a length (H) of the first arm (290a). Accordingly, a movable range of the microscope unit (110) in a vertical direction is wide.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: December 26, 2023
    Assignee: Sony Olympus Medical Solutions Inc.
    Inventor: Kenji Hirose
  • Patent number: 11832787
    Abstract: A user-interface for aiding navigation of an endoscope through a lumen of a tubular anatomical structure during an endoscopy procedure includes a video region in which a live video feed received from the endoscope is displayed and an observation location map. The observation location map depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope longitudinally traverses the tubular anatomical structure within the lumen during the endoscopy procedure.
    Type: Grant
    Filed: December 27, 2021
    Date of Patent: December 5, 2023
    Assignee: Verily Life Sciences LLC
    Inventors: Daniel Freedman, Yacob Yochai Blau, Dmitri Veikherman, Roman Goldenberg, Ehud Rivlin
  • Patent number: 11806102
    Abstract: A system may comprise an image capture device to capture an image of a work site. The system may also comprise a processor to determine whether a tool disposed at the work site is energized and determine a first area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image. The processor may also determine a second area of the captured image including a remainder of the captured image that does not include the first area. Conditioned upon determining that the tool is energized, at least one of the first area and the second area of the captured image of the work site may be processed to indicate that the tool in the first area is being energized. The image of the work site with the first area and the second area may be displayed.
    Type: Grant
    Filed: June 3, 2022
    Date of Patent: November 7, 2023
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Simon P. Dimaio, Brian D. Hoffman, Brandon D. Itkowitz, Paul W. Mohr, David W. Robinson, Tao Zhao, Wenyi Zhao
  • Patent number: 11792508
    Abstract: A remote control device 60 measures a distance to a noticed imaging target OB directly in front of the remote control device 60 by a distance measurement unit. Further, the remote control device 60 measures a movement from an initial state by a motion sensor unit and transmits imaging target position information indicative of the measured distance and movement from a communication unit to an imaging device 20. An imaging target position calculation unit provided on the imaging device 20 calculates, on the basis of the imaging target position information from the remote control device 60, a direction of the noticed imaging target OB with respect to the direction in the initial state of the imaging device 20. By generating a direction controlling signal on the basis of a calculation result of the imaging target position calculation unit and outputting the direction controlling signal to a pan head 40, the imaging direction of the imaging device 20 can be set to the direction of the noticed imaging target OB.
    Type: Grant
    Filed: January 7, 2020
    Date of Patent: October 17, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Tomoya Ouchi, Toshiaki Ueda, Takayuki Hatanaka
  • Patent number: 11785348
    Abstract: Disclosed are an endoscopic reflection microscope using an optical fiber bundle and an image acquisition method using the same. The endoscopic reflection microscope includes an incident wave output unit configured to output an incident wave to a target object through any one optical fiber in an optical fiber bundle, a reflected wave receiver configured to receive a reflected wave output from the target object in response to the incident wave through a plurality of corresponding optical fibers in the optical fiber bundle, and an image acquirer configured to establish a reflection matrix corresponding to the reflected wave and to acquire an image in which at least one of phase retardation of the incident wave or phase retardation of the reflected wave is compensated for based on the established reflection matrix.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: October 10, 2023
    Assignees: Korea University Research and Business Foundation, Institute for Basic Science
    Inventors: Won Shik Choi, Won Jun Choi, Mun Kyu Kang
  • Patent number: 11781906
    Abstract: Aspects of embodiments pertain to a sensing systems configured to receive scene electromagnetic (EM) radiation comprising a first wavelength (WL1) range and a second wavelength (WL2) range. The sensing system comprises at least one spectral filter configured to filter the received scene EM radiation to obtain EM radiation in the WL1 range and the WL2 ranges; and a self-adaptive electromagnetic (EM) energy attenuating structure. The self-adaptive EM energy attenuating structure may comprise material that includes nanosized particles which are configured such that high intensity EM radiation at the WL1 range incident onto a portion of the self-adaptive EM energy attenuating structure causes interband excitation of one or more electron-hole pairs, thereby enabling intraband transition in the portion of the self-adaptive EM energy attenuating structure by EM radiation in the WL2 range.
    Type: Grant
    Filed: September 2, 2022
    Date of Patent: October 10, 2023
    Assignee: ELBIT SYSTEMS LTD.
    Inventors: Noam Yona Gross, Ariela Donval
  • Patent number: 11743596
    Abstract: Endoscopic systems, non-transitory, machine-readable storage media, and methods for correcting brightness non-uniformity are described. In an embodiment, the endoscopic system includes a light source positioned to emit illumination light onto a scene; a photodetector positioned to receive illumination light reflected off of the scene and configured to generate a scene signal based on the received illumination light; a display; and a controller operatively coupled to the light source, the photodetector, and the display.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: August 29, 2023
    Assignee: Verily Life Sciences LLC
    Inventors: Aurelien Bouvier, Nishant Verma
  • Patent number: 11690683
    Abstract: Systems and methods for vision-based position and orientation determination for endovascular tools are disclosed. In one example, a method includes receiving a two-dimensional medical image including a view of at least a distal portion of a medical instrument, the distal portion of the medical instrument including one or more fiducials positioned thereon, the one or more fiducials being radio-opaque and visible in the medical image. The method also includes detecting, within the medical image, a two-dimensional appearance of the one or more fiducials, and based on the two-dimensional appearance of the one or more fiducials, determining at least one of a roll angle of the distal portion of the medical instrument, and an incline of the distal portion of the medical instrument.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: July 4, 2023
    Assignee: REMEDY ROBOTICS, INC
    Inventors: David James Bell, Jake Anthony Sganga, Gregory Kahn
  • Patent number: 11653824
    Abstract: Provided is a medical observation system including a medical observation device and an image processing device. The medical observation device includes a plurality of imaging elements and a branching optical system configured to split incident light into a plurality of rays of light, and each of the plurality of rays of light split by the branching optical system is guided to at least one of the plurality of imaging elements. Of the plurality of imaging elements, two or more imaging elements each capture images having mutually different brightness, and two or more imaging elements are arranged so as to have mutually different optical distances from the branching optical system.
    Type: Grant
    Filed: April 16, 2018
    Date of Patent: May 23, 2023
    Assignee: SONY CORPORATION
    Inventors: Kenji Takahashi, Yasuaki Takahashi, Takeshi Miyai
  • Patent number: 11606497
    Abstract: Disclosed is an endoscope system, which comprises an endoscope, the endoscope having at its distal end multiple cameras each having a different field of view (FOV). The system also comprises an image processing box adapted to receive images of different FOVs from the multiple cameras and process the image to form a consolidated image covering 360-degree view of areas surrounding the distal end using the received images of different FOVs and image-stitching techniques.
    Type: Grant
    Filed: June 10, 2015
    Date of Patent: March 14, 2023
    Inventor: Nitesh Ratnakar
  • Patent number: 11596293
    Abstract: In an endoscope system, a frame adjustment unit makes a frame adjustment for changing the number of frames to be displayed per unit time (frame rate) for a normal image and for a computational image on the basis of a computational processing time detected by a computational processing time detection unit and an amount of motion detected by a motion detection unit. A display control unit determines a display method for the normal image and the computational image on the basis of the amount of motion, and the normal image and the computational image are displayed on a monitor in accordance with the display method.
    Type: Grant
    Filed: August 17, 2020
    Date of Patent: March 7, 2023
    Assignee: FUJIFILM Corporation
    Inventor: Maiko Endo
  • Patent number: 11576739
    Abstract: Methods, systems, and computer-readable media for detecting image degradation during a surgical procedure are provided. A method includes receiving images of a surgical instrument; obtaining baseline images of an edge of the surgical instrument; comparing a characteristic of the images of the surgical instrument to a characteristic of the baseline images of the edge of the surgical instrument, the images of the surgical instrument being received subsequent to obtaining the baseline images of the edge of the surgical instrument and being received while the surgical instrument is disposed at a surgical site in a patient; determining whether the images of the surgical instrument are degraded, based on the comparing of the characteristic of the images of the surgical instrument and the characteristic of the baseline images of the surgical instrument; and generating an image degradation notification, in response to a determination that the images of the surgical instrument are degraded.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: February 14, 2023
    Assignee: COVIDIEN LP
    Inventor: Dwight Meglan
  • Patent number: 11523084
    Abstract: A stereoscopic imaging apparatus for use in a robotic surgery system is disclosed and includes an elongate sheath having a bore. First and second image sensors are adjacently mounted at the distal end to capture high definition images from different perspective viewpoints for generating three-dimensional image information. The image sensors produce an unprocessed digital data signal representing the captured images. A wired signal line transmits the unprocessed digital data signals along the sheath to a proximal end to processing circuitry. The processing circuitry is configured to perform processing operations on the unprocessed digital data signals to produce respective video signals suitable for transmission to a host system or for driving a 3D display. A secondary camera is also disclosed and includes an elongate strip of circuit substrate sized for insertion through a narrow conduit, the strip of circuit substrate connecting between an image sensor and a processing circuit substrate.
    Type: Grant
    Filed: July 9, 2021
    Date of Patent: December 6, 2022
    Assignee: Titan Medical Inc.
    Inventors: Evan Rittenhouse Jones, Spencer James Costello
  • Patent number: 11510599
    Abstract: An endoscope system includes a light source unit, an image sensor, an image acquisition unit, a first image generation unit, a second image generation unit, and a region discrimination unit. The light source unit emits a plurality of types of illumination light beams with different wavelengths. The image acquisition unit acquires images corresponding to the respective illumination light beams. The first image generation unit generates a first image (white light image) serving as a base of a display image. The second image generation unit generates a second image (bright/dark region discrimination image or the like), using at least one image having a different corresponding wavelength from that of the image used for the generation of the first image. The region discrimination unit discriminates the regions in the observation target, using the second image.
    Type: Grant
    Filed: August 21, 2019
    Date of Patent: November 29, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Hiroaki Yamamoto
  • Patent number: 11478134
    Abstract: A stereoscopic-vision endoscope optical system includes a pair of objective optical systems, a pair of relay optical systems, and a pair of image forming optical systems. The image forming optical system includes a first lens unit, a first optical-path bending element, and a second optical-path bending element. The objective optical system and the relay optical system are disposed in a first optical path. A second optical path is formed between the first optical-path bending element and the second optical-path bending element. A third optical path is formed between the second optical-path bending element and a final image. The second optical path is positioned farther from the central axis, than the first optical path. The third optical path is positioned closer to the central axis, than the second optical path.
    Type: Grant
    Filed: September 18, 2019
    Date of Patent: October 25, 2022
    Assignee: OLYMPUS CORPORATION
    Inventors: Yoshihiro Uchida, Tsutomu Uzawa
  • Patent number: 11426052
    Abstract: An endoscopic system includes a left optical system having a first focal position, a right optical system having a second focal position that is different from the first focal position. An image capturing device generates a first image and a second image respectively from images of a subject that are obtained by the left optical system and the right optical system. A display device displays the first image or the second image. A proper image determiner determines the magnitude relationship between the position of the subject in a predetermined area displayed on the display device and at least one threshold value Th is established between the first focal position and the second focal position. A video signal processor switches to the first image or the second image depending on a determined result from the proper image determiner and displays the image on the display device.
    Type: Grant
    Filed: December 10, 2018
    Date of Patent: August 30, 2022
    Assignee: OLYMPUS CORPORATION
    Inventor: Naoki Yamamoto
  • Patent number: 11406250
    Abstract: A manipulation assembly includes a delivery catheter having a lumen extending therethrough and a deployment catheter positioned within the delivery catheter. The deployment catheter is independently manipulatable with respect to the delivery catheter. The assembly further includes a visualization element extendable distally beyond the deployment catheter and an ablation probe comprising an energy transmitting surface positionable to ablate tissue adjacent to a distal end of the ablation probe. The ablation probe is extendable distally beyond the deployment catheter.
    Type: Grant
    Filed: May 12, 2017
    Date of Patent: August 9, 2022
    Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
    Inventors: Vahid Saadat, Ruey-Feng Peh, Edmund A. Tam, Chris A. Rothe
  • Patent number: 11308663
    Abstract: The present invention relates to production of 2D digital images suitable for use in medical imaging. The invention particularly relates to remapping X-ray images taken from a first viewpoint so that they present the same image as seen from a second viewpoint. Remapping is achieved by registering separate 2D images taken from the first and second viewpoints of an area with a 3D scan volume of the same region to ascertain their relative viewpoints with respect to the 3D scan volume. The image taken with respect to the first viewpoint is then remapped to yield the image as seen from the second viewpoint.
    Type: Grant
    Filed: February 19, 2016
    Date of Patent: April 19, 2022
    Assignee: Cydar Limited
    Inventors: Mazen Alhrishy, Graeme Penney, Tom Carrell
  • Patent number: 11298047
    Abstract: Imaging methods aid a user in understanding relative depths of objects or topography within a field of view. In one method, image data is gathered using 3D image sensors, while illumination of an area of interest is alternated with projection of a pattern onto the area of interest. The captured image data is used to display a 3D true color image; a monochrome grid on surfaces of the area of interest; a 3D true color image with a monochrome grid on surfaces of the area of interest; a 2D or 3D false color image where different colors identify different depths of regions of the area of interest; and/or a 2D or 3D true color image of an area of interest with features in the area of interest located a first depth relative to the image sensors highlighted with a common color. In another method, 3D image data is used to generate a 2D image that highlights features at a common depth using the same color.
    Type: Grant
    Filed: October 6, 2020
    Date of Patent: April 12, 2022
    Assignee: Asensus Surgical US, Inc.
    Inventors: Bradley Scott Thomas, Brian P Cash
  • Patent number: 11232632
    Abstract: Disclosed herein are a learning-based three-dimensional (3D) model creation apparatus and method. A method for operating a learning-based 3D model creation apparatus includes generating multi-view feature images using supervised learning, creating a three-dimensional (3D) mesh model using a point cloud corresponding to the multi-view feature images and a feature image representing internal shape information, generating a texture map by projecting the 3D mesh model into three viewpoint images that are input, and creating a 3D model using the texture map.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: January 25, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Seong-Jae Lim, Tae-Joon Kim, Seung-Uk Yoon, Seung-Wook Lee, Bon-Woo Hwang, Jin-Sung Choi
  • Patent number: 11202555
    Abstract: This optical adapter for an endoscope includes a plurality of incident optical systems eccentrically disposed with each other, an optical axis of each of the plurality of incident optical systems being spaced away from an axis of the optical adapter for an endoscope with an interval; a brightness stop including a plurality of apertures corresponding to the plurality of incident optical systems respectively; a relay lens configured to relay incident light entering each of the plurality of incident optical systems to the corresponding aperture; and a distal light-shielding portion which is disposed more distally than the relay lens, wherein the plurality of incident optical systems, the relay lens, and the brightness stop are disposed in this order from a distal end side toward a proximal end side of the optical adapter for an endoscope along an incident direction of the incident light.
    Type: Grant
    Filed: April 30, 2018
    Date of Patent: December 21, 2021
    Assignee: OLYMPUS CORPORATION
    Inventor: Masaki Ichihashi
  • Patent number: 11187886
    Abstract: An optical system for stereoscopic vision includes in order from an object side, a front unit and a rear unit. Each of the front unit and the rear unit includes a lens component consisting of a single lens or a cemented lens. The front unit includes a first front unit and a second front unit, and an optical axis of the first front unit, an optical axis of the second front unit, and an optical axis of the rear unit are positioned in a same plane. The optical axis of the rear unit is positioned between the optical axis of the first front unit and the optical axis of the second front unit, and the following conditional expression (1) is satisfied: 0.15<De/?<0.85??(1).
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: November 30, 2021
    Assignee: OLYMPUS CORPORATION
    Inventor: Yoshihiro Uchida
  • Patent number: 11172993
    Abstract: Described are various embodiments of a sensored surgical tool, and surgical intraoperative tracking and imaging system incorporating same. In one embodiment, the surgical tool comprises a rigid elongate tool body having a substantially rigid tool tip to be displaced and tracked within the surgical cavity so to reproducibly locate the tool tip within the cavity. The tool further comprises one or more tool tip cameras and/or pressure sensors operatively disposed along the body at or proximal to the tool tip.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: November 16, 2021
    Assignee: SYNAPTIVE MEDICAL INC.
    Inventors: Yanhui Bai, Michael Frank Gunter Wood, Cameron Anthony Piron
  • Patent number: 11172184
    Abstract: Systems and methods of imaging include projecting infrared (IR) light from the endoscope toward the at least one anatomical feature (e.g., the exterior of a liver or lung), capturing the IR light, projecting optical light from the endoscope toward a similar portion of the anatomical feature, and capturing the optical light. Once the IR light and the optical light are captured, both are associated with one another to generate an intra-operative 3D image. This projection and capture of IR and optical light may occur at discrete times during the imaging process, or simultaneously.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: November 9, 2021
    Assignee: COVIDIEN LP
    Inventors: John W. Komp, Joe D. Sartor
  • Patent number: 11122968
    Abstract: Optical fiber waveguide for communicating electromagnetic radiation pulsed by an emitter in an endoscopic imaging system. A system includes an emitter for emitting pulses of electromagnetic radiation and an endoscope comprising an image sensor for sensing reflected electromagnetic radiation. The system includes a waveguide communicating the pulses of electromagnetic radiation from the emitter to the endoscope. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises electromagnetic radiation having a wavelength from about 513 nm to about 545 nm, from about 565 nm to about 585 nm, and/or from about 900 nm to about 1000 nm.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: September 21, 2021
    Inventors: Joshua D. Talbert, Donald M. Wichern
  • Patent number: 11092797
    Abstract: The disclosed technology is directed to an endoscopic image capturing device. The image capturing device comprises a first objective lens frame a first lens compartment housing therein first optical members of a first objective optical system and a second lens compartment housing therein second optical members of a second objective optical system that is positioned contiguously with the first objective optical system. A second objective lens frame is disposed for sliding movement with respect to the first objective lens frame in optical axis directions. An image capturing frame is disposed for sliding movement with respect to the second objective lens frame in the optical axis directions and housing therein an image capturing device that has an image capturing surface onto which first and second optical images that has passed through the first and second objective optical systems are focused. A positioning member is disposed in the objective optical system hole.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: August 17, 2021
    Assignee: OLYMPUS CORPORATION
    Inventor: Toru Kuchimaru
  • Patent number: 11070762
    Abstract: A stereoscopic imaging apparatus for use in a robotic surgery system is disclosed and includes an elongate sheath having a bore. First and second image sensors are adjacently mounted at the distal end to capture high definition images from different perspective viewpoints for generating three-dimensional image information. The image sensors produce an unprocessed digital data signal representing the captured images. A wired signal line transmits the unprocessed digital data signals along the sheath to a proximal end to processing circuitry. The processing circuitry is configured to perform processing operations on the unprocessed digital data signals to produce respective video signals suitable for transmission to a host system or for driving a 3D display. A secondary camera is also disclosed and includes an elongate strip of circuit substrate sized for insertion through a narrow conduit, the strip of circuit substrate connecting between an image sensor and a processing circuit substrate.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: July 20, 2021
    Assignee: TITAN MEDICAL INC.
    Inventors: Evan Rittenhouse Jones, Spencer James Costello
  • Patent number: 11051716
    Abstract: Disclosed are a method and an apparatus for jaundice diagnosis based on an image. The method for jaundice diagnosis based on an image includes: receiving a jaundice diagnostic image acquired by photographing both a specific body part of a user and a reference object at a place where the user is positioned at present; generating color distortion information indicating a color distortion degree of the reference object included in the jaundice diagnostic image; generating a jaundice diagnostic correction image by correcting color distortion of the jaundice diagnostic image based on the color distortion information; and diagnosing a jaundice symptom for the user by using the jaundice diagnostic correction image.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: July 6, 2021
    Assignee: AJOU UNIVERSITY INDUSTRY-ACADEMIC COOPERATION FOUNDATION
    Inventors: Myung Hoon Sunwoo, Jung Won Lee, Jin Hong Kim
  • Patent number: 11033182
    Abstract: The invention relates to a correlated set for minimal invasive surgery comprising a surgical instrument and a pattern generating member, a surgical system, a training kit, a method of training and a meth of performing a minimal invasive surgery. The surgical instrument comprises a handle portion, a surgical tool and a body portion connecting the handle portion to the surgical tool. The pattern generating member comprises a pattern light source and a projector for projecting a light pattern. The projector is adapted for being at least temporarily fixed to the body portion of the surgical instrument such that a movement of said surgical tool results in a correlated movement of said projector.
    Type: Grant
    Filed: February 20, 2015
    Date of Patent: June 15, 2021
    Assignee: 3DIntegrated Aps
    Inventors: Steen Møller Hansen, Henriette Schultz Kirkegaard
  • Patent number: 10974394
    Abstract: According to an aspect of some embodiments of the present invention there is provided a method for generating a dataset mapping visual features of each of a plurality of objects, comprising: for each of a plurality of different objects: instructing a robotic system to move an arm holding a respective the object to a plurality of positions, and when the arm is in each of the plurality of positions: acquiring at least one image depicting the respective object in the position, receiving positional information of the arm in respective the position, analyzing the at least one image to identify at least one visual feature of the object in the respective position, and storing, in a mapping dataset, an association between the at least one visual feature and the positional information, and outputting the mapping dataset.
    Type: Grant
    Filed: May 18, 2017
    Date of Patent: April 13, 2021
    Assignee: Deep Learning Robotics Ltd.
    Inventors: Carlos Benaim, Tsofnat Barsheshet
  • Patent number: 10970875
    Abstract: An image acquisition unit acquires an actual endoscopic image that is generated by an endoscope inserted into a tubular structure of a subject and represents an inner wall of the tubular structure, and a virtual endoscopic image that is generated from a three-dimensional image including the tubular structure of the subject and spuriously represents the inner wall of the tubular structure. A conversion unit converts an expression form of the actual endoscopic image into an expression form of the virtual endoscopic image. A similarity calculation unit calculates similarity between the converted actual endoscopic image and the virtual endoscopic image.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: April 6, 2021
    Assignee: FUJIFILM Corporation
    Inventor: Shinnosuke Hirakawa
  • Patent number: 10932882
    Abstract: A surgical camera system is provided which includes a plurality of imaging devices each having a tunable iris configured to change between at least two different sized numerical apertures. A video stream is produced at a frame rate greater than or equal to about 20 frames per second from first and second images produced by respective sensors and tunable irises of at least two of the imaging devices, the tunable irises controlled to different numerical apertures, the first images acquired at a respective first numerical aperture of a first imaging device and the second images acquired at a respective second numerical aperture of a second imaging device, different from the respective first numerical aperture. The video stream alternates between the first images and the second images so that the video stream results in a three-dimensional effect at a display device when the video stream is rendered thereon.
    Type: Grant
    Filed: July 3, 2018
    Date of Patent: March 2, 2021
    Assignee: SYNAPTIVE MEDICAL (BARBADOS) INC.
    Inventors: Siu Wai Jacky Mak, Michael Frank Gunter Wood, Yanhui Bai
  • Patent number: 10912452
    Abstract: An illumination light guiding device includes a phosphor layer that is disposed on another surface opposite to one surface of a board, and converts the wavelengths of a plurality of light beams transmitted through the board and incident on one surface of the phosphor layer, and an emission-side fiber including a plurality of optical fibers that are provided so as to be erected side by side on another surface opposite to one surface of the phosphor layer, each optical fiber guiding a different one of the plurality of light beams having wavelengths converted by the phosphor layer.
    Type: Grant
    Filed: April 12, 2018
    Date of Patent: February 9, 2021
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Masahito Yamana, Noboru Iizawa, Shintaro Hayashi
  • Patent number: 10869642
    Abstract: A method and device is proposed for automatic detection of an event in which a device is leaving a stable position relative to and within an anatomy. The method comprises the steps of receiving a sequence of fluoroscopic images, detecting a device in at least two of the fluoroscopic images, determining a motion field of the detected device in the sequence of fluoroscopic images, generating a sequence of integrated images by integrating the sequence of fluoroscopic images taking into consideration the motion field, determining a saliency metric based on the integrated images, identifying a landmark in the integrated images based on the saliency metric, and determining as to whether the landmark is moving relative to the device, based on a variation of the saliency metric.
    Type: Grant
    Filed: March 2, 2016
    Date of Patent: December 22, 2020
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventors: Olivier Pierre Nempont, Guillaume Julien Joseph Pizaine, Raoul Florent
  • Patent number: 10857455
    Abstract: A method is provided, including: providing a first view of a virtual environment to a first HMD, the first view having a first view direction towards a virtual object, the first view being from a first-person perspective positioned at the first location; simultaneously, providing a second view to a second HMD, the second view being from a first-person perspective positioned at the first location, and rendering in the second view a virtual character associated to the first view, the rendering configured to present the virtual character as being positioned at a second location, and configured to present the virtual character having a second view direction adjusted relative to the first view direction so as to be from a first-person perspective of the virtual character as the virtual character is positioned at the second location, and so as to be towards the virtual object as shown in the second view.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: December 8, 2020
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Richard L. Marks, Steven Osman
  • Patent number: 10855973
    Abstract: A depth camera assembly (DCA) determines distances between the DCA and objects in a local area within a field of view of the DCA. The DCA projects a series of sinusoidal patterns into the local area DCA and captures images of the sinusoidal patterns via a sensor. The DCA determines a distance between the DCA and locations in the local area based on a phase shift each of the sinusoidal patterns captured by each pixel of the sensor. Initially, a calibration offset is determined for each pixel of the sensor by emitting the sinusoidal patterns onto a target at a predetermined distance from the DCA and using phase shifts for a pixel and the predetermined distance to determine the pixel's calibration offset.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: December 1, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Michael Hall, Qing Chao
  • Patent number: 10841514
    Abstract: An endoscopy video feature enhancement platform (EVFEP) is connected to the output of any type endoscope system, and inputs and captures the output video. The video is visually augmented live with indicators of possible polyp detection and localization, polyp attributes, and procedure metrics, based on the collective learning of the output results of many different types of endoscopy systems on a large scale. An artificial intelligence model is trained on confirmed polyp detection previously determined by this and other EVFEP devices used with many different types of endoscope systems on a large scale. Augmented video, images and automatically generated short video clips of key procedure segments are passed to a reporting system, and supplemented with meta data.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: November 17, 2020
    Assignee: EndoVigilant Inc
    Inventors: Vineet Sachdev, Ravindra Kompella, Om P. Chaurasia, H. David Helsley, Jr.
  • Patent number: 10765306
    Abstract: An improved endoscopic device for obtaining 3-dimensional human vision simulated imaging with real dynamic convergence in therapeutic, diagnostic, and other applications. Imaging probes are mounted on a tubular shaft and a simple/sleek slider moves back-and-forth on the shaft, with slider movement optionally modified and redirected to affect imaging probe convergence/divergence. Imaging probe convergence/divergence can be optionally manual for visual target selection, and the probe arms upon which the imaging probes are mounted may also be moved through a combined 180 degree movement range using a manual control. The first and second movement transmitting means respectively adapted to cause slider-initiated convergence, or manual convergence, of the imaging probes each share at least one integrated movement element with the control means adapted for engaging and disengaging the first and second movement transmitting means.
    Type: Grant
    Filed: July 29, 2015
    Date of Patent: September 8, 2020
    Inventor: Tarek Ahmed Nabil Abou El Kheir
  • Patent number: 10729309
    Abstract: An endoscope system includes: a first processor configured to perform first image processing on a set of image data; a second processor configured to perform second image processing on another set of image data; a third processor configured to generate, based on sets of image data output from the first and second processors, display image data; a recorder configured to record therein image data based on the sets of image data output from the first and second processors; a fourth processor configured to generate a first synchronization signal for synchronization among the first processor, the second processor, and the third processor; a fifth processor configured to generate a second synchronization signal for synchronization between the third processor and the recorder; and a controller configured to select one of the first and second synchronization signals, and perform control for synchronization between the third processor and the recorder.
    Type: Grant
    Filed: May 2, 2019
    Date of Patent: August 4, 2020
    Assignee: OLYMPUS CORPORATION
    Inventors: Koji Kojima, Hideyuki Kugimiya, Ryo Koshida
  • Patent number: 10694119
    Abstract: A direct-viewing observation image is displayed on a monitor, and a side-viewing observation image is not displayed on the monitor. A region of interest is detected using the side-viewing observation image. A display region for observation, which displays the direct-viewing observation image, of the monitor is maintained regardless of whether or not the region of interest is detected.
    Type: Grant
    Filed: October 10, 2019
    Date of Patent: June 23, 2020
    Assignee: FUJIFILM Corporation
    Inventor: Ryo Kitano
  • Patent number: 10598914
    Abstract: System and method configured to operate under conditions when the object being imaged destroys or negates the information which otherwise allows the user to take advantage of optical parallax, configured to elicit luminescence from the same targets in the object as a result of irradiation of these targets with pump light at different, respectively corresponding wavelengths, and acquire optical data from so-illuminated targets through the very same optical path to image the object at different wavelengths. One embodiment enables acquisition, by the same optical detector and from the same object, of imaging data that includes a reflectance image and multiple fluorescence-based images caused by light at different wavelengths, to assess difference in depths of locations of targets within the object.
    Type: Grant
    Filed: July 13, 2016
    Date of Patent: March 24, 2020
    Assignee: Massachusetts Institute of Technology
    Inventors: Andrew M. Siegel, Nandini Rajan, Angela M. Belcher, Neelkanth M. Bardhan
  • Patent number: 10595713
    Abstract: An ocular device for a surgical instrument having an ocular mount for an optical assembly. The ocular device including: an optical flat; and a holder for accommodating the optical flat, wherein the holder is configured to be connected to the ocular mount; wherein the optical flat having a widened side edge provided with a first contact surface for the ocular mount and a second contact surface for the holder, and a surface normal of the optical flat and the first contact surface of the optical flat facing the ocular mount form an angle different than 0° relative to each other.
    Type: Grant
    Filed: July 27, 2017
    Date of Patent: March 24, 2020
    Assignee: OLYMPUS WINTER & IBE GMBH
    Inventor: Gregor Kiedrowski
  • Patent number: 10555661
    Abstract: An endoscope system includes: a first processor configured to process a first imaging signal acquired by a first endoscope; a second processor communicably connected to the first processor and configured to process second imaging signal acquired by a second endoscope; a mode switch configured to switch a processing mode of image processing; an image processor configured to execute first image processing on the first imaging signal when the mode switch switches the processing mode to a first processing mode and to execute second image processing on an signal input from the second processor when the mode switch switches the processing mode to a second processing mode; and a video-signal output unit configured to generate a video signal for display based on an output signal from the image processor and output the video signal to an external device.
    Type: Grant
    Filed: December 10, 2018
    Date of Patent: February 11, 2020
    Assignee: OLYMPUS CORPORATION
    Inventor: Susumu Hashimoto
  • Patent number: 10447906
    Abstract: A novel dual-path-endoscope where a multi-function light source produces a first-light and a second-light toward an object. The first-light exhibits first-light-characteristics. The second-light exhibits second-light-characteristics different from the first-light-characteristics. The endoscope includes two light-paths, the disparity there between is larger than zero. Each light-path includes a respective pupil and a respective light-separator coupled with the pupil, transmitting there through one of the first-light and the second-light, associating the first-light and the second-light with a respective light-path. The dual-channel-imager includes two imaging sensors, each associated with a respective light-path and optically coupled with a respective light-separator. Each imaging-sensor exhibits sensitivity to the characteristics of the respective one of the first-light and the second-light.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: October 15, 2019
    Assignee: VISIONSENSE LTD.
    Inventor: Alex Chanin
  • Patent number: 10326944
    Abstract: An image pickup system includes: a camera including a first image pickup unit and a second image pickup unit; and a processor configured to: define a first common area in a first image and a second common area in a second image, respectively; detect brightness of an image in the first common area; detect brightness of an image in the second common area; adjust brightness of the first image based on the brightness of the image in the first common area; and adjust brightness of the second image based on the brightness of the image in the second common area.
    Type: Grant
    Filed: December 3, 2016
    Date of Patent: June 18, 2019
    Assignee: OLYMPUS CORPORATION
    Inventor: Masaru Sudo