Patents by Inventor Jeffrey M. Dicarlo
Jeffrey M. Dicarlo has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11980347Abstract: The technology described herein can be embodied in a method that includes receiving data representing information captured using a first sensor and a second sensor of a multi-sensor camera. The sensors are configured to capture a surgical scene illuminated by a light source configured to emit wavelengths in the visible spectrum corresponding to sensing capabilities of the first and second sensors, respectively. The method also includes receiving data representing information captured using a third sensor of the multi-sensor camera, the third sensor configured to capture the surgical scene as illuminated by a near-infrared light source, and generating a first visual representation of the surgical scene based on the data representing the information captured using the first and second sensors. The first visual representation is combined with the information captured using the third sensor to generate a second visual representation, and the second visual representation is presented on a display device.Type: GrantFiled: December 3, 2019Date of Patent: May 14, 2024Assignee: Intuitive Surgical Operations, Inc.Inventors: Jeffrey M. DiCarlo, Max J. Trejo
-
Patent number: 11936989Abstract: An illustrative apparatus may perform gaze-based auto-exposure management of image frames. For example, the apparatus may determine, for an image frame within an image frame sequence captured by an image capture system, auto-exposure values for pixel units into which the image frame is divided. The apparatus may then assign weight values to the pixel units based on a gaze direction of a viewer viewing the image frame sequence. Based on the auto-exposure values determined for the pixel units and the weight values assigned to the pixel units, the apparatus may update one or more auto-exposure parameters for use by the image capture system to capture an additional image frame within the image frame sequence. Corresponding apparatuses, systems, and methods for gaze-based auto-exposure management of image frames are also disclosed.Type: GrantFiled: July 7, 2021Date of Patent: March 19, 2024Assignee: Intuitive Surgical Operations, Inc.Inventors: Zhen He, Jeffrey M. DiCarlo, Heath Feather
-
Patent number: 11911003Abstract: A computer-assisted surgical system simultaneously provides visible light and alternate modality images that identify tissue or increase the visual salience of features of clinical interest that a surgeon normally uses when performing a surgical intervention using the computer-assisted surgical system. Hyperspectral light from tissue of interest is used to safely and efficiently image that tissue even though the tissue may be obscured in the normal visible image of the surgical field. The combination of visible and hyperspectral images are analyzed to provide details and information concerning the tissue or other bodily function that were not previously available.Type: GrantFiled: September 8, 2017Date of Patent: February 27, 2024Assignee: Intuitive Surgical Operations, Inc.Inventors: Ian E. McDowall, Jeffrey M. DiCarlo, Brian D. Hoffman, William Jason Culman
-
Publication number: 20240007762Abstract: An example method includes causing an illuminator to simultaneously illuminate tissue with a first visible color illumination component, a second visible color illumination component, and a fluorescence excitation illumination component; and causing a display unit to display, based on the illumination, a display scene that includes: a reduced color scene component corresponding to the first and second visible color illumination components, and a highlighted scene component corresponding to the fluorescence excitation illumination component.Type: ApplicationFiled: September 18, 2023Publication date: January 4, 2024Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
-
Publication number: 20230325984Abstract: An example method includes determining an estimated pixel noise parameter based on a signal level of a first pixel of the first frame of pixel data; determining a difference between the signal level of the first pixel and at least a signal level of a second pixel; obtaining a filtered pixel based at least in part on a comparison of the difference to the estimated pixel noise parameter; and outputting the filtered pixel to an output frame of filtered pixel data.Type: ApplicationFiled: May 31, 2023Publication date: October 12, 2023Applicant: Intuitive Surgical Operations, Inc.Inventors: Max J. Trejo, Jeffrey M. DiCarlo
-
Publication number: 20230316521Abstract: An illustrative system may include an imaging device and an image processing system. The imaging device may be configured to output first image information corresponding to a first wavelength band associated with fluorescence emitted by a substance and may be configured to output second image information corresponding to a second wavelength band different from the first wavelength band and associated with the fluorescence emitted by the substance. The image processing system may be configured to receive the first image information and the second image information from the imaging device and may determine, based on a comparison of the first image information to the second image information, a property of the substance.Type: ApplicationFiled: July 19, 2021Publication date: October 5, 2023Inventors: Max J. Trejo, Jeffrey M. DiCarlo
-
Patent number: 11778340Abstract: An example method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.Type: GrantFiled: May 31, 2022Date of Patent: October 3, 2023Assignee: Intuitive Surgical Operations, Inc.Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
-
Publication number: 20230262347Abstract: An illustrative apparatus may determine a color-skew metric for an image frame captured by an image capture system. The color-skew metric may be indicative of an extent to which the image frame skews to a particular color. Based on the color-skew metric and an adaptive target control function, the apparatus may determine a frame auto-exposure target. Based on the frame auto-exposure target, the apparatus may update one or more auto-exposure parameters for use by the image capture system to capture an additional image frame. Corresponding apparatuses, systems, and methods for managing auto-exposure of image frames are also disclosed.Type: ApplicationFiled: July 7, 2021Publication date: August 17, 2023Inventors: Zhen He, Jeffrey M. DiCarlo
-
Publication number: 20230255443Abstract: An illustrative apparatus may identify, in an image frame captured by an image capture system, an object region corresponding to a depiction of an object portrayed in the image frame. The apparatus may determine a frame auto-exposure value for the image frame by discounting the object region in the image frame. Based on the frame auto-exposure value, the apparatus may update one or more auto-exposure parameters for use by the image capture system to capture an additional image frame. Corresponding apparatuses, systems, and methods for managing auto-exposure of image frames are also disclosed.Type: ApplicationFiled: July 7, 2021Publication date: August 17, 2023Inventors: Zhen He, Jeffrey M. DiCarlo
-
Publication number: 20230254469Abstract: An image capture device may include an image sensor comprising a first pixel cell and a second pixel cell adjacent to the first pixel cell, a plurality of individual alternative light filters configured to filter non-visible light, one individual alternative light filter of the plurality of individual alternative light filters covering both a first set of pixels of the first pixel cell and a second set of pixels of the second pixel cell, and a plurality of individual visible color filters covering pixels of the first and second pixel cells, the pixels of the first and second pixel cells covered by the individual visible light color filters being different from the first and second sets of pixels covered by the individual alternative light filters.Type: ApplicationFiled: April 17, 2023Publication date: August 10, 2023Inventors: David C. Shafer, Jeffrey M. DiCarlo, Ian E. McDowall, Max J. Trejo
-
Publication number: 20230225795Abstract: The technology described herein can be embodied in a method that includes obtaining a representation of a first image of a surgical scene using electromagnetic radiation of a first wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the first wavelength range received from a first tissue type is lower than that received for a second tissue type. The method also includes obtaining a representation of a second image using electromagnetic radiation of a second wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the second wavelength range received from the second tissue type is substantially different from that received for the first tissue type. The visual representation of the surgical scene is rendered on the one or more displays using the representation of the first image and the representation of the second image.Type: ApplicationFiled: March 20, 2023Publication date: July 20, 2023Inventors: William Jason Culman, Jeffrey M. DiCarlo, Ian E. McDowall
-
Patent number: 11704774Abstract: A system includes an image sensor, an imaging pipeline, and a display device. The image sensor is configured to capture a first frame of pixel data. The imaging pipeline is coupled to the image sensor to receive the first frame of pixel data. The imaging pipeline includes an adaptive noise filter. The adaptive noise filter is configured to filter a pixel based on noise in the pixel. The imaging pipeline is configured to output a second frame of pixel data. The second frame of pixel data includes pixels filtered by the adaptive noise filter. The display device is coupled to the imaging pipeline to receive the second frame of pixel data. The display device is configured to display the second frame of pixel data.Type: GrantFiled: April 21, 2021Date of Patent: July 18, 2023Assignee: Intuitive Surgical Operations, Inc.Inventors: Max J. Trejo, Jeffrey M. DiCarlo
-
Patent number: 11671581Abstract: A stereoscopic image capture device includes a first image sensor, a second image sensor, a first frame timer, and a second frame timer. The first and second frame timers are different frame timers. The first image sensor includes a first plurality of rows of pixels. The second image sensor includes a second plurality of rows of pixels. The first and second image sensors can be separate devices or different areas of a sensor region in an integrated circuit. The first frame timer is coupled to the first image sensor to provide image capture timing signals to the first image sensor. The second frame timer coupled to the second image sensor to provide image capture timing signals to the second image sensor.Type: GrantFiled: September 17, 2019Date of Patent: June 6, 2023Assignee: Intuitive Surgical Operations, Inc.Inventors: David C. Shafer, Jeffrey M. DiCarlo, Ian E. McDowall, Max J. Trejo
-
Patent number: 11648059Abstract: The technology described herein can be embodied in a method that includes obtaining a representation of a first image of a surgical scene using electromagnetic radiation of a first wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the first wavelength range received from a first tissue type is lower than that received for a second tissue type. The method also includes obtaining a representation of a second image using electromagnetic radiation of a second wavelength range outside the visible range of wavelengths, wherein an amount of electromagnetic radiation of the second wavelength range received from the second tissue type is substantially different from that received for the first tissue type. The visual representation of the surgical scene is rendered on the one or more displays using the representation of the first image and the representation of the second image.Type: GrantFiled: September 21, 2018Date of Patent: May 16, 2023Assignee: Intuitive Surgical Operations, Inc.Inventors: William Jason Culman, Jeffrey M. DiCarlo, Ian E. McDowall
-
Publication number: 20220304769Abstract: An illustrative surgical system may access a plurality of images captured outside a structure within a patient; detect a difference between spectral reflectances of scenes captured in the plurality of images; and identify, based on the detected difference between the spectral reflectances of the scenes captured in the plurality of images, pixels in at least one of the plurality of images that correspond to structure tissue of the structure.Type: ApplicationFiled: June 14, 2022Publication date: September 29, 2022Inventors: Jeffrey M. DiCarlo, Ian E. McDowall, Jonathan M. Sorger
-
Publication number: 20220294995Abstract: An example method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.Type: ApplicationFiled: May 31, 2022Publication date: September 15, 2022Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall
-
Publication number: 20220280042Abstract: An exemplary fluorescence imaging control system may direct, during a surgical procedure performed with a computer-assisted surgical system, an illumination source included in the computer-assisted surgical system to illuminate a scene associated with the surgical procedure with fluorescence excitation illumination configured to excite a fluorophore present at the scene and direct an imaging device included in the computer-assisted surgical system to detect, during the surgical procedure, fluorescence emitted by the fluorophore in response to excitation of the fluorophore by the fluorescence excitation illumination. The fluorescence imaging control system may determine, based on the detected fluorescence, a lifetime of the fluorescence and determine, based on the determined lifetime of the fluorescence, an identity of the fluorophore.Type: ApplicationFiled: August 18, 2020Publication date: September 8, 2022Inventors: Alexander L. Antaris, Jeffrey M. DiCarlo, Ian E. McDowall, Jonathan M. Sorger
-
Patent number: 11389267Abstract: An exemplary surgical system is configured to 1) access a plurality of surgical site scenes captured entirely outside a structure within a patient, each surgical site scene in the plurality of surgical site scenes being captured from reflected light of a different waveband of a plurality of wavebands, each waveband of the plurality of wavebands being reflected by structure tissue of the structure and non-structure tissue outside the structure; 2) detect a difference between spectral reflectances of each of the surgical site scenes in the captured surgical site scenes, and 3) identify, based on the detected difference between the spectral reflectances of each of the surgical site scenes in the captured surgical site scenes, pixels in the captured surgical site scenes that correspond to the structure tissue and pixels in the captured surgical site scenes that correspond to the non-structure tissue outside the structure.Type: GrantFiled: January 29, 2020Date of Patent: July 19, 2022Assignee: Intuitive Surgical Operations, Inc.Inventors: Jeffrey M. DiCarlo, Ian E. McDowall, Jonathan M. Sorger
-
Publication number: 20220218424Abstract: A system determines that a change in luminance of captured frames of a scene in response to a change in illumination brightness of the scene is less than a threshold value and commands, based on the determination that the change in luminance of the captured frames of the scene is less than the threshold value, attenuation of the illumination brightness of the scene.Type: ApplicationFiled: March 30, 2022Publication date: July 14, 2022Inventors: Geoff Richmond, Brian D. Hoffman, Jeffrey M. DiCarlo
-
Patent number: 11381759Abstract: An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.Type: GrantFiled: January 27, 2021Date of Patent: July 5, 2022Assignee: Intuitive Surgical Operations, Inc.Inventors: Wenyi Zhao, Jeffrey M. DiCarlo, Ian E. McDowall