Abstract: An imaging system processes images of a plurality of objects which have been captured by an image capture device for display. Normal processing of the images is modified as either a function of a depth corresponding to one or more of the plurality of objects appearing in the captured images relative to the image capture device or as a function of the depth and one or more image characteristics extracted from the captured images. A depth threshold may be used to avoid inadvertent modifications due to noise.

Abstract: An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.

Abstract: An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer.

Abstract: An exemplary system includes a scene processing module configured to receive a single frame comprising a first set of pixel data comprising a first combined scene including a fluorescence scene component and a second set of pixel data comprising a second combined scene including a combination of a visible color component scene and the fluorescence scene component. The scene processing module is further configured to extract a display fluorescence scene component from the first combined scene and extract a display visible scene component from the second combined scene. The system further includes a display unit configured to generate, based on the display fluorescence scene component and the display visible scene component, a displayed scene.

Abstract: A bleeding detection system may receive, from an image capture system during a surgical procedure, a first frame of data of a scene of a surgical site and identify, based on the first frame, a region of blood in the scene. The system may receive, from the image capture system subsequent to receiving the first frame, a second frame of data of the scene, the second frame including data representative of the region of blood. The system may estimate, based on the first frame and the second frame, motion of blood flow in the region of blood and generate data representative of a combined image comprising the second frame and a visual indicator indicating the motion of blood flow in the region of blood. The system may transmit, during the surgical procedure, the data representative of the combined image to a display unit for display of the combined image.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.

Abstract: In one embodiment of the invention, an interactive vital signs scanning method is disclosed including concurrently scanning for a plurality of vital signs with a portable vital signs scanner; detecting movement of the portable vital signs scanner during the scanning for the plurality of vital signs; and determining a measure of quality of the scanning for the plurality of vital signs with the portable vital signs scanner. In another embodiment, a method of improving the quality of vital signs data is disclosed including concurrently sensing data from a plurality of vital signs sensors over a period of time with a portable vital signs scanner; determining a plurality of vital sign values for a respective plurality of vital signs in response to the sensed data from the plurality of vital signs sensors over the period of time; and fusing at least two vital sign values of the plurality of vital sign values for the respective plurality of vital signs.

Abstract: An exemplary method includes a demosaic module receiving a frame of raw pixels having values in a first color space, generating vertical and horizontal color difference signals using information from the frame of raw pixels, generating reconstructed color pixel values for raw pixels that are missing captured color pixel values of a first color component of the first color space, and transforming the captured and reconstructed color pixel values of the first color component to brightness pixel values in a second color space. In certain examples, the demosaic module may transform the vertical and horizontal color difference signals into other pixel values (e.g., chrominance pixel values) in the second color space.

Abstract: An imaging system comprises an image capturing device, a viewer, a control element, and a processor. The control element controls or adjusts an image characteristic of one of the image capturing device and the viewer. The processor is programmed to determine a depth value relative to the image capturing device, determine a desirable adjustment to the control element by using the determined depth value, and control adjustment of the control element to assist manual adjustment of the control element to the desirable adjustment. The processor may also be programmed to determine whether the adjustment of the control element is to be automatically or manually adjusted and control adjustment of the control element automatically to the desirable adjustment if the control element is to be automatically adjusted.

Abstract: A tool tracking method comprises receiving stereo image data of a tool. The tool includes a tracking marker. The method also comprises receiving first kinematic data for the tool and determining a three-dimensional image-derived pose of the tool from the stereo image data of the tool and the tracking marker. The method also comprises determining a first kinematic pose of the tool from the first kinematic data and determining a pose offset between the image-derived pose of the tool and the first kinematic pose of the tool. The method also comprises determining a corrected first kinematic pose of the tool based on the pose offset and the first kinematic data.

Abstract: A bleeding detection unit in a surgical system processes information in an acquired scene before that scene is presented on a display unit in the operating room. For example, the bleeding detection unit analyzes the pixel data in the acquired scene and determines whether there are one or more initial sites of blood in the scene. Upon detection of an initial site of blood, the region is identified by an initial site icon in the scene displayed on the display unit. In one aspect, the processing is done in real-time which means that there is no substantial delay in presenting the acquired scene to the surgeon.

Abstract: A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions.

Abstract: An exemplary demosaicing method includes a demosaic module receiving a frame of raw pixels, generating vertical and horizontal estimated color pixel values for missing color pixel values using information from the frame of raw pixels, generating vertical and horizontal color difference signals using information from the frame of raw pixels and the vertical and horizontal estimated color pixel values, and creating a full resolution frame of pixels using information from the frame of raw pixels and color difference signals selected from the vertical and horizontal color difference signals. The full resolution frame of pixels may include one captured color pixel value and two reconstructed color pixel values for each location in the full resolution frame of pixels and may be sent to a display unit for display.

Abstract: The present disclosure relates to calibration assemblies and methods for use with an imaging system, such as an endoscopic imaging system. A calibration assembly includes: an interface for constraining engagement with an endoscopic imaging system; a target coupled with the interface so as to be within the field of view of the imaging system, the target including multiple of markers having calibration features that include identification features; and a processor configured to identify from first and second images obtained at first and second relative spatial arrangements between the imaging system and the target, respectively, at least some of the markers from the identification features, and using the identified markers and calibration feature positions within the images to generate calibration data.

Abstract: An imaging system comprises an image capturing device, a viewer, a control element, and a processor. The control element controls or adjusts an image characteristic of one of the image capturing device and the viewer. The processor is programmed to determine a depth value relative to the image capturing device, determine a desirable adjustment to the control element by using the determined depth value, and control adjustment of the control element to assist manual adjustment of the control element to the desirable adjustment. The processor may also be programmed to determine whether the adjustment of the control element is to be automatically or manually adjusted and control adjustment of the control element automatically to the desirable adjustment if the control element is to be automatically adjusted.

Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.

Abstract: In one embodiment of the invention, a system for periodically and simultaneously scanning for a plurality of vital signs of a user is disclosed. The system includes a personal portable wireless vital signs scanner having a pair of electrodes to form a circuit with a user's body; and a personal wireless multifunction device wirelessly in communication with the personal portable wireless vital signs scanner. Users may tag their vital signs scans with additional information. Vital signs data may be stored on non-volatile memory on the multifunction device and periodically uploaded to a vital signs storage server. The accumulated vital signs data is used to build the user's canonical curve. In another embodiment of the invention, multiple users may upload their vital signs to a group vital signs server. Group vital sign reference curves can made with the group data obtained. Group data may be compared with the user's personal vital sign data and health recommendations made accordingly to the user.

Abstract: The present disclosure relates to systems, methods, and tools for tool tracking using image-derived data from one or more tool-located references features. In some embodiments, a medical system includes a tool having a distal end that is insertable into a patient body, an image capture device insertable into the patient body so that the image capture device captures an image of at least a portion of a two-dimensional marker at least partially surrounding a portion of the tool, and a processor coupled to the image capture device and configured to determine a pose of the tool by processing the image.

Abstract: An exemplary system includes a scene processing module configured to receive a single frame comprising a first set of pixel data comprising a first combined scene including a fluorescence scene component and a second set of pixel data comprising a second combined scene including a combination of a visible color component scene and the fluorescence scene component. The scene processing module is further configured to extract a display fluorescence scene component from the first combined scene and extract a display visible scene component from the second combined scene. The system further includes a display unit configured to generate, based on the display fluorescence scene component and the display visible scene component, a displayed scene.

Abstract: The present disclosure relates to calibration assemblies and methods for use with an imaging system, such as an endoscopic imaging system. A calibration assembly includes: an interface for constraining engagement with an endoscopic imaging system; a target coupled with the interface so as to be within the field of view of the imaging system, the target including multiple of markers having calibration features that include identification features; and a processor configured to identify from first and second images obtained at first and second relative spatial arrangements between the imaging system and the target, respectively, at least some of the markers from the identification features, and using the identified markers and calibration feature positions within the images to generate calibration data.