Abstract: A method for intelligent manual adjustment of a manually rotatable focus control of a camera may comprise determining a depth value of a target area relative to the camera and determining a desirable focus adjustment according to a direction and an amount that a focal point of the camera is to be moved in order to coincide with the depth value of the target area. The method may also comprise assisting an operator of the manually rotatable focus control to the desirable focus adjustment by providing a haptic force on the manually rotatable focus control that decreases as the focal point of the camera moves toward the depth value of the target area and increases as the focal point of the camera moves away from the depth value of the target area.

Abstract: A medical robotic system includes a viewer, a gaze tracker, and a processor programmed to: draw an area or volume defining shape overlaid on an image based on the tracked gaze point after the user has gazed on the tracked gaze point for a programmed period of time; in response to receiving a user-selected action command, assign a fixed virtual constraint to the area or volume defining shape and constrain movement of a robotic tool; map points of the robotic tool in a tool reference frame to a viewer reference frame; determine a closest object to the tracked gaze point is the robotic tool based at least in part on the mapped points; display an object including text identifying the robotic tool, overlaid on the image, proximate to the robotic tool based on determining the robotic tool is the closest object; and perform an action indicated by the object.

Abstract: A robotic system provides user selectable actions associated with gaze tracking according to user interface types. User initiated correction and/or recalibration of the gaze tracking may be performed during the processing of individual of the user selectable actions.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera configured to capture an image of a camera field of view. The system further comprises an input device, a display, and a processor. The processor is configured to display a first synthetic image including a first synthetic image of the tool. The first synthetic image of the tool includes a portion of the tool outside of the camera field of view. The processor is also configured to receive a user input at the input device and responsive to the user input, change the display of the first synthetic image to a display of a second synthetic image including a second synthetic image of the tool that is different from the first synthetic image of the tool.

Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system possibly comprising a plurality of cameras that image the user's eye and glints for thereon and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of cornea of the user's eye using data derived from the glint images. The display system may use spherical and aspheric cornea models to estimate a location of the corneal center of the user's eye.

Abstract: A stereo imaging system comprises a depth sensing system, a stereo viewer, and a processor configured to receive captured stereo worksite images, compare a depth value to a predetermined threshold value, and generate stereo images for display by adjusting or not adjusting native disparities based on the comparison of the depth value to the threshold value.

Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.

Abstract: A system comprises a first robotic arm adapted to support and move a tool and a second robotic arm adapted to support and move a camera. The system also comprises an input device, a display, and a processor. The processor is configured to, in a first mode, command the first robotic arm to move the camera in response to a first input received from the input device to capture an image of the tool and present the image as a displayed image on the display. The processor is configured to, in a second mode, display a synthetic image of the first robotic arm in a boundary area around the captured image on the display, and in response to a second input, change a size of the boundary area relative a size of the displayed image.

Abstract: A stereo imaging system comprises a stereoscopic camera having left and right image capturing elements for capturing stereo images; a stereo viewer; and a processor configured to modify the stereo images prior to being displayed on the stereo viewer so that a disparity between corresponding points of the stereo images is adjusted as a function of a depth value within a region of interest in the stereo images after the depth value reaches a target depth value.

Abstract: A system may comprise a tool including at least one reference feature. a processor, and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, may cause the system to receive image data including an image of the tool and the at least one reference feature, determine a pose of the tool from the image data, and modify the image data to visually decrement a portion of the image data corresponding to the at least one reference feature.

Abstract: A tool tracking method comprises receiving stereo image data of a tool. The tool includes a tracking marker. The method also comprises receiving first kinematic data for the tool and determining a three-dimensional image-derived pose of the tool from the stereo image data of the tool and the tracking marker. The method also comprises determining a first kinematic pose of the tool from the first kinematic data and determining a pose offset between the image-derived pose of the tool and the first kinematic pose of the tool. The method also comprises determining a corrected first kinematic pose of the tool based on the pose offset and the first kinematic data.

Abstract: A system may comprise an image capture device to capture an image of a work site. The system may also comprise a processor to determine whether a tool disposed at the work site is energized and determine a first area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image. The processor may also determine a second area of the captured image including a remainder of the captured image that does not include the first area. Conditioned upon determining that the tool is energized, at least one of the first area and the second area of the captured image of the work site may be processed to indicate that the tool in the first area is being energized. The image of the work site with the first area and the second area may be displayed.

Abstract: An example method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component; and generating, based on the first set of pixel data that includes the fluorescence scene component and the second set of pixel data that includes the combination of the visible color component scene and the fluorescence scene component, a display scene.

Abstract: An exemplary method includes a demosaic module receiving a frame of raw pixels having values in a first color space, generating vertical and horizontal color difference signals using information from the frame of raw pixels, generating reconstructed color pixel values for raw pixels that are missing captured color pixel values of a first color component of the first color space, transforming the captured and reconstructed color pixel values of the first color component to brightness pixel values in a second color space, and transforming the vertical and horizontal color difference signals into chrominance pixel values in the second color space.

Abstract: A robotic system includes a processor that is programmed to determine and cause work site measurements for user specified points in the work site to be graphically displayed in order to provide geometrically appropriate tool selection assistance to the user. The processor is also programmed to determine an optimal one of a plurality of tools of varying geometries for use at the work site and to cause graphical representations of at least the optimal tool to be displayed along with the work site measurements.

Abstract: A system may comprise an image capture device disposed to capture an image of a work site, a display, and a processor. The processor may be configured to determine whether a tool disposed at the work site is energized and determine an area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image, to be filtered to indicate the tool has been energized. Conditioned upon determining that the tool is energized, the processer may also filter the area of the captured image of the work site to generate a filtered area of the captured image of the work site so as to create a glowing effect on the image of the portion of the energized tool, indicating that the tool is being energized. The image of the work site with the filtered area may be displayed on the display.

Abstract: An illustrative method includes receiving a single frame comprising a first set of pixel data that includes a fluorescence scene component and a second set of pixel data that includes a combination of a visible color component scene and the fluorescence scene component, determining a display fluorescence scene component from the first set of pixel data, determining a display visible scene component from the second set of pixel data, and generating, based on the display fluorescence scene component and the display visible scene component, a display scene.

Abstract: A method for intelligent manual adjustment of a manually rotatable focus control of a camera may comprise determining a depth value of a target area relative to the camera and determining a desirable focus adjustment according to a direction and an amount that a focal point of the camera is to be moved in order to coincide with the depth value of the target area. The method may also comprise assisting an operator of the manually rotatable focus control to the desirable focus adjustment by providing a haptic force on the manually rotatable focus control that decreases as the focal point of the camera moves toward the depth value of the target area and increases as the focal point of the camera moves away from the depth value of the target area.

Abstract: A flexible display panel includes a flexible display body and a supporting structure disposed on a side of the flexible display body. The supporting structure includes a plurality of supporting layers disposed on a stack and a flexible layer disposed between each two adjacent supporting layers. An angle between at least one supporting layer of the plurality of supporting layers and a plane where a display surface of the flexible display body is located is greater than 0° and less than 90°.

Abstract: A calibration assembly may be used with an endoscopic imaging system having a field of view. The calibration assembly may comprise an interface configured for constraining engagement with the endoscopic imaging system and a target coupled with the interface so as to be within the field of view. The target may include a plurality of calibration features. The calibration assembly may be reconfigurable from a first spatial arrangement between the target and the endoscopic imaging system to a second spatial arrangement between the target and the endoscopic imaging system. The calibration assembly may also comprise a processor configured to obtain, from the endoscopic imaging system, first and second images of at least some of the calibration features of the target at the first and second spatial arrangements. The processor may also generate calibration data for the endoscopic imaging system using the first and second images.