Abstract: Mediated-reality imaging systems, methods, and devices are disclosed herein. In some embodiments, an imaging system includes (i) a camera array configured to capture intraoperative image data of a surgical scene in substantially real-time and (ii) a processing device communicatively coupled to the camera array. The processing device can be configured to synthesize a three-dimensional (3D) image corresponding to a virtual perspective of the scene based on the intraoperative image data from the cameras. The imaging system is further configured to receive and/or store preoperative image data, such as medical scan data corresponding to a portion of a patient in the scene. The processing device can register the preoperative image data to the intraoperative image data, and overlay the registered preoperative image data over the corresponding portion of the 3D image of the scene to present a mediated-reality view.

Abstract: Methods and systems for calibrating an imaging system having a plurality of sensors are disclosed herein. In some embodiments, a method includes initially calibrating the imaging system, operating the imaging system during an imaging procedure, and then updating the calibration during the imaging procedure to account for degradation of the initial calibration due to environmental factors, such as heat. The method of updating the calibration can include capturing image data of a rigid body having a known geometry with the sensors and determining that the calibration has drifted for a problematic one of the sensors based on the captured image data. After determining the problematic one of the sensors, the method can include updating the calibration of the problematic one of the sensors based on the captured image data.

Abstract: Methods and systems for calibrating an instrument, such as a surgical instrument, within an imaging system are disclosed herein. In some embodiments, a method includes capturing images of the instrument with a plurality of cameras of the imaging system and identifying common features of the instrument in the captured images. The method further includes generating a three-dimensional (3D) representation of the instrument based on the common features and determining a reference frame of the instrument based on the generated 3D representation of the instrument. A first transform is determined between the reference frame of the instrument and a reference frame of the cameras. Then, a second transform between the reference frame of the instrument and a reference frame of the tracking structure can be determined based on the first transform.

Abstract: Mediated-reality imaging systems, methods, and devices are disclosed herein. In some embodiments, an imaging system includes (i) a camera array configured to capture intraoperative image data of a surgical scene in substantially real-time and (ii) a processing device communicatively coupled to the camera array. The processing device can be configured to synthesize a three-dimensional (3D) image corresponding to a virtual perspective of the scene based on the intraoperative image data from the cameras. The imaging system is further configured to receive and/or store preoperative image data, such as medical scan data corresponding to a portion of a patient in the scene. The processing device can register the preoperative image data to the intraoperative image data, and overlay the registered preoperative image data over the corresponding portion of the 3D image of the scene to present a mediated-reality view.

Abstract: Medical imaging systems, methods, and devices are disclosed herein. In some embodiments, an imaging system includes (i) a camera array configured to capture intraoperative image data of a surgical scene in substantially real-time and (ii) a processing device communicatively coupled to the camera array. The processing device can be configured to synthesize a three-dimensional (3D) image corresponding to a virtual perspective of the scene based on the intraoperative image data from the cameras. The imaging system is further configured to receive and/or store initial image data, such as medical scan data corresponding to a portion of a patient in the scene. The processing device can register the initial image data to the intraoperative image data, and overlay the registered initial image data over the corresponding portion of the 3D image of the scene to present a mediated-reality view.

Abstract: Mediated-reality imaging systems, methods, and devices are disclosed herein. In some embodiments, an imaging system includes (i) a camera array configured to capture intraoperative image data of a surgical scene in substantially real-time and (ii) a processing device communicatively coupled to the camera array. The processing device can be configured to synthesize a three-dimensional (3D) image corresponding to a virtual perspective of the scene based on the intraoperative image data from the cameras. The imaging system is further configured to receive and/or store preoperative image data, such as medical scan data corresponding to a portion of a patient in the scene. The processing device can register the preoperative image data to the intraoperative image data, and overlay the registered preoperative image data over the corresponding portion of the 3D image of the scene to present a mediated-reality view.

Abstract: Mediated-reality imaging systems, methods, and devices are disclosed herein. In some embodiments, an imaging system includes (i) a camera array configured to capture intraoperative image data of a surgical scene in substantially real-time and (ii) a processing device communicatively coupled to the camera array. The processing device can be configured to synthesize a three-dimensional (3D) image corresponding to a virtual perspective of the scene based on the intraoperative image data from the cameras. The imaging system is further configured to receive and/or store preoperative image data, such as medical scan data corresponding to a portion of a patient in the scene. The processing device can register the preoperative image data to the intraoperative image data, and overlay the registered preoperative image data over the corresponding portion of the 3D image of the scene to present a mediated-reality view.

Abstract: Example methods and systems to facilitate osteocutaneous free flap reconstructions are provided. One example method involves causing a surgical navigation system to display a representation of a patient undergoing surgery; receiving input data representing one or more osteotomies made during the surgery to form a defect within the patient; determining a donor site for a bone graft having a contour that corresponds to the defect within the patient using a geometric alignment algorithm to identify, as the donor site, a portion of the bone graft that virtually aligns with the defect; generating a virtual template representing the bone graft; displaying the generated virtual template representing the bone graft within the representation of the patient as a navigational guide for harvesting of the bone graft; and displaying the generated virtual template positioned into the defect within the representation as a navigational guide for reconstructing the defect using the harvested bone graft.