Patents by Inventor Thomas CALLOWAY

Thomas CALLOWAY has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210228281
    Abstract: A surgical system includes a camera tracking system that determines a first pose transform between a first object coordinate system and the first tracking camera coordinate system based on first object tracking information from the first tracking camera which indicates pose of the first object. The camera tracking system determines a second pose transform between the first object coordinate system and the second tracking camera coordinate system based on first object tracking information from the second tracking camera indicating pose of the first object, and determines a third pose transform between a second object coordinate system and the second tracking camera coordinate system based on second object tracking information from the second tracking camera indicating pose of the second object. The camera tracking system determines a fourth pose transform between the second object coordinate system and the first tracking camera coordinate system based on combining the first, second, and third pose transforms.
    Type: Application
    Filed: January 28, 2020
    Publication date: July 29, 2021
    Inventor: Thomas Calloway
  • Patent number: 11062522
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: July 13, 2021
    Assignee: Global Medical Inc
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Publication number: 20210169605
    Abstract: A surgical robot positions an end effector that guides movement of a surgical tool during a surgical procedure on a patient anatomical structure. A tracking system determines a pose of the anatomical structure and a pose of the end effector and/or the surgical tool. A navigation controller determines a target pose for the surgical tool based on a surgical plan and based on the pose of the anatomical structure, and generates steering information based on the target pose for the surgical tool, the pose of the anatomical structure, and the pose of the surgical tool and/or the end effector. The steering information indicates where the surgical tool and/or the end effector need to be moved. An AR headset controller receives the steering information from the navigation controller and displays a graphical representation of the steering information and/or the target pose for the surgical tool on a see-through display screen.
    Type: Application
    Filed: December 10, 2019
    Publication date: June 10, 2021
    Inventors: Thomas Calloway, Weston Healy, Isaac Dulin, Dale Earle, Keiichi Matsuda, Norbert Johnson, Bessam Al Jewad, Christine Russ, Michael Robinson, Keerthighaan Kanagasegar
  • Publication number: 20210169581
    Abstract: A surgical system including a XR headset, a tracking system, and an XR headset controller. The XR headset can be worn by a user during a surgical procedure and includes a see-through display screen configured to display a world-registered XR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The tracking system can determine a real-world pose of the XR headset and a real-world pose of a real-world element. The real-world pose of the XR headset and the real-world pose of the real-world element being determined relative to a real-world coordinate system. The XR headset controller can generate the world-registered XR image based on the real-world pose of the XR headset and the real-world pose of the real-world element. The world-registered XR image includes a virtual element that is generated based on a characteristic of the real-world element.
    Type: Application
    Filed: February 4, 2020
    Publication date: June 10, 2021
    Inventors: Thomas Calloway, Isaac Dulin, Keiichi Matsuda, Christine Russ, Keerthighaan Kanagasegar, Amelia Raphaelson
  • Publication number: 20210169578
    Abstract: A surgical system includes an AR headset and a AR headset controller. The AR headset is configured to be worn by a user during a surgical procedure and has a see-through display screen configured to display an AR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The AR headset also includes an opacity filter positioned between at least one of the user's eyes and the real-world scene when the see-through display screen is viewed by the user. The opacity filter provides opaqueness to light from the real-world scene. The AR headset controller communicates with a navigation controller to receive navigation information from the navigation controller which provides guidance to the user during the surgical procedure on an anatomical structure, and generates the AR image based on the navigation information for display on the see-through display screen.
    Type: Application
    Filed: December 10, 2019
    Publication date: June 10, 2021
    Inventors: Thomas Calloway, Weston Healy, Isaac Dulin, Dale Earle, Keiichi Matsuda
  • Patent number: 10976163
    Abstract: A method, a system, and a computer-readable medium for tracking position and orientation of a pedestrian. The system tracks a head position or head orientation of the pedestrian, and a foot position or foot orientation of the pedestrian. The system determines a first heading or position uncertainty associated with the head position or the head orientation of the pedestrian, and determines a second heading or position uncertainty associated with the foot position or the foot orientation of the pedestrian. Moreover, the system determines which of the first heading or position uncertainty or the second heading or position uncertainty is smaller. The system transfers the first heading or position uncertainty to a device or system portion for foot position, or transfers the second heading or position uncertainty to a device or system portion for head position.
    Type: Grant
    Filed: November 9, 2016
    Date of Patent: April 13, 2021
    Assignee: THALES DEFENSE & SECURITY, INC.
    Inventor: Thomas Calloway
  • Publication number: 20200242845
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Application
    Filed: April 8, 2020
    Publication date: July 30, 2020
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Publication number: 20200219324
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Application
    Filed: March 17, 2020
    Publication date: July 9, 2020
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Publication number: 20200184729
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Application
    Filed: December 9, 2019
    Publication date: June 11, 2020
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Patent number: 10650594
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Grant
    Filed: September 25, 2017
    Date of Patent: May 12, 2020
    Assignee: Globus Medical Inc.
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Patent number: 10580217
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Grant
    Filed: June 5, 2018
    Date of Patent: March 3, 2020
    Assignee: Globus Medical, Inc.
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Patent number: 10546423
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: January 28, 2020
    Assignee: Globus Medical, Inc.
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Publication number: 20190380794
    Abstract: A surgical robot system includes a robot. The robot includes a robot base and a robot arm coupled to the robot base. The robot also includes an end-effector coupled to the robot arm. The robot is configured to control movement of the end-effector to perform a surgical procedure. The robot also includes an inertial measurement unit coupled to the robot arm. The surgical robot system also includes camera that is configured to capture one or more pictures or videos used to determine a location of the end-effector. The inertial measurement unit is configured to capture one or more measurements used to determine the location of the end-effector when a view of the camera is occluded.
    Type: Application
    Filed: June 5, 2019
    Publication date: December 19, 2019
    Inventors: Bessam Al Jewad, Thomas Calloway, Norbert Johnson, Neil R. Crawford
  • Patent number: 10482668
    Abstract: A system and method for tracking positions of objects in an actual scene in a wide range of lighting conditions. A vision-inertial navigation system is provided that may be configured to track relative positions of objects of interest in lighting conditions ranging from, e.g., typical indoor lighting conditions to direct sunlight to caves with virtually with no light. The navigation system may include two or more helmet-mounted cameras each configured to capture images of the actual scene in a different lighting condition. A remote processing element may combine data from the two or more helmet-mounted cameras with data from a helmet-mounted inertial sensor to estimate the position (e.g., 3D location) of the objects.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: November 19, 2019
    Assignee: THALES VISIONIX, INC.
    Inventor: Thomas Calloway
  • Patent number: 10212355
    Abstract: An apparatus, system, and method for dual mode imaging under different lighting conditions. A sensor is configured to image a target. A dual-mode illumination source is configured to illuminate the target while the sensor images the target. The dual-mode illumination source is configured to illuminate the target using a first wavelength of light under a first lighting condition and to illuminate the target using a second wavelength of light under a second lighting condition. The system may be used in an optical tracking system to track the motion of an object.
    Type: Grant
    Filed: February 24, 2016
    Date of Patent: February 19, 2019
    Assignee: THALES DEFENSE & SECURITY, INC.
    Inventors: William Whitehouse, Eric Foxlin, Thomas Calloway, John Popoolapade
  • Publication number: 20180299271
    Abstract: A method, a system, and a computer-readable medium for tracking position and orientation of a pedestrian. The system tracks a head position or head orientation of the pedestrian, and a foot position or foot orientation of the pedestrian. The system determines a first heading or position uncertainty associated with the head position or the head orientation of the pedestrian, and determines a second heading or position uncertainty associated with the foot position or the foot orientation of the pedestrian. Moreover, the system determines which of the first heading or position uncertainty or the second heading or position uncertainty is smaller. The system transfers the first heading or position uncertainty to a device or system portion for foot position, or transfers the second heading or position uncertainty to a device or system portion for head position.
    Type: Application
    Filed: November 9, 2016
    Publication date: October 18, 2018
    Inventor: Thomas CALLOWAY
  • Publication number: 20180286136
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Application
    Filed: June 5, 2018
    Publication date: October 4, 2018
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Patent number: 10013808
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Grant
    Filed: February 2, 2016
    Date of Patent: July 3, 2018
    Assignee: Globus Medical, Inc.
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Publication number: 20180012413
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Application
    Filed: September 8, 2017
    Publication date: January 11, 2018
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
  • Publication number: 20180012416
    Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.
    Type: Application
    Filed: September 25, 2017
    Publication date: January 11, 2018
    Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin