Patents by Inventor Thomas CALLOWAY
Thomas CALLOWAY has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20210346098Abstract: A surgical tool tracking array can include a first marker holder, a second marker holder, and a tool holder. The first marker holder is configured to couple a first marker to the surgical tracking array in a first plane. The second marker holder is configured to couple a second marker to the surgical tool tracking array in a second plane that is independent and substantially parallel to the first plane. The tool holder is configured to couple a portion of a surgical tool to the surgical tool tracking array in a third plane that is independent from the first plane and the second plane.Type: ApplicationFiled: May 8, 2020Publication date: November 11, 2021Inventors: Thomas Calloway, Dana Wisniewski, Amaya Raphaelson, Michael Robinson
-
Publication number: 20210352267Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.Type: ApplicationFiled: May 8, 2020Publication date: November 11, 2021Inventors: Weston Healy, Thomas Calloway, Norbert Johnson, Keerthighaan Kanagasegar
-
Publication number: 20210346115Abstract: A surgical system includes an XR headset and an XR headset controller. The XR headset is configured to be worn by a user during a surgical procedure and includes a see-through display screen configured to display an XR image for viewing by the user. The XR headset controller is configured to receive a plurality of two-dimensional (ā2Dā) image data associated with an anatomical structure of a patient. The XR headset controller is further configured to generate a first 2D image from the plurality of 2D image data based on a pose of the XR headset. The XR headset controller is further configured to generate a second 2D image from the plurality of 2D image data based on the pose of the XR headset. The XR headset controller is further configured to generate the XR image by displaying the first 2D image in a field of view of a first eye of the user and displaying the second 2D image in a field of view of a second eye of the user.Type: ApplicationFiled: May 8, 2020Publication date: November 11, 2021Inventors: Isaac Dulin, Thomas Calloway, Norbert Johnson
-
Publication number: 20210338337Abstract: A camera tracking system is disclosed for computer assisted navigation during surgery. The camera tracking system is configured to identify a reference array tracked by a set of tracking cameras attached to an extended reality (XR) headset, and determine whether the reference array is registered as being paired with characteristics of one of a plurality of surgical tools defined in a surgical tool database. The camera tracking system is further configured to, based on the reference array being determined to not be registered and receiving user input, register the reference array to be paired with characteristics of one of the plurality of surgical tools selected based on the user input. The camera tracking system is further configured to provide a representation of the characteristics to a display device of the XR headset for display to the user.Type: ApplicationFiled: April 29, 2020Publication date: November 4, 2021Inventors: Thomas Calloway, Isaac Dulin
-
Patent number: 11153555Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.Type: GrantFiled: May 8, 2020Date of Patent: October 19, 2021Assignee: Globus Medical Inc.Inventors: Weston Healy, Thomas Calloway, Norbert Johnson, Keerthighaan Kanagasegar
-
Publication number: 20210251717Abstract: A shroud for an extended reality (XR) headset may include an opacity filter including a first region having a first light transmissivity, and a second region having a second light transmissivity different from the first light transmissivity. The shroud may also include a connection mechanism for removably connecting the opacity filter to the XR headset to position at least a portion of the opacity filter in a user's field of view when viewing a real-world scene while the XR headset is worn by the user.Type: ApplicationFiled: February 19, 2020Publication date: August 19, 2021Inventors: Weston Healy, Thomas Calloway, Norbert Johnson, Zachary Wassall
-
Publication number: 20210251716Abstract: A virtual model a planned instrument attachment can be provided to ensure correct selection of a physical instrument attachment. An XR headset controller can generate a shape and a pose of the virtual model of the planned instrument attachment based on predetermined information associated with the planned instrument attachment and based on a pose of an instrument relative to the XR headset. An XR headset can display the virtual model on a see-through display screen of the XR headset that is configured to allow at least a portion of a real-world scene to pass therethrough.Type: ApplicationFiled: February 19, 2020Publication date: August 19, 2021Inventors: Weston Healy, Thomas Calloway, Norbert Johnson
-
Publication number: 20210244479Abstract: A camera tracking system is disclosed that is configured to obtain a model defining a tracking volume of a set of tracking cameras relative to pose of the set of tracking cameras, and receive tracking information from the set of tracking cameras indicating pose of an extended reality (XR) headset relative to the set of tracking cameras. The camera tracking system is further configured to generate a graphical representation of the tracking volume from a perspective of the XR headset based on the pose of the XR headset indicated by the tracking information and based the model defining the tracking volume of the set of tracking cameras, and provide the graphical representation of the tracking volume to the XR headset for display to the user.Type: ApplicationFiled: February 10, 2020Publication date: August 12, 2021Inventors: Zachary Wassall, Thomas Calloway
-
Publication number: 20210228281Abstract: A surgical system includes a camera tracking system that determines a first pose transform between a first object coordinate system and the first tracking camera coordinate system based on first object tracking information from the first tracking camera which indicates pose of the first object. The camera tracking system determines a second pose transform between the first object coordinate system and the second tracking camera coordinate system based on first object tracking information from the second tracking camera indicating pose of the first object, and determines a third pose transform between a second object coordinate system and the second tracking camera coordinate system based on second object tracking information from the second tracking camera indicating pose of the second object. The camera tracking system determines a fourth pose transform between the second object coordinate system and the first tracking camera coordinate system based on combining the first, second, and third pose transforms.Type: ApplicationFiled: January 28, 2020Publication date: July 29, 2021Inventor: Thomas Calloway
-
Patent number: 11062522Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: GrantFiled: December 9, 2019Date of Patent: July 13, 2021Assignee: Global Medical IncInventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
-
Publication number: 20210169578Abstract: A surgical system includes an AR headset and a AR headset controller. The AR headset is configured to be worn by a user during a surgical procedure and has a see-through display screen configured to display an AR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The AR headset also includes an opacity filter positioned between at least one of the user's eyes and the real-world scene when the see-through display screen is viewed by the user. The opacity filter provides opaqueness to light from the real-world scene. The AR headset controller communicates with a navigation controller to receive navigation information from the navigation controller which provides guidance to the user during the surgical procedure on an anatomical structure, and generates the AR image based on the navigation information for display on the see-through display screen.Type: ApplicationFiled: December 10, 2019Publication date: June 10, 2021Inventors: Thomas Calloway, Weston Healy, Isaac Dulin, Dale Earle, Keiichi Matsuda
-
Publication number: 20210169605Abstract: A surgical robot positions an end effector that guides movement of a surgical tool during a surgical procedure on a patient anatomical structure. A tracking system determines a pose of the anatomical structure and a pose of the end effector and/or the surgical tool. A navigation controller determines a target pose for the surgical tool based on a surgical plan and based on the pose of the anatomical structure, and generates steering information based on the target pose for the surgical tool, the pose of the anatomical structure, and the pose of the surgical tool and/or the end effector. The steering information indicates where the surgical tool and/or the end effector need to be moved. An AR headset controller receives the steering information from the navigation controller and displays a graphical representation of the steering information and/or the target pose for the surgical tool on a see-through display screen.Type: ApplicationFiled: December 10, 2019Publication date: June 10, 2021Inventors: Thomas Calloway, Weston Healy, Isaac Dulin, Dale Earle, Keiichi Matsuda, Norbert Johnson, Bessam Al Jewad, Christine Russ, Michael Robinson, Keerthighaan Kanagasegar
-
Publication number: 20210169581Abstract: A surgical system including a XR headset, a tracking system, and an XR headset controller. The XR headset can be worn by a user during a surgical procedure and includes a see-through display screen configured to display a world-registered XR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user. The tracking system can determine a real-world pose of the XR headset and a real-world pose of a real-world element. The real-world pose of the XR headset and the real-world pose of the real-world element being determined relative to a real-world coordinate system. The XR headset controller can generate the world-registered XR image based on the real-world pose of the XR headset and the real-world pose of the real-world element. The world-registered XR image includes a virtual element that is generated based on a characteristic of the real-world element.Type: ApplicationFiled: February 4, 2020Publication date: June 10, 2021Inventors: Thomas Calloway, Isaac Dulin, Keiichi Matsuda, Christine Russ, Keerthighaan Kanagasegar, Amelia Raphaelson
-
Patent number: 10976163Abstract: A method, a system, and a computer-readable medium for tracking position and orientation of a pedestrian. The system tracks a head position or head orientation of the pedestrian, and a foot position or foot orientation of the pedestrian. The system determines a first heading or position uncertainty associated with the head position or the head orientation of the pedestrian, and determines a second heading or position uncertainty associated with the foot position or the foot orientation of the pedestrian. Moreover, the system determines which of the first heading or position uncertainty or the second heading or position uncertainty is smaller. The system transfers the first heading or position uncertainty to a device or system portion for foot position, or transfers the second heading or position uncertainty to a device or system portion for head position.Type: GrantFiled: November 9, 2016Date of Patent: April 13, 2021Assignee: THALES DEFENSE & SECURITY, INC.Inventor: Thomas Calloway
-
Publication number: 20200242845Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: ApplicationFiled: April 8, 2020Publication date: July 30, 2020Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
-
Publication number: 20200219324Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: ApplicationFiled: March 17, 2020Publication date: July 9, 2020Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
-
Publication number: 20200184729Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: ApplicationFiled: December 9, 2019Publication date: June 11, 2020Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
-
Patent number: 10650594Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: GrantFiled: September 25, 2017Date of Patent: May 12, 2020Assignee: Globus Medical Inc.Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
-
Patent number: 10580217Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: GrantFiled: June 5, 2018Date of Patent: March 3, 2020Assignee: Globus Medical, Inc.Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin
-
Patent number: 10546423Abstract: An augmented reality surgical system includes a head mounted display (HMD) with a see-through display screen, a motion sensor, a camera, and computer equipment. The motion sensor outputs a head motion signal indicating measured movement of the HMD. The computer equipment computes the relative location and orientation of reference markers connected to the HMD and to the patient based on processing a video signal from the camera. The computer equipment generates a three dimensional anatomical model using patient data created by medical imaging equipment, and rotates and scales at least a portion of the three dimensional anatomical model based on the relative location and orientation of the reference markers, and further rotate at least a portion of the three dimensional anatomical model based on the head motion signal to track measured movement of the HMD. The rotated and scaled three dimensional anatomical model is displayed on the display screen.Type: GrantFiled: September 8, 2017Date of Patent: January 28, 2020Assignee: Globus Medical, Inc.Inventors: Kenneth Milton Jones, John Popoolapade, Thomas Calloway, Thierry Lemoine, Christian Jutteau, Christophe Bruzy, Yannick James, Joachim Laguarda, Dong-Mei Pei Xing, Sebastien Gorges, Paul Michael Yarin