Patents by Inventor MICHAEL K. SOUTHWORTH
MICHAEL K. SOUTHWORTH has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11829526Abstract: In an embodiment, a processing system provides an augmented reality object for display by a head-mounted device (HMD) worn by a user. The processing system provides an augmented reality graphic for display by the HMD on a plane and overlaid on the augmented reality object. The processing system determines a gaze direction of the user using sensor data captured by a sensor of the HMD. Responsive to determining that the gaze direction intersects with the augmented reality graphic on the plane and remains intersecting for at least a period of time, the processing system determines a position of intersection between the gaze direction and the augmented reality graphic on the plane. The processing system provides a modified version of the augmented reality object for display by the HMD according to the position of intersection during the period of time.Type: GrantFiled: November 12, 2021Date of Patent: November 28, 2023Assignee: SENTIAR, INC.Inventors: Walter Blume, Michael K. Southworth, Jennifer N. Avari Silva, Jonathan R. Silva
-
Publication number: 20230341932Abstract: A processing system provides two-way communication between an electroanatomic navigation and mapping system (EAMS) and a head-mounted display (HMD). A user wearing the HMD can use hands-free or touch-free actions to interact with a user interface for EAMS information displayed by the HMD (e.g., 3D augmented reality graphics) or by a display monitor (e.g., 2D graphics). For example, the processing system updates the position of a cursor on the display monitor to track a gaze direction of the user as determined by the HMD.Type: ApplicationFiled: April 21, 2023Publication date: October 26, 2023Applicant: SentiAR, Inc.Inventors: Jennifer N. Avari SILVA, Jonathan R. SILVA, Michael K. SOUTHWORTH, Ignacio SORIANO, Matthew DAGLEY, Christopher Michael ANDREWS, Sharif RAZZAQUE, Irene HOUGARD, Berk TAS
-
Patent number: 11737700Abstract: In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.Type: GrantFiled: September 8, 2022Date of Patent: August 29, 2023Assignee: SentiAR, Inc.Inventors: Walter Blume, Michael K. Southworth, Jonathan R. Silva, Jennifer N. Avari Silva, Ignacio Soriano
-
Publication number: 20230000419Abstract: In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.Type: ApplicationFiled: September 8, 2022Publication date: January 5, 2023Inventors: Walter Blume, Michael K. Southworth, Jonathan R. Silva, Jennifer N. Avari Silva, Ignacio Soriano
-
Patent number: 11507336Abstract: A visualization system provides graphics for presentation on displays of multiple users who may be wearing head-mounted displays (HMDs). In an embodiment, the system determines that a first gaze direction of a first user is directed toward a first display. The system determines user inputs performed by the first user. The user inputs may be hands-free such as gestures of a hand or finger or voice commands. The system generates a graphical annotation using the user inputs. The system provides the graphical annotation to a first HMD for presentation to the first user. The system determines a second display paired to the first display. The system provides the graphical annotation to a second HMD for presentation to a second user looking at the second display. The displays may include a physical display or a virtual display, for example, in an augmented reality environment.Type: GrantFiled: April 7, 2021Date of Patent: November 22, 2022Inventors: Walter Blume, Michael K. Southworth
-
Publication number: 20220354462Abstract: In an embodiment, a system receives data from a first electromagnetic sensor coupled to a head-mounted display (HMD) and detecting an electromagnetic field generated by an electromagnetic reference source coupled to an ultrasound probe. The system receives data from a second electromagnetic sensor coupled to a medical instrument and detecting the electromagnetic field. The system determines a position of the HMD relative to the ultrasound probe. The system determines a position of the medical instrument relative to the ultrasound probe. The system generates a visualization of a path of the medical instrument oriented relative to an ultrasound image plane. The system provides a graphic for display by the HMD to a user wearing the HMD, where the graphic includes the visualization and image data captured by the ultrasound probe displayed on the ultrasound image plane.Type: ApplicationFiled: May 9, 2022Publication date: November 10, 2022Inventors: Michael K. Southworth, Christopher Michael Andrews, Ignacio Soriano, Alexander Bair Henry, Jonathan R. Silva, Jennifer N. Avari Silva
-
Patent number: 11452477Abstract: In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.Type: GrantFiled: October 23, 2020Date of Patent: September 27, 2022Assignee: SentiAR, Inc.Inventors: Walter Blume, Michael K. Southworth, Jonathan R. Silva, Jennifer N. Avari Silva, Ignacio Soriano
-
Patent number: 11372618Abstract: An intercom system provides audio communication between multiple users wearing head-mounted devices (HMDs). In an embodiment, the intercom system determines a first location of a first HMD of a first user. The intercom system determines a second location of a second HMD of a second user. The intercom system receives audio of the first user from a microphone of the first HMD. The intercom system determines a volume level of the audio at the second location using at least the first location and the second location. The intercom system transmits the audio to the second HMD responsive to determining that the volume level is less than a threshold volume. The intercom system may also selectively transmit audio based on gaze direction of a user. Additionally, the intercom system may generate a transcript of audio input by users.Type: GrantFiled: August 23, 2021Date of Patent: June 28, 2022Assignee: SentiAR, Inc.Inventors: Walter Blume, Michael K. Southworth
-
Publication number: 20220075449Abstract: In an embodiment, a processing system provides an augmented reality object for display by a head-mounted device (HMD) worn by a user. The processing system provides an augmented reality graphic for display by the HMD on a plane and overlaid on the augmented reality object. The processing system determines a gaze direction of the user using sensor data captured by a sensor of the HMD. Responsive to determining that the gaze direction intersects with the augmented reality graphic on the plane and remains intersecting for at least a period of time, the processing system determines a position of intersection between the gaze direction and the augmented reality graphic on the plane. The processing system provides a modified version of the augmented reality object for display by the HMD according to the position of intersection during the period of time.Type: ApplicationFiled: November 12, 2021Publication date: March 10, 2022Inventors: WALTER BLUME, MICHAEL K. SOUTHWORTH, JENNIFER N. AVARI SILVA, JONATHAN R. SILVA
-
Patent number: 11199898Abstract: In an embodiment, a processing system provides an augmented reality object for display by a head-mounted device (HMD) worn by a user. The processing system provides an augmented reality graphic for display by the HMD on a plane and overlaid on the augmented reality object. The processing system determines a gaze direction of the user using sensor data captured by a sensor of the HMD. Responsive to determining that the gaze direction intersects with the augmented reality graphic on the plane and remains intersecting for at least a period of time, the processing system determines a position of intersection between the gaze direction and the augmented reality graphic on the plane. The processing system provides a modified version of the augmented reality object for display by the HMD according to the position of intersection during the period of time.Type: GrantFiled: June 26, 2019Date of Patent: December 14, 2021Assignee: SentiAR, Inc.Inventors: Walter Blume, Michael K. Southworth, Jennifer N. Avari Silva, Jonathan R. Silva
-
Publication number: 20210382682Abstract: An intercom system provides audio communication between multiple users wearing head-mounted devices (HMDs). In an embodiment, the intercom system determines a first location of a first HMD of a first user. The intercom system determines a second location of a second HMD of a second user. The intercom system receives audio of the first user from a microphone of the first HMD. The intercom system determines a volume level of the audio at the second location using at least the first location and the second location. The intercom system transmits the audio to the second HMD responsive to determining that the volume level is less than a threshold volume. The intercom system may also selectively transmit audio based on gaze direction of a user. Additionally, the intercom system may generate a transcript of audio input by users.Type: ApplicationFiled: August 23, 2021Publication date: December 9, 2021Inventors: Walter Blume, Michael K. Southworth
-
Patent number: 11126395Abstract: An intercom system provides audio communication between multiple users wearing head-mounted devices (HMDs). In an embodiment, the intercom system determines a first location of a first HMD of a first user. The intercom system determines a second location of a second HMD of a second user. The intercom system receives audio of the first user from a microphone of the first HMD. The intercom system determines a volume level of the audio at the second location using at least the first location and the second location. The intercom system transmits the audio to the second HMD responsive to determining that the volume level is less than a threshold volume. The intercom system may also selectively transmit audio based on gaze direction of a user. Additionally, the intercom system may generate a transcript of audio input by users.Type: GrantFiled: February 13, 2019Date of Patent: September 21, 2021Assignee: SentiAR, Inc.Inventors: Walter Blume, Michael K. Southworth
-
Publication number: 20210224020Abstract: A visualization system provides graphics for presentation on displays of multiple users who may be wearing head-mounted displays (HMDs). In an embodiment, the system determines that a first gaze direction of a first user is directed toward a first display. The system determines user inputs performed by the first user. The user inputs may be hands-free such as gestures of a hand or finger or voice commands. The system generates a graphical annotation using the user inputs. The system provides the graphical annotation to a first HMD for presentation to the first user. The system determines a second display paired to the first display. The system provides the graphical annotation to a second HMD for presentation to a second user looking at the second display. The displays may include a physical display or a virtual display, for example, in an augmented reality environment.Type: ApplicationFiled: April 7, 2021Publication date: July 22, 2021Inventors: Walter Blume, Michael K. Southworth
-
Patent number: 11003410Abstract: A visualization system provides graphics for presentation on displays of multiple users who may be wearing head-mounted displays (HMDs). In an embodiment, the system determines that a first gaze direction of a first user is directed toward a first display. The system determines user inputs performed by the first user. The user inputs may be hands-free such as gestures of a hand or finger or voice commands. The system generates a graphical annotation using the user inputs. The system provides the graphical annotation to a first HMD for presentation to the first user. The system determines a second display paired to the first display. The system provides the graphical annotation to a second HMD for presentation to a second user looking at the second display. The displays may include a physical display or a virtual display, for example, in an augmented reality environment.Type: GrantFiled: February 13, 2019Date of Patent: May 11, 2021Assignee: SentiAR, Inc.Inventors: Walter Blume, Michael K. Southworth
-
Publication number: 20210121089Abstract: In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.Type: ApplicationFiled: October 23, 2020Publication date: April 29, 2021Inventors: Walter Blume, Michael K. Southworth, Jonathan R. Silva, Jennifer N. Avari Silva, Ignacio Soriano
-
Patent number: 10964291Abstract: A sticker system includes at least a head-mounted device and a sticker. In an embodiment, the sticker system receives an image of the sticker captured by an imaging sensor. The sticker system determines registration information by processing a fiducial marker of the sticker shown in the image. The sticker system determines location information of the HMD. Additionally, the sticker system determines a position of the sticker relative to the HMD using the registration information and the location information. The sticker system provides a (e.g., augmented reality) graphic to the HMD for presentation to the user based on the position of the sticker.Type: GrantFiled: July 10, 2020Date of Patent: March 30, 2021Assignee: SENTIAR, INC.Inventors: Michael K. Southworth, Walter Blume, Jennifer N. Avari Silva, Jonathan R. Silva
-
Publication number: 20200342832Abstract: A sticker system includes at least a head-mounted device and a sticker. In an embodiment, the sticker system receives an image of the sticker captured by an imaging sensor. The sticker system determines registration information by processing a fiducial marker of the sticker shown in the image. The sticker system determines location information of the HMD. Additionally, the sticker system determines a position of the sticker relative to the HMD using the registration information and the location information. The sticker system provides a (e.g., augmented reality) graphic to the HMD for presentation to the user based on the position of the sticker.Type: ApplicationFiled: July 10, 2020Publication date: October 29, 2020Inventors: Michael K. Southworth, Walter Blume, Jennifer N. Avari Silva, Jonathan R. Silva
-
Patent number: 10733960Abstract: A sticker system includes at least a head-mounted device and a sticker. In an embodiment, the sticker system receives an image of the sticker captured by an imaging sensor. The sticker system determines registration information by processing a fiducial marker of the sticker shown in the image. The sticker system determines location information of the HMD. Additionally, the sticker system determines a position of the sticker relative to the HMD using the registration information and the location information. The sticker system provides a (e.g., augmented reality) graphic to the HMD for presentation to the user based on the position of the sticker.Type: GrantFiled: May 24, 2019Date of Patent: August 4, 2020Assignee: SentiAR, Inc.Inventors: Michael K. Southworth, Walter Blume, Jennifer N. Avari Silva, Jonathan R. Silva
-
Publication number: 20200004328Abstract: In an embodiment, a processing system provides an augmented reality object for display by a head-mounted device (HMD) worn by a user. The processing system provides an augmented reality graphic for display by the HMD on a plane and overlaid on the augmented reality object. The processing system determines a gaze direction of the user using sensor data captured by a sensor of the HMD. Responsive to determining that the gaze direction intersects with the augmented reality graphic on the plane and remains intersecting for at least a period of time, the processing system determines a position of intersection between the gaze direction and the augmented reality graphic on the plane. The processing system provides a modified version of the augmented reality object for display by the HMD according to the position of intersection during the period of time.Type: ApplicationFiled: June 26, 2019Publication date: January 2, 2020Inventors: WALTER BLUME, MICHAEL K. SOUTHWORTH, JENNIFER N. AVARI SILVA, JONATHAN R. SILVA
-
Publication number: 20190371272Abstract: A sticker system includes at least a head-mounted device and a sticker. In an embodiment, the sticker system receives an image of the sticker captured by an imaging sensor. The sticker system determines registration information by processing a fiducial marker of the sticker shown in the image. The sticker system determines location information of the HMD. Additionally, the sticker system determines a position of the sticker relative to the HMD using the registration information and the location information. The sticker system provides a (e.g., augmented reality) graphic to the HMD for presentation to the user based on the position of the sticker.Type: ApplicationFiled: May 24, 2019Publication date: December 5, 2019Inventors: MICHAEL K. SOUTHWORTH, WALTER BLUME, JENNIFER N. AVARI SILVA, JONATHAN R. SILVA