Patents by Inventor Martin Habbecke
Martin Habbecke has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11941050Abstract: Systems and methods for segmenting surgical videos are disclosed. One example method includes receiving, by a processor of a computing device, surgical video, the surgical video comprising at least a sequence of video frames of a surgical procedure; in response to receiving an identification of a video frame, generating, by the processor, a bookmark based on the video frame; associating, by the processor, the bookmark with the video frame; and storing, by the processor, the bookmark in a non-transitory computer-readable medium.Type: GrantFiled: February 16, 2021Date of Patent: March 26, 2024Assignee: VERILY LIFE SCIENCES LLCInventors: Joëlle K. Barral, Martin Habbecke, Michal Levin, Antons Krumins, Thomas Teisseyre
-
Patent number: 11836917Abstract: One example method for identifying useful segments in surgical videos includes accessing a video of a surgical procedure and user activities of a plurality of users who have watched the video of the surgical procedure. The user activities include operations performed during playback of the video. The method further includes dividing the video into multiple segments and determining a popularity score for each of the multiple segments based on the operations. Useful segments are identified from the segments based on the popularity scores. The method further includes generating metadata for the video of the surgical procedure to include an indication of the identified useful segments and associating the metadata with the video of the surgical procedure.Type: GrantFiled: April 14, 2022Date of Patent: December 5, 2023Assignee: Verily Life Sciences LLCInventors: Joëlle Barral, Martin Habbecke, Lin Yang, Xing Jin
-
Publication number: 20230252075Abstract: A system includes a display, and a database including surgical videos, images of organs in a human body obtained from a medical imaging device, and images of disease in a human body obtained from the medical imaging device. A controller including a processor is coupled to memory, the database, and the display, and the memory stores information that when executed by the processor causes the system to perform operations. For example, the processor may determine first organ information from the images of the organs, and first disease information from the images of the disease. The processor my calculate a similarity score between the first organ information and the first disease information and second disease information and second organ information indexed to the surgical videos. The processor selects one or more of the surgical videos based on the similarity score, and displays the surgical videos on the display.Type: ApplicationFiled: April 10, 2023Publication date: August 10, 2023Inventors: Martin Habbecke, Joëlle K. Barral, Lin Yang, Xing Jin
-
Patent number: 11657087Abstract: A system includes a display, and a database including surgical videos, images of organs in a human body obtained from a medical imaging device, and images of disease in a human body obtained from the medical imaging device. A controller including a processor is coupled to memory, the database, and the display, and the memory stores information that when executed by the processor causes the system to perform operations. For example, the processor may determine first organ information from the images of the organs, and first disease information from the images of the disease. The processor my calculate a similarity score between the first organ information and the first disease information and second disease information and second organ information indexed to the surgical videos. The processor selects one or more of the surgical videos based on the similarity score, and displays the surgical videos on the display.Type: GrantFiled: March 12, 2019Date of Patent: May 23, 2023Assignee: Verily Life Sciences LLCInventors: Martin Habbecke, Joëlle K. Barral, Lin Yang, Xing Jin
-
Publication number: 20220324102Abstract: An apparatus, system and process for guiding a surgeon during a medical procedure to prevent surgical mistakes are described. The system may include a machine learning medical procedure server that generates one or more machine learning medical procedure models using, at least, medical procedure data captured during medical procedures performed at a plurality of different medical procedure systems. The system may also include a medical procedure system communicably coupled with the machine learning medical procedure server that receives a selected machine learning medical procedure model from the machine learning medical procedure server, and utilizes the selected machine learning medical procedure model during a corresponding medical procedure to control one or more operations of the medical procedure system.Type: ApplicationFiled: June 27, 2022Publication date: October 13, 2022Inventors: Joëlle Barral, Martin Habbecke, Daniele Piponi, Thomas Teisseyre
-
Publication number: 20220237792Abstract: One example method for identifying useful segments in surgical videos includes accessing a video of a surgical procedure and user activities of a plurality of users who have watched the video of the surgical procedure. The user activities include operations performed during playback of the video. The method further includes dividing the video into multiple segments and determining a popularity score for each of the multiple segments based on the operations. Useful segments are identified from the segments based on the popularity scores. The method further includes generating metadata for the video of the surgical procedure to include an indication of the identified useful segments and associating the metadata with the video of the surgical procedure.Type: ApplicationFiled: April 14, 2022Publication date: July 28, 2022Applicant: Verily Life Sciences LLCInventors: Joëlle Barral, Martin Habbecke, Lin Yang, Xing Jin
-
Patent number: 11370113Abstract: An apparatus, system and process for guiding a surgeon during a medical procedure to prevent surgical mistakes are described. The system may include a machine learning medical procedure server that generates one or more machine learning medical procedure models using, at least, medical procedure data captured during medical procedures performed at a plurality of different medical procedure systems. The system may also include a medical procedure system communicably coupled with the machine learning medical procedure server that receives a selected machine learning medical procedure model from the machine learning medical procedure server, and utilizes the selected machine learning medical procedure model during a corresponding medical procedure to control one or more operations of the medical procedure system.Type: GrantFiled: August 25, 2017Date of Patent: June 28, 2022Assignee: Verily Life Sciences LLCInventors: Joëlle Barral, Martin Habbecke, Daniele Piponi, Thomas Teisseyre
-
Patent number: 11348235Abstract: One example method for identifying useful segments in surgical videos includes accessing a video of a surgical procedure and user activities of a plurality of users who have watched the video of the surgical procedure. The user activities include operations performed during playback of the video. The method further includes dividing the video into multiple segments and determining a popularity score for each of the multiple segments based on the operations. Useful segments are identified from the segments based on the popularity scores. The method further includes generating metadata for the video of the surgical procedure to include an indication of the identified useful segments and associating the metadata with the video of the surgical procedure.Type: GrantFiled: March 3, 2020Date of Patent: May 31, 2022Assignee: VERILY LIFE SCIENCES LLCInventors: Joëlle Barral, Martin Habbecke, Lin Yang, Xing Jin
-
Publication number: 20220108450Abstract: A surgical simulator for simulating a surgical scenario comprises a display system, a user interface, and a controller. The controller includes one or more processors coupled to memory that stores instructions that when executed cause the system to perform operations. The operations include generating simulated surgical videos, each representative of the surgical scenario. The operations further include associating simulated ground truth data from the simulation with the simulated surgical videos. The ground truth data corresponds to context information of at least one of a simulated surgical instrument, a simulated anatomical region, a simulated surgical task, or a simulated action. The operations further include annotating features of the simulated surgical videos based, at least in part, on the simulated ground truth data for training a machine learning model.Type: ApplicationFiled: December 16, 2021Publication date: April 7, 2022Inventors: Xing Jin, Joëlle K. Barral, Lin Yang, Martin Habbecke, Gianni Campion
-
Patent number: 11250726Abstract: A simulator for simulating soft body deformation includes a display system, a user interface, and a controller. The controller includes one or more processors coupled to memory that stores instructions that when executed cause the system to perform operations. The operations include generating a simulated soft body having a shape represented, at least in part, by a plurality of nodes. The operations further include determining, with at least a first machine learning model, a displacement of individual nodes included in the plurality of nodes in response to a simulated force applied to the simulated soft body. The operations further include rendering a deformation of the simulated soft body in substantially real time in response to the simulated force based, at least in part, on the displacement.Type: GrantFiled: March 26, 2019Date of Patent: February 15, 2022Assignee: Verily Life Sciences LLCInventors: Joëlle K. Barral, Gianni Campion, Martin Habbecke, Xing Jin
-
Patent number: 11232556Abstract: A surgical simulator for simulating a surgical scenario comprises a display system, a user interface, and a controller. The controller includes one or more processors coupled to memory that stores instructions that when executed cause the system to perform operations. The operations include generating simulated surgical videos, each representative of the surgical scenario. The operations further include associating simulated ground truth data from the simulation with the simulated surgical videos. The ground truth data corresponds to context information of at least one of a simulated surgical instrument, a simulated anatomical region, a simulated surgical task, or a simulated action. The operations further include annotating features of the simulated surgical videos based, at least in part, on the simulated ground truth data for training a machine learning model.Type: GrantFiled: April 2, 2019Date of Patent: January 25, 2022Assignee: Verily Life Sciences LLCInventors: Xing Jin, Joëlle K. Barral, Lin Yang, Martin Habbecke, Gianni Campion
-
Patent number: 11224486Abstract: A robotic system includes a communication system coupled to communicate with one or more external devices that include first user preferences. The robotic system also includes memory storing a database including second user preferences. A controller is coupled to the user interface, the communication system, and the memory, and the controller includes logic that when executed by the controller causes the robotic system to perform operations. Operations may include retrieving the first user preferences using the communication system; retrieving the second user preferences from the database; resolving conflicts between the first user preferences and the second user preferences to create a final set of user preferences; and configuring the robotic system with the revised set of user preferences.Type: GrantFiled: August 22, 2018Date of Patent: January 18, 2022Assignee: Verily Life Sciences LLCInventors: Joëlle K. Barral, Martin Habbecke, James Shuma, Robin Thellend, Miles Eldon
-
Publication number: 20210200804Abstract: Systems and methods for segmenting surgical videos are disclosed. One example method includes receiving, by a processor of a computing device, surgical video, the surgical video comprising at least a sequence of video frames of a surgical procedure; in response to receiving an identification of a video frame, generating, by the processor, a bookmark based on the video frame; associating, by the processor, the bookmark with the video frame; and storing, by the processor, the bookmark in a non-transitory computer-readable medium.Type: ApplicationFiled: February 16, 2021Publication date: July 1, 2021Applicant: Verily Life Sciences LLCInventors: Joëlle K. Barral, Martin Habbecke, Michal Levin, Antons Krumins, Thomas Teisseyre
-
Publication number: 20210145523Abstract: Systems and methods for depth detection and virtual modeling using surgical robots during a surgical procedure are described. The robotic surgical systems include robotic arms with interchangeable surgical tools. An endoscope at the end of one of the robotic arms includes a depth sensor for detecting a distance from the camera to patient anatomy. The depth data and image data are used to generate a feature model of the patient anatomy for reference by a surgeon. The feature model is displayed to the surgeon in an augmented reality view with preoperative and intraoperative images mapped thereon for reference and guidance of a surgical procedure.Type: ApplicationFiled: November 13, 2020Publication date: May 20, 2021Applicant: Verily Life Sciences LLCInventors: Jin Xing, Caitlin Donhowe, Martin Habbecke, Joëlle Barral
-
Patent number: 10956492Abstract: Systems and methods for segmenting surgical videos are disclosed. One example method includes receiving, by a processor of a computing device, surgical video, the surgical video comprising at least a sequence of video frames of a surgical procedure; in response to receiving an identification of a video frame, generating, by the processor, a bookmark based on the video frame; associating, by the processor, the bookmark with the video frame; and storing, by the processor, the bookmark in a non-transitory computer-readable medium.Type: GrantFiled: October 17, 2018Date of Patent: March 23, 2021Assignee: VERILY LIFE SCIENCES LLCInventors: Joëlle K. Barral, Martin Habbecke, Michal Levin, Antons Krumins, Thomas Teisseyre
-
Publication number: 20210030483Abstract: Systems and methods for identifying surgery tools of a robotic surgery system in surgery video based on robot kinematics are described. Kinematic data describing a position of a first robotic surgery arm including a surgery tool is used to determine a nominal position of the first robotic surgery arm. A search area within image data obtained during a robotic surgery from an endoscope attached to a second robotic surgery arm is determined based on the kinematic data and a nominal position of the surgery tool. The surgery tool is identified within the search area of the image data using an object detection technique.Type: ApplicationFiled: July 24, 2020Publication date: February 4, 2021Applicant: Verily Life Sciences LLCInventors: Xing Jin, Joëlle Barral, Martin Habbecke, Caitlin Donhowe
-
Patent number: 10835344Abstract: A system for video-assisted surgery includes one or more displays, a memory including at least one preoperative image, and a camera coupled to capture a video. A controller is coupled to the memory, the camera, and the one or more displays, and the controller includes logic that when executed by the controller causes the system to perform a variety of operations. The system may capture a video of a surgical area, including anatomical features, using the camera, and display the video of the surgical area on the one or more displays. The system may also display the at least one preoperative image on the one or more displays at the same time as the video. The location of the anatomical features shown in the video is displayed as an accentuated region on the at least one preoperative image.Type: GrantFiled: October 12, 2018Date of Patent: November 17, 2020Assignee: VERILY LIFE SCIENCES LLCInventors: Joëlle K. Barral, Martin Habbecke, Eric Johnson, Francois Brahic
-
Publication number: 20200302600Abstract: One example method for identifying useful segments in surgical videos includes accessing a video of a surgical procedure and user activities of a plurality of users who have watched the video of the surgical procedure. The user activities include operations performed during playback of the video. The method further includes dividing the video into multiple segments and determining a popularity score for each of the multiple segments based on the operations. Useful segments are identified from the segments based on the popularity scores. The method further includes generating metadata for the video of the surgical procedure to include an indication of the identified useful segments and associating the metadata with the video of the surgical procedure.Type: ApplicationFiled: March 3, 2020Publication date: September 24, 2020Applicant: Verily Life Sciences LLCInventors: Joëlle Barral, Martin Habbecke, Lin Yang, Xing Jin
-
Publication number: 20200060773Abstract: A robotic system includes a communication system coupled to communicate with one or more external devices that include first user preferences. The robotic system also includes memory storing a database including second user preferences. A controller is coupled to the user interface, the communication system, and the memory, and the controller includes logic that when executed by the controller causes the robotic system to perform operations. Operations may include retrieving the first user preferences using the communication system; retrieving the second user preferences from the database; resolving conflicts between the first user preferences and the second user preferences to create a final set of user preferences; and configuring the robotic system with the revised set of user preferences.Type: ApplicationFiled: August 22, 2018Publication date: February 27, 2020Inventors: Joëlle K. Barral, Martin Habbecke, James Shuma, Robin Thellend, Miles Eldon
-
Publication number: 20190378610Abstract: One example method for robotic surgery using multi-user authentication without credentials includes receiving, by a robotic surgical device, a case code associated with a medical procedure; validating the case code; determining one or more users associated with the case code; and providing access to the one or more users to the robotic surgical device to enable a robotic surgical procedure.Type: ApplicationFiled: June 3, 2019Publication date: December 12, 2019Applicant: Verily Life Sciences LLCInventors: Joëlle Barral, Martin Habbecke, James Shuma, Robin Thellend, Brian Carnes, Neil Inala, Timothy Chung, Michael Newton, Michal Levin