Abstract: Systems and methods for tracking an evolution of a disease in a colon of a patient over time are configured for operations including receiving video data representing a colon of a patient; segmenting the video data into segments representing portions of a colon of the patient; extracting, from the video data based on the segmenting, a set of features representing locations in the colon of the patient; and registering the feature vector as representing the colon of the patient for tracking the evolution of the disease in the colon of the patient. The system can be configured to predict disease progression predict drug dosage for patients.

Abstract: Generating a structured medical record from endoscopy data includes obtaining image data including endoscopic images representing portions of a gastrointestinal tract (GI) of a patient; determining features to extract from the image data, the features each representing a physical parameter of the GI tract; extracting the features from the image data; generating anatomical location data specifying a location within the GI tract of a portion of the GI tract represented in the image data; associating the anatomical location data with images that represent the portion of the GI tract; storing, in a node of a data store, data entries including the anatomical location data and the associated one or more images. The data store is configured to receive structured queries for the data entries in the data store and provide the data entries including the transformed features in response to receiving the structured queries.

Abstract: A system generates a user interface that enables a user to generate a chart from one or more statements of a data processing package. Via one or more user interactions with the user interface, the system may receive one or more chart parameters for a chart. Using a statement from the data processing package and the one or more chart parameters, the system may generate an additional statement and append the generated statement to the data processing package to form an enriched data processing package. The system may communicate the enriched data processing package to a search service for execution. The system may display the results in an interactive chart.

Abstract: This specification describes systems and methods for performing endoscopy, obtaining medical images for inflammatory bowel disease (IBD) and scoring severity of IBD in patients. The methods and systems are configured for using machine learning to determine measurements of various characteristics related to IBD. The methods and systems may also obtain and incorporate electronic health data of patients along with endoscopic data to use for scoring purposes.

Abstract: A system generates a user interface that enables a user to generate a chart from one or more statements of a data processing package. Via one or more user interactions with the user interface, the system may receive one or more chart parameters for a chart. Using a statement from the data processing package and the one or more chart parameters, the system may generate an additional statement and append the generated statement to the data processing package to form an enriched data processing package. The system may communicate the enriched data processing package to a search service for execution. The system may display the results in an interactive chart.

Abstract: A system generates a user interface that enables a user to generate a chart from one or more statements of a data processing package. Via one or more user interactions with the user interface, the system may receive one or more chart parameters for a chart. Using a statement from the data processing package and the one or more chart parameters, the system may generate an additional statement and append the generated statement to the data processing package to form an enriched data processing package. The system may communicate the enriched data processing package to a search service for execution. The system may display the results in an interactive chart.

Abstract: This specification describes systems and methods for performing endoscopy, obtaining medical images for inflammatory bowel disease (IBD) and scoring severity of IBD in patients. The methods and systems are configured for using machine learning to determine measurements of various characteristics related to IBD. The methods and systems may also obtain and incorporate electronic health data of patients along with endoscopic data to use for scoring purposes.

Abstract: One or more machine learning techniques can be used to identify locations of potential malignancies within images (e.g., video images) captured during a medical procedure, such as an endoscopic procedure. The images can be displayed, in real-time, on a display unit. The images can be displayed with a graphical overlay that isolates the identified locations of potential malignancies.

Abstract: A system generates a user interface that enables a user to interact with an interactive chart associated with a statement of a data processing package. Via one or more user interactions with the user interface, the system may receive one or more chart parameters for the chart. Using a statement from the data processing package and the one or more chart parameters, the system may generate an additional statement and append the generated statement to the data processing package to form an enriched data processing package. The system may communicate the enriched data processing package to a search service for execution. The system may display the results in the chart.

Abstract: A system generates a user interface that enables a user to generate a chart from one or more statements of a data processing package. Via one or more user interactions with the user interface, the system may receive one or more chart parameters for a chart. Using a statement from the data processing package and the one or more chart parameters, the system may generate an additional statement and append the generated statement to the data processing package to form an enriched data processing package. The system may communicate the enriched data processing package to a search service for execution. The system may display the results in an interactive chart.

Abstract: This specification describes systems and methods for obtaining various patient related data for inflammatory bowel disease (IBD). The methods and systems are configured for using machine learning to determine measurements of various characteristics and provide analysis related to IBD. The methods and systems may also obtain and incorporate electronic health data as well as other relevant data of patients along with endoscopic data to use for prediction IDB progression and recommending treatment.

Abstract: This specification describes systems and methods for generating structured data records, such as electronic health records (EHR) or electronic medical records (EMR), based on medical data generated during an endoscopy procedure. More specifically, the data processing system and methods described in this document are configured to generate structured medical data automatically from images, videos, associated metadata, and other data generated during an endoscopy procedure for a patient.

Abstract: A system is described that receives a query model of a query that includes one or more query commands. The query model includes a command model that corresponds to at least query command of the one or more query commands. The system uses the command model to generate an interactive action model summary and causes a user interface to display the query and the interactive action model summary in a query actions panel. A modification to the query in the user interface causes an update to the query actions panel and a modification to the action model summary causes an update to the at least one query command of the query.

Abstract: A system generates a user interface that enables a user to generate a data summarization statement for a data processing package. Via one or more user interactions with the user interface, the system may receive one or more parameters for the summarization statement. Using the parameters, the system may generate a summarization statement for execution by a data service, an action model display object, a statement action model display object, and/or a filter token object for display in the user interface.

Abstract: A computerized method is disclosed that includes operations of detecting user input to a first webpage rendered within a web browser, the user input corresponds to closure of the first webpage, providing an indication of the user input corresponding to the closure of the first webpage to a web browser extension operating in accordance with the web browser, the indication includes an identifier, performing, by the web browser extension operating in accordance with the web browser, a search for the identifier within a URL of each webpage currently opened by the web browser in order to determine that a second webpage is associated with the first webpage based on inclusion of the identifier in a URL of the second webpage, and initiating, by the web browser extension, closure of the second webpage associated with the first webpage following the user input corresponding to closure of the first webpage.

Abstract: One or more machine learning techniques can be used to identify locations of potential malignancies within images (e.g., video images) captured during a medical procedure, such as an endoscopic procedure. The images can be displayed, in real-time, on a display unit.

Abstract: This specification describes systems and methods for obtaining various patient related data for inflammatory bowel disease (IBD). The methods and systems are configured for using machine learning to determine measurements of various characteristics and provide analysis related to IBD. The methods and systems may also obtain and incorporate electronic health data as well as other relevant data of patients along with endoscopic data to use for prediction IDB progression and recommending treatment.

Abstract: One or more machine learning techniques can be used to identify locations of potential malignancies within images (e.g., video images) captured during a medical procedure, such as an endoscopic procedure. The images can be displayed, in real-time, on a display unit. The images can be displayed with a graphical overlay that isolates the identified locations of potential malignancies.

Abstract: Systems and methods for tracking an evolution of a disease in a colon of a patient over time are configured for operations including receiving video data representing a colon of a patient; segmenting the video data into segments representing portions of a colon of the patient; extracting, from the video data based on the segmenting, a set of features representing locations in the colon of the patient; and registering the feature vector as representing the colon of the patient for tracking the evolution of the disease in the colon of the patient. The system can be configured to predict disease progression predict drug dosage for patients.

Abstract: Generating a structured medical record from endoscopy data includes obtaining image data including endoscopic images representing portions of a gastrointestinal tract (GI) of a patient; determining features to extract from the image data, the features each representing a physical parameter of the GI tract; extracting the features from the image data; generating anatomical location data specifying a location within the GI tract of a portion of the GI tract represented in the image data; associating the anatomical location data with images that represent the portion of the GI tract; storing, in a node of a data store, data entries including the anatomical location data and the associated one or more images. The data store is configured to receive structured queries for the data entries in the data store and provide the data entries including the transformed features in response to receiving the structured queries.