Abstract: A system generates a user interface that enables a user to interact with an interactive chart associated with a statement of a data processing package. Via one or more user interactions with the user interface, the system may receive one or more chart parameters for the chart. Using a statement from the data processing package and the one or more chart parameters, the system may generate an additional statement and append the generated statement to the data processing package to form an enriched data processing package. The system may communicate the enriched data processing package to a search service for execution. The system may display the results in the chart.

Abstract: A system generates a user interface that enables a user to generate a chart from one or more statements of a data processing package. Via one or more user interactions with the user interface, the system may receive one or more chart parameters for a chart. Using a statement from the data processing package and the one or more chart parameters, the system may generate an additional statement and append the generated statement to the data processing package to form an enriched data processing package. The system may communicate the enriched data processing package to a search service for execution. The system may display the results in an interactive chart.

Abstract: Aspects of the disclosure provide for the identification of parkable areas. In one instance, observations of parked vehicles may be identified from logged data. The observations may be used to determine whether a sub-portion of an edge of a roadgraph corresponds to a parkable area. In some examples, the edge may define a drivable area in the roadgraph. In addition, map information is generated based on the determination of whether the sub-portion of the edge corresponds to the parkable area.

Abstract: This specification describes systems and methods for obtaining various patient related data for inflammatory bowel disease (IBD). The methods and systems are configured for using machine learning to determine measurements of various characteristics and provide analysis related to IBD. The methods and systems may also obtain and incorporate electronic health data as well as other relevant data of patients along with endoscopic data to use for prediction IDB progression and recommending treatment.

Abstract: This specification describes systems and methods for generating structured data records, such as electronic health records (EHR) or electronic medical records (EMR), based on medical data generated during an endoscopy procedure. More specifically, the data processing system and methods described in this document are configured to generate structured medical data automatically from images, videos, associated metadata, and other data generated during an endoscopy procedure for a patient.

Abstract: A system is described that receives a query model of a query that includes one or more query commands. The query model includes a command model that corresponds to at least query command of the one or more query commands. The system uses the command model to generate an interactive action model summary and causes a user interface to display the query and the interactive action model summary in a query actions panel. A modification to the query in the user interface causes an update to the query actions panel and a modification to the action model summary causes an update to the at least one query command of the query.

Abstract: A system generates a user interface that enables a user to generate a data summarization statement for a data processing package. Via one or more user interactions with the user interface, the system may receive one or more parameters for the summarization statement. Using the parameters, the system may generate a summarization statement for execution by a data service, an action model display object, a statement action model display object, and/or a filter token object for display in the user interface.

Abstract: A computerized method is disclosed that includes operations of detecting user input to a first webpage rendered within a web browser, the user input corresponds to closure of the first webpage, providing an indication of the user input corresponding to the closure of the first webpage to a web browser extension operating in accordance with the web browser, the indication includes an identifier, performing, by the web browser extension operating in accordance with the web browser, a search for the identifier within a URL of each webpage currently opened by the web browser in order to determine that a second webpage is associated with the first webpage based on inclusion of the identifier in a URL of the second webpage, and initiating, by the web browser extension, closure of the second webpage associated with the first webpage following the user input corresponding to closure of the first webpage.

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.

Abstract: One or more machine learning techniques can be used to identify locations of potential malignancies within images (e.g., video images) captured during a medical procedure, such as an endoscopic procedure. The images can be displayed, in real-time, on a display unit.

Abstract: Various arrangements are detailed herein related to managing video recording based on spoken commands. A system receives a video stream from a video camera and analyzes a field of view in the received video stream to determine a location for one or more identified or potential users. The system can beamform audio from microphones of a home assistant device based on the location of the one or more identified or potential users. The system adjusts an audio output based on the location of the one or more identified or potential users, receives a spoken command from the one or more identified or potential users, and outputs a response to the spoken command.

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.

Abstract: This specification describes systems and methods for obtaining various patient related data for inflammatory bowel disease (IBD). The methods and systems are configured for using machine learning to determine measurements of various characteristics and provide analysis related to IBD. The methods and systems may also obtain and incorporate electronic health data as well as other relevant data of patients along with endoscopic data to use for prediction IDB progression and recommending treatment.

Abstract: One or more machine learning techniques can be used to identify locations of potential malignancies within images (e.g., video images) captured during a medical procedure, such as an endoscopic procedure. The images can be displayed, in real-time, on a display unit. The images can be displayed with a graphical overlay that isolates the identified locations of potential malignancies.

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

Abstract: Methods, devices, systems, and means for video integration with a home assistant device are described herein. The home assistant device interacts with a person in a video stream by capturing, using a network-enabled outdoor video camera, a video stream of an outdoor location of a premises at which the person is present and analyzing the person appearing in the captured video stream to determine an identity of the person. Based on determining the identity of the person, the home assistant device announces a presence of the person that is outdoors and outputs instructions to the person.

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.

Abstract: Generating a structured medical record from endoscopy data includes obtaining image data including endoscopic images representing portions of a gastrointestinal tract (GI) of a patient; determining features to extract from the image data, the features each representing a physical parameter of the GI tract; extracting the features from the image data; generating anatomical location data specifying a location within the GI tract of a portion of the GI tract represented in the image data; associating the anatomical location data with images that represent the portion of the GI tract; storing, in a node of a data store, data entries including the anatomical location data and the associated one or more images. The data store is configured to receive structured queries for the data entries in the data store and provide the data entries including the transformed features in response to receiving the structured queries.

Abstract: Systems and methods for tracking an evolution of a disease in a colon of a patient over time are configured for operations including receiving video data representing a colon of a patient; segmenting the video data into segments representing portions of a colon of the patient; extracting, from the video data based on the segmenting, a set of features representing locations in the colon of the patient; and registering the feature vector as representing the colon of the patient for tracking the evolution of the disease in the colon of the patient. The system can be configured to predict disease progression predict drug dosage for patients.