Abstract: The present concepts include a neuroergonomic service that processes multimodal physiological, digital, and/or environmental inputs from a user and predicts cognitive states of the user. Thus, the neuroergonomic service provides personalized feedback to the user about her current mental and physiological wellbeing to enable modulation of mood, stress, attention, and other cognitive measures for improved productivity and satisfaction. The neuroergonomic service utilizes machine learning models that are trained offline using sensor inputs taken from participants in a controlled environment that purposefully induce an array of cognitive states upon the participants.

Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.

Abstract: A system is described for generating diagnostic information from a video sequence of ultrasound images acquired in “blind sweeps”, i.e., without operator seeing ultrasound images as they are acquired. We disclose two different types of machine learning systems for predicting diagnostic information: a “Temporal Accumulation” system and a “3-D Modeling Component” system. These machine learning systems could be implemented in several possible ways: using just one or the other of them in any given implementation, or using both of them in combination. We also disclose a computing system which implements (a) an image selection system including at least one machine learning model trained to identify clinically suitable images from the sequence of ultrasound images and (b) an image diagnosis/measurement system including of one or more machine learning models, configured to obtain the clinically suitable images identified by the image selection system and further process such images to predict health states.

Abstract: A system is described for conducting an ultrasound scan on a human subject. The system includes an ultrasound probe generating ultrasound image data and provisioned with one or more position sensors generating real time position and orientation data as to the position of the ultrasound probe and orientation in three-dimensional space during use of the probe; one or more machine learning models trained to correlate ultrasound images with probe position and orientation, wherein the one or more machine learning models receive images generated from the ultrasound probe; a feedback generator generating feedback data based on the current probe position determined by the position sensors; and a feedback display receiving the feedback data providing real-time suggestions to the user of the ultrasound probe for adjusting the probe position, orientation, pressure and/or other parameters of the ultrasound probe to improve the quality of the images generated from the ultrasound probe.

Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.

Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.

Abstract: A system and/or method configured to determine highlight segments. Content files that define content in a content segment set may be obtained. A highlight segment set may be determined from the content segment set. Determining the highlight segment set may include iterating (a)-(c) for multiple iterations. At (a), individual content segments included in the content segment set may be selected as a selected content segment for inclusion in the highlight segment set. At, (b) diversity scores for content segments that are (i) included in the content segment set and (ii) not yet selected for inclusion in the highlight segment set may be determined. At (c), one or more of the content segments may be disqualified for inclusion in the highlight segment set for future iterations based on the diversity scores.

Abstract: A set of sensor information conveyed by sensor output signals may be accessed. The sensor output signals may be generated by a set of sensors. The set of sensor information may characterize an event monitored by the set of sensors. A multi-feature convolutional neural network may be trained using a branch-loss function. The branch-loss function may include individual loss functions for individual sensor information and one or more combined loss functions for combined sensor information. The set of sensor information may be processed through the multi-feature convolutional neural network. A classification of the event may be obtained from the multi-feature convolutional network based on the set of sensor information.

Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.

Abstract: A system and/or method configured to determine highlight segments. Content files that define content in a content segment set may be obtained. A highlight segment set may be determined from the content segment set. Determining the highlight segment set may include iterating (a)-(c) for multiple iterations. At (a), individual content segments included in the content segment set may be selected as a selected content segment for inclusion in the highlight segment set. At, (b) diversity scores for content segments that are (i) included in the content segment set and (ii) not yet selected for inclusion in the highlight segment set may be determined. At (c), one or more of the content segments may be disqualified for inclusion in the highlight segment set for future iterations based on the diversity scores.

Abstract: Systems and method of generating video summaries are presented herein. Information defining a video may be obtained. The video may include a set of frame images. Parameter values for parameters of individual frame images of the video may be determined. Interest weights for the frame images may be determined. An interest curve for the video that characterizes the video by interest weights as a function of progress through the set of frame images may be generated. One or more curve attributes of the interest curve may be identified and one or more interest curve values of the interest curve that correspond to individual curve attributes may be determined. Interest curve values of the interest curve may be compared to threshold curve values. A subset of frame images of the video to include within a video summary of the video may be identified based on the comparison.

Abstract: A system and/or method configured to determine highlight segments. Content files that define content in a content segment set may be obtained. A highlight segment set may be determined from the content segment set. Determining the highlight segment set may include iterating (a)-(c) for multiple iterations. At (a), individual content segments included in the content segment set may be selected as a selected content segment for inclusion in the highlight segment set. At, (b) diversity scores for content segments that are (i) included in the content segment set and (ii) not yet selected for inclusion in the highlight segment set may be determined. At (c), one or more of the content segments may be disqualified for inclusion in the highlight segment set for future iterations based on the diversity scores.

Abstract: Systems and method of identifying activities and/or events represented in a video are presented herein. An activity and/or event may be represented in a video by virtue of one or both of an entity moving with a capture device during capture of the video preforming the activity and/or event, or the video portraying one or more entities performing the activity and/or event. Activity types may be characterized by one or more of common movements, equipment, spatial context, and/or other features. Events may be characterized by one or both of individual movements and/or sets of movements that may routinely occur during performance of an activity. The identification of activities and/or events represented in a video may be based on one or more spectrogram representations of sensor output signals of one or more sensors coupled to a capture device.

Abstract: A first command may be received from a client computing platform. The first command may include proxy visual content. The proxy visual content may represent visual content stored on the client computing platform. An identifier may be associated with the proxy visual content. The identifier may be transmitted to the client computing platform. The identifier may be associated with the visual content stored on the client computing platform. Edits to the visual content based upon the proxy visual content may be determined at a remote computing platform. Instructions may be transmitted from the remote computing platform to the client computing platform. The instructions may include the identifier. The instructions may be configured to cause the client computing platform to process the edits on the visual content.

Abstract: Video information defining video content may be accessed. The video content may include video frames. The video frames may be grouped into similarity groups based on similarity of the video frames. The similarity groups may include a first similarity group including a first video frame and a second video frame. The first video frame may be similar to the second video frame. Representative video frames may be selected from the similarity groups. An individual representative video frame may correspond to an individual similarity group. Representative video frames may include a first representative video frame selected from and corresponding to the first similarity group. The video content may be analyzed based on the representative video frames.

Abstract: Video information defining video content may be accessed. The video content may have a progress length and include a capture of an activity and a sub-activity at one or more moments in the progress length. Portions of the video content may be associated individually with values of an interest metric such that the values of the interest metric as a function of progress through the video content form an interest curve for the video content. The activity and the sub-activity captured within the video content may be identified. An activity metric modifier for the interest curve at the one or more moments in the progress length may be determined based on the identification of the activity and the identification of the sub-activity. The interest curve may be modified at the one or more moments based on the activity metric modifier.

Abstract: A first command may be received from a client computing platform. The first command may include proxy visual content. The proxy visual content may represent visual content stored on the client computing platform. An identifier may be associated with the proxy visual content. The identifier may be transmitted to the client computing platform. The identifier may be associated with the visual content stored on the client computing platform. Edits to the visual content based upon the proxy visual content may be determined at a remote computing platform. Instructions may be transmitted from the remote computing platform to the client computing platform. The instructions may include the identifier. The instructions may be configured to cause the client computing platform to process the edits on the visual content.

Abstract: A system and/or method configured to determine a sample frame order for analyzing a video. The video may have multiple frames ordered in a sequence from a beginning to an end. A first sample frame order for analyzing the video may be determined. Determining the first sample frame order may include determining an initial frame for a first iteration, and determining secondary frames for a second iteration. Determining the initial frame and the secondary frames may be based on a function of frame position in the sequence of frames. The initial frame may be associated with a first sample position, and the secondary frames may be associated with secondary sample positions in the sample frame order. A first feature of the video may be determined based on an analysis of the frames in the video performed on the frames in the first sample frame order.

Abstract: System and/or method configured to determine a sample frame order for analyzing a video. The video may have multiple frames ordered in a sequence from a beginning to an end. Segments of the video may be determined based on an analysis of the frames of the video. A first sample frame order for analyzing the video may be determined based on multiple iterations performed on individual ones of the segments of the video. Determining the first sample frame order may include determining initial frames for a first iteration, and determining secondary frames for a second iteration based on a function of frame position in the sequence of frames. The initial frames and the secondary frames may be associated with sample positions in the sample frame order. A first feature of the video may be determined based on an analysis of the frames performed in the first sample frame order.

Abstract: An image including a visual capture of a scene may be accessed. The image may be processed through a convolutional neural network. The convolutional neural network may generate a set of two-dimensional feature maps based on the image. The set of two-dimensional feature maps may be processed through a contextual long short-term memory unit. The contextual long short-term memory unit may generate a set of two-dimensional outputs based on the set of two-dimensional feature maps. A set of attention-masks for the image may be generated based on the set of two-dimensional outputs and the set of two-dimensional feature maps. The set of attention-masks may define dimensional portions of the image. The scene may be classified based on the two-dimensional outputs.