Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for automated identification and mapping of objects in video content. Example methods may include determining a first set of frames in video content, determining, using one or more object recognition algorithms, a first object present in the first set of frames, determining that a first product corresponding to the first object is present in a product catalog comprising a set of product images, associating a first product identifier of the first product with a video identifier of the video content, and causing presentation of a set of product identifiers associated with the video identifier.

Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for automated identification and mapping of objects in video content. Example methods may include determining a first set of frames in video content, determining, using one or more object recognition algorithms, a first object present in the first set of frames, determining that a first product corresponding to the first object is present in a product catalog comprising a set of product images, associating a first product identifier of the first product with a video identifier of the video content, and causing presentation of a set of product identifiers associated with the video identifier.

Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for semantic video segmentation to identify objects appearing in video content. Example methods may include determining a voice-based request at a first device to identify an object appearing in video content, determining a first video identifier for video content being consumed in association with the first device, determining a timestamp associated with the video content at a time the voice-based request was received, determining, using one or more knowledge graphs, a set of product identifiers for products present in the video content at a scene corresponding to the timestamp, and generating a response to the voice-based request comprising a first product identifier in the set of product identifiers.

Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for automated identification and mapping of objects in video content. Example methods may include determining a first set of frames in video content, determining, using one or more object recognition algorithms, a first object present in the first set of frames, determining that a first product corresponding to the first object is present in a product catalog comprising a set of product images, associating a first product identifier of the first product with a video identifier of the video content, and causing presentation of a set of product identifiers associated with the video identifier.

Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for automated generation of textual descriptions of video content. Example methods may include determining, by one or more computer processors coupled to memory, a first segment of video content, the first segment including a first set of frames and first audio content, determining, using a first neural network, a first action that occurs in the first set of frames, and determining a first sound present in the first audio content. Some methods may include generating a vector representing the first action and the first sound, and generating, using a second neural network and the vector, a first textual description of the first segment, where the first textual description includes words that describe events of the first segment.

Abstract: A method for providing notifications is provided. The method includes a tangible user interface (TUI) element the receives an input from a computing device coupled to the TUI element. The input is indicative of an outcome corresponding to a functionality of an application on the computing device. Based on the outcome, the TUI element determines at least one illumination pattern from a plurality of pre-stored illumination patterns. Thereafter, the TUI element generates an output based on the at least one determined illumination pattern.

Abstract: A method for providing notifications is provided. The method includes a tangible user interface (TUI) element the receives an input from a computing device coupled to the TUI element. The input is indicative of an outcome corresponding to a functionality of an application on the computing device. Based on the outcome, the TUI element determines at least one illumination pattern from a plurality of pre-stored illumination patterns. Thereafter, the TUI element generates an output based on the at least one determined illumination pattern.