Abstract: Aspects of the disclosed technology provide solutions for searching objects within multimedia content based on multi-modal embeddings. An example method can include receiving media content including a plurality of video frames. The method can include steps for generating, using a pre-output layer of a machine learning algorithm, one or more multimodal feature embeddings describing at least one object for the plurality of video frames, receiving a query including a request to search the media content for a matching object, determining whether the media content includes the matching object based on the one or more multimodal feature embeddings describing the at least one object, and returning one or more results in response to determining that the media content includes the matching object. Systems and machine-readable media are also provided.

Abstract: Surround sound systems can dramatically expand the size of a user's sound field. Much surround sound content is mixed in a simplistic way where the front audio is copied to the rear, at a lower volume. It can be difficult for users to appreciate the value proposition of a surround sound system without more compelling spatially complex content. Quantifying surround sound complexity of various content items based on an audio spatial complexity scoring system can address this issue. Algorithms can be implemented to determine an audio spatial complexity score based on audio channels of a content item. Large catalog of content items can be analyzed, and audio spatial complexity scores can be associated with various content items. If a user has a surround sound system, content items with a high audio spatial complexity can be retrieved or recommended to the user to demonstrate the surround sound system's value better.

Abstract: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for processing, understanding, and defining video content. An example can include determining a plurality of contextual features associated with at least one part of a media content item; identifying one or more targeted media content items that are associated with at least one contextual feature from the plurality of contextual features; selecting, based on the at least one contextual feature, a targeted media content item from the one or more targeted media content items, wherein the targeted media content item includes content that is contextually related to the at least one part of the media content item; and presenting the targeted media content item in association with playback of the at least one part of the media content item.

Abstract: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for cue point discovery for content. For example, system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof are provided for using unsupervised machine learning to automatically classify cue points for episodic content. The cue points can be associates with an opening credits section, an end credits section, a recap section, or a behind-the-scenes section.

Abstract: In one aspect, a method includes receiving video content comprising a first data portion comprising parameters that control a visual appearance of frames of video content presented by a content-presentation device. The content-presentation device is communicatively coupled to a light unit that is (i) present in a viewing area of the content-presentation device and (ii) configured to provide ambient light in the viewing area. The method also includes extracting, from the received video content, a second data portion, separate from the first data portion, specifying one or more light control parameters that a controller associated with the light unit is configured to interpret as instructions for controlling the light unit. The method also includes transmitting the extracted second data portion to the controller to facilitate the controller controlling the light unit according to the specified one or more light control parameters.

Abstract: In one aspect, disclosed is an example method for use in connection with a media-presentation device having an associated presentation area, the method including: (i) obtaining presentation area data associated with the presentation area; (ii) determining that the obtained presentation area data satisfies each and every condition of a condition set; (iii) responsive to at least determining that the obtained presentation area data satisfies each and every condition of the condition set, identifying an upcoming media segment insertion point within a media program; and (iv) facilitating the media-presentation device outputting for presentation a media segment starting at the identified media segment insertion point within the media program.

Abstract: Aspects of the disclosed technology provide solutions for customizing audio streams for individual users. An example process can include steps for receiving an audio stream, establishing a connection with a first audio device associated with a first user, establishing a connection with a second audio device associated with a second user, and delivering a first segment of the audio stream to the first audio device based on user preferences associated with the first user. The process can further include steps for delivering a second segment of the audio stream to the second audio device based on user preferences associated with the second user. Systems and machine-readable media are also provided.

Abstract: System, apparatus, article of manufacture, method and/or computer program embodiments are provided for implementing smart video experiences. An example method includes receiving a request to perform a video control operation during playback of a video; based on a type of video control operation of the video control operation and a playback position of the video, selecting one or more video markers for the video control operation from a plurality of video markers associated with respective video frames from a plurality of video frames of the video, the one or more video markers being associated with one or more video frames of the video; selecting the one or more video frames for the video control operation based on the one or more video markers; and generating a signal configured to trigger the video control operation based on the one or more video frames associated with the one or more video markers.

Abstract: Provided are system, apparatus, device, method and/or computer-program product embodiments, combinations and/or sub-combinations thereof for using an AI model to facilitate natural language interactions with databases. An example method can include receiving a natural language prompt associated with a user and identifying tables in a database based on the natural language prompt. The method can further include determining a table schema(s) of each of the tables identified, generating, using a large language model, a query to the tables in the database based on the natural language prompt and the table schema(s), and obtaining, using the query, data from at least one table of the tables in the database. The method can include generating, using the large language model or another large language model, a response to the natural language prompt based on the data obtained from the at least one table of the tables in the database.

Abstract: Provided are system, apparatus, device, method and/or computer-program product embodiments, combinations and/or sub-combinations thereof for determining, using an artificial intelligence (AI) model, content item placements based on text information associated with scripted content. An example method can include receiving textual information descriptive of one or more scenes associated with media content and, based on the textual information, determining, by an AI model, one or more contextual attributes of each scene from the one or more scenes. The method can include, based on the contextual attributes, determining one or more content placement locations within the one or more scenes, the one or more content placement locations depicting at least one of an object, an activity, and a dialogue. The method can further include generating one or more suggested content modifications for the at least one of the object, the activity, and the dialogue in the one or more content placement locations.

Abstract: In one aspect, disclosed is an example method for use by a lighting device including a microphone and a light source, the method including: (i) receiving, by the lighting device via the microphone, an audio signal; (ii) decoding and extracting, by the lighting device, a lighting device control instruction from the received audio signal; and (iii) using, by the lighting device, at least the decoded and extracted lighting device control instruction as a basis to control operation of the light source.

Abstract: System, apparatus, article of manufacture, method and/or computer program embodiments are provided for determining a presentation configuration of content. An example method can include determining information about primary content displayed on a first display and an environment of the first display, the information including a display configuration of the primary content, a characteristic of the primary content, and/or an indication whether a user is present in the environment and/or the environment includes a second display coupled to a client or a different client that is coupled to the client; based on the information, determining a different display configuration for displaying the secondary content; and based on the different display configuration, generating an instruction to display the secondary content at the second display or on an ROI at the first display, the ROI excluding the primary content or including a portion of the primary content having a saliency below a threshold.

Abstract: Aspects of the disclosed technology provide solutions for controlling multiple displays (e.g., multiple display devices, multiple displays on a media device, etc.) using a remote control device. An example method can include assigning a code for each of a plurality of display devices based on an image of the plurality of display devices. In some instances, the code of each of the plurality of display devices enables a remote control to independently operate each of the plurality of display devices. Moreover, the example method can include determining a position of the remote control relative to each of the plurality of display devices based on the image. Further, the example method can include determining a display device of the plurality of display devices for the remote control to control based on the position of the remote control relative to each of the plurality of display devices.

Abstract: A method and a system for using crowdsourcing as a basis to predict and respond to emergency impact. An example method includes (i) a computing system receiving emergency-state reporting provided by multiple customer premises in a region, (ii) the computing system determining, based on the received emergency-state reporting provided by the multiple customer premises in the region, that a region-wide emergency situation exists in the region, and (iii) the computing system taking action, in response to the determining, based on the emergency-state reporting provided by the multiple customer premises in the region, that the region-wide emergency situation exists in the region.

Abstract: In one aspect, disclosed is an example method for use in connection with a media-presentation device presenting a media program via a display screen of the media-presentation device, the method including: (i) during presentation of a temporal portion of the media program, identifying an audience engagement region of presented content, wherein the identified audience engagement region is less than an entirety of a display area that corresponds to the display screen; (ii) using at least the identified audience engagement region as a basis to select a media segment from among multiple candidate media segments; (iii) identifying an upcoming media segment insertion point within the media program; and (iv) facilitating the media-presentation device inserting, at the identified media segment insertion point within the media program, the selected media segment.

Abstract: In one aspect, disclosed is an example method for use in connection with a media-presentation device presenting a media program via a display screen of the media-presentation device, the method including: (i) during presentation of a temporal portion of the media program, identifying an audience engagement region of presented content, wherein the identified audience engagement region is less than an entirety of a display area that corresponds to the display screen; (ii) using at least the identified audience engagement region as a basis to select a media segment from among multiple candidate media segments; (iii) identifying an upcoming media segment insertion point within the media program; and (iv) facilitating the media-presentation device inserting, at the identified media segment insertion point within the media program, the selected media segment.

Abstract: Aspects of the disclosed technology provide solutions for improving video streams by generating dropped video frames. An example process can include steps for receiving a set of video frames, identifying a discontinuity in the set of frames, generating one or more replacement frames associated with the discontinuity, and providing the one or more replacement frames to a user. Systems and machine-readable media are also provided.

Abstract: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for cue point discovery for content. For example, system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof are provided for using unsupervised machine learning to automatically classify cue points for episodic content. The cue points can be associates with an opening credits section, an end credits section, a recap section, or a behind-the-scenes section.

Abstract: In one aspect, disclosed is an example method for use in connection with a media-presentation device having an associated presentation area, the method including: (i) obtaining presentation area data associated with the presentation area; (ii) determining that the obtained presentation area data satisfies each and every condition of a condition set; (iii) responsive to at least determining that the obtained presentation area data satisfies each and every condition of the condition set, identifying an upcoming media segment insertion point within a media program; and (iv) facilitating the media-presentation device outputting for presentation a media segment starting at the identified media segment insertion point within the media program.

Abstract: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for processing, understanding, and defining video content. An example can include determining a first set of contextual features associated with a first portion of a media content item; identifying at least one contextual feature from the first set of contextual features that is associated with one or more targeted media content items; and selecting, based on the at least one contextual feature, a first targeted media content item from the one or more targeted media content items, wherein the first targeted media content item includes content that is related to the first portion of the media content item, and wherein the first targeted media content item is selected for presentation after the first portion of the media content item.