Abstract: Embodiments are directed towards video enhancement in accordance with time constraint. An example method includes determining a time constraint for transforming low dynamic range (LDR) video content to high dynamic range (HDR) video content, processing the LDR video content to generate instructions for transforming to HDR video content in accordance with the time constraint, rendering the HDR video content based on executing the generated instructions; and producing metadata including the generated instructions for sharing.

Abstract: Systems and methods are provided for determining a candidate identity of a person in video data based on a biometric motion signature corresponding to motion of a face of the person in the video data. Motion information is obtained corresponding to motion of the face in the video data. The motion information is provided as input to a neural network and the neural network generates the biometric motion signature in response. The biometric motion signature is compared with a plurality of biometric signatures stored in data storage. The candidate identity of the person is determined as a result of a correspondence between the biometric motion signature and a stored biometric signature of the plurality of biometric signatures.

Abstract: Embodiments are directed towards hue-based video enhancement. An example method includes processing low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the LDR video content to high dynamic range (HDR) video content, converting the LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data, de-noising the H-channel data, remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based on the ITM; and rendering the HDR video content based thereon.

Abstract: Embodiments are directed towards metadata service for video enhancement. An example method includes receiving a request for metadata applicable to instruct a display device to transform low dynamic range (LDR) video content to high dynamic range (HDR) video content, determining availability of candidate metadata, and responsive to determining that no candidate metadata is available, providing options for generating the metadata applicable to instruct the display device. The example method can also include causing generation of the metadata based at least one of the options, and providing the generated metadata to the display device.

Abstract: Embodiments are directed towards hue-based video enhancement. An example method includes processing low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the LDR video content to high dynamic range (HDR) video content, converting the LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data, de-noising the H-channel data, remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based on the ITM; and rendering the HDR video content based thereon.

Abstract: Embodiments are directed towards metadata service for video enhancement. An example method includes receiving a request for metadata applicable to instruct a display device to transform low dynamic range (LDR) video content to high dynamic range (HDR) video content, determining availability of candidate metadata, and responsive to determining that no candidate metadata is available, providing options for generating the metadata applicable to instruct the display device. The example method can also include causing generation of the metadata based at least one of the options, and providing the generated metadata to the display device.

Abstract: Embodiments are directed towards video enhancement in accordance with time constraint. An example method includes determining a time constraint for transforming low dynamic range (LDR) video content to high dynamic range (HDR) video content, processing the LDR video content to generate instructions for transforming to HDR video content in accordance with the time constraint, rendering the HDR video content based on executing the generated instructions; and producing metadata including the generated instructions for sharing.

Abstract: An unencoded video frame of a sequence of video frames is encoded to generate an encoded bit-stream representative of the unencoded video frame. The unencoded video frame is divided into a plurality of coding blocks. A local sensitivity measurement may be determined for each of the coding blocks. Based on the local sensitivity measurement, an encoder may determining one or more quantization parameters, one or more adaptive rounding offsets, or one or more quantization steps. The determined parameters may be provided to a quantizer of a video encoder for use in encoding the coding block of the unencoded video frame.

Abstract: Systems and methods are provided for determining a candidate identity of a person in video data based on a biometric motion signature corresponding to motion of a face of the person in the video data. Motion information is obtained corresponding to motion of the face in the video data. The motion information is provided as input to a neural network and the neural network generates the biometric motion signature in response. The biometric motion signature is compared with a plurality of biometric signatures stored in data storage. The candidate identity of the person is determined as a result of a correspondence between the biometric motion signature and a stored biometric signature of the plurality of biometric signatures.

Abstract: Systems and methods are provided for determining a candidate identity of a person in video data based on a biometric motion signature corresponding to motion of a face of the person in the video data. Motion information is obtained corresponding to motion of the face in the video data. The motion information is provided as input to a neural network and the neural network generates the biometric motion signature in response. The biometric motion signature is compared with a plurality of biometric signatures stored in data storage. The candidate identity of the person is determined as a result of a correspondence between the biometric motion signature and a stored biometric signature of the plurality of biometric signatures.

Abstract: Systems and methods for enabling a video capture/encoding device to capture frames of a video sequence; obtain feedback from a video decoding/rendering device; divide each frame into an array of patches; select one or more patches of each frame for supplemental processing; cause the frames of the video sequence to be encoded by a video encoding module and cause the selected patches to be processed by one or more supplemental processing module(s); and assemble a multi-layer video transport stream wherein, for each frame of the video sequence, a base layer of the transport stream includes data corresponding to an encoded version of the current frame and one or more supplemental layers of the transport stream include meta-data corresponding to the division of the current frame into patches and data corresponding to the output of the supplemental processing of the selected patches of the current frame.

Abstract: Systems and methods are provided for determining a candidate identity of a person in video data based on a biometric motion signature corresponding to motion of a face of the person in the video data. Motion information is obtained corresponding to motion of the face in the video data. The motion information is provided as input to a neural network and the neural network generates the biometric motion signature in response. The biometric motion signature is compared with a plurality of biometric signatures stored in data storage. The candidate identity of the person is determined as a result of a correspondence between the biometric motion signature and a stored biometric signature of the plurality of biometric signatures.

Abstract: Systems and methods for enabling a video capture/encoding device to capture frames of a video sequence; obtain feedback from a video decoding/rendering device; divide each frame into an array of patches; select one or more patches of each frame for supplemental processing; cause the frames of the video sequence to be encoded by a video encoding module and cause the selected patches to be processed by one or more supplemental processing module(s); and assemble a multi-layer video transport stream wherein, for each frame of the video sequence, a base layer of the transport stream includes data corresponding to an encoded version of the current frame and one or more supplemental layers of the transport stream include meta-data corresponding to the division of the current frame into patches and data corresponding to the output of the supplemental processing of the selected patches of the current frame.

Abstract: An apparatus for creating a musical composition comprising an audio interface, and audio converter module, and a multi-track compositor module is disclosed. The audio interface operably receives audio from an audio input device and outputting audio to an audio output device. The audio converter module is operably connected to the audio interface to convert audio received via the audio interface into an audio track having one or more partitions. The multi-track compositor module is configured to receive a first audio track and a second audio track and automatically score each partition of the first and second audio tracks based on one or more criteria. The multi-track compositor module is then configured to construct a third audio track from the partitions of the first and second audio tracks based on the scores for each partition. A method is also provided.

Abstract: A method for providing audio data corresponding to a requested musical note is disclosed, the method comprising: (a) providing a render cache having a plurality of cache entries, each of the cache entries corresponding to a different note; (b) receiving a request for a first note from a client; (c) identifying a first cache entry corresponding to the first note; (d) determining that a first audio segment corresponding to the first cache entry is not available; (e) identifying a second audio segment corresponding to a near-hit cache entry in the render cache; and (f) processing the second audio segment into a third audio segment that is substantially similar to the first audio segment.

Abstract: A method for applying audio effects to one or more tracks off musical compilation is disclosed. The method comprises identifying a first virtual musician to be associated with a first instrument track; identifying a first virtual producer to be associated with the first instrument track; applying a first series of effects to the first instrument track, the first series of effects being dependent upon the first virtual musician; and applying a second series of effects to the first instrument track, the second series of effects being dependent upon the first virtual producer.

Abstract: A system and process for producing a more harmonious musical accompaniment for a musical compilation, the process comprising determining a plurality of probable key signatures for the musical compilation, creating an interval profiling matrix for each of the probable key signatures, finding products of a major key interval profile matrix with each of the interval profiling matrices, summing each of the major key interval products into a running major key sum, finding a product of a minor key interval profile with each of the interval profiling matrices, summing each of the minor key interval products into a running minor key sum, and selecting the most probable key signature from the plurality of probable key signatures by comparing the minor key sum and the major key sum.

Abstract: An apparatus for creating a musical composition comprising an audio interface, and audio converter module, and a multi-track compositor module is disclosed. The audio interface operably receives audio from an audio input device and outputting audio to an audio output device. The audio converter module is operably connected to the audio interface to convert audio received via the audio interface into an audio track having one or more partitions. The multi-track compositor module is configured to receive a first audio track and a second audio track and automatically score each partition of the first and second audio tracks based on one or more criteria. The multi-track compositor module is then configured to construct a third audio track from the partitions of the first and second audio tracks based on the scores for each partition. A method is also provided.

Abstract: An apparatus for enhancing audio comprising a first interface and a harmonizing module is disclosed. The first interface receive a first audio segment from a first source. The harmonizing module is coupled to the first interface. The harmonizing module is configured to identify at least one musical property of the first audio segment; calculate a subset of notes that are harmonious with the first audio segment based on the at least one musical property; and select from the subset of notes to generate an audio track to be played substantially synchronously with the first audio segment. A second interface may also be provided to receive a second audio segment from a second source. In this case, the harmonizing module may be configured to generate the audio track by transforming one or more notes of the second audio segment. A method is also provided.

Abstract: A method for applying audio effects to one or more tracks off musical compilation is disclosed. The method comprises identifying a first virtual musician to be associated with a first instrument track; identifying a first virtual producer to be associated with the first instrument track; applying a first series of effects to the first instrument track, the first series of effects being dependent upon the first virtual musician; and applying a second series of effects to the first instrument track, the second series of effects being dependent upon the first virtual producer.