Abstract: A system includes an interface unit to receive a request, from a media client, to obtain a segment of media content at an ABR representation, and a transcoding unit. The transcoding unit includes a scalable decoder, hint stream decoder, and re-encoder. The scalable decoder receives and decodes a set of two or more layers of a scalable coded representation corresponding to the requested segment of media content at the requested ABR representation to provide a set of media frames and scalable stream information for the segment. The hint stream decoder receives and decodes a hint stream corresponding to the requested segment of media content at the requested ABR representation and the scalable stream information to provide transcoding hints for the segment. The re-encoder re-encodes the set of media frames using the transcoding hints to provide an encoded bit stream corresponding to the requested segment of media content.

Abstract: In one example, a sequence of pictures may be transformed at a given spatial resolution to a plurality of output spatial resolutions and/or an additional spatial resolution that is lower than the plurality of output spatial resolutions. The sequence of pictures and a picture type may be received for each of the pictures at respective output spatial resolutions. Estimating a set of combinations of encoding parameters for coding tree blocks (CTBs) in each of the pictures at a lowest output spatial resolution or mapping combinations of encoding parameters for each CTB in each of the pictures at an immediate coarser spatial resolution to corresponding blocks at the respective output spatial resolution is performed. A set of combinations of encoding parameters may be determined for each CTB and best combinations of encoding parameters from the determined set of combinations may be identified for encoding the sequence of pictures.

Abstract: In one example, a sequence of pictures may be transformed at a given spatial resolution to a plurality of output spatial resolutions and/or an additional spatial resolution that is lower than the plurality of output spatial resolutions. The sequence of pictures and a picture type may be received for each of the pictures at respective output spatial resolutions. Estimating a set of combinations of encoding parameters for coding tree blocks (CTBs) in each of the pictures at a lowest output spatial resolution or mapping combinations of encoding parameters for each CTB in each of the pictures at an immediate coarser spatial resolution to corresponding blocks at the respective output spatial resolution is performed. A set of combinations of encoding parameters may be determined for each CTB and best combinations of encoding parameters from the determined set of combinations may be identified for encoding the sequence of pictures.

Abstract: A system and method for multi-bitrate and multi-spatial resolution media encoding are disclosed. In an embodiment for encoding a sequence of pictures at a given spatial resolution to an encoding format at a plurality of output bitrates, the sequence of pictures and a picture type for each of the pictures are received. Further, best combinations of encoding parameters for each coding tree block (CTB) in each of the pictures are identified from a determined set of combinations of encoding parameters supported by the encoding format for the associated picture type. Furthermore, the sequence of pictures are encoded using the best of the identified combinations of encoding parameters for each CTB in each of the pictures to create media bit streams at the plurality of output bitrates.

Abstract: A system and method for a low complexity and robust spatiotemporal combining for video enhancement is disclosed. In one embodiment, the method includes computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in a video sequence, computing an error value, for each sub-block of pixels within a block of pixels in a current video frame, between pixel values within the sub-block in the current video frame and corresponding motion compensated pixel values in a temporally neighboring video frame of the current video frame, computing a temporal weighting factor for each sub-block of pixels as a function of the error value and the standard deviation estimate, and combining the block of pixels in the current video frame and their corresponding motion compensated pixel values in the temporally neighboring video frame using the computed temporal weighting factor.

Abstract: A method for generating a high dynamic range (HDR) image from images of a scene obtained at one or more exposure values is disclosed. In this embodiment, one of the obtained images is selected as a reference image. Further, mapped images are obtained by mapping pixel intensity values to corresponding irradiance values in each image. Furthermore, a pixel intensity value dependent weighting factor is determined. Moreover, a set of images is identified from the mapped images for pixels in the reference image. Also, a set of corresponding mapped pixels is established for the mapped pixels in reference image in the set of images. Further, a similarity measure is computed for the mapped pixels of reference image and corresponding mapped pixels in the set of images. Furthermore, each mapped pixel of the reference image is combined with a subset of its established corresponding mapped pixels in the set of images.

Abstract: A platform for end point and digital content centric real-time shared experience for collaboration across endpoints is disclosed. In one embodiment, media centric collaboration terminals (MCCTs) are communicatively connected to one or more terminals selected from the group consisting of video communication terminals (VCTs), voice over Internet protocol (IP) communication terminals (VoCTs), remote servers, remote streaming clients and/or appliances, machines and gadgets (AMGs) via a communication network. Further, audio and/or video bridging of one or more audio and/or video streams originating from one of the MCCTs designated as a current host along with incoming audio and/or video streams from at least one of any remaining MCCTs designated as clients or the one or more terminals is enabled on the current host, via the communication network.

Abstract: A method for low complexity change detection in a sequence of images using configurable block sizes is disclosed. In one embodiment, a first change detection map is generated by performing change detection based on configurable block sizes between a current image and one of an estimated first background image and a previous image. The first change detection map classifies each block as changed or unchanged. The selection between the previous image and the estimated background image for use in change detection is done using a confidence estimate, which is updated both at the low level and at the end of a high-level change analysis. In another embodiment, an estimated second background image is used in addition to the estimate first background image to help quickly adapt when a stationary object starts moving or when a scene object becomes stationary.

Abstract: A method for generating a high dynamic range (HDR) image from images of a scene obtained at one or more exposure values is disclosed. In this embodiment, one of the obtained images is selected as a reference image. Further, mapped images are obtained by mapping pixel intensity values to corresponding irradiance values in each image. Furthermore, a pixel intensity value dependent weighting factor is determined. Moreover, a set of images is identified from the mapped images for pixels in the reference image. Also, a set of corresponding mapped pixels is established for the mapped pixels in reference image in the set of images. Further, a similarity measure is computed for the mapped pixels of reference image and corresponding mapped pixels in the set of images. Furthermore, each mapped pixel of the reference image is combined with a subset of its established corresponding mapped pixels in the set of images.

Abstract: A method and device for tracking error propagation and refreshing a video stream is provided. The proposed subject matter comprises of an error propagation tracking method that works in the sub-sampled domain to reduce computational cycles and memory bandwidth. Further, the tracking based update of the error propagation metric is done differently for static and non-static regions to avoid unnecessary refresh of static areas. Through suitable thresholding of the metric at a macroblock (MB) level, a set of refresh MBs are selected for each frame. These refresh MBs are coded either as an intra MB or as an inter MB that is predicted from one or more reliable reference frames (—frames that are known to be available at the decoder with negligible errors—). Such inter coding of refresh MBs improves the compression efficiency when compared to pure intra coding of refresh MBs.

Abstract: A platform for end point and digital content centric real-time shared experience for collaboration across endpoints is disclosed. In one embodiment, media centric collaboration terminals (MCCTs) are communicatively connected to one or more terminals selected from the group consisting of video communication terminals (VCTs), voice over Internet protocol (IP) communication terminals (VoCTs), remote servers, remote streaming clients and/or appliances, machines and gadgets (AMGs) via a communication network. Further, audio and/or video bridging of one or more audio and/or video streams originating from one of the MCCTs designated as a current host along with incoming audio and/or video streams from at least one of any remaining MCCTs designated as clients or the one or more terminals is enabled on the current host, via the communication network.

Abstract: A system and method for multi-bitrate and multi-spatial resolution media encoding are disclosed. In an embodiment for encoding a sequence of pictures at a given spatial resolution to an encoding format at a plurality of output bitrates, the sequence of pictures and a picture type for each of the pictures are received. Further, best combinations of encoding parameters for each coding tree block (CTB) in each of the pictures are identified from a determined set of combinations of encoding parameters supported by the encoding format for the associated picture type. Furthermore, the sequence of pictures are encoded using the best of the identified combinations of encoding parameters for each CTB in each of the pictures to create media bit streams at the plurality of output bitrates.

Abstract: A method for low complexity change detection in a sequence of images using configurable block sizes is disclosed. In one embodiment, a first change detection map is generated by performing change detection based on configurable block sizes between a current image and one of an estimated first background image and a previous image. The first change detection map classifies each block as changed or unchanged. The selection between the previous image and the estimated background image for use in change detection is done using a confidence estimate, which is updated both at the low level and at the end of a high-level change analysis. In another embodiment, an estimated second background image is used in addition to the estimate first background image to help quickly adapt when a stationary object starts moving or when a scene object becomes stationary.

Abstract: An automated system and method for ingest bandwidth reduction while uploading media content acquired at a given bit-rate to a cloud based media service are disclosed. In one embodiment, the media content is converted to a lower bit-rate coded representation than the given bit-rate using one of an electronic device used for initiating the upload and a dedicated appliance connected to the electronic device. Further, the converted media content is uploaded to the cloud based media service using one of the electronic device and the dedicated appliance either in sequence or in parallel with the conversion.

Abstract: A system and method for adaptive intra refresh rate setting for each video frame in a video encoder is disclosed. In one embodiment, a video encoding method includes computing channel induced distortion values at multiple intra refresh rates for a coded video frame as a function of channel loss and spatiotemporal content, computing source coding distortion values at the multiple intra refresh rates for the coded video frame as a function of the spatiotemporal content and an operating bit-rate, selecting an intra refresh rate value for one or more video frames subsequent to the encoded video frame as a function of the sum of the corresponding computed channel induced distortion values and the source coding distortion values, and encoding the one or more video frames using the selected intra refresh rate value.

Abstract: A method/system of transcoding an MPEG 2/4 bit stream into an H.264 format, handles an input MPEG 2/4 bit stream in a decoder, and identifies certain data in the input bit stream for reuse in the H.264 format; and, reuses the identified data in a re-encoder with assistance from a mapping module in transcoding by converting the input bit stream into an output H.264 format. The identified data includes information at a macrolevel and information at a picture level. The information at the macrolevel might comprise additional stages incorporated in the re-encoder module including a Mapping Process stage, a Sub Pixel Refinement stage, a Mode Selection stage to choose from Intra, Inter or Skip modes, followed by the standard H.264 encoding loop and the Entropy Coding Block. The information at the picture level might include; a) average quantizer of frame, and, b) total bits per frame.

Abstract: A system and method for a low complexity and robust spatiotemporal combining for video enhancement is disclosed. In one embodiment, the method includes computing a standard deviation estimate between a video frame and a temporally neighboring frame of the video frame in a video sequence, computing an error value, for each sub-block of pixels within a block of pixels in a current video frame, between pixel values within the sub-block in the current video frame and corresponding motion compensated pixel values in a temporally neighboring video frame of the current video frame, computing a temporal weighting factor for each sub-block of pixels as a function of the error value and the standard deviation estimate, and combining the block of pixels in the current video frame and their corresponding motion compensated pixel values in the temporally neighboring video frame using the computed temporal weighting factor.

Abstract: A system and method for adaptive intra refresh rate setting for each video frame in a video encoder is disclosed. In one embodiment, a video encoding method includes computing channel induced distortion values at multiple intra refresh rates for a coded video frame as a function of channel loss and spatiotemporal content, computing source coding distortion values at the multiple intra refresh rates for the coded video frame as a function of the spatiotemporal content and an operating bit-rate, selecting an intra refresh rate value for one or more video frames subsequent to the encoded video frame as a function of the sum of the corresponding computed channel induced distortion values and the source coding distortion values, and encoding the one or more video frames using the selected intra refresh rate value.

Abstract: A motion estimation algorithm finds the best match for a given block or macroblock so that the resulting error signal has very low energy level which is computed, for e.g., by the SAD method. The motion estimation algorithm also provides for an optional sub-pixel level estimation and an inter4v search, and allows for restricting the number of searches for a Frame-frame ME (motion estimation) using Top-Top and Bottom-Bottom field MEs. The algorithm provides for a selective early exit and enables selecting a suitable search area with N candidate points (4 to 8) for starting the search. The search is conducted progressively till a minimum error signal (low energy level signal) is reached. The candidate points for search may be in a diamond shaped configuration, and there may be a plurality of successive diamond configurations, the number of which is configurable. The invention has application in MPEG-4 and H.264 standards.

Abstract: A method for achieving bit rate controlled encoding, e.g., constant bit rate, uses a bit rate control model based on bits allocated per macroblock and based on error in estimating bits consumed in an encoding process in a macroblock. The method computes bits consumed per macroblock as a function of the formed bit rate control model, and allocates bits for the macroblock. To this end, a quadratic (second order) equation is used for the model, which equation might default into a first order equation requiring fewer computations, in the event that no second order solutions exist. In one form, the bit rate control model computes the bit rate to satisfy video buffer verifier (VBV) compliance in accordance with MPEG requirements. The bit rate control model makes allowances for the type of macroblock, i.e., inter, intra or bidirectional, and provides for any frame-skips.