Abstract: In accordance with an embodiment of the present invention, a method of streaming media with a media preview includes generating a preview data by extracting preview information from a media file to be streamed. The preview data has a multi-dimensional hierarchical data structure having a plurality of layers with increasing content of the preview information in each layer of the plurality of layers. The preview data is configured to provide a differentiated preview service.

Abstract: A method for scheduling user equipment (UE) devices comprising sorting the plurality of UE devices based on a weight of priority associated with each of the UE devices with respect to a plurality of subbands, and assigning one or more of the UE devices to each of the subbands using the weight of priority associated with the UE devices, wherein the weight of priority is based on one or more network utility functions associated with the UE devices. A computer program product comprising computer executable instructions to receive a media content segment using a dynamic adaptive video streaming over hypertext transfer protocol (HTTP) (DASH) protocol, monitor a playback buffer size of a UE device, monitor a battery energy level of the UE device, and adjust a representation quality level in a segment request based on the target requested video rate, the playback buffer size and the battery energy level.

Abstract: A video summary method comprises dividing a video into a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, determining a saliency of each frame of the video shot, determining a key frame of the video shot based on the saliency of each frame of the video shot, extracting visual features from the key frame and performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features. The method further comprises fusing different concept patterns using a saliency tuning method and generating a summary of the video based upon a global optimization method.

Abstract: Method, device and apparatus for delivering video telephony by using a media controller and a software defined networking (SDN) controller to enable multicasting for multi-party video conferencing. A media controller generates a video sending rate for each of the plurality of client devices based on a received video conference request and received network information. The media controller determines and independently constructs a maximum-rate delay-bounded multicast tree for each of the plurality of client devices that supports the largest possible multicast rate. The media controller determines a common congested link in the multicast trees, re-routes the multicast tree with the common congested link for the client device with the lowest weight of utility divided by its video sending rate and creating two subtrees, and iteratively re-routes the multicast trees until an aggregate video sending rate of the multicast trees sharing the common congested link meets a link capacity of the common congested link.

Abstract: In an image processing method, an object is located within an image. An area around the object is determined and divided into at least first and second portions based upon image information within the area. The object can then be classified based upon both image information in the first portion of the area and image information in the second portion of the area.

Abstract: In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern.

Abstract: In accordance with an embodiment of the present invention, an apparatus for streaming a media includes a server side receiver for receiving a request to stream a media from a media player. The apparatus further includes a content generator, a server side transmitter, and a media stream generator. The content generator is configured to generate content information providing a plurality of presentation options to consume the media. The server side transmitter is configured to send the content information. The server side receiver is further configured to receive a selected presentation option from amongst the plurality of presentation options. The media stream generator is configured to generate a media stream comprising the media based on the selected presentation option.

Abstract: An apparatus comprising one or more processors configured to receive a digital image comprising a current pixel and a plurality of nearby pixels, determine a pixel intensity of the current pixel, wherein the pixel intensity comprises a noise component, and reduce the noise component by applying a bilateral filter as a combination of a domain filter and a range filter on the current pixel, wherein the domain filter is dependent on the pixel intensity and geometric closeness between the current pixel and the nearby pixels, and wherein the range filter is dependent on the pixel intensity and photometric similarity between the current pixel and the nearby pixels.

Abstract: In an image processing method, an object is located within an image. An area around the object is determined and divided into at least first and second portions based upon image information within the area. The object can then be classified based upon both image information in the first portion of the area and image information in the second portion of the area.

Abstract: Methods and systems for a multimedia queue management solution that maintaining graceful Quality of Experience (QoE) degradation are provided. The method selects a frame from all weighted queues based on a gradient function indicating a network performance rate change and a distortion rate caused by the frame and its related frames in the queue, and dropping the selected frame and all its related frames, and continues to drop similarly chosen frame until a network performance rate change caused by the dropping frame and its related frames meets a predetermined performance metric. A frame gradient is a distortion rate divided by a network performance rate change caused by the frame and its related frames, and a distortion rate is based on a sum of each individual frame distortion rate when the frame and its related frames are replaced by some other frames derived from remaining frames based on a replacement method.

Abstract: A system and method for providing media streaming are provided. A media description file having a range string indicator is used to specify location offsets of a plurality of media fragments within a media file. The range string may be stored directly in the media description file or the media description file may contain an indicator specifying a file containing the range string. The media description file may also include a range unit specifying the size of the offsets in the range string. In an embodiment, offsets within the individual media fragments may also be provided, either in the media description file or in a different file.

Abstract: A system and method for image and video compression using compressive sensing is provided. An embodiment method for compressing an image having a plurality of image blocks includes selecting an image block from the plurality of image blocks to compress, computing a sum of sinusoidal signals at different frequencies and amplitudes representation for the selected image block, quantizing the amplitudes of the sinusoidal signals at different frequencies, and saving the quantized amplitudes as a first compressed image block. The method also includes truncating the quantized amplitudes, thereby producing truncated quantized amplitudes, saving the truncated quantized amplitudes as a second compressed image block, and selecting either the first compressed image block or the second compressed image block as a final compressed image block. The selecting is based on a measure of the quality of the first compressed image block and the second compressed image block.

Abstract: An embodiment of a system and method that uses inline measurements to probe available bandwidth for a transmission control protocol, and adaptively sets a slow-start threshold according to the available bandwidth. The method includes initializing a congestion window “cwnd,” sending cwnd packets, estimating an available bandwidth for the cwnd packets. The congestion window cwnd is set to a higher number, and the higher number of further packets is sent if the available bandwidth is greater than a first threshold level. The available bandwidth is re-estimated for the higher number of the further packets, and a soft start threshold “ssthresh” is set to the re-estimated available bandwidth. A statistical measure is calculated for the re-estimated available bandwidth, and the congestion window cwnd is set equal to ssthresh if a ratio of the statistical measure to the re-estimated available bandwidth is less than a second threshold level.

Abstract: In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern.

Abstract: A device is disclosed comprising a memory configured for holding video and a processor coupled to the memory. The memory contains computer-executable instructions that, when executed by the processor, cause the device to perform operations to stabilize the video, the operations comprising buffering consecutive original video frames, determining transformation matrices from subsets of the original video frames, wherein the transformation matrices represent estimates of stable camera motion, using the transformation matrices to warp the original video frames and generate video that is stabilized relative to the original video frames, and adjusting a size of a subset of original video frames in response to detecting a condition.

Abstract: System and methods for connection pooling for video streaming in content delivery networks (CSNs) are provided. An embodiment method for connection pooling in a content delivery network (CDN) by a proxy server includes receiving, from a client, a request for media content, sending, to a control server, a query to locate an origin media server having the media content if the media content is cache-missing, receiving, from the control server, information regarding the origin media server having the media content requested by the client, and forwarding the request for the media content to the origin media server having the media content using a reusable connection from a pool of the reusable connections between the proxy server and the origin media server if the reusable connection is unoccupied.

Abstract: A method for performing a video conference in a mobile phone is provided. The video conference involves a plurality of conferencing devices that display presentation content and a video image of one or more participants in the video conference. The mobile phone receives a first and second real-time transport protocol (RTP) packets including a video image of a participant and presentation content in the video conference, respectively. The video image of the participant includes a face portion of the participant and a background portion. The mobile phone decodes the video image of the participant and the presentation content, extracts the face portion of the participant from the video image of the participant, overlays the face portion of the participant over a portion of the presentation content to form a composite image, and displays the composite image on a display device of the mobile phone.

Abstract: A method for video denoising, the method includes extracting a current pixel from a current video frame and n?1 pixels from respective n?1 previous video frames to form an n-point pixel data set, wherein the current pixel has an initial value; temporally filtering the current pixel using the n-point pixel data set to generate a temporal estimated true value for the pixel; estimating a quantity of outliers in the n-point pixel data set; if the quantity of outliers is greater than or equal to a threshold, spatially filtering the current pixel using neighboring pixels in the current video frame to generate an spatial estimated true value for the pixel, and using the spatial estimated true value for the pixel as a final estimated value for the pixel; if the quantity of outliers is less than the threshold, using the temporal estimated true value for the pixel as the final estimated value for the pixel.

Abstract: Apparatus and method for modification of emotion conveyed by an image. In one aspect, a metric corresponding to the emotion conveyed by an image is generated, and a command for modifying the emotion of the image causes the emotion conveyed by the image to be changed according to the specified change to emotion. The command to modify the image emotion can be made via an emotion keyword, and can include an indicated magnitude of emotion change. Emotion conveyed by an image can be specified via an emotion vector, where elements of the vector correspond with emotions arranged along orthogonal dimensions in an emotion space. In one aspect, an emotion predictor is trained to predict the emotion conveyed by an image via determining characteristic values for a set of image feature categories, based on a set of images associated with emotion keywords of the emotion space.

Abstract: A method and system is proposed to create a generative model to interpolate any view of a planar scene given a sequence of reference views and a synthesis view that is optimized by the marginalization of photometric regulation, and geometric registration parameters. According to one aspect of the claimed subject matter, a technique is proposed to combine information from varying input camera poses. Planar homography based image super resolution in free view interpolation for planar structure is applied to the combined information. Non-redundant information is combined in such a manner that the high resolution and free view problems in traditional 2D based image-based rendering techniques are overcome.