Abstract: Some embodiments provide an apparatus and method wherein the non-linearity of the response of a multi-bit QIS is controllable (e.g., selectively variable) by dynamically choosing the bit depth n during A/D conversion, and/or later (i.e., post-conversion) by firmware and/or software.

Abstract: Provided are a data transmission method and device. The method includes: processing a first data packet to be sent by using a compression strategy obtained in advance from a receiving end, deleting specified duplicated data comprised in the compression strategy in the first data packet; generating a second data packet to be sent from the processed first data packet, where the second data packet includes a modification record field for indicating the deleted duplicated data; and sending the second data packet to the receiving end.

Abstract: A method and an apparatus for improving digital video signal transmission over a long transmission line are disclosed. A simple equalization reference signal is generated and then combined with a digital video signal in the digital domain such that the transmission of the reference signal takes place at a predefined time period during the vertical blanking interval of the video signal. The combined signal is then converted into an analog video transport signal, which analog signal is then transmitted over the long transmission line to a downstream video receiver. The equalization reference signal is extracted and used at the video receiver to restore the analog video signal which in turn is converted back to digital video signal.

Abstract: According to one implementation, a video processing system includes a computing platform having a hardware processor and a system memory storing a software code including an artificial neural network (ANN). The hardware processor is configured to execute the software code to receive a first video sequence having a first display resolution, and to produce a second video sequence based on the first video sequence using the ANN. The second video sequence has a second display resolution higher than the first display resolution. The ANN is configured to provide sequential frames of the second video sequence that are temporally stable and consistent in color to reduce visual flicker and color shifting in the second video sequence.

Abstract: A non-transitory computer-readable storage medium storing an encoding processing program that causes a computer to execute a process, the process including acquiring image feature information of each of a plurality of image regions obtained by partitioning first image data and image feature information of each of the plurality of image regions obtained by partitioning second image data, determining, for each of the plurality of image regions, whether image feature information of the first image data and image feature information of the second image data have a correlation greater than or equal to a certain value, and coding a specified image region of the second image data which has the correlation, the coding being performed by using coding unit used for coding of an image region of the first image data whose position corresponds to the specified image region of the second image data.

Abstract: The present disclosure relates generally to apparatus and methods for image sensing, and, more particularly, to a multi-bit quanta image sensor (QIS) having a controllable (e.g., adjustably variable) exposure response characteristic. Some embodiments provide an apparatus and method wherein the non-linearity of the response of a multi-bit QIS is controllable (e.g., selectively variable) by dynamically choosing the bit depth n during AID conversion, and/or later (i.e., post-conversion) by firmware and/or software.

Abstract: According to one implementation, a video processing system includes a computing platform having a hardware processor and a system memory storing a frame interpolation software code, the frame interpolation software code including a convolutional neural network (CNN) trained using a loss function having an image loss term summed with a phase loss term. The hardware processor executes the frame interpolation software code to receive first and second consecutive video frames including respective first and second images, and to decompose the first and second images to produce respective first and second image decompositions. The hardware processor further executes the frame interpolation software code to use the CNN to determine an intermediate image decomposition corresponding to an interpolated video frame for insertion between the first and second video frames based on the first and second image decompositions, and to synthesize the interpolated video frame based on the intermediate image decomposition.

Abstract: Techniques are described to use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. A dynamic motion vector coding mode generates a ranked list of motion vector candidates using a distance between previously coded blocks and a current block, and the frequency of use of the motion vectors of those previously coded blocks. The list is used to assign the effective motion vectors to different inter-prediction modes, including a variable number of reference motion vector modes.

Abstract: A system provides automated editing of a media file. Frames of a media file are extracted and feature vectors are generated based thereon. The feature vectors are clustered according to similarity of the content of the feature vectors and the temporal proximity of frames corresponding to the feature vectors in the media file. Clusters are ranked and selected according to the ranking. Segments of the media file corresponding to the selected clusters are combined into a highlight video. Hotspots in a media file may be identified in a media file by detecting local maxima in a measure of movement of pixels between frames. Clusters may be ranked and selected according to an iterative algorithm that identifies clusters that are the most different from an average of the feature vectors and from other selected clusters.

Abstract: Methods and products to deliver at least a portion of an advertisement to a viewer at normal playback speeds after receiving a command from the viewer to fast-forward through an advertisement faster than normal playback speeds is described. In certain embodiments, the invention delivers a portion of the advertisement to be played at normal playback speeds to the viewer: and delivers the remaining portion of the advertisement to be played at a playback speed that is faster than the specified playback speed so that the combination of the portions delivered at normal and faster playback speeds is delivered to the user at the specified playback speed. In some other embodiments, the invention delivers at least a portion of the first advertisement to the viewer at normal playback speeds; and delivers one or more other advertisements to the viewer simultaneously with the first advertisement with the audio information muted based on the specified playback speed.

Abstract: A video data transmission method which is able to transmit compressed video data along with uncompressed video data determines whether any compressed data needs to be transmitted when transmitting uncompressed video data. When the compressed data needs to be transmitted, all pixels in each frame of the uncompressed video data are analyzed and one color which is dominant according to the number of pixels receiving it is obtained. The compressed data is inserted into the data for the relevant large number of pixels and the video data is transmitted to a receiving device after insertion of the compressed data.

Abstract: A method of adjusting motion in a video sequence, includes performing motion estimation on an original video sequence and producing initial motion vectors and motion statistics, using the motion statistics to determine a level of motion estimation and motion compensation (MEMC) in the video sequence, adjusting a frame interpolation process based upon the level, and producing a frame interpolated video sequence from the original video sequence and the adjusted frame interpolation process.

Abstract: Systems and methods for improved video formats used in delivery and playback are presented. According to an embodiment, the movie package format contains tiers that provide for multiple sets of movie variations that are individually selectable for transfer to a device for local playback. A locally stored movie package may contain any subset of available tiers for a movie. Non-resident tiers can be discovered and downloaded into the movie package as needed or when available. Tiers, and other movie files may be updated or added to the movie package at any time. Then users can request updates or the updates can be pushed to the user without affecting the previously downloaded files.

Abstract: Method for improving audio time stretching starts with processor receiving input media file and rate schedule. Rate schedule includes identification of portions of input media file and playback output rates associated with each of the portions of input media file. Writer thread being executed by processor generates timeline that is linked list including segments that respectively represent portions of input media file and associated playback output rates as desired playback rate curves. Generating timeline include writing each segment in linked list to end of linked list. Processor then performs time scaling of media file based on rate schedule to generate output media file. Performing time scaling of media file includes identifying by reader thread being executed by processor a segment in timeline corresponding to desired output time, and translating by reader thread desired output time to corresponding input time based on identified segment. Other embodiments are described.

Abstract: An image data processing system can include one or more processors, a first video output port, and a second video output port. The one or more processors can: receive an encoded stream of digital motion picture image data encoded using an encoding function; generate a first monitoring data stream from the encoded stream using a first decoding function, the first monitoring data stream including first image data; and generate a second monitoring data stream from the encoded stream using a second decoding function different from the first decoding function, the second monitoring data stream including second image data having a narrower brightness range than the first image data. The first and second video output ports can output the first and second monitoring data streams for display in parallel.

Abstract: An image processing apparatus comprising: an input unit configured to input image signals which include a first signal and a second signal lower in spatial resolution than the first signal; an obtaining unit configured to obtain information about a spatial high-frequency component of the first signal which is included in the image signals input by the input unit; a generation unit configured to generate an expanded second signal obtained by expanding the spatial resolution of the second signal included in the image signals by using the information about the spatial high-frequency component of the first signal obtained by the obtaining unit; and an output unit configured to output a processed image signal which includes the expanded second signal generated by the generation unit.

Abstract: An interface apparatus and method of operating the same are provided. The interface apparatus receives an uncompressed image data read request using a first addressing scheme at a first bus interface and transmits a compressed image data read request using a second addressing scheme from a second bus interface. Address translation circuitry translates between the first addressing scheme and the second addressing scheme. Decoding circuitry decodes a set of compressed image data received via the second bus interface to generate the set of uncompressed image data which is then transmitted via the first bus interface. The use of a second addressing scheme and image data compression is thus transparent to the source of the uncompressed image data read request, and the interface apparatus can therefore be used to connect devices which use different addressing schemes and image data formats, without either needing to be modified.

Abstract: Systems and methods for improved video formats used in delivery and playback are presented. According to an embodiment, the movie package format contains tiers that provide for multiple sets of movie variations that are individually selectable for transfer to a device for local playback. A locally stored movie package may contain any subset of available tiers for a movie. Non-resident tiers can be discovered and downloaded into the movie package as needed or when available. Tiers, and other movie files may be updated or added to the movie package at any time. Then users can request updates or the updates can be pushed to the user without affecting the previously downloaded files.

Abstract: An artifact detector detects artifacts in a video sequence comprising interpolated frames generated by performing motion estimation. The detector comprises a pixel processor which processes pixel values in first and second input frames of the video sequence to identify respective blocks of pixels representing an image feature. A feature-matching module matches identified blocks in the first input frame with corresponding identified in the second input frame to determine matched block pairs. For each matched block pair, a feature-detector module: (i) identifies a block of an interpolated frame between the first and second input frames corresponding to the matched block pair, and (ii) characterizes the corresponding block of the interpolated frame as an artifact in dependence on a determination of whether said corresponding block does or does not represent the image feature. A corrector module corrects the interpolated frame based on the characterization of the blocks of the interpolated frame.

Abstract: An adaptive scaler switching system may implement multiple scalers including both a software scaler and a hardware scaler, and a controller that may manage the switch between scalers by considering the real-time constraints of the system and the available system resources. Information about the availability of system resources may be received in real-time, for example the controller may receive information about the system thermal status, the timing requirements for processing the video data, the quality of the scaled data, and any other relevant system statistics that may affect the scaler switch decision. According to an embodiment, the system may maintain statistics in a table, and update the table information as necessary.

Abstract: Coordinated audio and video filter pairs are applied to enhance artistic and emotional content of audiovisual performances. Such filter pairs, when applied in audio and video processing pipelines of an audiovisual application hosted on a portable computing device (such as a mobile phone or media player, a computing pad or tablet, a game controller or a personal digital assistant or book reader) can allow user selection of effects that enhance both audio and video coordinated therewith. Coordinated audio and video are captured, filtered and rendered at the portable computing device using camera and microphone interfaces, using digital signal processing software executable on a processor and using storage, speaker and display devices of, or interoperable with, the device. By providing audiovisual capture and personalization on an intimate handheld device, social interactions and postings of a type made popular by modern social networking platforms can now be extended to audiovisual content.

Abstract: A video processing method includes receiving a multimedia file including a first video file encrypted with a first compression algorithm and converting the first video file to a second video file, which is encrypted with a second compression algorithm. The method includes extracting, from the second file, video data indicative of at least one video characteristic of the second file and displaying the video data on a display screen or forwarding the video data to a content insertion server. The first video compression algorithm may be a MPEG-2 video compression algorithm and the second video compression algorithm may be an H.264 algorithm and/o an H.265 algorithm. The video data may include run time data indicative of a run time of the second video file, frame rate data indicative of a frame rate of the second video file, and pixel data indicative of a resolution of the second video file.

Abstract: Suppressing flicker in digital images includes deriving pixel values from a non-content area of a digital image, estimating flicker values within the non-content area, and suppressing flicker throughout the digital image based on the estimated flicker values of the non-content area.

Abstract: A system and method of image processing is provided, including implementing adaptive pixel replacement techniques or reducing noise. The method includes obtaining a data map of an image frame, wherein the data map comprises good pixels and bad pixels at locations associated with the data map. The method also includes assigning different techniques to the bad pixels, wherein a first technique is assigned to a first bad pixel and a second technique is assigned to a second bad pixel. The method further includes adjusting information associated with the bad pixels for a chosen technique for each of the bad pixels.

Abstract: A digital television (TV) including a display terminal, a TV chip and an image driving circuit is provided. The display terminal includes multiple adjacent rows of pixels. The TV chip includes a digital TV decoder, a data stream decoder, a scaler and a color space converting circuit. The digital TV decoder outputs a data stream according to an interlaced TV signal. The data stream decoder decodes the data stream to output an interlaced image. The scaler outputs a scaled image according to the interlaced image. The color space converting circuit outputs color pixel data according to the scaled image. The image driving circuit simultaneously turns on the rows of pixels, and writes the color pixel data into the rows of pixels to display a de-interlaced image.

Abstract: A low-resolution image is displayed at higher resolution and afterimages are reduced. Resolution is made higher by super-resolution processing. In this case, the super-resolution processing is performed after frame interpolation processing is performed. Further, in that case, the super-resolution processing is performed using a plurality of processing systems. Therefore, even when frame frequency is made higher, the super-resolution processing can be performed at high speed. Further, since frame rate doubling is performed by the frame interpolation processing, afterimages can be reduced.

Abstract: A method and apparatus for measuring the quality of a video is provided. The method comprises: generating a frame loss pattern of the video by indicating whether each frame in the video is lost or successfully transmitted; and evaluating the quality of the video as a function of the generated t came loss pattern.

Abstract: In an embodiment, there is provided a video processing component comprising a compensation engine configured to generate pixels of a first video frame from a second video frame based at least in part on specified pixel motion; and an access buffer configured to store pixel data corresponding to pixels of the second video frame for reference by the compensation engine, wherein the pixel data is stored by the access buffer at different vertical resolutions depending on vertical distances of the pixels corresponding to the pixel data from a target pixel that is indicated by the compensation engine.

Abstract: A method for detecting motion in video fields of video data, comprises the steps of: calculating texture information for a pixel in the video fields; determining a threshold value as a function of the calculated texture information; calculating a differential value for the pixel; and detecting motion in the video fields as a function of the determined threshold value and the calculated differential value.

Abstract: According to one embodiment, a controller of a multiformat video playback device creates control information including a conversion instruction intended for an input processor, size specification intended for a scaler, and format specification intended for an output processor, and supplies the created control information to the input processor. A first delay section delays the control information supplied to the input processor by one frame, and supplies the delayed control information to the scaler. A second delay section delays the control information supplied to the scaler by one frame, and supplies the resultant control information to the output processor.

Abstract: Methods, systems and devices described herein improve vertical resolution at sides of a four cornered image produced by a scanning projector display device. In accordance with an embodiment, a first plurality of frames (e.g., odd frames) of the image are scanned back and forth from side to side starting at a first line level, in one of the corners. Additionally, a second plurality of frames (e.g., even frames) of the image are scanned back and forth from side to side, starting at a vertical offset level from the first line level, in the same one of the corners. The scanning of the first plurality of frames (e.g., the odd frames) is interleaved with the scanning of the second plurality of frames (e.g., the even frames).

Abstract: The intended display aspect-ratio for video is determined automatically by analyzing an image to identify image blocks resulting from prior block-based processing of the video; comparing horizontal and vertical dimensions of those image blocks with horizontal and vertical dimensions of the image, with black border regions excluded as necessary; and determining from that comparison a display aspect ratio for the video.

Abstract: A deinterlacing apparatus includes a buffer to receive a plurality of consecutive fields of an interlaced video and a field combination module coupled to the buffer to deinterlace the interlaced video in accordance with cadence of the interlaced video. The deinterlacing apparatus also includes a cadence detection module to detect the cadence by (1) causing each of the fields to be combined with its preceding field into a frame and with its subsequent field into another frame to obtain a plurality of combined frames, (2) determining a comb factor of each of the combined frames to obtain a sequence of comb factors of the combined frames, and (3) determining if the sequence of comb factors of the combined frames follows a pre-determined repeating pattern. A cadence detection method is also described.

Abstract: A method and system for transmission of video information is provided. A transmitting wireless station performs chroma partitioning of pixels in a video frame into different partitions. The chroma partitioning includes separating luminance (Y) information from chrominance information (CB and CR) of each pixel in a set of spatially correlated pixels. The luminance (Y) information are placed into different partitions. The different partitions into different packets and transmitted over a wireless communication medium to a receiving wireless station. The video information is selectively adapted to a lower data transmission rate with reduced quality degradation by dropping less important partitions.

Abstract: A method of displaying video data includes receiving, at a timing controller, a frame of pixel data at a resolution lower than the display resolution from an application processor, generating new frames of video data at the timing controller by applying a filter with a different set of coefficients to at least one neighboring frame at the lower resolution to generate a display frame of video data at a higher resolution. A video processing device has an application processor to execute instructions causing the application process to transmit frames of image data at a resolution lower than an original resolution, and a timing controller to execute instructions causing the timing controller to reconstruct frames of image data at the original resolution from the frames of lower resolution.

Abstract: A video input section acquires a video signal formed of a plurality of frames. A frame separator separates the video signal acquired by the video input section on a frame basis and distributes the separated video signals. A plurality of parallel processors perform video processing in parallel on the separated video signals corresponding to the frames separated and distributed by the frame separator. A frame combiner combines the separated video signals on which the plurality of parallel processors have performed the video processing.

Abstract: A signal transmission apparatus includes: a vertical rectangular region sampling-out control section that obtains vertical rectangular regions, repeatedly performs a process where pixel samples read out from each line of class images are mapped to each line of video data regions of sub-images, maps pixel samples to each line of the video data regions, and repeatedly maps pixel samples to the next line; a line sampling-out control section that samples out the pixel samples every other line from each line of the sub-images to which the pixel samples have been mapped, so as to generate an interlace signal; a word sampling-out control section that samples out for each word the pixel samples which have been sampled out for each line so as to be mapped to video data regions of an HD-SDI prescribed by the SMPTE 435-2; and a readout control section that outputs the HD-SDI.

Abstract: Systems and methods are provided for upscaling a digital image. A digital image to be upscaled is accessed, where the digital image comprises a plurality of pixel values. A first half pixel value is computed for a first point in the digital image based on a plurality of pixel values of the digital image surrounding the first point and an activity level. A second half pixel value is computed for a second point in the digital image, and an interpolated pixel of an upscaled version of the digital image is determined using a plurality of the pixel values, the first half pixel value, and the second half pixel value.

Abstract: Spatial or temporal interpolation may be performed upon source video content to create interpolated video content. A video signal including the interpolated video content and non-interpolated video content (e.g. the source video content) may be generated. At least one indicator for distinguishing the non-interpolated video content from the interpolated video content may also be generated. The video signal and indicator(s) may be passed from a video source device to a video sink device. The received indicator(s) may be used to distinguish the non-interpolated video content from the interpolated video content in the received video signal. The non-interpolated video content may be used to “redo” the interpolation or may be recorded to a storage medium.

Abstract: Blur is one of the most important features related to image quality. Accurately estimating the blur level of an image is a great help to accurately evaluate its quality. A method for calculating blur of video images comprises calculating a horizontal blur value, and determining characteristic parameters of the video images, including at last progressive/interlaced and spatial resolution level. If the video images are progressive, also a vertical blur value is calculated, and combined with the horizontal blur value. The next step is normalizing the horizontal blur value, or the combined horizontal and vertical blur value, according to predefined min and max values, wherein the min and max values are adapted to the spatial resolution level.

Abstract: A method for efficient digital capturing of analog video signals of computer game consoles is provided. The video format of the signal is changed from 480p to 720p, without any scaling artifacts. The number of active horizontal resolution lines and active vertical resolution lines is reduced in the higher definition space, so that the output picture is a pixel-for-pixel transformed replica of the 480p image.

Abstract: A method and apparatus for converting an image in an image processing system are provided, in which if a plurality of low-definition video frames are used for converting a low-definition picture to a high-definition picture, a weight is determined for each of the plurality of low-definition video frames, and one of two image fields that form a high-definition video frame is generated using the plurality of low-definition video frames according to the weights of the plurality of low-definition video frames.

Abstract: An apparatus configured to match an input frame rate of a video stream with an output frame rate of an output stream, the apparatus comprising, at least one memory buffer, an output frame generator, and a threshold measurement unit, the threshold measurement unit configured to generate a control feedback, wherein the box is configured to analyze the control feedback to monitor a state of the at least one memory buffer, the threshold measurement unit further configured analyze the control feedback to regulate between two or more different settings, wherein the two or more different settings include slowing down or speeding up the output frame, wherein the two or more different settings further include slowing down or speeding up of the line rate of the output stream.

Abstract: An image processing apparatus includes: a normal interpolated image generation unit to generate an image that is interpolated between a plurality of original images reproduced along time series, the image being a normal interpolated image, based on each of the plurality of original images; a high-frequency area extraction unit to extract a high-frequency area having a spatial frequency higher than a predetermined value in each of the plurality of original images; a high-frequency area interpolated image generation unit to generate an image that is interpolated between the plurality of original images, the image being a high-frequency area interpolated image, based on a change in position of the high-frequency area along with an elapse of time on the time series and on each of the plurality of original images; and a combination unit to execute combining processing to combine the normal interpolated image and the high-frequency area interpolated image.

Abstract: Image deterioration when image data containing scanning lines of the previous and next fields mixed together by video editing is displayed is prevented. An inter-field scanning line interpolating unit superimposes scanning line data of the previous and next fields of interlacing image data in a video stream input from a tuner or a memory card to perform inter-field scanning line interpolation, and generates progressive image data corresponding to that video stream. An IP-conversion selection signal indicating a determination result whether or not the reliability of the video stream meets a predetermined level is input into a back-end from a CPU. A selector refers to the IP-conversion selection signal, and when the CPU determines that the reliability of the video stream is lower than the predetermined level, image data having undergone interpolation by the inter-field scanning line interpolating unit is selected as an image to be displayed.

Abstract: A method for identifying state of macro block of de-interlacing computing and an image processing apparatus are provided, the method is as follows. A video frame is divided into a plurality of regions, where each of the regions includes a plurality of macro blocks. Then, a basic threshold corresponding to each of the regions is provided according to a position of each of the regions in the video frame, and a first macro block is identified to be a first type macro block or a second type macro block according to the basic threshold corresponding to one of the regions where the first macro block of the macro blocks locates. Then, a corresponding de-interlacing computing step is performed on the first macro block according to an result that the first macro block is identified as the first type macro block or the second type macro block.

Abstract: A method for de-interlacing interlaced video includes receiving a first video field and a second video field of an interlaced video frame, generating a first video frame from the first video field and a first synthesized video field, where video data of the first synthesized video field is based exclusively on video data of the first and second video fields, generating a second video frame from the second video field and a second synthesized video field, where video data of the second synthesized video field is based exclusively on the video data of the first and second video fields, and outputting two de-interlaced video frames for every received interlaced video frame. The first (second) synthesized video field is generated by combining image data from the second (first) video field with image data from corresponding lines of an up-scaled first (second) field generated by a scaler.

Abstract: A digital cable broadcast receiver and a method for automatically processing caption data of various standards and types, is disclosed. The digital broadcast receiver includes: a demultiplexer for dividing a received broadcast stream into video data, audio data, supplementary information; a controller for determining whether caption data included in the video data is digital caption data or analog caption data on the basis of caption information included in the supplementary information, and outputting a control signal according to a result of the determining; a digital caption decoder for extracting and decoding digital caption data from the video data according to the control signal; and an analog caption decoder for extracting and decoding analog caption data from the video data according to the control signal.

Abstract: In an embodiment, there is provided a video processing component comprising a compensation engine configured to generate pixels of a first video frame from a second video frame based at least in part on specified pixel motion; and an access buffer configured to store pixel data corresponding to pixels of the second video frame for reference by the compensation engine, wherein the pixel data is stored by the access buffer at different vertical resolutions depending on vertical distances of the pixels corresponding to the pixel data from a target pixel that is indicated by the compensation engine.

Abstract: Operating on video frames includes determining a frame set backdrop of a set of video frames that is a characterization of the relative difference in content of the set of video frames. Decreasing video quality of the set of video frames when the frame set backdrop is relatively higher indicating relatively greater content difference among video frames of the set of video frames and increasing/leaving quality of the set of video frames when the frame set backdrop is relatively lower indicating relatively lesser content difference among video frames of the set of video frames. Alteration of video quality of the set of video frames includes altering a frame rate, altering a pixel resolution, and/or altering color resolution of the set of video frames and/or altering a ratio of independent frames to predictive frames of the set of frames.