Abstract: A system, computer program product, and method are presented for providing replacement data for data in a time series data stream that has issues indicative of errors, where the data issues and the replacement data are related to one or more KPIs. The method includes determining one or more predicted replacement values for potentially erroneous data instances in the time series data stream. The method further includes resolving the potentially erroneous data instances with one predicted replacement value of the one or more predicted replacement values in the time series data stream.

Abstract: An electronic device and a controlling method thereof are provided. The electronic device includes a memory, a first camera including a first image sensor and at least one processor, and the at least one processor obtains a plurality of image frames by photographing surroundings of the electronic device through the first camera, sets a region of interest (ROI) on the plurality of image frames, obtains a motion identification map corresponding to each of the plurality of image frames and select at least one image frame from among the plurality of image frames based on the obtained motion identification map, identifies whether there is a motion of an object on the ROI set on the selected at least one image frame, and performs a Super Slow Motion (SSM) function through the first camera based on a result of the identification.

Abstract: Techniques related to video pre-processing for video coding are discussed. Such video pre-processing techniques may include applying adaptive temporal and spatial filtering to pixel values of video frames of input video to generate pre-processed video such that the adaptive temporal and spatial filtering includes blending spatial and temporal filtering of the individual pixel value when the block of pixels is a non-motion block and spatial-only filtering the individual pixel value when the block of pixels is a motion block.

Abstract: A system including a motion adaptive de-interlacer, a film mode detector, and a combiner. The motion adaptive de-interlacer is configured to determine a first output by de-interlacing a plurality of interlaced frames based on at least a first motion indicator indicating motion between fields of the plurality of interlaced frames. The film mode detector is configured to determine a second output based on a film mode detected based on at least a second motion indicator indicating motion between fields of the plurality of interlaced frames. The film mode detector is further configured to output a control signal based on the second motion indicator and the film mode. The combiner is configured to combine the first output and the second output based on the control signal.

Abstract: An frame rate up-conversion (FRC) apparatus and method are provided. The motion vector generating circuit compares a previous original frame with a current original frame to obtain the first motion vectors of the blocks of the current original frame, and compares the current original frame and a posterior original frame to obtain the second motion vectors of the blocks of the current original frame. The motion vector correction circuit checks whether the blocks of the second original frame are located in an occlusion area, and corrects the motion vectors of the blocks in the occlusion area based on the first motion vectors and the second motion vectors of the first original frame, the second original frame and the third original frame. The interpolation frame generating circuit creates at least one interpolation frame between the first original frame and the second original frame based on the corrected motion vectors.

Abstract: Provided in embodiments of the present invention are a method and device for transmitting a high-definition video signal, comprising: isolating from the high-definition video signal a brightness signal and a chrominance signal, and, by using an analog signal transmission mode, using non-overlapping frequency hands to transmit respectively the brightness signal and the chrominance signal. The solution of the present invention employs the analog signal transmission method, utilizes independent frequency bands to transmit respectively the brightness signal and the chrominance signal, and ensures that the brightness signal and the chrominance signal do not affect each other, thus ensuring video quality and timeliness of the high-definition video signal when transmitted over a long distance.

Abstract: Devices and methods are provided for directionally receiving and/or transmitting acoustic waves and/or radio waves for use in applications such as wireless communications systems and/or radar. High directional gain and spatial selectivity are achieved while employing an array of receiving antennas that is small as measured in units of the wavelength of radio waves being received or transmitted, especially in the case of spatially oversampled arrays. Frequency/wavenumber, multi-dimensional spectrum analysis, as well as one-dimensional frequency spectrum analysis can be performed.

Abstract: A video processing method and apparatus, which relate to the field of multimedia, and the method includes acquiring, by an video processing apparatus, two field images of an interlaced frame image in an interlaced video; performing temporal deinterlacing on either field image in the two field images to obtain a temporal virtual field image, and performing spatial deinterlacing on the either field image to obtain a spatial virtual field image; performing directional combing detection on the temporal virtual field image along a preset candidate combing detection direction with reference to the other field image in the interlaced frame image, to determine whether combing exists in the temporal virtual field image; and according to this, selecting the temporal virtual field image or the spatial virtual field image to be fused with the other field image to generate a new image.

Abstract: An apparatus and method for reducing noise of an image are provided. The apparatus includes: a temporal noise reduction unit configured to remove temporal noise from an input frame by adjusting a temporal noise reduction intensity of the input frame based on a pixel-based motion degree and a block-based motion degree that are detected from the input frame and a reference frame and generate a first output frame; and a spatial noise reduction unit configured to remove spatial noise from the first output frame by adjusting a spatial noise reduction intensity of the first output frame based on similarity between peripheral pixels of the first output frame and the pixel-based motion degree and the block-based motion degree, thereby to generate a final output frame.

Abstract: Devices and methods are provided for directionally receiving and/or transmitting acoustic waves and/or radio waves for use in applications such as wireless communications systems and/or radar. High directional gain and spatial selectivity are achieved while employing an array of receiving antennas that is small as measured in units of the wavelength of radio waves being received or transmitted, especially in the case of spatially oversampled arrays. Frequency/wavenumber, multi-dimensional spectrum analysis, as well as one-dimensional frequency spectrum analysis can be performed.

Abstract: An interpolation unit receives an incoming video bit stream comprising a plurality of frames including first macroblocks encoded using block-matching motion compensation and second macroblocks encoded using global motion compensation. A translation unit converts global motion parameters included in a current frame of the incoming video bit stream into a global motion vector. The interpolation unit performs luminance and chrominance interpolation operations on each macroblock contained in each frame of the incoming video bit stream. When processing a current macroblock, if the current macroblock is encoded using global motion compensation, the interpolation unit performs the luminance interpolation operations according to the global motion vector at half-pel resolution, and performs the chrominance interpolation operations at quarter-pel resolution.

Abstract: An event aware video system (EAVS) is to capture video frames during a first time period and process events in the video frames before transferring the processed data to a central computing system. The EAVS may establish a present no-event frame from the video frames by marking the last frame as the present no-event frame if the difference between adjacent pair of video frames is less than a threshold value. The EAVS may establish an event frame, wherein a present frame captured after establishing the no-event frame is marked as the event frame if the difference between the present frame and a previous frame is greater than the threshold value. The EAVS may provide event information including motion vectors to a central computing system by performing one-dimensional search on a moving object of the event frame, wherein the motion vectors may represent displacement of objects moving within the moving object.

Abstract: An event aware video system (EAVS) is to capture video frames during a first time period and process events in the video frames before transferring the processed data to a central computing system. The EAVS may establish a no-event frame by marking a last frame as the no-event frame if the difference between adjacent pair of video frames is less than a threshold value. The EVAS may mark a present frame captured after establishing the no-event frame as the event frame if the difference between the present and a previous frame is greater than the threshold value. The EAVS may provide event information to the central computing system by performing temporal blending, which includes linearly combining the movement of objects within the moving object in adjacent event frames to generate blurred images. The difference between the blurred images may represent displacement of objects moving within the moving object.

Abstract: Devices and methods are provided for directionally receiving and/or transmitting acoustic waves and/or radio waves for use in applications such as wireless communications systems and/or radar. High directional gain and spatial selectivity are achieved while employing an array of receiving antennas that is small as measured in units of the wavelength of radio waves being received or transmitted, especially in the case of spatially oversampled arrays. Frequency/wavenumber, multi-dimensional spectrum analysis, as well as one-dimensional frequency spectrum analysis can be performed.

Abstract: An automatic tracking camera system includes: a rotating unit for panning and tilting an image pickup unit including a lens apparatus and an image pickup apparatus; a tracking object detector; a motion vector detector for detecting a motion vector of the object to be tracked; a capture position setting unit for setting a capture position of the object to be tracked in the picked up image; and a controller for controlling drive of the rotating unit. The controller controls the rotating unit in a capture mode to capture the object to be tracked at the capture position based on the motion vector detected by the motion vector detector after the tracking object detector has detected the object to be tracked in the picked up image, and a maintenance mode to continuously capture the object to be tracked at the capture position after the capture mode.

Abstract: A frame rate conversion processing system can generate a second row of frames that is different from a first row of frames in the number of frames. The frame rate conversion processing system includes a luminance change detection unit configured to calculate a luminance change value of the first row of frames based on luminance changes in the entire area or a partial area of the frames that constitutes the first row of frames and configured to compare the calculated luminance change value with a predetermined value. The frame rate conversion processing system further includes a correction unit configured to correct the luminance of the entire area or a partial area of the frames that constitutes the second row of frames according to a comparison result obtained by the luminance change detection unit.

Abstract: The present invention provides a method and apparatus for de-interlacing video data by using a horizontal motion vector of a horizontal motion between fields. The horizontal motion regarding a target pixel of a frame is compensated if the horizontal motion vector is found to be substantially not null according to the pixels residing in the fields determined by the horizontal motion vector. This results in an upgraded quality of image after the de-interlacing process.

Abstract: In an embodiment, there is provided a video processing component comprising a compensation engine configured to generate pixels of a first video frame from a second video frame based at least in part on specified pixel motion; and an access buffer configured to store pixel data corresponding to pixels of the second video frame for reference by the compensation engine, wherein the pixel data is stored by the access buffer at different vertical resolutions depending on vertical distances of the pixels corresponding to the pixel data from a target pixel that is indicated by the compensation engine.

Abstract: A method for detecting motion in video fields of video data, comprises the steps of: calculating texture information for a pixel in the video fields; determining a threshold value as a function of the calculated texture information; calculating a differential value for the pixel; and detecting motion in the video fields as a function of the determined threshold value and the calculated differential value.

Abstract: A deinterlacing apparatus includes a buffer to receive a plurality of consecutive fields of an interlaced video and a field combination module coupled to the buffer to deinterlace the interlaced video in accordance with cadence of the interlaced video. The deinterlacing apparatus also includes a cadence detection module to detect the cadence by (1) causing each of the fields to be combined with its preceding field into a frame and with its subsequent field into another frame to obtain a plurality of combined frames, (2) determining a comb factor of each of the combined frames to obtain a sequence of comb factors of the combined frames, and (3) determining if the sequence of comb factors of the combined frames follows a pre-determined repeating pattern. A cadence detection method is also described.

Abstract: A system is disclosed for controlling operation of an electronic device, such as a TV. The system includes a first sensor located at or near the electronic device and a second sensor spaced apart from the first sensor, wherein the first and second sensors are configured to detect motion of a user within an operating zone associated with the electronic device. A processor is coupled to the electronic device and the first and second sensors, the processor being configured to input a signal from the first and second sensors. Memory is coupled to the processor, the memory comprising a sensing algorithm configured to process the input signal from the first and second sensors and determine the location of the user with respect to the operating zone. The processor is configured to send a control command to the electronic device based on an output of the sensing algorithm.

Abstract: Disclosed herein is an image processing apparatus including an interlace/progressive conversion section configured to carry out interpolation processing on image data of the current field by making use of the image data of the current field and image data of a field leading ahead of the current field by one field period in order to obtain image data of a progressive system with no delay time.

Abstract: Spatial or temporal interpolation may be performed upon source video content to create interpolated video content. A video signal including the interpolated video content and non-interpolated video content (e.g. the source video content) may be generated. At least one indicator for distinguishing the non-interpolated video content from the interpolated video content may also be generated. The video signal and indicator(s) may be passed from a video source device to a video sink device. The received indicator(s) may be used to distinguish the non-interpolated video content from the interpolated video content in the received video signal. The non-interpolated video content may be used to “redo” the interpolation or may be recorded to a storage medium.

Abstract: An image processing apparatus includes: a normal interpolated image generation unit to generate an image that is interpolated between a plurality of original images reproduced along time series, the image being a normal interpolated image, based on each of the plurality of original images; a high-frequency area extraction unit to extract a high-frequency area having a spatial frequency higher than a predetermined value in each of the plurality of original images; a high-frequency area interpolated image generation unit to generate an image that is interpolated between the plurality of original images, the image being a high-frequency area interpolated image, based on a change in position of the high-frequency area along with an elapse of time on the time series and on each of the plurality of original images; and a combination unit to execute combining processing to combine the normal interpolated image and the high-frequency area interpolated image.

Abstract: A method for identifying state of macro block of de-interlacing computing and an image processing apparatus are provided, the method is as follows. A video frame is divided into a plurality of regions, where each of the regions includes a plurality of macro blocks. Then, a basic threshold corresponding to each of the regions is provided according to a position of each of the regions in the video frame, and a first macro block is identified to be a first type macro block or a second type macro block according to the basic threshold corresponding to one of the regions where the first macro block of the macro blocks locates. Then, a corresponding de-interlacing computing step is performed on the first macro block according to an result that the first macro block is identified as the first type macro block or the second type macro block.

Abstract: An image processing apparatus in which output pixels of an output image are generated with respect to input pixels of an input image, a first subset of the output pixels being identical to respective input pixels and a second subset of the output pixels being derived from respective groups of one or more input pixels. The apparatus includes a spatial filter arrangement for filtering the second subset of pixels, the filter not being applied to filter the first subset of output pixels, the filter arrangement having a response such that high spatial frequencies are attenuated in the output image.

Abstract: A frame rate conversion method includes detecting a plurality of input frames to determine an image mode corresponding to the plurality of input frames; performing motion estimation on the plurality of input frames to generate a motion estimation result; and interpolating a plurality of interpolated frames according to the determined image mode, the motion estimation result and the plurality of input frames to generate a plurality of converted output frames, wherein a frame rate of the outputted frames is different from that of the input frames.

Abstract: Determining video content type of a video displayed on a LCD and triggering adjustment in drive power of the LCD based on the video content type. The video content type indicates relative content motion of the video. A video content type detection module is one or combination of a software and a hardware and directs the LCD to be driven relative slower or faster based upon video content. The module independently or in conjunction with another module identifies an active window from a plurality of windows corresponding to a plurality of applications running on the host device and sets the drive power of the LCD based on speed of a video displayed on the active window. The module may also adapt LCD drive power based upon user input and/or remaining battery life.

Abstract: Described herein are a method and system for frame rate adaptation. There may be conditions that require the rate of a video sequence to be dynamically controlled, and a frame interval may be adaptively selected every frame. A frame within the video sequence may contain, for example, a time stamp that is transmitted to a decoder to indicate the change in temporal spacing between frames.

Abstract: In an embodiment, there is provided a video processing component comprising a compensation engine configured to generate pixels of a first video frame from a second video frame based at least in part on specified pixel motion; and an access buffer configured to store pixel data corresponding to pixels of the second video frame for reference by the compensation engine, wherein the pixel data is stored by the access buffer at different vertical resolutions depending on vertical distances of the pixels corresponding to the pixel data from a target pixel that is indicated by the compensation engine.

Abstract: An imager achieves a desired image resolution by successively reproducing partial images which complement each other. The imager assigns pixels from an input image to the respective partial images according to complementing patterns that correspond to the pixel pattern of the imager. The imager reproduces the complementing pattern at different spatial positions, such that the complementing patterns merge. In order to avoid perceived double imaging of moving objects the image signal provided to the imager is assembled from an original image and a motion compensated interpolated image, which is derived from at least two consecutive images. Accordingly, every other partial image that is reproduced is derived from an interpolated image and takes into account movement of objects in the image that takes place between two consecutive images. In one embodiment the partial images are re-combined into one full image in a sequence that anticipates the distribution of the pixels used in the imaging device.

Abstract: A method for increasing the resolution of a frame of a video includes receiving at least three frames of the video and compensating for the motion of a portion of at least two of the frames with respect to another one of the frames. After the motion compensation, spatially processing each of the frames of the video to increase the resolution of each of the at least three frames of the video. After the spatial processing, temporally processing at least three frames to determine the increased resolution of the frame of the video, wherein the frame is one of the at least three frames of the video.

Abstract: A video processing apparatus determines whether a video signal of a predetermined resolution is a pseudo-resolution video signal generated from a video signal of resolution lower than the predetermined resolution. The video processing apparatus generates a first frequency histogram relating to a video signal of a first resolution among a plurality of video signals which are identical in contents and different from one another in resolution and a second frequency histogram relating to a video signal of a second resolution which is lower than the first resolution, compares the first frequency histogram with the second frequency histogram, compares a similarity between the first frequency histogram and the second frequency histogram with a predetermined threshold value, and determines, if the similarity is equal to or less than the predetermined threshold value, that the video signal of the first resolution is a pseudo-resolution video signal.

Abstract: Described is a hierarchical filtered motion field technology such as for use in recognizing actions in videos with crowded backgrounds. Interest points are detected, e.g., as 2D Harris corners with recent motion, e.g. locations with high intensities in a motion history image (MHI). A global spatial motion smoothing filter is applied to the gradients of MHI to eliminate low intensity corners that are likely isolated, unreliable or noisy motions. At each remaining interest point, a local motion field filter is applied to the smoothed gradients by computing a structure proximity between sets of pixels in the local region and the interest point. The motion at a pixel/pixel set is enhanced or weakened based on its structure proximity with the interest point (nearer pixels are enhanced).

Abstract: Systems and methods directed to determining motion in a video signal are provided. A plurality of pixels of a plurality of adjacent field lines of alternating parity of the video signal are evaluated to generate a plurality of differential values. A sign of each differential value is determined, and when each differential value has the same sign, at least one differential value can be compared with a threshold value. Responsive to the comparison of at least one differential value with a threshold value, a motion coefficient indicative of a magnitude of motion associated with one of the plurality of pixels can be generated.

Abstract: An image de-interlacing method comprises: (a) defining a first threshold value and a second threshold value, wherein the second threshold value is larger than the first threshold value; (b) generating a parameter according to motion level of a interlaced image; and (c) utilizing a first interpolation method and a second interpolation method to jointly process the interlaced image if the parameter is in a range between the first threshold value and the second threshold value.

Abstract: In particular embodiments, a process relating to the creation of a high-resolution video from a low-resolution video. In a particular embodiment, the process receives as input a sequence of low-resolution video frames. The process first determines a matching score for consecutive frames in the sequence, where the matching score is based on a preliminary global transformation between consecutive frames. From the matching scores, the process determines a set of matching windows and relative-motion estimates and then uses the set and estimates to calculate more thorough global transformations and any residual relative-motion which can be explained using independent object motion and/or optical flow. The process uses the latter global transformation and any independent object motion and/or optical flow to create motion trajectories and to generate high-resolution frames by interpolating low-resolution frames at trajectory-defined points, using regular-to-irregular spatio-temporal interpolation.

Abstract: A method and apparatus of dejuddering image data includes receiving a video data signal that includes a plurality of successive source frames. A first source frame of the plurality of successive source frames is displayed a predetermined number of times. A first black frame is displayed, and successive source frames are displayed.

Abstract: A super resolution (SR) method or system with database-free texture synthesis is disclosed. An input image is up-sampled to result in an up-sampled image. It is determined whether the input image possesses a smooth region. Edges of the up-sampled image are enhanced, and the enhancing edges step is bypassed if the smooth region has been detected. The enhanced or unenhanced up-sampled image is texture synthesized by taking the input image as texture example, thereby resulting in a synthesized image.

Abstract: Described herein are a method and system for frame rate adaptation. There may be conditions that require the rate of a video sequence to be dynamically controlled, and a frame interval may be adaptively selected every frame. A frame within the video sequence may contain, for example, a time stamp that is transmitted to a decoder to indicate the change in temporal spacing between frames.

Abstract: A down-sampling operation is performed on moving image data to reduce a sample count of the data to 1/M times the original sample count. In the down-sampling operation, a band-limitation operation is performed on the moving image data using a low-pass filter. The low-pass filter has a stop band frequency that prevents a harmonic component having a K-th order or higher, of harmonic components generated in the down-sampling operation, from overlapping an original signal component. The down-sampling operation is then performed on the band-limited moving image data, thereby compressing the moving image data. Aliasing distortion caused by a harmonic component of a high order is controlled. The resulting compressed image is free from a substantial loss of a high-frequency component of the original signal.

Abstract: There are provided methods and apparatus for inter-layer residue prediction for scalable video. An apparatus is described for an encoder for encoding a block of a picture, or a decoder for decoding a block of a picture, by applying inverse tone mapping to an inter-layer residue prediction process for the block, wherein the inverse tone mapping is performed in the pixel domain. Methods for encoding or decoding a block of a picture are also described; and performed by applying inverse tone mapping to an inter-layer residue prediction process for the block, wherein the inverse tone mapping is performed in the pixel domain.

Abstract: A method for frame rate up conversion. The method is executed by a frame rate up-converter. The frame rate up-converter receives a plurality of consecutive input video frames and detects luminance information for a current frame. The frame rate up-converter generates a first output frame according to the luminance information for the current frame and a preceding frame before the current frame and generates a second output frame according to the luminance information for the current frame and a succeeding frame after the current frame, wherein the second output frame is outputted after the first output frame.

Abstract: A de-interlacing method includes the following steps. A de-interlacing pixel datum of a target pixel is obtained according to a current field and multiple correlated fields. A caption region of the current field is defined according to the fields, and a region motion vector and a region confidence are correspondingly obtained. When the target pixel belongs to the caption region, a compensation pixel datum of the target pixel is obtained by motion compensation according to at least a part of the fields and the region motion vector, and the target pixel is judged as a foreground pixel or a background pixel to output a compensation select signal according to the region motion vector and the region confidence. The de-interlacing pixel datum or the compensation pixel datum is outputted as a correlated pixel datum of the target pixel according to the compensation select signal.

Abstract: A method and a system for determining a video deinterlacing strategy are disclosed. First, all the pixels of a (i+2)th field are subtracted from the corresponding pixels of the ith field to obtain a difference field. Next, a specific check-area is located according to the difference field. Next, the ith field is combined with the (i+1)th field into a specific frame. Next, the combing phenomenon of the specific check-area in the specific frame is checked to determine the deinterlacing scheme for the pixels in the specific check-area.

Abstract: A method for video conversion of a video stream includes: interpolating a first interpolated frame according a first frame and a second frame of the video stream; and interpolating a second interpolated frame according to the first frame and the first interpolated frame. In addition, the method further includes interpolating a third interpolated frame according to the second frame and the first interpolated frame.

Abstract: A motion adaptive video deinterlacer may process fields of video derived from frames of video. The deinterlacer may use multiple pixel motion engines to provide motion information about the pixels within each field. The output of the motion engines may be used to deinterlace the fields of video based on the detail within a field of video. The deinterlacer may use motion recursion and motion recirculation to provide temporal motion expansion for the pixels within each field. In addition, the deinterlacer may detect various cadences for various regions within the frames of video. The cadences may be detected using a calculated threshold, or without using a calculated threshold.

Abstract: An output of a conventional color-difference inter-field interpolating unit (10) and an output obtained by a color-difference 4:2:0 inter-field interpolating unit (11) and a color-difference intra-field line interpolating unit (12) as a progressive signal through inter-field interpolation by changing a 4:2:2 color-difference signal into a 4:2:0 color-difference signal are switched by a color-difference static image processing method selecting/mixing unit (14) in accordance with an output or the like of a detecting unit (13) for detecting a characteristic of an image signal. Thus, it is possible to realize color-difference signal IP conversion static image processing in which degradation of a correct 4:2:2 color-difference signal is suppressed and jaggy is reduced with respect to a 4:2:2 color-difference signal obtained through interpolation of a 4:2:0 signal.

Abstract: A method of image processing for conversion of an image in a sequence of images comprises the steps of associating pixels of an image with respective motion values indicative of a degree of inter-image motion for each pixel; adjusting the motion value of each pixel based upon the motion value of a secondary pixel found within a first region of a first predetermined size substantially centered upon each respective pixel, said secondary pixel being that whose associated motion value is indicative of the greatest motion of any pixel in the first region; adjusting the motion value of each pixel based upon the motion value of a secondary pixel that lies within a second region of a second predetermined size substantially centered upon each respective pixel, said secondary pixel being that whose associated motion value is indicative of the least motion of any pixel in the second region; categorizing each pixel as a static pixel or a motion pixel according to its respective associated motion value, and then selecting

Abstract: An apparatus includes a memory which successively stores frame data of video data, an interpolating unit which generates interpolation frame data which is inserted between the frame data and stores the interpolation frame data in the memory, and a readout unit which successively reads out the frame data and the interpolation frame data from the memory at a frame rate higher than a frame rate of the video data. The apparatus further includes a generating unit which generates image data which is composited with the frame data and stores the image data in the memory, and a control unit which, based on display-related characteristics of the image data, controls the interpolating unit to halt the generation of the interpolation frame data, and also controls the readout unit to read out the frame data in duplicate instead of the interpolation frame data.