Motion Adaptive Patents (Class 348/452)
  • Patent number: 11917128
    Abstract: A motion field estimate determined using motion vector information of two or more reference frames of a current/encoded frame is used to derive a motion vector for inter-prediction of the current/encoded frame. Motion trajectory information, including concatenated motion vectors and locations of the current/encoded frame at which those concatenated motion vectors point, is determined by concatenating motion vectors of the reference frames. A motion field estimate is determined using the motion trajectory information and, in some cases, by interpolating unavailable motion vectors using neighbors. The motion field estimate is used to determine a co-located reference frame for the current/encoded frame, and an inter-prediction process is performed for the current/encoded frame using a motion vector derived using the co-located reference frame.
    Type: Grant
    Filed: November 5, 2020
    Date of Patent: February 27, 2024
    Assignee: GOOGLE LLC
    Inventors: Bohan Li, Yaowu Xu, Jingning Han
  • Patent number: 11823393
    Abstract: The present disclosure relates to a scene detection method, a chip, an electronic device, and a storage medium, the present disclosure detects periodic scenes, which helps to improve the accuracy of motion estimation.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: November 21, 2023
    Assignee: AMLOGIC (SHANGHAI) CO., LTD
    Inventors: Zheng Bao, Tao Ji, Zhihong He, Chun Wang, Dongjian Wang, Xuyun Chen
  • Patent number: 11636573
    Abstract: An image processing method includes: downsizing a current frame and a reference frame; dividing the down-sized current frame and the down-sized reference frame into multiple first current blocks and multiple first reference blocks, respectively; performing a first motion estimation to the first current blocks and the first reference blocks to generate multiple first motion vectors; dividing the current picture and the reference picture into multiple second current blocks and multiple second reference blocks, respectively; performing a second motion estimation to the second current blocks and the second reference blocks to generate multiple second motion vectors; and generating a compensated frame between the current frame and the reference frame according to the second motion vectors. The second motion estimation includes: performing a 3D recursive search for each second current block; and adjusting multiple estimation parameters in the 3D recursive search according to the first motion vector.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: April 25, 2023
    Assignee: REALTEK SEMICONDUCTOR CORPORATION
    Inventor: Chung-Ping Yu
  • Patent number: 11615510
    Abstract: An electronic device includes at least one imaging sensor and at least one processor coupled to the at least one imaging sensor. The at least one imaging sensor is configured to capture a burst of image frames. The at least one processor is configured to generate a low-resolution image from the burst of image frames. The at least one processor is also configured to estimate a blur kernel based on the burst of image frames. The at least one processor is further configured to perform deconvolution on the low-resolution image using the blur kernel to generate a deconvolved image. In addition, the at least one processor is configured to generate a high-resolution image using super resolution (SR) on the deconvolved image.
    Type: Grant
    Filed: December 31, 2020
    Date of Patent: March 28, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Baekdu Choi, Ruiwen Zhen, John W. Glotzbach, Hamid R. Sheikh
  • Patent number: 11533451
    Abstract: Embodiments of the disclosure provide systems and methods for performing frame rate up-conversion of video data including a sequence of image frames. The method may include determining a set of motion vectors of a target frame relative to a plurality of reference frames. The target frame is to be generated and interpolated into the sequence of image frames. The method may further include performing a motion vector classification on the set of motion vectors to generate a target object map for the target frame. The method may additionally include projecting the target object map onto the plurality of reference frames to generate a plurality of reference object maps based on the set of motion vectors. The method may additionally include detecting an occlusion area in the target frame based on the set of motion vectors, the target object map, and the plurality of reference object maps.
    Type: Grant
    Filed: July 20, 2021
    Date of Patent: December 20, 2022
    Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD
    Inventors: Yi-Wen Chen, Xianglin Wang, Shuiming Ye, Guoxin Jin, Shufei Fan, Bing Yu
  • Patent number: 11501408
    Abstract: There is provided an information processing apparatus, an information processing method, and a program with which highly accurate depth information can be acquired. The information processing apparatus includes an interpolation image generation unit, a difference image generation unit, and a depth calculation unit. The interpolation image generation unit generates an interpolation image on the basis of a first normal image and a second normal image among the first normal image, a pattern image irradiated with infrared pattern light, and the second normal image, the interpolation image corresponding to a time at which the pattern image is captured. The difference image generation unit generates a difference image between the interpolation image and the pattern image. The depth calculation unit calculates depth information by using the difference image.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: November 15, 2022
    Assignee: SONY CORPORATION
    Inventor: Akihiko Kaino
  • Patent number: 11503248
    Abstract: A motion estimation method for a video processor includes steps of: calculating frame difference between a current input frame and a previous input frame; comparing the frame difference and a threshold to generate a comparison result; if the comparison result indicates the frame difference less than the threshold, determining whether a first block of the current input frame is a mixed block according to a block difference that indicates a difference between the first block and a block of the previous input frame at the same position; generating at least one temporal motion vector candidate for the first block; modifying the temporal motion vector candidate according to a current position difference value of video part in the current input frame when the first block is determined as the mixed block; and determining a motion vector for the first block from multiple motion vector candidates including the temporal motion vector candidate.
    Type: Grant
    Filed: January 4, 2022
    Date of Patent: November 15, 2022
    Assignee: NOVATEK Microelectronics Corp.
    Inventor: Hsiao-En Chang
  • Patent number: 11451740
    Abstract: A video-image-interpolation apparatus is provided, which includes at least three image-layering circuits, at least three motion-estimation circuits, a motion-estimation-filtering circuit, a motion-compensated frame-interpolation circuit, and a display-control circuit. Each motion-estimation circuit performs motion estimation on a reference image-layer sequence and a reference subtitle-layer sequence that are generated from an input video signal by each image-layering circuit. The motion-estimation-filtering circuit adaptively determines the motion-estimation circuit having the smallest motion error.
    Type: Grant
    Filed: November 10, 2021
    Date of Patent: September 20, 2022
    Assignee: TERAWINS, INC.
    Inventors: Yu-Kuang Wang, Wen-Yi Huang, Pei-Kai Hsu
  • Patent number: 11361795
    Abstract: Control apparatus to control operation of a data buffer to which data items are written according to a write pointer which advances in position in response to an input data item rate and from which data items are read according to a read pointer which advances in position in response to an output data item rate, comprises: a detector configured to detect an occupancy difference between a current buffer occupancy and a target buffer occupancy, in which the current buffer occupancy represents a difference between the read and write pointers; an output data item interpolator configured to interpolate a data item at an interpolated data buffer location displaced by a read offset displacement from a data buffer location pointed to by the read pointer; and output control circuitry configured, in response to a current occupancy difference exceeding a threshold occupancy difference, to change the read pointer from an initial read pointer to a target read pointer by a change amount so as to reduce the occupancy differ
    Type: Grant
    Filed: February 15, 2019
    Date of Patent: June 14, 2022
    Assignee: Sony Corporation
    Inventor: Stephen Mark Keating
  • Patent number: 11270126
    Abstract: A person tracking method, comprising: acquiring N frames in units of time windows; acquiring, in time windows, tracking paths of a target person according to the N frames; and constructing continuous tracking paths by means of continuous time windows, so as to obtain the tracking results of the target person.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: March 8, 2022
    Assignees: BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO., LTD., BEIJING JINGDONG CENTURY TRADING CO., LTD.
    Inventors: Peiming Zhou, Yun Ye, Aixi Zhang, Junhui Wu, Yu Chen, Zhi Weng
  • Patent number: 11206420
    Abstract: Encoding methods, decoding methods, encoding apparatuses, and decoding apparatuses are provided, for a video image with forward and backward reference blocks. One encoding method includes: determining an optimal integrated neighboring block for a current block based on a motion vector integration technology; determining, based a prediction direction of the optimal integrated neighboring block, a motion vector derivation mode that needs to be used by a decoder; correcting a motion vector of the current block based on the motion vector derivation mode, and determining a residual between a predicted value and an original value of the current block based on the corrected motion vector, thereby encoding the current block. According to the technical solutions, a more accurate predicted value is obtained by correcting the motion vector, and a smaller residual is generated.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: December 21, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Sixin Lin, Mingyuan Yang
  • Patent number: 10917609
    Abstract: A motion vector detector detects a motion vector, and generates reliability data of the motion vector. Pixel selectors select pixels for dynamic interpolation and pixels for static interpolation. The mixing ratio generator generates a first mixing ratio of interpolation pixels of the dynamic interpolation and interpolation pixels of the static interpolation based on the reliability data. A mixing ratio generator generates a second mixing ratio based on a difference value between the pixels for the dynamic interpolation. A mixing ratio adjuster adjusts the mixing ratio so that the mixing ratio of the interpolation pixels of the static interpolation becomes larger to generate a third mixing ratio. An interpolation data generator mixes the interpolation pixels of the dynamic interpolation and the static interpolation with each other in response to the third mixing ratio.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: February 9, 2021
    Assignee: JVCKENWOOD CORPORATION
    Inventors: Maki Takami, Atsushi Yoshida
  • Patent number: 10880552
    Abstract: The present invention provides a method for performing bidirectional prediction on a current block by using a weight index, the method comprising the steps of: determining whether the number of pixels of the current block is less than or equal to a threshold number of pixels; determining a weight index or a weight value of the current block on the basis of a weight index of a neighboring block if the number of pixels of the current block is less than or equal to the threshold number of pixels; obtaining a bidirectional predicted value for the current block on the basis of the weight index or the weight value of the current block; and restoring the current block by using the bidirectional predicted value, wherein the threshold number of pixels indicates a maximum number of pixels within a block necessary to share a weight index between blocks.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: December 29, 2020
    Assignee: LG ELECTRONICS INC.
    Inventors: Jaeho Lee, Hyeongmoon Jang
  • Patent number: 10869057
    Abstract: Coding techniques for a video image compression system involve improving an image quality of a sequence of two or more bi-directionally predicted intermediate frames, where each of the frames includes multiple pixels. One method involves determining a brightness value of at least one pixel of each bi-directionally predicted intermediate frame in the sequence as an equal average of brightness values of pixels in non-bidirectionally predicted frames bracketing the sequence of bi-directionally predicted intermediate frames. The brightness values of the pixels in at least one of the non-bidirectionally predicted frames is converted from a non-linear representation.
    Type: Grant
    Filed: January 24, 2019
    Date of Patent: December 15, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventor: Gary A. Demos
  • Patent number: 10856006
    Abstract: A method and system for motion vector refinement in a search space for multi-reference inter-prediction are provided. Two or more reference pictures are selected, one of those used for motion vector refinement. Based on an initial estimate of a motion vector to the reference picture for motion vector refinement, a search space in this reference image is constructed. Using template matching, the first motion vector is refined. The second motion vector to another reference picture is calculated using its initial estimate, the initial estimate of the first motion vector and the refined first motion vector. The search spaces used in template matching in different iterations overlap.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: December 1, 2020
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Zhijie Zhao, Anand Meher Kotra, Han Gao
  • Patent number: 10848662
    Abstract: Provided is an image processing device including a global motion detection unit configured to detect a global motion indicating a motion of an entire image, a local motion detection unit configured to detect a local motion indicating a motion of each of areas of an image, and a main subject determination unit configured to determine a main subject based on the global motion and the local motion.
    Type: Grant
    Filed: April 6, 2017
    Date of Patent: November 24, 2020
    Assignee: Sony Corporation
    Inventor: Masaya Kinoshita
  • Patent number: 10805638
    Abstract: A method for coding a digital image divided into blocks. The method includes, for a current block: processing the current block to provide a vector of transformed coefficients; selecting a sequence of M signs of coefficients to be predicted in the coefficient vector, M being an integer greater than or equal to 2; predicting values of the signs from a plurality of assumptions of combinations and a cost function; and for a sign of the sequence, coding an indicator representing a difference between its actual value and its predicted value. The predicting includes, for at least one second, current assumption: obtaining a pixel vector associated with the current assumption, by linear combination of at least one pixel vector associated with a first assumption and at least one pattern vector obtained from the vector of transformed coefficients; an calculating the cost function for the current assumption from the pixel vector obtained.
    Type: Grant
    Filed: September 12, 2017
    Date of Patent: October 13, 2020
    Assignee: B<>COM
    Inventors: Felix Henry, Gordon Clare
  • Patent number: 10743018
    Abstract: Several methods and systems for estimating motion in a plurality of multimedia pictures are disclosed. In an embodiment, at least one temporal distance between a multimedia picture and one or more reference pictures corresponding to the multimedia picture in a capture order associated with the plurality of multimedia pictures is computed. The at least one temporal distance is computed subsequent to an encoding of the multimedia picture. At least one motion estimation parameter is determined based on the at least one temporal distance. Motion associated with a subsequent multimedia picture to be encoded is estimated based on the at least one motion estimation parameter.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: August 11, 2020
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Arun Shankar Kudana, Soyeb Nagori
  • Patent number: 10735773
    Abstract: Techniques for coding video data are described that maintain high precision coding for low motion video content. Such techniques include determining whether a source video sequence to be coded has low motion content. When the source video sequence contains low motion content, the video sequence may be coded as a plurality of coded frames using a chain of temporal prediction references among the coded frames. Thus, a single frame in the source video sequence is coded as a plurality of frames. Because the coded frames each represent identical content, the quality of coding should improve across the plurality of frames. Optionally, the disclosed techniques may increase the resolution at which video is coded to improve precision and coding quality.
    Type: Grant
    Filed: June 4, 2015
    Date of Patent: August 4, 2020
    Assignee: Apple Inc.
    Inventors: Peikang Song, Jae Hoon Kim, Xiaosong Zhou, Chris Y. Chung, Hsi-Jung Wu, Dazhong Zhang
  • Patent number: 10659725
    Abstract: The present invention discloses an image processing device and an image processing method. The image processing method includes steps of: referring to multiple frames or an auxiliary data associated with the frames to determine whether the frames contain substantially the same frames; selecting the frames according to whether the frames contain substantially the same frames to generate multiple selected frames; and performing video processing on the selected frames. When the frames do not contain substantially the same frames, the selected frames are the same as the frames, and when the frames contain substantially the same frames, the selected frames are part of the frames.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: May 19, 2020
    Assignee: REALTEK SEMICONDUCTOR CORPORATION
    Inventors: Chia-Wei Yu, Cheng-Hsin Chang, Chun-Hsing Hsieh, Chi-Hsiung Cheng
  • Patent number: 10614554
    Abstract: The present invention discloses a contrast adaptive video denoising system, which comprises a frame memory for buffering the filtered frame; an inter-frame difference calculating module for inter-frame difference of the current input frame of the video and a previous filtered frame in the frame memory; a contrast calculating module for calculating the local contrast of the current input frame and inputting it into a low-contrast region detection module, a calculated low-contrast region confidence together with the inter-frame difference are input into a motion detection module to calculate the motion probability for each pixel. The motion adaptive temporal filtering module performs motion adaptive temporal filtering by using the current input frame of the video and the previous filtered frame in the frame memory as well as the motion probability of each pixel, and finally outputs the current filtered frame to store in the frame memory.
    Type: Grant
    Filed: April 16, 2015
    Date of Patent: April 7, 2020
    Assignee: Beijing SmartLogic Technology Ltd.
    Inventors: Ruoshan Guo, Lu Ye, Rui Han, Renjun Tang, Yang Luo, Fengli Yan, Xiaoli Tang
  • Patent number: 10546521
    Abstract: Architecture and designs of modulating both amplitude and phase at the same time in spatial light modulation are described. According to one aspect of the present invention, light propagation is controlled in two different directions (e.g., 0 and 45 degrees) to perform both amplitude modulation and phase modulation at the same time in liquid crystals. In one embodiment, a mask is used to form a pattern, where the pattern includes an array of alignment cells or embossed microstructures, a first group of the cells are aligned in the first direction and a second group of the cells are aligned in the second direction. Depending on applications, two cells from the first group and the second group may correspond to a single pixel or two neighboring pixels, resulting in amplitude modulation and phase modulation within the pixel or within an array of pixels.
    Type: Grant
    Filed: April 19, 2019
    Date of Patent: January 28, 2020
    Inventors: Darwin Hu, Cheng Hsing Liao
  • Patent number: 10354423
    Abstract: A calculating device includes a receiver-and-transmitter and a processor. The receiver-and-transmitter is configured to communicate with a server. The processor performs processes including: transmitting (i) an increment of an independent variable per one display dot according to a variance range of the independent variable and the number of display dots on a screen, (ii) a function expression of the independent variable, and (iii) the variance range of the independent variable, to the server; receiving coordinate data of each display dot for generating a graph in a graph display range on the screen, from the server; and displaying a graph image generated at each display dot of the graph display range based on the coordinate data.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: July 16, 2019
    Assignee: CASIO COMPUTER CO., LTD.
    Inventors: Makoto Ozawa, Naoki Akae, Hirokazu Tanaka, Miki Suzuki
  • Patent number: 10356417
    Abstract: Techniques related to video coding perform by using projected motion vectors.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: July 16, 2019
    Assignee: Intel Corporation
    Inventor: Sean J. Lawrence
  • Patent number: 10348966
    Abstract: A control apparatus includes a signal readout unit 15 which reads out a frame image obtained from an image pickup device while the frame image is divided into a plurality of different regions, an image information calculating unit 16 which calculates image information based on an image signal of each of the plurality of different regions obtained from the signal readout unit, and an adjusting unit 17 which determines a target adjustment value of an image pickup unit including an image pickup optical system and the image pickup device based on the image information during capturing the frame image.
    Type: Grant
    Filed: April 28, 2016
    Date of Patent: July 9, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Koichi Washisu, Masafumi Kimura, Fumihiro Kajimura
  • Patent number: 10147350
    Abstract: Techniques for displaying a video or images in perceived better resolution are described. An input image is expanded into two frames based on the architecture of sub-pixels. A first frame is derived from the input image while the second frame is generated based on the first frame. These two frames are of equal size to the input image and displayed alternatively at twice the refresh rate of the input image.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: December 4, 2018
    Inventors: Darwin Hu, Tsunglu Syu
  • Patent number: 10148882
    Abstract: Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: December 4, 2018
    Assignee: GoPro, Inc.
    Inventors: Paul Mobbs, Scott Patrick Campbell, David A. Newman, Kasturi Rangam, Sumit Chawla
  • Patent number: 10019967
    Abstract: There is provided an image processing apparatus including an image reception unit configured to receive an image with markers including a sub image and marker pixels each indicating, using a pixel value, a combining ratio of a main image and the sub image that is combined with the main image, a combining ratio acquisition unit configured to acquire the combining ratio indicated by a pixel value of the marker pixel in the image with markers, and a combining unit configured to combine the main image and the sub image based on the acquired combining ratio.
    Type: Grant
    Filed: March 12, 2014
    Date of Patent: July 10, 2018
    Assignee: Saturn Licensing LLC
    Inventors: Takumi Takahashi, Nobuyuki Asakura, Etsuro Yamauchi, Junya Kameyama
  • Patent number: 9972070
    Abstract: Low spatial frequencies of an original image and an upscaled filtered image are analyzed. Differences will be observed in the low frequency components of the two images in the general case since the pixel art upscaler filter as a side effect introduces low frequency changes. A modification to images produced by the PAU is applied to attempt to match the brightness of the original images in the low frequency spectrum. From a viewer perspective (e.g., based on typical blurring visual effects), the original image and the modified filtered image will look the same—demonstrating that there is no low frequency brightness creep or resulting increased photosensitivity concerns.
    Type: Grant
    Filed: June 24, 2013
    Date of Patent: May 15, 2018
    Assignee: Nintendo Co., Ltd.
    Inventors: Sébastien Guido, Janos Boudet
  • Patent number: 9961367
    Abstract: A spatial prediction method capable of reducing the complexity of spatial prediction includes: detecting an edge (E) overlapping the current block by obtaining a horizontal gradient (Gy) and a vertical gradient (Gx) between pixels within a block adjacent to the current block; calculating an integer slope of the edge; determining, for each pixel position within the current block, a sub-pel position being an intersection between (i) a line that has the integer slope and passes through the pixel position and (ii) a boundary of the adjacent block; and predicting, for each pixel position, a pixel value at the pixel position based on a pixel value interpolated in the sub-pel position, wherein the boundary of the adjacent block is a row or a column that is the closest to the current block, among rows or columns of pixels included in the adjacent block.
    Type: Grant
    Filed: February 7, 2017
    Date of Patent: May 1, 2018
    Assignee: SUN PATENT TRUST
    Inventors: Virginie Drugeon, Youji Shibahara, Takahiro Nishi, Hisao Sasai, Kyoko Tanikawa
  • Patent number: 9860531
    Abstract: An encoding method, a decoding method, an encoding apparatus, a decoding apparatus, for a video image. The encoding method includes: determining an optimal integrated candidate block for a current block based on a motion vector integration technology; determining, based a prediction direction of the optimal integrated candidate block, a motion vector derivation mode that needs to be used by a decoder; correcting a motion vector of the current block based on the motion vector derivation mode; and determining a residual between a predicted value and an original value of the current block based on the corrected motion vector, thereby encoding the current block. According to the technical solutions, a more accurate predicted value is obtained by correcting the motion vector, and a smaller residual is generated, thereby improving encoding efficiency, avoiding an increase in data bandwidth, improving decoding quality, and reducing calculation complexity.
    Type: Grant
    Filed: September 9, 2013
    Date of Patent: January 2, 2018
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Sixin Lin, Mingyuan Yang
  • Patent number: 9819900
    Abstract: Method and apparatus for de-interlacing a television signal are provided. The method includes: determining whether a pixel to be interpolated is in a strictly static mode; if it is in the strictly static mode, obtaining a pixel value of a first pixel in a previous field which corresponds to the pixel to be interpolated, and setting a pixel value of the pixel to be interpolated to be equal to the pixel value of the first pixel; if it is not in the strictly static mode, determining gradient bands along a plurality of directions by taking the pixel to be interpolated as a center, determining a direction of the pixel to be interpolated based on the gradient bands, and setting the pixel value of the pixel to be interpolated by interpolation based on the direction. Accuracy of the pixel value of the pixel to be interpolated may be improved.
    Type: Grant
    Filed: August 11, 2016
    Date of Patent: November 14, 2017
    Assignee: SPREADTRUM COMMUNICATIONS (SHANGHAI) CO., LTD.
    Inventors: Hong Zhou, Hu Wei, Xiaowei Luo, Sen Wang, Minjie Chen, Jun Zhu, Duan Xue, Fuhuei Lin
  • Patent number: 9641861
    Abstract: An integrated circuit capable of video processing and a method thereof is disclosed. The integrated circuit comprises an image information generator, an adaptive motion vector (MV) candidate generator, and a block matching unit. The image information generator receives reference and current video data to determine image information. The adaptive MV candidate generator, coupled to the image information generator, receives the reference and current video data to generate spatial and temporal MV candidates, and generates an updated MV candidate based on the image information. The block matching unit, coupled to the adaptive MV candidate generator, receives the spatial and temporal MV candidates and the updated MV candidate and performs block matching to determine an output MV therefrom.
    Type: Grant
    Filed: January 25, 2008
    Date of Patent: May 2, 2017
    Assignee: MEDIATEK INC.
    Inventors: Te-Hao Chang, Siou-Shen Lin, Chin-Chuan Liang
  • Patent number: 9565428
    Abstract: A method and apparatus for chroma intra prediction for a current chroma block with reduced line memory requirement are disclosed. The chroma intra predictor is derived from reconstructed luma pixels of a current luma block using a model with parameters. In various embodiments according to the present invention, the derivation of the parameters relies on a reconstructed luma pixel set corresponding to neighboring reconstructed luma pixels from causal luma neighboring areas of the current luma block, wherein said causal luma neighboring areas include a first area corresponding to reconstructed luma pixels above a horizontal luma block boundary on a top side of the current luma block, and wherein the reconstructed luma pixels from the first area that are included in the reconstructed luma pixel set are from a luma pixel line immediately above the horizontal luma block boundary.
    Type: Grant
    Filed: June 15, 2012
    Date of Patent: February 7, 2017
    Assignee: MEDIATEK SINGAPORE PTE. LTD.
    Inventors: Mei Guo, Xun Guo, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9552630
    Abstract: Motion de-blurring systems and methods are described herein. One motion de-blurring system includes an image sensing element, one or more motion sensors in an imaging device, a lens element that undergoes motion during a capture of an image by the sensing element, and a de-blurring element to de-blur the image captured by the sensing element via de-convolving a Point Spread Function (PSF).
    Type: Grant
    Filed: February 10, 2014
    Date of Patent: January 24, 2017
    Assignee: Honeywell International Inc.
    Inventors: Scott McCloskey, Kelly Muldoon, Sharath Venkatesha
  • Patent number: 9510008
    Abstract: A method, system and computer program for decompressing video data, storing the compressed video data in such a way that random access is possible and the data can be mapped efficiently into existing memory systems and interface protocols. The compression is accomplished via lossless compression using an algorithm optimized for video data. Due to the compressed format, data transmission consumes less bandwidth than using uncompressed data and prevents degradation in the decoded video.
    Type: Grant
    Filed: February 7, 2014
    Date of Patent: November 29, 2016
    Assignee: ENTROPIC COMMUNICATIONS, LLC
    Inventors: Matthew Damian Bates, Mark Alan Baur
  • Patent number: 9438908
    Abstract: A method to produce a frame of video data includes receiving original frame true motion information, original frame object boundary information, and original frame layer information for at least two original frames of video data, and generating interpolation phase block-level motion and interpolation phase pixel-level layer information from the original frame block-level true motion information, original frame pixel-level object boundary information, and original frame pixel-level layer information for the original frame.
    Type: Grant
    Filed: February 25, 2014
    Date of Patent: September 6, 2016
    Assignee: PIXELWORKS, INC.
    Inventors: Xiaojie Sheng, Neil Woodall, Bob Zhang, Guohua Cheng, Yue Ma
  • Patent number: 9430713
    Abstract: According to an aspect of the present invention, there is provided a method of detecting a repetitive pattern. The method includes: clustering a plurality of pixels that form an input image according to color and obtaining one or more color layers composed of pixels included in each cluster; selecting one or more effective layers from the color layers, wherein each of the effective layers includes a predetermined number or more of pixel components, each composed of a plurality of pixels and having a predetermined shape or a predetermined size of area; selecting a unit pattern repeatedly disposed at different locations in each effective layer from the pixel components included in each effective layer; calculating distances between the unit patterns in each effective layer; and calculating a repetition cycle of the unit pattern of the input image based on the calculated distances in each effective layer.
    Type: Grant
    Filed: March 23, 2016
    Date of Patent: August 30, 2016
    Assignee: SAMSUNG SDS CO., LTD.
    Inventors: Sudhakar Sah, Sang Hak Lee, Jong Hang Kim, Seong Jong Ha, Yu Ri Ahn, Yeon Hee Kwon
  • Patent number: 9432624
    Abstract: This disclosure describes an apparatus (106) for improving performance of a multipoint control unit (210). The apparatus (106) provides a video stream manipulator (208) and a multipoint control unit (210). The video stream manipulator (208) may encode one or more video streams in a predetermined video codec standard separately. Each of the encoded video streams includes at least one encoded video frame made of a plurality of macroblocks, where the macroblocks are segregated into a predetermined number of macroblock lines. The multipoint control unit (210) may assemble predetermined number of macroblock lines from each of the encoded video streams in a predetermined composition.
    Type: Grant
    Filed: December 29, 2014
    Date of Patent: August 30, 2016
    Assignee: ClearOne Communications Hong Kong Ltd.
    Inventor: Oren J. Maurice
  • Patent number: 9384561
    Abstract: A method of selecting at least one region of interest within an image includes the selection of a preliminary region having a preliminary border. The selection uses one or more characteristics of the image. An inner probability distribution of color components is determined within the preliminary region and an outer probability distribution of color components outside the preliminary region. The preliminary border is adjusted in dependence on the probability distributions, the adjusted border defining the at least one region of interest.
    Type: Grant
    Filed: January 29, 2015
    Date of Patent: July 5, 2016
    Assignee: APICAL LTD
    Inventor: Ilya Romanenko
  • Patent number: 9349204
    Abstract: Scene information describing a three-dimensional virtual space and/or virtual objects within the virtual space may be used to generate an animated video. A user interface may be presented to a user. The user interface may be configured to receive user entry and/or selection of parameter values for one or more video parameters. The user-provided parameter values may facilitate one or more of determining frames of the video, rendering images for the frames, generating a video using the rendered images, and/or other operations.
    Type: Grant
    Filed: August 7, 2015
    Date of Patent: May 24, 2016
    Assignee: HOUSE OF MOVES, INC.
    Inventors: Alberto Menache, Kilo Akuna
  • Patent number: 9288432
    Abstract: A motion vector detector detects, using pixel data in at least two real frames in an input video signal, a motion vector MV1 necessary for generating interpolated pixel data forming an interpolated frame to be inserted between the two real frames. A motion vector corrector corrects the motion vector MV1 to decrease the magnitude of motion vector MV1 when the magnitude of motion vector MV1 exceeds a predetermined threshold, and outputs it as a motion vector MV3.
    Type: Grant
    Filed: March 9, 2011
    Date of Patent: March 15, 2016
    Assignee: JVC KENWOOD CORPORATION
    Inventors: Tomoyuki Shishido, Hiroshi Noguchi, Hideki Aiba
  • Patent number: 9277168
    Abstract: A new motion adaptive deinterlacing method and apparatus detects motion corresponding to a pixel to be interpolated. The method and apparatus generates a subframe level motion map based on at least a portion of a current field and at least a portion of a plurality of previous fields. Based on the generated subframe level motion map, the apparatus and method generates a plurality of motion vectors associated with the subframe level motion map by applying a plurality of motion masks, associated with the pixel to be interpolated, to the subframe level motion map. The apparatus and method further generates deinterlaced content by adaptively interpolating the pixel to be interpolated for the current field based on the plurality of motion vectors produced by applying a plurality of motion masks to the subframe level motion map.
    Type: Grant
    Filed: July 16, 2012
    Date of Patent: March 1, 2016
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Rex George, Daniel P. Shimizu, Sateesh Lagudu, Niranjan P. Dasiga, Sai Kishore Reddipalli
  • Patent number: 9264128
    Abstract: A receiving circuit, method for receiving a signal, and use of a detection circuit and a control circuit of a receiving circuit of a node of a radio network is provided to deactivate an analog signal processing and/or determination of digital data from a signal received over an antenna of the node, when a stored current frame of the digital data has been recognized as valid, and to activate the analog signal processing and/or the determination, when the transmission of the current frame over an interface of the control circuit has been confirmed, whereby the control circuit is connected to the detection circuit and/or an input circuit for deactivation and activation, and whereby the detection circuit is formed to determine the digital data from the received signal.
    Type: Grant
    Filed: January 28, 2013
    Date of Patent: February 16, 2016
    Assignee: Atmel Corporation
    Inventors: Sascha Beyer, Tilo Ferchland, Thomas Hanusch
  • Patent number: 9262809
    Abstract: Methods and apparatus for filtering noise of low frequency from an image of the surface characteristics of an object expressed with reference to orthogonal first and second axis and obtained with linear light scanning, involve calculating a difference between pixel values of an image column vector along the second axis adjacent a selected reference image column vector and respective pixel values of the selected reference image column vector to obtain a pixel difference vector. The pixel difference values not mainly associated with a corresponding atypical change of surface characteristics as compared with noise are then selected, and a mean value from the selected pixel difference values are calculated as an estimated value of the noise. The estimated noise value are subtracted from the adjacent image column vector to obtain a corrected image column vector.
    Type: Grant
    Filed: April 4, 2014
    Date of Patent: February 16, 2016
    Assignee: CENTRE DE RECHERCHE INDUSTRIELLE DU QUEBEC
    Inventors: Richard Gagnon, Jean-Pierre Couturier
  • Patent number: 9213901
    Abstract: A method and system for video-based object tracking includes detecting an initial instance of an object of interest in video captured of a scene being monitored and establishing a representation of a target object from the initial instance of the object. The dominant motion trajectory characteristic of the target object are then determined and a frame-by-frame location of the target object can be collected in order to track the target object in the video.
    Type: Grant
    Filed: September 4, 2013
    Date of Patent: December 15, 2015
    Assignee: Xerox Corporation
    Inventors: Edgar A. Bernal, Wencheng Wu, Thomas F. Wade, Daniel Hann
  • Patent number: 9215465
    Abstract: A spatial prediction method capable of reducing the complexity of spatial prediction includes: detecting an edge (E) overlapping the current block by obtaining a horizontal gradient (Gy) and a vertical gradient (Gx) between pixels within a block adjacent to the current block; calculating an integer slope of the edge; determining, for each pixel position within the current block, a sub-pel position being an intersection between (i) a line that has the integer slope and passes through the pixel position and (ii) a boundary of the adjacent block; and predicting, for each pixel position, a pixel value at the pixel position based on a pixel value interpolated in the sub-pel position, wherein the boundary of the adjacent block is a row or a column that is the closest to the current block, among rows or columns of pixels included in the adjacent block.
    Type: Grant
    Filed: July 30, 2014
    Date of Patent: December 15, 2015
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Virginie Drugeon, Youji Shibahara, Takahiro Nishi, Hisao Sasai, Kyoko Tanikawa
  • Patent number: 9131127
    Abstract: A method and apparatus is provided for reconstructing video frames that include missing pixels as a result of video stabilization techniques to compensate for camera movement and/or zooming. In one example, the method and apparatus caches transformed frames of video, identifies coordinates of missing pixels in a current transformed frame, and sequentially processes, for only the missing pixel coordinates, the cached transformed frames in reverse chronological order to identify pixels at coordinates in the cached transformed frames having valid data and corresponding to one of the missing pixel coordinates. Upon identifying a pixel having valid data at a coordinate in a cached transformed frame corresponding to a missing pixel coordinate, the method and apparatus inserts the valid data at the missing pixel coordinate.
    Type: Grant
    Filed: February 8, 2013
    Date of Patent: September 8, 2015
    Assignee: ATI TECHNOLOGIES, ULC
    Inventors: Yubao Zheng, Zingping Cao
  • Patent number: 9123115
    Abstract: This disclosure describes techniques for estimating a depth of image objects for a two-dimensional (2D) view of a video presentation. For example, an initial indication of depth (e.g., an optical flow) may be determined for a 2D view. The initial indication of depth may be used to estimate global motion, e.g., motion of an observer (e.g., camera), of the 2D view. The initial indication of depth may be modified based on the estimation of global motion to create a global motion-adjusted indication of depth. The global motion-adjusted depth indication may be used to create a depth map for the 2D view, which may be used to generate an alternative view of the video presentation that may be used to display a three-dimensional (3D) video presentation.
    Type: Grant
    Filed: November 23, 2010
    Date of Patent: September 1, 2015
    Assignee: Qualcomm Incorporated
    Inventors: Rong Zhang, Ying Chen, Marta Karczewicz
  • Patent number: RE46468
    Abstract: Methods for motion estimation with adaptive motion accuracy of the present invention include several techniques for computing motion vectors of high pixel accuracy with a minor increase in computation. One technique uses fast-search strategies in sub-pixel space that smartly searches for the best motion vectors. An alternate technique estimates high-accurate motion vectors using different interpolation filters at different stages in order to reduce computational complexity. Yet another technique uses rate-distortion criteria that adapts according to the different motion accuracies to determine both the best motion vectors and the best motion accuracies. Still another technique uses a VLC table that is interpreted differently at different coding units, according to the associated motion vector accuracy.
    Type: Grant
    Filed: January 31, 2014
    Date of Patent: July 4, 2017
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Jordi Ribas-Corbera, Jiandong Shen