Including Motion Vector Patents (Class 348/416.1)
  • Patent number: 11354848
    Abstract: Systems, apparatuses and methods may provide for technology that assigns a first shading rate to a first region of a frame. The technology further assigns a second shading rate to a second region of the frame. The first shading rate indicates that the first region will be rendered at a first resolution, and the second shading rate indicates that the second region will be rendered at a second resolution less than the first resolution. The first and second shading rates are associated with a selection based on a motion vector that corresponds to motion of an object. The object is rendered as part of a scene that includes the first region rendered at the first resolution and the second region rendered at the second resolution.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: June 7, 2022
    Assignee: Intel Corporation
    Inventors: Prasoonkumar Surti, Karthik Vaidyanathan, Atsuo Kuwahara, Hugues Labbe, Sameer Kp, Jonathan Kennedy, Joydeep Ray, Travis T. Schluessler, John H. Feit, Nikos Kaburlasos, Jacek Kwiatkowski, Tomer Bar-On, Carsten Benthin, Adam T. Lake, Vasanth Ranganathan, Abhishek R. Appu
  • Patent number: 11315211
    Abstract: The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine a motion estimation priority for one or more regions in a frame. In some aspects, each of the one or more regions can include a group of pixels. Additionally, the apparatus can adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels. The apparatus can also perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.
    Type: Grant
    Filed: August 7, 2020
    Date of Patent: April 26, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Samuel Benjamin Holmes, Jonathan Wicks
  • Patent number: 10924625
    Abstract: An image processing system and method are described which use entropy values in processing the image. For each of a plurality of segments of an image, the segment is considered as a stream of bits and a bit difference is computed between pairs of sequential bit sequences in the stream of bits. An entropy value of the segment is computed as a function of the bit differences. The image is processing based on the computed entropy values, which may include compressing some or all of the image segments using an acceleration factor that is based on the computed entropy value for the segment. In this way, differences in entropy, which correlate with the compressibility of the image segment, can ensure an optimal compression of the segment, or in some cases, no compression.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: February 16, 2021
    Assignee: XEROX CORPORATION
    Inventors: Louis B. La, David J. Metcalfe
  • Patent number: 10873755
    Abstract: Techniques related to motion estimation with neighbor block pattern for video coding.
    Type: Grant
    Filed: June 9, 2016
    Date of Patent: December 22, 2020
    Assignee: Intel Corporation
    Inventors: Zhipin Deng, Iole Moccagatta, Lidong Xu, Wenhao Zhang, Yi-Jen Chiu
  • Patent number: 10860877
    Abstract: The embodiments of the present application provide a method, apparatus and system for processing an image of a logistics parcel, which can capture an image with a barcode in a proper position. The method comprises: identifying a barcode in a Nth image to acquire position of the barcode in the Nth image, and placing the position into a queue; predicting a position that the barcode would locate in a (N+1)th image to be captured; identifying a barcode in the (N+1)th image to acquire position of the barcode relative to the (N+1)th image; determining whether the position of the barcode in the (N+1)th image matches with the predicted position; if so, placing the information of the barcode in the (N+1)th image into the queue; and after the parcel leaves the field of view, selecting, according to a preset optimal position of the barcode in an image and the information of the barcode placed into the queue, an optimal image from all images captured for the parcel.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: December 8, 2020
    Assignee: Hangzhou Hikvision Digital Technology Co., Ltd.
    Inventors: Qiming Wan, Xing Shi, Mingling Zhu
  • Patent number: 10796438
    Abstract: A method for tracking a target profile in a video includes: determining position information of corner points of the target profile and parameter information of a first edge formed by adjacent corner points in a previous image frame adjacent to a current image frame; tracking corner points of the target profile in the previous image frame to acquire position information of the corner points of the target profile in the current image frame to determine parameter information of a second edge; predicting to acquire predicted parameter information, and generating candidate target profiles based on the predicted parameter information, in response to determining that a similarity between the first edge and a second edge corresponding to the first edge being less than a first preset threshold; and determining a final position of the target profile in the current image frame based on the candidate target profiles.
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: October 6, 2020
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Jian Wang, Shilei Wen, Xiao Liu, Xubin Li, Errui Ding
  • Patent number: 10735142
    Abstract: A computer system is provided for exchanging data with a second computer system using a one-way protocol. The computer system includes a communication port, a memory configured to store instructions, and a processor disposed in communication with the memory. The processor upon execution of the instructions is configured to receive via the communication port a plurality of data packets of a data transmission transmitted in accordance with a one-way protocol from the second computer system, the data transmission representing a data structure, each data packet having a header that indicates a data type of the data transmission, and determine if a data packet of the data transmission is missing based on the data type and the number of data packets received.
    Type: Grant
    Filed: May 29, 2015
    Date of Patent: August 4, 2020
    Assignee: Goodrich Corporation
    Inventor: Jonathan C. Jarok
  • Patent number: 10685542
    Abstract: This document describes a monitoring system for detecting conditions at a physical premises. The monitoring system can receive, by a computing system, from a video sensor system deployed at the physical premises, block-based encoded video data encoded with a block-based encoder in the video sensor system. The monitoring system can parse, by the computing system, the block-based encoded video data to extract from the block-based encoded data macroblock arrays that correspond to areas of a frame of video data. The monitoring system can reduce, by the computing system, the macroblock arrays to one or more data clusters. The monitoring system can apply, by the computing system, a pattern recognition algorithm to the one or more data clusters to detect patterns in the one or more data clusters.
    Type: Grant
    Filed: April 26, 2016
    Date of Patent: June 16, 2020
    Assignee: SENSORMATIC ELECTRONICS, LLC
    Inventors: James Trani, Irene Lam
  • Patent number: 10630993
    Abstract: An apparatus includes a first holding unit configured to hold, in a reference image, first reference pixels in a search range including a block corresponding to a first block as a coding target in the input image, a first search unit configured to search for a motion vector of a prediction block included in the first block, using the first reference pixels, a second holding unit configured to hold, in the reference image, second reference pixels in a search range including a block corresponding to a second block as a coding target, a second search unit configured to search for a motion vector of a prediction block included in the second block, using the second reference pixels, and a transfer unit configured to read, from among the first reference pixels, a reference pixel to be used by the second search unit for the search.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: April 21, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Satoshi Naito
  • Patent number: 10552962
    Abstract: Techniques related to improved video frame segmentation based on motion, color, and texture are discussed. Such techniques may include segmenting a video frame of a video sequence based on differencing global motion or dominant motion from local motion in the video frame.
    Type: Grant
    Filed: April 27, 2017
    Date of Patent: February 4, 2020
    Assignee: Intel Corporation
    Inventors: Daniel Socek, Atul Puri
  • Patent number: 10536726
    Abstract: In a video coding system, an encoder may include a coding engine to predictively code input video, a decoder to reconstruct reference pictures generated by the coding engine, a reference picture cache to store the reconstructed reference pictures, a patch cache to store prediction patches generated from other sources, and a prediction search unit to search among the reference picture cache and the patch cache to generate prediction references for use by the coding engine while coding input video. The prediction patches may be assembled from a variety of sources including: predefined image content, reference pictures being evicted from the reference picture cache, image content of prior coding sessions and image data stored by applications on a common terminal where the encoder resides. A decoder may store prediction patches in its own patch cache for synchronous decoding.
    Type: Grant
    Filed: May 3, 2012
    Date of Patent: January 14, 2020
    Assignee: APPLE INC.
    Inventors: Xiaosong Zhou, James Oliver Normile, Hsi-Jung Wu
  • Patent number: 10444860
    Abstract: There is provided a failure identification method of an optical navigation device including the steps of: constructing a fixed noise map according to image frames captured by an image sensor; calculating a feature value of the fixed noise map; identifying whether the fixed noise map is uniform or not according to the feature value; and generating an alert signal when the fixed noise map is non-uniform for indicating failure of the optical navigation device.
    Type: Grant
    Filed: June 8, 2018
    Date of Patent: October 15, 2019
    Assignee: PIXART IMAGING INC.
    Inventor: Willie Song
  • Patent number: 10395378
    Abstract: A method of evaluating motion estimation between a pair of digitized images includes receiving a distance map between a source block in a source image and all the blocks in a search area in a target image, scanning each column of the distance map, and saving indices of a minimum distance value for each column, scanning each row of the distance map, and saving indices of a minimum distance value for each row, locating candidate lines that pass through at least some local minima points that correspond to locations in the distance map of the minimum distance value in each of the columns or the minimum distance value in each of the rows determining a confidence level for each candidate line that passes through at least some of the local minima points, and selecting those candidate lines whose confidence level is greater than a predetermined threshold value.
    Type: Grant
    Filed: July 11, 2017
    Date of Patent: August 27, 2019
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Idan Ram, Omry Sendik
  • Patent number: 10303976
    Abstract: Methods and systems are disclosed for increased speed of processing operations on data in two-dimensional arrays, and for detecting a feature in an image. A method for detecting a feature in an image comprises storing, in a set of data memories within a parallel processing system, first image data representing pixels of a first image. The method further comprises storing, in a memory of a host processor coupled to the parallel processing system, feature kernel data representing a set of weight matrices. A method for increased speed of processing operations on data in two-dimensional arrays comprises storing, in a set of data memories within a parallel processing system, first array data representing elements of a first array. The method further comprises, for each of multiple selected elements within the first array, performing a processing operation on the selected element to produce an output element corresponding to the selected element.
    Type: Grant
    Filed: July 24, 2016
    Date of Patent: May 28, 2019
    Assignee: Mireplica Technology, LLC
    Inventors: William M. Johnson, Toshio Nagata
  • Patent number: 10255683
    Abstract: Techniques are generally described for discontinuity detection. A first and second frame of video data representing a portion of a physical environment are received. The first and second frames are divided into first and second blocks of pixels, respectively. A set of matching blocks are determined by matching each block of the first blocks with a corresponding block of the second blocks. A difference value is determined for each pair of matching blocks of the set of matching blocks. A mean difference value for the set of matching blocks. The mean difference value is convolved with a convolution kernel. A determination is made that a result of the convolving the mean difference value with the convolution kernel exceeds a mean threshold value. A determination is made that a discontinuity between the first frame and the second frame is not due to motion in the physical environment.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: April 9, 2019
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Sharath Kumar Gopal, Rohith Mysore Vijaya Kumar
  • Patent number: 10250910
    Abstract: A method for temporal filtering based on motion detection on areas of different sizes includes computing a plurality of motion scores of a plurality of areas in a target picture in a sequence of pictures by motion detection of the areas between the target picture and a reference picture in the sequence of pictures, where the areas may be at least two overlapping areas of different sizes, computing a combined motion score by combining the plurality of motion scores, and generating a filtered picture by temporal filtering the target picture with the reference picture based on the combined motion score. At least one of (i) the motion scores and (ii) the filtered picture may be based on one or more gain settings in a circuit.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: April 2, 2019
    Assignee: Ambarella, Inc.
    Inventors: Elliot N. Linzer, Leslie D. Kohn
  • Patent number: 10185030
    Abstract: An automotive radar system includes a radar camera that captures a sequence of frames of radar images of a field of view of the radar. A boundary detector receives the radar data from the radar camera and detects object boundary data in the radar data. An image processor receives the radar data and the object boundary data and performs image analysis including image deblurring and generating response control signals based at least in part on the radar data and the object boundary data. Response equipment implements one or more response actions based on the response control signals. Object boundary detection includes performing pixel-level Doppler analysis to associate pixel velocities to pixels of the radar data and identifying discontinuities in the pixel velocities. Response equipment may include, for example, one or more of a navigation display, collision avoidance warning, automatic cruise control, automatic braking, and automatic steering.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: January 22, 2019
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Inna Stainvas Olshansky, Igal Bilik, Oded Bialer
  • Patent number: 10051147
    Abstract: The present disclosure is directed to systems, methods, and devices that enable monitoring of threshold values related to parameters within a printing device through the communication of one or more terminal devices and the printing device with a threshold subscription unit. The terminal devices transmit threshold values to be monitored to the threshold subscription unit. The threshold subscription unit then orders those threshold values into a queue and assigns one to the printing device. Upon receiving an alert from the printing device that a parameter value related to the assigned threshold value has been reached, the threshold subscription unit notifies the terminal devices of this and assigns the next threshold value in the queue to the printing device. This continues until all threshold values in the queue have been reached.
    Type: Grant
    Filed: September 29, 2015
    Date of Patent: August 14, 2018
    Assignee: KYOCERA DOCUMENT SOLUTIONS INC.
    Inventor: Oleksandr Osadchyy
  • Patent number: 10027982
    Abstract: The current application is directed to flexible methods for motion-vector-based encoding of macroblocks within video frames. The flexible methods for encoding video-frame macroblocks provide for segmentation of a video-frame block and encoding the segmented video-frame block by a segmented-block motion vector that includes a reference to a segmentation-defining region of a segmentation map and that also includes references to sources of intensity-and-color data for each segment. Segmented-block motion vectors provide for flexible segmentation-based encoding of video-frame blocks without sacrificing the coding efficiencies attendant with conventional motion-vector-based video encoding.
    Type: Grant
    Filed: October 19, 2011
    Date of Patent: July 17, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Dinei Florencio
  • Patent number: 10013078
    Abstract: There is provided a failure identification method of an optical navigation device including the steps of: constructing a fixed noise map according to image frames captured by an image sensor; calculating a feature value of the fixed noise map; identifying whether the fixed noise map is uniform or not according to the feature value; and generating an alert signal when the fixed noise map is non-uniform for indicating failure of the optical navigation device.
    Type: Grant
    Filed: April 11, 2014
    Date of Patent: July 3, 2018
    Assignee: PIXART IMAGING INC.
    Inventor: Willie Song
  • Patent number: 9977992
    Abstract: Points of interest are identified in an image to characterize that image by dividing the image tiles consisting of adjacent pixels; finding within each tile the position of a pixel with an extremum value and ascribing that extremal value to the tile; identifying a tile with an extremal value which is more extreme than that of all adjacent tiles; and selecting as a point of interest the position within the image of the pixel with the extremum value in that identified tile.
    Type: Grant
    Filed: October 30, 2015
    Date of Patent: May 22, 2018
    Assignee: Snell Advanced Media Limited
    Inventor: Jonathan Diggins
  • Patent number: 9967616
    Abstract: Aspects of a method and system for priority-based digital multi-stream decoding. A multi-stream decoder may be enabled to decode and present multiple streams of a multi-stream multimedia application, simultaneously. The multi-stream decoder may be enabled to determine a priority level for each of the received multiple streams of the multimedia application. A high-priority stream may be decoded and presented at a high frame rate and a relative high resolution level, while a lower-priority stream may be decoded and presented at a low frame rate and a relative low resolution level. The decoded frames may be presented in a picture-in-picture format. The priority level for each of the received multiple streams may depend on user input, a user profile, and/or a display capability.
    Type: Grant
    Filed: October 21, 2014
    Date of Patent: May 8, 2018
    Assignee: Avago Technologies General IP (Singapore) Pte. Ltd.
    Inventor: Jon Daniel Garrett
  • Patent number: 9918040
    Abstract: Methods and systems are described for displaying a thumbnail preview of video content. In an aspect, one or more mosaic images made up of thumbnails corresponding to frames of the video content at multiple time points can be loaded into the system or created by the methods described. In an aspect, the selected thumbnail, as well as any other thumbnails, can be selected in response to receiving a command (e.g., trick play request) from the viewer. The command can dictate the direction from the selected thumbnail that the next thumbnails will be selected. The command can also dictate the frequency with which thumbnails will be selected from the mosaic image. In an aspect, frames comprised of thumbnails can be encoded to create the video content.
    Type: Grant
    Filed: December 5, 2014
    Date of Patent: March 13, 2018
    Assignee: COMCAST CABLE COMUNICATIONS MAGAGEMENT, LLC
    Inventor: Joseph Lesh
  • Patent number: 9906814
    Abstract: A method for temporal filtering based on motion detection on areas of different sizes is disclosed. Step (A) may compute a first motion score of a first area in a target picture by motion detection of the first area between the target picture and a reference picture. Step (B) may compute a second motion score of a second area in the target picture by motion detection of the second area between the target picture and the reference picture. The first area and the second area are generally of different sizes. Step (C) may temporal filter the target picture with the reference picture based on the first motion score and the second motion score to generate a filtered picture. At least one of the first motion score, the second motion score and the filtered picture may be based on one or more gain settings in a circuit.
    Type: Grant
    Filed: March 25, 2015
    Date of Patent: February 27, 2018
    Assignee: Ambarella, Inc.
    Inventors: Elliot N. Linzer, Leslie D. Kohn
  • Patent number: 9858655
    Abstract: Embodiments of the present invention relate to method and apparatus for video anti-shaking. There is disclosed a method for use in a video anti-shaking, especially for real-time digital image stabilization, the method comprises: dividing at least one part of a current frame of a video into a plurality of regions (S301); performing a progressive local motion detection for each of the plurality of regions to determine a local motion vector for the region (S302, S303, S304); and determining a global motion vector for the current frame based on the local motion vectors for the plurality of regions (S305). There is also described a corresponding apparatus and user equipment. With embodiments of the present invention, the video anti-shaking processing can be done without any additional hardware. Moreover, embodiments of the present invention may quickly and effectively determine a motion vector and corresponding compensation.
    Type: Grant
    Filed: September 18, 2014
    Date of Patent: January 2, 2018
    Assignee: Nokia Technologies Oy
    Inventors: An Jiang, Feng Cui, Haitao Zhu, Yan Wang
  • Patent number: 9819952
    Abstract: Methods and apparatus are provided for embedded quantization parameter adjustment in video encoding and decoding. An apparatus includes an encoder for encoding picture data for at least a block in a picture. A quantization parameter, applied to one or more transform coefficients obtained by transforming a difference between an original version of the block and at least one reference block, is derived from reconstructed data corresponding to at least the block.
    Type: Grant
    Filed: September 29, 2010
    Date of Patent: November 14, 2017
    Assignee: Thomson Licensing DTV
    Inventors: Xiaoan Lu, Joel Sole, Peng Yin, Qian Xu, Yunfei Zheng
  • Patent number: 9756348
    Abstract: A video processing device for producing a frame of a merged digital video sequence. A memory storing a first and a second digital video sequence depicting the same scene. The first digital video sequence has a higher pixel density than the second digital video sequence. A scaler generating an up-scaled version having the same pixel density as the first video sequence. A decoder decoding a frame of the first digital video sequence and a skip block identifying a position for a skip block and a non-skip block in the frame of the first digital video sequence. A block extractor extracting a block of pixels from the frame of the second digital video sequence based on the skip block and a block of pixels from the frame of the first digital video sequence based on the non-skip block. A merging unit merging both extracted blocks to produce the merged video sequence.
    Type: Grant
    Filed: June 26, 2014
    Date of Patent: September 5, 2017
    Assignee: AXIS AB
    Inventor: Stefan Lundberg
  • Patent number: 9674547
    Abstract: To stabilize video (an image sequence), reconstructed block data and decoding information of a video frame are received by unit of macroblock from a decoding circuit. Global affine parameters are determined and provided based on the reconstructed block data and the decoding information, and the global affine parameters represent an affine transform of a frame. Stabilized block data are provided based on the global affine parameters by compensating the reconstructed block data for an affine motion corresponding to the affine transform.
    Type: Grant
    Filed: March 4, 2014
    Date of Patent: June 6, 2017
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Nyeong-Kyu Kwon, Yo-Won Jeong, Hideki Yamauchi, Woong-Hee Lee, Young-Beom Jung
  • Patent number: 9655498
    Abstract: A medical image displaying apparatus is provided that improves the workability of making a definitive diagnosis in capsule endoscopy. A medical image displaying apparatus of an embodiment is capable of displaying a virtual endoscopic image in a tube based on a viewpoint set inside the tube of the tubular body by using a three-dimensional image of the tubular body, and comprises a capsule endoscopic image storage and a display controller, and the capsule endoscopic image storage stores capsule endoscopic images acquired by a capsule endoscope passing inside the tube. The display controller displays the capsule endoscopic images based on the location of the viewpoint.
    Type: Grant
    Filed: May 31, 2012
    Date of Patent: May 23, 2017
    Assignees: TOSHIBA MEDICAL SYSTEMS CORPORATION, KABUSHIKI KAISHA TOSHIBA
    Inventors: Tomohiro Kawasaki, Nobuyuki Konuma
  • Patent number: 9648340
    Abstract: A method performed by a motion vector encoding apparatus for encoding a motion vector includes: determining a first motion vector and a second motion vector relating to a current block to be encoded; determining predicted motion vectors of the first motion vector and the second motion vector, respectively; calculating a first differential motion vector and a second differential motion vector; the first differential motion vector corresponding to a difference between the first motion vector and the predicted motion vector of the first motion vector, the second differential motion vector corresponding to a difference between the second motion vector and the predicted motion vector of the second motion vector; and encoding the first differential motion vector and the second differential motion vector, wherein the first motion vector and the second motion vector have different resolutions.
    Type: Grant
    Filed: July 15, 2013
    Date of Patent: May 9, 2017
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jeongyeon Lim, Joohee Moon, Yunglyul Lee, Haekwang Kim, Byeungwoo Jeon, Jongki Han, Juock Lee, Hyoungmee Park
  • Patent number: 9609298
    Abstract: Disclosed herein are an imaging apparatus, an imaging method, a recording medium, and a program which are capable of processing imaging data in a manner similar to that of a normal frame rate. Image data captured by a solid-state imaging element capable of performing imaging at a high resolution and a high frame rate is supplied to a memory control. The memory control, at the same time as writing the imaging data input from the imaging element in a frame memory, reads preceding frames of imaging data that are recorded on the frame memory, and sequentially respectively outputs them in parallel, as video image data items, for each frame, to respective camera signal processing units. In the camera signal processing units, a video output, a viewfinder output, codec units, and recording units, processing similar to that when a frame rate that is ¼ the imaging frame rate is executed.
    Type: Grant
    Filed: June 5, 2015
    Date of Patent: March 28, 2017
    Assignee: SONY CORPORATION
    Inventors: Seiji Kobayashi, Isao Ohashi, Yoshihiko Kuroki
  • Patent number: 9516313
    Abstract: A video encoding apparatus includes: a parameter calculator to calculate a brightness compensation parameter based on one or more first pixels adjacent to a current block and one or more second pixels adjacent to a motion prediction block obtained by using a prediction motion vector, the one or more second pixels being located in locations corresponding to the one or more first pixels; a target pixel selector to select one or more target pixels for a brightness compensation from pixels in a prediction block determined by a motion vector of the current block, by using pixels adjacent to the motion prediction block; and a predictive encoder to generate a compensated prediction block of the prediction block by applying the brightness compensation parameter to the selected one or more target pixels and to perform a predictive encoding on the generated compensated prediction block.
    Type: Grant
    Filed: December 30, 2013
    Date of Patent: December 6, 2016
    Assignee: SK TELECOM COM., LTD.
    Inventors: Jeongyeon Lim, Joong Gunn Park, Jongki Han, Yunglyul Lee, Joohee Moon, Haekwang Kim, Byeungwoo Jeon, Chanwon Seo
  • Patent number: 9432690
    Abstract: Methods and apparatus for facilitating motion estimation in video processing are provided. In one embodiment, search block is defined within one frame. A relative location of a corresponding block in another frame with respect to the search block is determined based on comparative searching at a predetermined granularity to produce a motion vector for the search block with a first precision. Correlation values are determined with respect to the search block for the corresponding block and for one block or more blocks defined at relative locations of less than the predetermined granularity with respect to the corresponding block in different directions. A refined motion vector for the search block with a second higher precision is determined based on the relative location of the block having a selected correlation value that is selected from among the determined correlation values.
    Type: Grant
    Filed: January 30, 2013
    Date of Patent: August 30, 2016
    Assignee: ATI Technologies ULC
    Inventors: Yubao Zheng, Boris Ivanovic, Allen J. Porter, Xingping Cao
  • Patent number: 9418280
    Abstract: An image segmentation method and an image segmentation device are provided. The method comprises receiving a video image of a dynamic movement of a target object, acquiring a full-image optical flow of the video image to estimate a first displacement of each pixel therein, acquiring a background optical flow of the video image to estimate a second displacement of a background pixel therein; comparing the first displacement with the second displacement to obtain a foreground region of the target object; extracting feature points in the video image in the foreground region, calculating a probability density of the feature points to determine a number of the target objects; performing visual tracking and movement trajectory analysis on the target object to track the same; performing stationary judgment and image segmentation on the target object according to an interframe displacement of the feature points, an interframe cutting window similarity and tracking box scaling.
    Type: Grant
    Filed: December 16, 2014
    Date of Patent: August 16, 2016
    Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
    Inventors: Jiawei Gu, Kai Yu
  • Patent number: 9407927
    Abstract: A motion vector coding unit executes processing including a neighboring block specification step of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step of coding the motion vector of the current block using the predictive motion vector.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: August 2, 2016
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe
  • Patent number: 9374532
    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.
    Type: Grant
    Filed: April 1, 2013
    Date of Patent: June 21, 2016
    Assignee: Google Inc.
    Inventors: Matthias Grundmann, Vivek Kwatra, Irfan Essa
  • Patent number: 9361523
    Abstract: A method and system for video-content based retrieval is described. A query video depicting an activity is processed using interest point selection to find locations in the video that are relevant to that activity. A set of spatio-temporal descriptors such as self-similarity and 3-D SIFT are calculated within a local neighborhood of the set of interest points. An indexed video database containing videos similar to the query video is searched using the set of descriptors to obtain a set of candidate videos. The videos in the video database are indexed hierarchically using a vocabulary tree or other hierarchical indexing mechanism.
    Type: Grant
    Filed: July 21, 2010
    Date of Patent: June 7, 2016
    Assignee: HRL Laboratories, LLC
    Inventors: Yang Chen, Swarup Medasani, Qin Jiang, David L. Allen, Tsai-Ching Lu
  • Patent number: 9350989
    Abstract: A moving image coding apparatus, a code amount control method, and a code amount control program enable appropriate code amount control to be performed in units shorter than frames. The moving image coding apparatus includes a coding unit, a quantization parameter determination unit, and a target code amount setting unit. The target code amount setting unit designates the number of macroblocks and sets a target code amount as a code amount to be allocated to the designated number of macroblocks. The quantization parameter determination unit calculates, for each macroblock, a quantization parameter to be used in quantization of a current macroblock based on a sum of absolute transformed differences SATD used in a motion estimate process. The moving image coding apparatus performs quantization using the calculated quantization parameter value.
    Type: Grant
    Filed: October 9, 2013
    Date of Patent: May 24, 2016
    Assignee: MegaChips Corporation
    Inventors: Takuya Hiraoka, Akira Okamoto
  • Patent number: 9317772
    Abstract: A method for tracking an object across a number of image frames comprises identifying a region containing the object in a first image frame to be stored as an exemplar view of the object. An appearance model (modified Exemplar View histogram is created based on the region in the first image frame and a background region in a second image frame, and the method determines at least one of a location and size of a predicted region for tracking the object in the second image frame using the appearance model. The method corrects at least one of the determined location and size of the predicted region in the second image frame in accordance with at least one of the location and size of the region in the first image frame corresponding to the exemplar view of the object.
    Type: Grant
    Filed: December 18, 2014
    Date of Patent: April 19, 2016
    Assignee: Canon Kabushiki Kaisha
    Inventor: Andrew John Shellshear
  • Patent number: 9237326
    Abstract: An imaging system and method are disclosed. In one aspect, the system includes an edge-detecting module detecting edge coordinates in a first image; first and second disparity-estimating modules respectively configured to obtain a first and second estimated disparity map, a cross-checking module configured to cross check the first estimated disparity map using the second estimated disparity map to identify occlusion pixels in the first estimated disparity map, an occlusion-refining module configured to refine the occlusion pixels by identifying at least a pixel under refinement on the first estimated disparity map as occluded based on the number of occlusion pixels in a refining base region, and a hole-filling module configured to fill the refined set of occlusion pixels. The imaging system improves the quality of a disparity map and controls the complexity of stereo-matching.
    Type: Grant
    Filed: June 27, 2012
    Date of Patent: January 12, 2016
    Assignee: IMEC Taiwan Co.
    Inventors: Chao Kang Liao, Chi Hao Wu
  • Patent number: 9161050
    Abstract: A motion vector coding unit executes processing including a neighboring block specification step of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step of coding the motion vector of the current block using the predictive motion vector.
    Type: Grant
    Filed: November 4, 2014
    Date of Patent: October 13, 2015
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe
  • Patent number: 9148622
    Abstract: A frame-rate converter reduces halo artifacts along edges of moving objects. Halo artifacts occur on interpolated frames where a moving object covers and uncovers pixels along its edges. Motion estimation among three original frames produces hybrid direction motion vectors that are bi-directional for background and objects, but are unidirectional for covered and uncovered regions, since motion vectors with large matching errors are deleted. Covered regions in the interpolated frame are detected as intersecting only a forward but no backward hybrid motion vector. Bi-directional motion estimation from the hybrid motion vectors of two original frames produces refined motion vectors for the interpolated frame. Refined motion vectors in the covered regions are deleted and replaced with hybrid motion vectors from the original frames. Hybrid motion vectors from the original frames are assigned to the critical covered regions rather than using interpolated vectors in the covered regions, reducing halo artifacts.
    Type: Grant
    Filed: December 29, 2011
    Date of Patent: September 29, 2015
    Assignee: Hong Kong Applied Science and Technology Research Institute Company, Limited
    Inventors: Xuejiao Liu, King Hung Chiu, Peng Luo, Tim Ka Lung Wong
  • Patent number: 9124898
    Abstract: An apparatus and method for motion vector prediction for a current block in a picture are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted. Motion Vector Prediction (MVP) has been used to further conserve the bitrate associated with motion vector. In conventional temporal MVP, the predictor is often based on a single candidate such as the co-located motion vector in the previous frame/picture. If the co-located motion vector in the previous frame/picture does not exist, the predictor for the current block is not available. A technique for improved MVP is disclosed where the MVP utilized multiple candidates based on co-located motion vectors from future and/or past reference pictures. The candidates are arranged according to priority order to provide better availability of MVP and also to provide more accurate prediction.
    Type: Grant
    Filed: March 3, 2011
    Date of Patent: September 1, 2015
    Assignee: MEDIATEK INC.
    Inventors: Yu-Pao Tsai, Jian-Liang Lin, Yu-Wen Huang, Shaw-Min Lei
  • Patent number: 9124897
    Abstract: A motion vector coding unit executes processing including a neighboring block specification step of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step of coding the motion vector of the current block using the predictive motion vector.
    Type: Grant
    Filed: November 6, 2014
    Date of Patent: September 1, 2015
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe
  • Patent number: 9124896
    Abstract: A motion vector coding unit executes processing including a neighboring block specification step of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step of coding the motion vector of the current block using the predictive motion vector.
    Type: Grant
    Filed: November 5, 2014
    Date of Patent: September 1, 2015
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe
  • Patent number: 9118889
    Abstract: A video signature extraction device includes an each-picture feature extraction unit which extracts a feature of each picture, which is a frame or a field, as an each-picture visual feature from an input video; a time axial direction change region extraction unit which analyzes an image change in a time direction with respect to predetermined regions in a picture from the video, obtains a region having a large image change, and generates change region information which is information designating the region; an each-region feature extraction unit which extracts a feature of the region corresponding to the change region information as an each-region visual feature from the video; and a multiplexing unit which multiplexes the each-picture visual feature, the each-region visual feature, and the change region information, and generates a video signature.
    Type: Grant
    Filed: November 14, 2012
    Date of Patent: August 25, 2015
    Assignee: NEC CORPORATION
    Inventors: Ryoma Oami, Kota Iwamoto
  • Patent number: 9071818
    Abstract: A video compression system and method to isolate and capture video data for video compression, thereby eliminating the need for motion vectors and blocks. When data is captured from a video input device, such as a video camera, the data is captured and isolated into clusters of difference image data. The clusters are then scanned, filled, marked, split and blended in in order to compress the video data.
    Type: Grant
    Filed: August 30, 2011
    Date of Patent: June 30, 2015
    Assignee: Organizational Strategies International Pte. Ltd.
    Inventor: Mark Morris
  • Patent number: 9041814
    Abstract: An automatic tracking camera system includes: a rotating unit for panning and tilting an image pickup unit including a lens apparatus and an image pickup apparatus; a tracking object detector; a motion vector detector for detecting a motion vector of the object to be tracked; a capture position setting unit for setting a capture position of the object to be tracked in the picked up image; and a controller for controlling drive of the rotating unit. The controller controls the rotating unit in a capture mode to capture the object to be tracked at the capture position based on the motion vector detected by the motion vector detector after the tracking object detector has detected the object to be tracked in the picked up image, and a maintenance mode to continuously capture the object to be tracked at the capture position after the capture mode.
    Type: Grant
    Filed: November 14, 2012
    Date of Patent: May 26, 2015
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yuji Takashima
  • Patent number: 9042673
    Abstract: Provided is a method and apparatus for deblurring a non-uniform motion blur in an input image, that may restore a clearer image by dividing a large scale input image into tiles corresponding to partial areas, selecting, among the divided tiles, an optimal tile for a partial area most suitable for estimating non-uniform motion blur information, and effectively removing an artifact in an outer portion of a tile through padding of each tile.
    Type: Grant
    Filed: March 11, 2013
    Date of Patent: May 26, 2015
    Assignees: SAMSUNG ELECTRONICS CO., LTD., POSTECH ACADEMY-INDUSTRY FOUNDATION POHANG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Jung Uk Cho, Seung Yong Lee, Young Su Moon, Shi Hwa Lee, Chi Young Lee, Sung Hyun Cho, Ho Jin Cho
  • Patent number: RE47337
    Abstract: The present invention relates to an interpolation method for enlarging a digital image or predicting a moving vector of a compressed image system as a sub-pixel unit when the image digitized through a CCD (Charge Coupled Device) camera ect. has a low resolution in a video phone or video conference or general digital video system, particularly the present invention can be adapted to a post processor of a compressed digital image in order to improve the image quality, and can be used for finding a moving vector of a moving picture compressed type, accordingly the present invention is capable of improving the image quality.
    Type: Grant
    Filed: December 4, 2015
    Date of Patent: April 2, 2019
    Assignee: LG ELECTRONICS INC.
    Inventors: Min-Cheol Hong, Yoon-Seong Soh