Motion Vector Generation Patents (Class 348/699)
  • Patent number: 10007519
    Abstract: A processor includes a core to execute an instruction for conversion between an element array and a packed bit array. The core includes logic to identify one or more bit-field lengths to be used by the packed bit array, identify a width of elements of the element array, and simultaneously for elements of the element array and for bit-fields of the packed bit array, convert between the element array and the packed bit array based upon the bit-field length and the width of elements of the element array.
    Type: Grant
    Filed: December 22, 2015
    Date of Patent: June 26, 2018
    Assignee: Intel IP Corporation
    Inventors: Elmoustapha Ould-Ahmed-Vall, Thomas Willhalm, Robert Valentine
  • Patent number: 10009626
    Abstract: Methods and systems for rate-constrained search ordering algorithms for reducing computational cost of motion estimation in video coding have been provided. Conventional search orderings, such as spiral search, can weaken the filtering criterion of rate-constrained successive elimination algorithms. Simulation results provided herein above demonstrate that, on average, the amount of SAD (sum of absolute differences) operations required to encode the tested sequences, is reduced using embodiments of the invention, when compared to the conventional implementations of spiral search for example. Advantageously, for sequences with unpredictable motion, this reduction may be greater than 5%, and may even exceed 10% when smaller block partitions are evaluated.
    Type: Grant
    Filed: January 29, 2015
    Date of Patent: June 26, 2018
    Assignee: ECOLE DE TECHNOLOGIE SUPERIEURE
    Inventors: Luc Normand Trudeau, Stéphane Coulombe, Christian Desrosiers
  • Patent number: 9977642
    Abstract: The invention relates to an encoder and a decoder and methods therein for supporting screen sharing, where the screen sharing comprises encoding pictures F representing pixels of a shared screen, providing said pictures to a decoder where they are decoded. The method performed by the encoder comprises deriving information related to an object which is moved on the shared screen between two pictures Fn and Fn+1. At least part of the derived information is related to an intermediate position of the object, on the shared screen, between the two pictures Fn and Fn+1. The method further comprises providing said information to the decoder, thereby enabling the decoder to generate intermediate pictures, FIMD, in addition to the pictures, F, based on the provided information, wherein the object is generated in different positions in said intermediate pictures, FIMD, thus reconstructing the movement of the object between two provided pictures Fn and Fn+1.
    Type: Grant
    Filed: January 27, 2015
    Date of Patent: May 22, 2018
    Assignee: Telefonaktiebolaget L M Ericsson (publ)
    Inventors: Martin Pettersson, Jonatan Samuelsson, Ying Wang
  • Patent number: 9955172
    Abstract: A video data processing device includes: a processor; and a memory which stores a plurality of instructions, which when executed by the processor, cause the processor to execute: making, on the basis of first key frames obtained by encoding images in frames included in moving image data, difference frames in each of which a partial image different from an image in a frame corresponding to each first key frame is encoded; and generating, if the number of generated difference frames reaches a first number, in response to detection that a difference between a difference frame generated thereafter and a difference frame preceding in time to the difference frame generated thereafter is not larger than a given value, a second key frame distinguished from the first key frames and obtained by encoding an image in the frame.
    Type: Grant
    Filed: October 22, 2015
    Date of Patent: April 24, 2018
    Assignee: FUJITSU LIMITED
    Inventors: Yousuke Yamaguchi, Shunsuke Kobayashi, Kazuhiro Yamashita, Yasuo Misuda
  • Patent number: 9934582
    Abstract: An image capture apparatus capable of identifying desired time points without using a special device is provided. The image capture apparatus 1 includes a moving image acquiring unit 53, a calculating unit 56, and an identification area analyzing unit 57. The moving image acquiring unit 53 acquires a plurality of images captured consecutively. The calculating unit 56 calculates variation values of pixel values along a time series of the plurality of images acquired by the moving image acquiring unit 53, within a predetermined region common to the plurality of images. The identification area analyzing unit 57 identifies two time points according to a predetermined standard from among a plurality of time points in the time series, on the basis of the variation values of the pixel values calculated by the calculating unit 56.
    Type: Grant
    Filed: September 16, 2015
    Date of Patent: April 3, 2018
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Masanori Ishihara
  • Patent number: 9918085
    Abstract: An improved loss recovery method for coding streaming media classifies each data unit in the media stream as an independent data unit (I unit), a remotely predicted unit (R unit) or a predicted data unit (P unit). Each of these units is organized into independent segments having an I unit, multiple P units and R units interspersed among the P units. The beginning of each segment is the start of a random access point, while each R unit provides a loss recovery point that can be placed independently of the I unit. This approach separates the random access point from the loss recovery points provided by the R units, and makes the stream more impervious to data losses without substantially impacting coding efficiency. The most important data units are transmitted with the most reliability to ensure that the majority of the data received by the client is usable. The I units are the least sensitive to transmission losses because they are coded using only their own data.
    Type: Grant
    Filed: November 24, 2015
    Date of Patent: March 13, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Albert Szu-Chi Wang, Ming-Chieh Lee
  • Patent number: 9912948
    Abstract: A method and device for encoding video including determining objects within a frame at least partially based on movement characteristics of underlying pixels and partitioning the frame into blocks by considering a plurality of partitioning options, such partitioning favoring options that result in different objects being placed in different blocks.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: March 6, 2018
    Assignee: Lyrical Labs Video Compression Technology, LLC
    Inventors: Edward Ratner, Jeffrey Alan Keswin
  • Patent number: 9900665
    Abstract: Exemplary methods for automatically testing closed caption (CC) rendering includes receiving a set of one or more reference audio video (AV) streams from an AV source, and generating reference CC images from the set of one or more reference AV streams starting from a recording start time to a recording stop time. In one embodiment, the method further includes receiving a set of one or more test AV streams from the AV source, and generating test CC images from the set of one or more test AV streams starting from the recording start time to the recording stop time. In one embodiment, the methods further include determining whether the AV source is performing CC rendering properly by automatically comparing the test CC images against the reference CC images.
    Type: Grant
    Filed: April 14, 2016
    Date of Patent: February 20, 2018
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Bhushan Ramnani, Zheng Nie, Xiaosong Zhu, Juan Flores, Aparna Varanasi
  • Patent number: 9883105
    Abstract: In an image processing apparatus, a first motion detector calculates an angular velocity indicating a motion of an imaging apparatus body. A second motion detector calculates a movement amount of a motion of an object based on successively captured images. In addition, a motion vector calculating unit corrects the movement amount of the motion of the object based on the angular velocity, and calculates a motion vector of a main object based on the corrected movement amount.
    Type: Grant
    Filed: July 28, 2016
    Date of Patent: January 30, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kohta Haruna
  • Patent number: 9877040
    Abstract: A predictive coding system can encode motion vectors by determining a motion vector of a target partition in a frame picture of an encoding target; determining a first motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to a left-neighboring region to the target partition; determining a second motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to an above-neighboring region to the target partition; selecting an optimum motion vector predictor and outputting motion vector predictor indication information to specify the selected optimum motion vector predictor, the optimum motion vector predictor selected based on comparison between one or more motion vector predictor candidates including the first motion vector predictor candidate and the second motion vector predictor candidate, and the motion vector of the target partition; and encoding the motion vector predictor indication information.
    Type: Grant
    Filed: December 9, 2016
    Date of Patent: January 23, 2018
    Assignee: NTT DOCOMO, INC.
    Inventors: Akira Fujibayashi, Yoshinori Suzuki, Choong Seng Boon
  • Patent number: 9854167
    Abstract: A frame skipping process suited to a scene is achieved by providing an encoder which encodes input image data, an encoding determination unit which compares image movement information with a threshold to determine whether or not encoding is to be performed, a frame skipping controller which performs a frame skipping control if encoding is not to be performed, and a threshold correction unit which corrects the encoding determination threshold based on the result of the encoding process. The image movement information used in the encoding determination unit is any one or a combination of pixel movement information obtained by a representative point matching scheme performed by a pixel movement calculation unit, angular velocity sensor information obtained from a lens controller, and frequency information obtained from an image processor.
    Type: Grant
    Filed: September 5, 2012
    Date of Patent: December 26, 2017
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Tomokazu Uchida, Masahiro Hojo
  • Patent number: 9843817
    Abstract: The present invention is directed to an image information decoding apparatus adapted for performing infra-image decoding based on resolution of color components and color space of an input image signal. An intra prediction unit serves to adaptively change block size in generating a prediction image based on a chroma format signal indicating whether resolution of color components is one of 4:2:0 format, 4:2:2 format, and 4:4:4 format, and a color space signal indicating whether color space is one of YCbCr, RGB, and XYZ. An inverse orthogonal transform unit and an inverse quantization unit serve to also change orthogonal transform technique and quantization technique in accordance with the chroma format signal and the color space signal. A decoding unit decodes the chroma format signal and the color space signal to generate a prediction image corresponding to the chroma format signal and the color space signal.
    Type: Grant
    Filed: March 9, 2016
    Date of Patent: December 12, 2017
    Assignee: Sony Corporation
    Inventors: Teruhiko Suzuki, Akira Sugiyama, Kyohei Koyabu
  • Patent number: 9836851
    Abstract: An apparatus for detecting multiple objects using adaptive block partitioning is disclosed. An object contour extracting unit configured to extract a contour information of an object using a local binary pattern LBP and difference image between adjacent images. An adaptive block partitioning unit configured to perform a block partitioning of an object not overlapped based on the extracted contour information. A motion quantization unit configured to calculate a motion orientation histogram MOH of the object by performing N-directional quantization about a motion vector. An object detection unit configured to detect the object using a block of the partitioned object, the contour information and the MOH, and estimate a moving direction of the object after performing labeling the detected object.
    Type: Grant
    Filed: December 28, 2015
    Date of Patent: December 5, 2017
    Assignee: Chung-Ang University Industry-Academy Cooperation Foundation
    Inventors: Joon-Ki Paik, Seung-Won Lee
  • Patent number: 9838710
    Abstract: Techniques related to providing motion estimation for arbitrary pixel block shapes are discussed. Such techniques may include generating a distortion mesh for a pixel block based on multiple calls to a motion estimation such that the distortion mesh includes distortion values associated with regions of the pixel block, a seed motion vector, and candidate motion vectors, and determining a best motion vector for the pixel block based on the distortion mesh.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: December 5, 2017
    Assignee: Intel Corporation
    Inventors: Sang-Hee Lee, James M. Holland, Lidong Xu, Hong Jiang
  • Patent number: 9836831
    Abstract: Implementations relate to simulating long-exposure images. In some implementations, a method includes examining a series of images, determining an optical flow of pixel features between the image and an adjacent image in the series of images, and blurring one or more regions in one or more of the images, where the one or more regions are spatially defined based on one or more attributes of the optical flow.
    Type: Grant
    Filed: August 7, 2014
    Date of Patent: December 5, 2017
    Assignee: Google Inc.
    Inventors: Aravind Krishnaswamy, Matthew Steiner
  • Patent number: 9832473
    Abstract: Decoding method for a moving picture included in a coded stream, including: determining whether a prediction mode (PM) of a target block (TB) is a PM in which motion vector (MV) is not transmitted from an encoding to decoding side, based on coded stream included information; and executing a decoding process when the PM of the TB is determined as the PM in which MV is not transmitted from an encoding to decoding side, wherein a calculation method of a MV used in the second step is selected among plural calculation methods including at least: a first method to select one MV among MVs used in plural adjacent blocks adjacent to the TB; and a second method to calculate a MV based on a MV used in a block that is located at the same position as the TB in another frame positioned backward of a frame including the TB.
    Type: Grant
    Filed: September 16, 2014
    Date of Patent: November 28, 2017
    Assignee: Hitachi Maxell, Ltd.
    Inventor: Yoshinori Suzuki
  • Patent number: 9819960
    Abstract: A moving picture coding method includes: coding a coding target block using a motion vector; generating motion vector predictors; and coding the motion vector using one of the motion vector predictors generated in the generating of the motion vector predictors. In the generating of the motion vector predictors, a replacement vector which replaces a temporal motion vector predictor is added to the motion vector predictors when it is impossible to obtain the temporal motion vector predictor from a block which is included in a coded picture different from the coding target picture and corresponds to the coding target block.
    Type: Grant
    Filed: May 26, 2017
    Date of Patent: November 14, 2017
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Hisao Sasai
  • Patent number: 9819841
    Abstract: An integrated circuit with optical flow computation circuitry is provided. The optical flow computation circuitry may include a first image shift register for receiving pixel values from a current video frame, a second image shift register for receiving pixel values from a previous video frame, column shift registers for storing column sums of various gradient-based values, square sum registers for storing square sums generated at least partly based on the column sum values, and an associated computation circuit that constructs a gradient matrix based on values stored in the square sum registers and that computes a 2-dimensional optical flow vector based on an inverse of the gradient matrix and differences between the current and previous frames. Optical flow computing circuitry configured in this way may be capable of supporting dense optical flow calculation for at least one pixel per clock cycle while supporting large window sizes.
    Type: Grant
    Filed: April 17, 2015
    Date of Patent: November 14, 2017
    Assignee: Altera Corporation
    Inventor: Dmitry N. Denisenko
  • Patent number: 9811909
    Abstract: An image processing apparatus comprises a corresponding point determining unit configured to, for a plurality of points contained in a first image, search a second image for corresponding points; a transformation coefficient calculating unit configured to divide the plurality of corresponding points into groups, based on amounts of misalignment between the images at the corresponding points, and configured to calculates a coordinate transformation coefficient for each of the groups; and an image synthesizing unit configured to generate a synthesis image, using a plurality of the coordinate transformation coefficients and the second image.
    Type: Grant
    Filed: July 5, 2016
    Date of Patent: November 7, 2017
    Assignee: Canon Kabushiki Kaisha
    Inventor: Satoru Komatsu
  • Patent number: 9813703
    Abstract: A compressed dynamic image encoding device is provided, in which a motion vector is generated by searching a reference image for an image area most similar to an image area of a video input signal; a motion-compensated reference image is generated from the motion vector and the reference image; a prediction residual is generated, by subtracting the motion-compensated reference image from the video input signal; the reference image is generated, by adding the motion-compensated reference image and the result of processing performed to the prediction residual; and an encoded video output signal is generated by the processing performed to the prediction residual. The reference image comprises on-screen reference images, located inside a video display screen, and an off-screen reference image located outside the video display screen, and the off-screen reference image is generated based on the positional relationship of plural similar reference images of the on-screen reference images.
    Type: Grant
    Filed: September 5, 2014
    Date of Patent: November 7, 2017
    Assignee: Renesas Electronics Corporation
    Inventors: Seiji Mochizuki, Junichi Kimura, Masakazu Ehama
  • Patent number: 9794586
    Abstract: Provided is an apparatus for decoding a moving picture that determines a quantization step size of a previous coding block according to scan order as the quantization step size predictor of the current coding block when a quantization step size of a left coding block of a current coding block and a quantization step size of an above coding block of the current coding block are unavailable and determines an available motion vector encountered first when retrieving motion vectors in the order of motion vector of a first predetermined position and motion vector of a second predetermined position in a reference picture as a temporal motion vector candidate. Therefore, it is possible to reduce the amount of coding bits required to decode motion information and the quantization step size of the current prediction block.
    Type: Grant
    Filed: November 30, 2016
    Date of Patent: October 17, 2017
    Assignee: M & K HOLDINGS INC.
    Inventors: Soo Mi Oh, Moonock Yang
  • Patent number: 9794592
    Abstract: An encoding target region in an image can be partitioned into a plurality of prediction regions. Based on prediction information of a neighboring region neighboring a target region, the number of previously-encoded prediction regions in the target region, and previously-encoded prediction information of the target region, a candidate for motion information to be used in generation of a predicted signal of the target prediction region as a next prediction region is selected from previously-encoded motion information of regions neighboring the target prediction region. According to the number of candidates for motion information selected, merging block information to indicate generation of the predicted signal of the target prediction region using the selected candidate for motion information and motion information detected by prediction information estimation means, or either one of the merging block information or the motion information is encoded.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: October 17, 2017
    Assignee: NTT DoCoMo, Inc.
    Inventors: Yoshinori Suzuki, Junya Takiue, Choong Seng Boon, Thiow Keng Tan
  • Patent number: 9794589
    Abstract: An embodiment of the invention relates to a method for processing the pixel amplitude of at least one block image pixel contained in a video sequence, the method comprising the steps of: constructing an individual motion trajectory comprising motion-shifted versions of said block image pixel over a multiplicity of neighboring frames; and combining the pixel amplitudes of the motion-shifted versions of said block image pixel along the individual motion trajectory using a weighting function, to form a processed pixel amplitude of said image pixel.
    Type: Grant
    Filed: May 9, 2016
    Date of Patent: October 17, 2017
    Assignee: VESTEL ELEKTRONIK SANAYI VE TICARET A.S.
    Inventors: Thomas Sikora, Andreas Krutz, Alexander Glantz
  • Patent number: 9792696
    Abstract: The motion of image content such as a point of interest in a video frames sequence is tracked using sub-pixel resolution motion estimation in forward and/or backward direction. The motion of image content or a point of interest between a reference frame and a following frame is estimated, starting from an integer pixel position in the reference frame. If the motion vector has a position between integer pixel positions, the coordinates of that motion vector are replaced by an adjacent integer pixel position in the following or previous frame, and the error value between these coordinates and the replacement coordinates is stored. Thereafter the following or previous frame is defined as the current frame, the motion of the object is estimated between the replacement coordinates in the current frame and a following frame, and the stored error value is added in opposite direction to the corresponding motion vector, so as to get a corresponding precise motion vector.
    Type: Grant
    Filed: November 16, 2015
    Date of Patent: October 17, 2017
    Assignee: THOMSON LICENSING
    Inventor: Dietmar Hepper
  • Patent number: 9787988
    Abstract: The present disclosure provides a video decoding apparatus including at least a decoder configured to decode information on a size of a current block from encoded data, transform information, an inverse transformer configured to reconstruct a residual block of the current block by inversely transforming the transform coefficients in units of the size of each of the transform blocks, a predictor configured to generate a predicted block by using an inter-prediction, an adder configured to reconstruct the current block by adding the residual block to the predicted block, and a filter configured to identify transform boundaries between the transform blocks in the reconstructed current block by using the size of each of the transform blocks determined based on both the size of the current block and the information on the transform type, and then perform deblocking-filtering on at least part of the transform boundaries.
    Type: Grant
    Filed: November 28, 2016
    Date of Patent: October 10, 2017
    Assignee: SK TELECOM CO., LTD.
    Inventors: Jinhan Song, Jeongyeon Lim, Yunglyul Lee, Joohee Moon, Haekwang Kim, Byeungwoo Jeon, Jongki Han, Daeyeon Kim, Sungwook Hong
  • Patent number: 9781415
    Abstract: For the purpose of providing an image encoding technique for reducing the amount of codes, in inter prediction in which motion search is performed by using a block obtained by dividing an input image and a reference image, the motion vector of the block is predicted by selecting from the motion vectors of the surrounding blocks. Further, in the method of calculating a differential vector and then performing encoding, the number or positions of candidate blocks from which a prediction vector is selected are changed block by block or frame by frame and thereby adaptive and efficient video image compression is performed.
    Type: Grant
    Filed: January 16, 2012
    Date of Patent: October 3, 2017
    Assignee: Hitachi Maxell, Ltd.
    Inventors: Tomokazu Murakami, Toru Yokoyama
  • Patent number: 9769494
    Abstract: A method, system, and computer program product that exploits motion hints associated with rendered video frames. These motion hints are provided to a video encoder to guide a motion-compensation prediction process performed by the video encoder. Specifically, these motion hints can be used to better position a search window in a reference video frame to better capture the motion of a block of pixels in the reference video frame. Because the search window is better positioned in the reference video frame, the memory required to perform the encoding process can be reduced without sacrificing the level of encoded image quality.
    Type: Grant
    Filed: August 1, 2014
    Date of Patent: September 19, 2017
    Assignee: ATI Technologies ULC
    Inventors: Khaled Mammou, Ihab M. A. Amer
  • Patent number: 9769485
    Abstract: Innovations described herein provide a generic encoding and decoding framework that includes some features of simulcast and some features of scalable video coding. For example, a bitstream multiplexer multiplexes component bitstreams into a multi-layer encoding (MLE) bitstream that provides temporal scalability, spatial resolution scalability and/or signal to noise ratio scalability. Each of the component bitstreams provides an alternative version of input video, and a given component bitstream can be a non-scalable bitstream or scalable bitstream. The multiplexer follows composition rules for the MLE bitstream and may rewrite values of certain syntax elements of component bitstreams using an approach that avoids bit shifting operations. A corresponding demultiplexer receives an MLE bitstream that includes component bitstreams and demultiplexes at least part of at least one of the component bitstreams from the MLE bitstream, following decomposition rules for the demultiplexing.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: September 19, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mei-Hsuan Lu, Ming-Chieh Lee
  • Patent number: 9762923
    Abstract: The present invention relates to a scalable video coding method and apparatus using an intra prediction mode. A decoding method includes configuring a maximum probability mode set for predicting an intra prediction mode for a target decoding block of an enhancement layer so that the maximum probability mode set includes an intra prediction mode for a corresponding block of a reference layer and restoring the target decoding block of the enhancement layer using any one of intra prediction modes included in the maximum probability mode set.
    Type: Grant
    Filed: November 15, 2016
    Date of Patent: September 12, 2017
    Assignee: Intellectual Discovery Co., Ltd.
    Inventors: Dong Gyu Sim, Jung Hak Nam, Hyun Ho Jo, Hyo Min Choi
  • Patent number: 9749686
    Abstract: A content receiver and a method for controlling the same are provided. The content receiver, for example, may include, but is not limited to, a communication system configured to receive video content comprising a plurality of video frames from a content source, a processor configured to insert artifacts into one or more video frames when the video frame is subject to data loss, and a video analyzer configured to determine a quality of the video content by quantifying an effect of the inserted artifacts into the one or more video frames, and trigger at least one content receiver response when the quality of the video content is less than a predetermined threshold.
    Type: Grant
    Filed: September 21, 2015
    Date of Patent: August 29, 2017
    Assignee: Sling Media PVT Ltd.
    Inventors: Sushant Sudhir Kulkarni, Yatish J. Naik Raikar, Varunkumar B. Tripathi
  • Patent number: 9743108
    Abstract: In one embodiment, a method for a moving picture coding system to derive at least one motion vector of a bi-predictive block in a current picture from a motion vector of a first block in a first picture includes selecting, by the moving picture coding system, a list 1 motion vector of the first block in the first picture as a motion vector for deriving list 0 and list 1 motion vectors of the bi-predictive block if the first block only has the list 1 motion vector, the first picture being permitted to be located temporally before the current picture and permitted to be located temporally after the current picture, scaling the selected motion vector and deriving the list 0 and list 1 motion vectors of the bi-predictive block by applying a bit operation to the scaled motion vector, the bit operation including 8 bits right shift.
    Type: Grant
    Filed: April 28, 2015
    Date of Patent: August 22, 2017
    Assignee: LG ELECTRONICS INC.
    Inventor: Byeong Moon Jeon
  • Patent number: 9736472
    Abstract: The embodiments relates to motion vector prediction and decoding for multi-view video content from multiple camera views (10, 20). At least one candidate motion vector predictor (54, 64) is provided for a current motion vector (34) to be encoded. A motion vector predictor is then determined from the at least one candidate motion vector predictor (54, 64) multiplied by a respective scaling factor determined based on baseline distances between camera views (10, 20). Correspondingly, during decoding a motion vector (34) is determined for a current pixel block (30) based on a motion vector predictor (determined for the current pixel block (30).
    Type: Grant
    Filed: May 28, 2012
    Date of Patent: August 15, 2017
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Zhuangfei Wu, Thomas Rusert
  • Patent number: 9729896
    Abstract: When a block (MB22) of which motion vector is referred to in the direct mode contains a plurality of motion vectors, 2 motion vectors MV23 and MV24, which are used for inter picture prediction of a current picture (P23) to be coded, are determined by scaling a value obtained from averaging the plurality of motion vectors or selecting one of the plurality of the motion vectors.
    Type: Grant
    Filed: October 31, 2016
    Date of Patent: August 8, 2017
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe
  • Patent number: 9721350
    Abstract: Disclosed are methods, circuits, devices, systems and associated executable code for multi factor image feature registration and tracking, wherein utilized factors include both static and dynamic parameters within a video feed. Assessed factors may originate from a heterogeneous set of sensors including both video and audio sensors. Acoustically acquired scene information may supplement optically acquired information.
    Type: Grant
    Filed: June 26, 2015
    Date of Patent: August 1, 2017
    Assignee: GETALERT LTD.
    Inventors: Dor Givon, Yoram Elichai
  • Patent number: 9723325
    Abstract: When a block (MB22) of which motion vector is referred to in the direct mode contains a plurality of motion vectors, 2 motion vectors MV23 and MV24, which are used for inter picture prediction of a current picture (P23) to be coded, are determined by scaling a value obtained from averaging the plurality of motion vectors or selecting one of the plurality of the motion vectors.
    Type: Grant
    Filed: October 31, 2016
    Date of Patent: August 1, 2017
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe
  • Patent number: 9712817
    Abstract: In some embodiments, a lossless 2D video decoder includes multiple parallel speculative decoding engines, each performing a sample-determination calculation according to one of several possible context values for the current pixel to be decoded. The actual context depends on a quantized value of a local inter-pixel gradient, which may become available only when an immediately-neighboring pixel has been decoded. A multiplexer selects one of the decoding engine outputs when the immediately-neighboring pixel has been decoded and the actual context becomes available. A sample (e.g. luma and/or chroma) value for the current pixel may be determined according to: a baseline prediction generated by applying a median filter to immediately-neighboring pixels; a context-dependent adjustment dependent on local context statistics; and a delta (difference) value read from a video bitstream.
    Type: Grant
    Filed: February 18, 2014
    Date of Patent: July 18, 2017
    Assignee: Apple Inc.
    Inventor: Sorin C. Cismas
  • Patent number: 9712827
    Abstract: An object is to suppress an instantaneous increase in the computational complexity of an encoder and an information amount of an encoding result without increasing a delay even when input timing of input video is not constant and fluctuates. A frame rate control method for adjusting a frame rate of input video to a frame rate at which an encoder is able to perform encoding includes: a step of determining whether the number of pictures input in the past within a predetermined time from a time when a determination target picture of dropping is input exceeds a predetermined threshold value; and a step of discarding the determination target picture if the number of pictures exceeds the threshold value and designating the determination target picture as an encoding target if the number of pictures does not exceed the threshold value.
    Type: Grant
    Filed: January 21, 2013
    Date of Patent: July 18, 2017
    Assignee: Nippon Telegraph And Telephone Corporation
    Inventors: Naoki Ono, Atsushi Shimizu, Ken Nakamura, Masaki Kitahara, Seisuke Kyochi
  • Patent number: 9693073
    Abstract: A moving picture coding method includes: coding a coding target block using a motion vector; generating motion vector predictors; and coding the motion vector using one of the motion vector predictors generated in the generating of the motion vector predictors. In the generating of the motion vector predictors, a replacement vector which replaces a temporal motion vector predictor is added to the motion vector predictors when it is impossible to obtain the temporal motion vector predictor from a block which is included in a coded picture different from the coding target picture and corresponds to the coding target block.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: June 27, 2017
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Hisao Sasai
  • Patent number: 9693051
    Abstract: A predictive video coder performs gradient prediction based on previous blocks of image data. For a new block of image data, the prediction determines a horizontal gradient and a vertical gradient from a block diagonally above the new block (vertically above a previous horizontally adjacent block). Based on these gradients, the encoder predicts image information based on image information of either the horizontally adjacent block or a block vertically adjacent to the new block. The encoder determines a residual that is transmitted in an output bitstream. The decoder performs the identical gradient prediction and predicts image information without need for overhead information. The decoder computes the actual information based on the predicted information and the residual from the bitstream.
    Type: Grant
    Filed: December 10, 2013
    Date of Patent: June 27, 2017
    Assignee: AT&T Intellectual Property II, L.P.
    Inventors: Barin Geoffry Haskell, Atul Puri, Robert Lewis Schmidt
  • Patent number: 9693052
    Abstract: A predictive coding system can encode motion vectors by determining a motion vector of a target partition in a frame picture of an encoding target; determining a first motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to a left-neighboring region to the target partition; determining a second motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to an above-neighboring region to the target partition; selecting an optimum motion vector predictor and outputting motion vector predictor indication information to specify the selected optimum motion vector predictor, the optimum motion vector predictor selected based on comparison between one or more motion vector predictor candidates including the first motion vector predictor candidate and the second motion vector predictor candidate, and the motion vector of the target partition; and encoding the motion vector predictor indication information.
    Type: Grant
    Filed: July 5, 2013
    Date of Patent: June 27, 2017
    Assignee: NTT DoCoMo, Inc.
    Inventors: Akira Fujibayashi, Yoshinori Suzuki, Choong Seng Boon
  • Patent number: 9691253
    Abstract: Methods, apparatuses and systems are described for associating remote physiological monitoring with an at-risk falling condition of a patient. The methods may include receiving movement data of a patient from one or more sensors. The methods may also include determining a patient posture and a patient activity level based, at least in part, on the received movement data, and determining that an at-risk condition is satisfied by the patient posture or the patient activity level. Once it is determined that the at-risk condition is satisfied, the methods may also include issuing an alert based, at least in part, on the determination that the at-risk condition is satisfied.
    Type: Grant
    Filed: February 2, 2015
    Date of Patent: June 27, 2017
    Assignee: Covidien LP
    Inventors: Brian Keith Russell, Jonathan James Woodward, Dietrich Otto Ruehlmann, Marjorie Jones Olsen, Benjamin David Morris
  • Patent number: 9686552
    Abstract: A moving picture coding method for coding a picture with switching between frame coding and field coding adaptively on a block-by-block basis includes: determining the maximum number of reference indices for field coding for specifying fields which are to be referred to at the time of field coding, using the maximum number of reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding; and assigning to fields the reference indices for field coding for specifying fields which are to be referred to at the time of field coding, within a range of the determined maximum number thereof, using the reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding.
    Type: Grant
    Filed: July 22, 2015
    Date of Patent: June 20, 2017
    Assignee: GODO KAISHA IP BRIDGE 1
    Inventors: Kiyofumi Abe, Shinya Kadono, Satoshi Kondo
  • Patent number: 9681136
    Abstract: A moving picture coding method for coding a picture with switching between frame coding and field coding adaptively on a block-by-block basis includes: determining the maximum number of reference indices for field coding for specifying fields which are to be referred to at the time of field coding, using the maximum number of reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding; and assigning to fields the reference indices for field coding for specifying fields which are to be referred to at the time of field coding, within a range of the determined maximum number thereof, using the reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding.
    Type: Grant
    Filed: July 22, 2015
    Date of Patent: June 13, 2017
    Assignee: GODO KAISHA IP BRIDGE 1
    Inventors: Kiyofumi Abe, Shinya Kadono, Satoshi Kondo
  • Patent number: 9674498
    Abstract: A suitability detector identifies a plurality of frames of an input video. The suitability detector determines, based on characteristics of the plurality of frames, whether the input video is suitable for conversion from monoscopic visual content to stereoscopic 3D. The characteristics may include a visual cue present in the plurality of frames and a visual quality of the plurality of frames. If the input video is suitable for conversion, an image converter converts the input video to stereoscopic 3D.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: June 6, 2017
    Assignee: GOOGLE INC.
    Inventors: Debargha Mukherjee, Chen Wu
  • Patent number: 9641859
    Abstract: A moving picture coding method includes: coding a coding target block using a motion vector; generating motion vector predictors; and coding the motion vector using one of the motion vector predictors generated in the generating of the motion vector predictors. In the generating of the motion vector predictors, a replacement vector which replaces a temporal motion vector predictor is added to the motion vector predictors when it is impossible to obtain the temporal motion vector predictor from a block which is included in a coded picture different from the coding target picture and corresponds to the coding target block.
    Type: Grant
    Filed: July 25, 2016
    Date of Patent: May 2, 2017
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Hisao Sasai
  • Patent number: 9635381
    Abstract: A motion vector predictor candidate generation unit derives a plurality of motion vector predictor candidates by prediction from first coded prediction blocks neighboring a prediction block subject to coding within the same picture as the prediction block subject to coding, or from a second coded prediction block located at the same position as or in the neighborhood of the prediction block subject to coding in a picture different from that of the prediction block subject to coding, and adds the derived motion vector predictor candidates in a motion vector predictor candidate. The motion vector predictor candidate generation unit determines, for the purpose of obtaining a predetermined number of motion vector predictor candidates, which of first coded prediction blocks provides the motion vector from which to derive the motion vector predictor candidate, organizing the blocks in the order of priority.
    Type: Grant
    Filed: January 28, 2015
    Date of Patent: April 25, 2017
    Assignee: JVC KENWOOD Corporation
    Inventors: Hiroya Nakamura, Masayoshi Nishitani, Shigeru Fukushima, Motoharu Ueda
  • Patent number: 9635385
    Abstract: Several methods and systems for estimating motion in a plurality of multimedia pictures are disclosed. In an embodiment, at least one temporal distance between a multimedia picture and one or more reference pictures corresponding to the multimedia picture in a capture order associated with the plurality of multimedia pictures is computed. The at least one temporal distance is computed subsequent to an encoding of the multimedia picture. At least one motion estimation parameter is determined based on the at least one temporal distance. Motion associated with a subsequent multimedia picture to be encoded is estimated based on the at least one motion estimation parameter.
    Type: Grant
    Filed: April 10, 2012
    Date of Patent: April 25, 2017
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Arun Shankar Kudana, Soyeb Nagori
  • Patent number: 9635262
    Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
    Type: Grant
    Filed: September 30, 2016
    Date of Patent: April 25, 2017
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Paul Mobbs, Balineedu Chowdary Adsumilli, Sumit Chawla
  • Patent number: 9628808
    Abstract: Input VDR images are received. A candidate set of function parameter values for a mapping function is selected from multiple candidate sets. A set of image blocks of non-zero standard deviations in VDR code words in at least one input VDR image is constructed. Mapped code values are generated by applying the mapping function with the candidate set of function parameter values to VDR code words in the set of image blocks in the at least one input VDR image. Based on the mapped code values, a subset of image blocks of standard deviations below a threshold value in mapped code words is determined as a subset of the set of image blocks. Based at least in part on the subset of image blocks, it is determined whether the candidate set of function parameter values is optimal for the mapping function to map the at least one input VDR image.
    Type: Grant
    Filed: March 25, 2014
    Date of Patent: April 18, 2017
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Guan-Ming Su, Qian Chen, Hubert Koepfer
  • Patent number: RE46678
    Abstract: Disclosed are an apparatus and a method of encoding/decoding a video, particularly a method and an apparatus for storing a quantization parameter differential value in a largest coding unit (LCU) based on quadtree splitting and adaptively predicting a quantization parameter value based on context information on neighboring CUs. Quadtree-based quantization parameter encoding and decoding methods and apparatuses effectively show information on a block having a quantization parameter differential value based on splitting information on a CU and adaptively predict a quantization parameter value using context information including a block size, block partition and a quantization parameter of a neighboring CU.
    Type: Grant
    Filed: July 31, 2015
    Date of Patent: January 16, 2018
    Assignee: Intellectual Discovery Co., LTD.
    Inventors: Dong Gyu Sim, Jung Hak Nam, Hyung Ho Jo