Motion Vector Generation Patents (Class 348/699)
  • Patent number: 10291928
    Abstract: Methods and devices for video coding using inter-coding and removing redundant motion vectors from a set of candidate motion vectors. The methods may determine that at least some candidate motion vectors in a set of candidate motion vectors in a search range around the motion vector predictor identify candidate blocks in the previously-reconstructed reference picture that are redundant and, based on that determination, eliminate said at least some of the candidate motion vectors to reduce the set to a subset. In some cases, a candidate block is redundant if it is less than a threshold different from another of the candidate blocks identified by one of the candidate motion vectors in the set. A function may be applied to the candidate block and the another candidate block. If the output from the function in the two cases is the same, then the blocks are determined to be redundant.
    Type: Grant
    Filed: January 10, 2017
    Date of Patent: May 14, 2019
    Assignee: BLACKBERRY LIMITED
    Inventor: Dake He
  • Patent number: 10284875
    Abstract: A method performed by an electronic device is described. The method includes obtaining a motion vector map based on at least two images. The motion vector map has fewer motion vectors than a number of pixels in each of the at least two images. The method also includes obtaining a feature point from one of the at least two images. The method further includes performing a matching operation between a template associated with the feature point and at least one search space based on the motion vector map. The method additionally includes determining a motion vector corresponding to the feature point based on the matching operation.
    Type: Grant
    Filed: August 8, 2016
    Date of Patent: May 7, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Sujith Srinivasan, Gokce Dane
  • Patent number: 10284872
    Abstract: Various embodiments for calculating a motion vector predictor for a current block are provided. A fixed number of motion vector predictor candidates is obtained, with the fixed number being at least two. Each of the motion vector predictor candidates is a candidate for the motion vector predictor. An index for identifying the motion vector predictor from among the fixed number of the motion vector predictor candidates is coded according to the fixed number and added to a bitstream. The motion vector predictor to be used for coding the current block is selected from among the fixed number of the motion vector predictor candidates based on the index. The fixed number of the motion vector predictor candidates includes a plurality of candidates each having a motion vector of value 0, and at least one of one or more first candidates and one or more new candidates.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: May 7, 2019
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Kyoko Tanikawa, Hisao Sasai, Toru Matsunobu
  • Patent number: 10271095
    Abstract: A system and method for identifying media segments using audio augmented image cross-comparisoning is disclosed, in which a media segment identifying system analyzes both audio and video content, producing a unique identifier to compare with previously identified media segments in a media segment database. The characteristic landmark-linked-image-comparisones are constructed by first identifying pairs of audio landmarks separated by a characteristic, or landmark, time. Digital images associated the audio landmarks are then image comparisoned, with the combination providing a characteristic landmark-linked-image-comparison. The audio landmarks are audio peaks that exceed predetermined thresholds. A landmark-time is the time between adjacent pairs of audio peaks. The pair of images associated with the audio peaks are reduced in pixel size and converted to gray scale. Corresponding pixels are compared to form a numeric comparison.
    Type: Grant
    Filed: August 23, 2018
    Date of Patent: April 23, 2019
    Inventors: Samuel Chenillo, Oren Steinfeld
  • Patent number: 10237454
    Abstract: Embodiments of present application relate to a method for detecting terminal static layer information, a terminal and a television. Based on the fact that a static layers in the terminal such as the OSD display layer and third-party application are managed as a whole by the terminal layer management module, this embodiment sets forth that: a current topmost layer is determined according to number information of each layer in a terminal layer management module; then a pixel value of a preset region in the topmost layer is obtained; analysis is performed on the pixel value in the preset region, and it is determined whether the pixel value of the preset region is different from a target pixel value. If the pixel value of the preset region is different from the target pixel value, then it is determined that there is image content in the topmost layer.
    Type: Grant
    Filed: December 29, 2016
    Date of Patent: March 19, 2019
    Assignees: HISENSE ELECTRIC CO., LTD., HISENSE USA CORPORATION, HISENSE INTERNATIONAL CO., LTD.
    Inventors: Hui Su, Xin Li, Qingxiao Yu
  • Patent number: 10237559
    Abstract: A technique for decoding video signals includes receiving, by electronic decoding circuitry, a set of video data representing a two-dimensional array of pixels of a video signal. The set of video data includes (i) multiple residual layers, each residual layer providing an incomplete, lossily-compressed representation of the two-dimensional array of pixels (ii) multiple sets of prediction information, one for each of the residual layers, and (iii) a set of masks for directing reconstruction of the two-dimensional array of pixels. The method further includes generating multiple decompressed layers based on the residual layers and on the sets of prediction information for the respective residual layers and combining the decompressed layers, as directed by the set of masks, to generate a complete reconstruction of the two-dimensional array of pixels of the video signal.
    Type: Grant
    Filed: February 6, 2015
    Date of Patent: March 19, 2019
    Assignee: GetGo, Inc.
    Inventor: Steffen Schulze
  • Patent number: 10223796
    Abstract: A method, system and apparatus for image capture, analysis and transmission are provided. A link aggregation method involves identifying controller network ports to a source connected to the same subnetwork; producing packets associating corresponding controller network ports selected by the source CPU for substantially uniform selection; and transmitting the packets to their corresponding network ports. An image analysis method involves producing by a camera an indication whether a region of an image differs by a threshold extent from a corresponding region of a reference image; transmitting the indication and image data to a controller via a communications network; and storing at the controller the image data and the indication in association therewith. The controller may perform operations according to positive indications.
    Type: Grant
    Filed: October 13, 2015
    Date of Patent: March 5, 2019
    Assignee: AVIGILON CORPORATION
    Inventors: Andrew Martz, Ross Wightman, Shaun P. Marlatt
  • Patent number: 10225572
    Abstract: System and method for improving operational efficiency of a video encoding pipeline used to encode image data.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: March 5, 2019
    Assignee: Apple Inc.
    Inventors: Jim C. Chou, Mark P. Rygh, Guy Côté
  • Patent number: 10218980
    Abstract: Provided is a camera. The camera further includes a motion area detection sensor that is configured to receive reflected wave signals by emitting radio frequency electromagnetic wave beam to each of divided areas set in a target capture region, determine whether motion has occurred in each of the divided areas depending on changes of reflection speed of each of the received reflected wave signals, generate motion information data based on the determination result, and input the motion information data into the controller. The controller is configured to compress a series of image frame data from the capturing unit according to the motion information data from the motion area detection sensor.
    Type: Grant
    Filed: November 25, 2013
    Date of Patent: February 26, 2019
    Assignee: HANWHA AEROSPACE CO., LTD
    Inventor: Moon Gyu Choi
  • Patent number: 10218955
    Abstract: Disclosed is a method for compensating for motion blur when performing a 3D scanning of at least a part of an object by means of a 3D scanner, where the motion blur occurs because the scanner and the object are moved relative to each other while the scanning is performed, and where the motion blur compensation comprises:—determining whether there is a relative motion between the scanner and the object during the acquisition of the sequence of focus plane images;—if a relative motion is determined, performing a motion compensation based on the determined motion; and—generating a 3D surface from the sequence of focus plane images.
    Type: Grant
    Filed: December 21, 2011
    Date of Patent: February 26, 2019
    Assignee: 3Shape A/S
    Inventors: Rune Fisker, Henrik Öjelund, Mike Van Der Poel, Kristian Evers Hansen, Anders Gaarde
  • Patent number: 10205951
    Abstract: Embodiments of a method for incrementally coding and signaling motion information for a video compression system involving a motion adaptive transform and embedded coding of transformed video samples using a computer are disclosed herein. In one such embodiment, the method includes (a) storing computer-readable instructions in the computer which, when executed, produce an embedded motion field bit-stream, representing each, motion field in coarse to fine fashion and (b) storing computer-readable instructions in the computer which, when executed, interleave contributions from said embedded motion field bit-stream with successive contributions from said embedded coding of the transformed video samples.
    Type: Grant
    Filed: March 15, 2012
    Date of Patent: February 12, 2019
    Assignee: Unisearch Limited
    Inventors: David Taubman, Andrew Secker
  • Patent number: 10194172
    Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.
    Type: Grant
    Filed: August 16, 2017
    Date of Patent: January 29, 2019
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Alexandros Tourapis, Athanasios Leontaris, Peshala V. Pahalawatta, Kevin J. Stec
  • Patent number: 10194164
    Abstract: A moving picture coding method includes: coding a coding target block using a motion vector; generating motion vector predictors; and coding the motion vector using one of the motion vector predictors generated in the generating of the motion vector predictors. In the generating of the motion vector predictors, a replacement vector which replaces a temporal motion vector predictor is added to the motion vector predictors when it is impossible to obtain the temporal motion vector predictor from a block which is included in a coded picture different from the coding target picture and corresponds to the coding target block.
    Type: Grant
    Filed: October 12, 2017
    Date of Patent: January 29, 2019
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Hisao Sasai
  • Patent number: 10187655
    Abstract: System and method for improving operational efficiency of a video encoding pipeline used to encode image data. In embodiments, the video encoding pipeline includes a low resolution pipeline that includes a low resolution motion estimation block, which generates downscaled image data by reducing resolution of the image data and determines a low resolution inter-frame prediction mode by performing a motion estimation search using the downscaled image data and previously downscaled image data.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: January 22, 2019
    Assignee: Apple Inc.
    Inventors: Jim C. Chou, Mark P. Rygh, Guy Cõté
  • Patent number: 10171878
    Abstract: Controlling the admission of interactive television iTV applications to an iTV application distribution system is accomplished through the use of iTV application profiles that enumerate sets of allowed functions and behaviors for the iTV applications within the distribution system. In general, the profiles comprise filters that enable various functions within the distribution system, and may be applied to the iTV applications according to any of a number of bases. The distribution system includes an interface or console adapted to permit a system operator to create the application profiles and establish rules for attaching the profiles to the iTV applications, and an application profile engine configured to automatically validate the iTV applications against the profiles according to those rules.
    Type: Grant
    Filed: September 27, 2013
    Date of Patent: January 1, 2019
    Assignee: Comcast Cable Communications Management, LLC
    Inventors: John Carney, David DeAndrade
  • Patent number: 10154226
    Abstract: A method and system for displaying images captured by an in vivo imaging device are disclosed. Embodiments according to the present invention display image sequence data in a first display area. When a first bookmarked image with annotation information is displayed in the first display area, a first thumbnail image in a second display area corresponding to the first bookmarked image is replaced to indicate an occurring correspondence between the first bookmarked image and the first thumbnail image corresponding to the first bookmarked image being displayed. In one embodiment, the method further comprises displaying the first thumbnail image in the second display area when one other image of the image sequence data is displayed in the first display area after the first bookmarked image is displayed.
    Type: Grant
    Filed: March 9, 2017
    Date of Patent: December 11, 2018
    Assignee: CAPSOVISION INC.
    Inventors: Kang-Huai Wang, Gordon C. Wilson
  • Patent number: 10154280
    Abstract: A predictive coding system can encode motion vectors by determining a motion vector of a target partition in a frame picture of an encoding target; determining a first motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to a left-neighboring region to the target partition; determining a second motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to an above-neighboring region to the target partition; selecting an optimum motion vector predictor and outputting motion vector predictor indication information to specify the selected optimum motion vector predictor, the optimum motion vector predictor selected based on comparison between one or more motion vector predictor candidates including the first motion vector predictor candidate and the second motion vector predictor candidate, and the motion vector of the target partition; and encoding the motion vector predictor indication information.
    Type: Grant
    Filed: January 16, 2018
    Date of Patent: December 11, 2018
    Assignee: NTT DOCOMO, INC.
    Inventors: Akira Fujibayashi, Yoshinori Suzuki, Choong Seng Boon
  • Patent number: 10147226
    Abstract: A method of converting three dimensional image data into two dimensional image data, includes identifying at least two vertices of an object to be rendered in a frame of three dimensional image data, calculating a three-dimensional (3D) motion vector for each vertex of the object to be rendered, determining a position of each vertex in a new frame, calculating the motion vectors for a block based upon the vertex position in the new frame and the motion vectors for the vertex, and using the motion vectors for the vertex to render pixels in the new frame.
    Type: Grant
    Filed: March 8, 2016
    Date of Patent: December 4, 2018
    Assignee: Pixelworks, Inc.
    Inventors: Songsong Chen, Bob Zhang, Neil Woodall
  • Patent number: 10140550
    Abstract: Image processing circuitry processes image frames in a sequence of image frames, for example, to identify objects of interest. The processing includes filtering motion vectors associated with a current image frame, grouping the filtered motion vectors associated with the current image frame into a set of clusters associated with the current image frame, and selectively merging clusters in the set of clusters associated with the current image frame. At least one of the filtering, the grouping and the merging may be based on one or more clusters associated with one or more previous image frames in the sequence of image frames. Motion vectors included in merged clusters associated with a previous frame may be added to filtered motion vectors before grouping the motion vectors in the current frame.
    Type: Grant
    Filed: May 31, 2016
    Date of Patent: November 27, 2018
    Assignee: STMICROELECTRONICS S.R.L.
    Inventors: Giuseppe Spampinato, Arcangelo Ranieri Bruna, Viviana D'Alto
  • Patent number: 10139897
    Abstract: An example security sensor includes a battery power supply, camera coupled to the battery power supply to receive power, activity sensor, processor, and microcontroller. The processor is placed in a sleep state and is wakeable to an awake state. The processor coupled to the battery power supply, and coupled to the camera to receive and process image data including images of an activity within a zone. The microcontroller is coupled to the battery power supply, coupled to the activity sensor to receive interrupts responsive to detection by the activity sensor of the activity within the zone proximate the security sensor, coupled to the processor to send and receive data, and, responsive to receiving a first interrupt from the activity sensor, place the processor in an awake state to signal the camera to capture a set of images and to receive and process the image data including the set of images.
    Type: Grant
    Filed: November 10, 2015
    Date of Patent: November 27, 2018
    Assignee: NOVI SECURITY, INC.
    Inventors: Ethan Grabau, Tyler Crawford, Martin Johnson, Ruchir Chauhan, Jonathan Jensen
  • Patent number: 10123037
    Abstract: A method and apparatus for performing motion estimation in a digital video system is disclosed. Specifically, the present invention discloses a system that quickly calculates estimated motion vectors in a very efficient manner. In one embodiment, a first multiplicand is determined by multiplying a first display time difference between a first video picture and a second video picture by a power of two scale value. This step scales up a numerator for a ratio. Next, the system determines a scaled ratio by dividing that scaled numerator by a second first display time difference between said second video picture and a third video picture. The scaled ratio is then stored calculating motion vector estimations. By storing the scaled ratio, all the estimated motion vectors can be calculated quickly with good precision since the scaled ratio saves significant bits and reducing the scale is performed by simple shifts.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: November 6, 2018
    Assignee: APPLE INC.
    Inventors: Barin Geoffry Haskell, David William Singer, Adriana Dumitras, Atul Puri
  • Patent number: 10115203
    Abstract: Disclosed are methods, circuits, devices, systems and associated executable code for multi factor image feature registration and tracking, wherein utilized factors include both static and dynamic parameters within a video feed. Assessed factors may originate from a heterogeneous set of sensors including both video and audio sensors. Acoustically acquired scene information may supplement optically acquired information.
    Type: Grant
    Filed: July 26, 2017
    Date of Patent: October 30, 2018
    Assignee: GETALERT LTD.
    Inventors: Dor Givon, Yoram Elichai, Gil Davidman
  • Patent number: 10116839
    Abstract: Methods and systems for camera movement compensation for gesture detection and object recognition. In some examples, the methods and systems analyze motion data associated with the sequential frames of a video stream, and reject those frames where the detected camera movement exceeds a predetermined threshold. In other examples, the methods and systems use motion data and portions of immediate previous frames to adjust a frame where the detected camera movement exceeds the predetermined threshold to create an adjusted frame that compensates for the detected camera movement. In still other examples, frames are adjusted if the detected motion exceeds a first threshold, and rejected if the detected motion exceeds a second, higher threshold.
    Type: Grant
    Filed: July 23, 2015
    Date of Patent: October 30, 2018
    Assignee: Atheer Labs, Inc.
    Inventors: Ryan Fink, Gary Peck, Bryan Ransil
  • Patent number: 10104394
    Abstract: A streaming video or a stored video is analyzed to identify salient features. The salient features are the more interesting portions of the video because salient features include the most motion. A motion vector field including a motion vector for multiple pixels in the video is generated. The motion vector field is partitioned into grid blocks, and each of the grid blocks is divided into a set of orientation ranges. The vectors of the motion vector field for each grid block are binned into the orientation ranges. A motion score is calculated based on a count of motion vectors for the orientation ranges. The section of the video having higher or the highest motion score is designated as a salient feature. Among other applications, salient features may be used for thumbnail images, highlight reels, or video editing.
    Type: Grant
    Filed: January 31, 2014
    Date of Patent: October 16, 2018
    Assignee: HERE Global B.V.
    Inventor: Aaron Licata
  • Patent number: 10104391
    Abstract: Methods and systems for improving coding efficiency of video. In one aspect of the disclosure, efficiency may be improved by trimming candidate motion vectors used for spatial and/or temporal prediction. In another aspect of the disclosure, efficiency may be improved by choosing selective combinations of syntax elements from video data.
    Type: Grant
    Filed: October 1, 2010
    Date of Patent: October 16, 2018
    Assignee: Dolby International AB
    Inventors: Yeping Su, Christopher A. Segall
  • Patent number: 10097852
    Abstract: A moving picture coding method for coding a picture with switching between frame coding and field coding adaptively on a block-by-block basis includes: determining the maximum number of reference indices for field coding for specifying fields which are to be referred to at the time of field coding, using the maximum number of reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding; and assigning to fields the reference indices for field coding for specifying fields which are to be referred to at the time of field coding, within a range of the determined maximum number thereof, using the reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding.
    Type: Grant
    Filed: June 12, 2017
    Date of Patent: October 9, 2018
    Assignee: GODO KAISHA IP BRIDGE 1
    Inventors: Kiyofumi Abe, Shinya Kadono, Satoshi Kondo
  • Patent number: 10097765
    Abstract: The method includes in order to generate a composite image: identifying, in the frame of a video stream captured by a camera, a motion characteristic associated with moving objects in a scene while the camera captured a sliding window of the video stream. The method includes for a plurality of frames in the sliding window: controlling, by the processing circuitry, a weight of blending of the frame based on the identified motion characteristic to enable the composite image to be generated according to the controlled weights of blending of the plurality of frames in the sliding window.
    Type: Grant
    Filed: April 20, 2016
    Date of Patent: October 9, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hamid Rahim Sheikh, Ibrahim Pekkucuksen, John Glotzbach
  • Patent number: 10091522
    Abstract: A moving picture coding method for coding a picture with switching between frame coding and field coding adaptively on a block-by-block basis includes: determining the maximum number of reference indices for field coding for specifying fields which are to be referred to at the time of field coding, using the maximum number of reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding; and assigning to fields the reference indices for field coding for specifying fields which are to be referred to at the time of field coding, within a range of the determined maximum number thereof, using the reference indices for frame coding for specifying frames which are to be referred to at the time of frame coding.
    Type: Grant
    Filed: June 8, 2017
    Date of Patent: October 2, 2018
    Assignee: GODO KAISHA IP BRIDGE 1
    Inventors: Kiyofumi Abe, Shinya Kadono, Satoshi Kondo
  • Patent number: 10083498
    Abstract: A compensation method for a driving circuit of a display device includes generating a motion vector between a previous frame and a current frame subsequent to the previous frame; generating a first estimation frame according to the current frame and the motion vector; adjusting the first estimation frame according to the difference between the current frame and the first estimation frame, to generate a first overdrive frame; and inserting the first overdrive frame between the current frame and a next frame subsequent to the current frame.
    Type: Grant
    Filed: February 24, 2016
    Date of Patent: September 25, 2018
    Assignee: NOVATEK Microelectronics Corp.
    Inventors: Kuei-Chung Chang, Shang-I Liu, Pu-Hsien Chang
  • Patent number: 10075727
    Abstract: A method is performed in an encoder for encoding a video stream captured by a camera, and a computer program product and encoder implementing the method.
    Type: Grant
    Filed: March 15, 2017
    Date of Patent: September 11, 2018
    Assignee: Axis AB
    Inventor: Viktor Edpalm
  • Patent number: 10063853
    Abstract: The invention pertains to a method for a video encoder to select data from a set of image blocks, each block being associated with a frame, a counter value and a cost, the method comprising: calculating, for a target block from among said set of image blocks, the respective counter values and the respective costs of other blocks from among said set of image blocks, said other blocks being associated with the same frame as the target block or with a previous frame; and selecting from said other blocks a reference block having the lowest cost and counter value, according to predefined criteria. The invention also pertains to a computer program product for carrying out the method, and to a video encoder apparatus.
    Type: Grant
    Filed: December 16, 2013
    Date of Patent: August 28, 2018
    Assignee: BARCO N.V.
    Inventor: Thijs Koen Vermeir
  • Patent number: 10055655
    Abstract: A traffic light detection device uses an image pickup unit mounted on a vehicle to extract, from an image taken of surroundings of the vehicle, synchronized pixels, whose brightness changes in synchronization with an alternating current period of electric power supplied to a traffic light, and detects the traffic light from the synchronized pixels. The traffic light detection device is provided with: a positional variation calculation unit that calculates positional variation amounts of continuously extracted positions of the synchronized pixels; and a signal lamp determination unit that determines, as a signal lamp candidate, the synchronized pixels whose positional variation amount is equal to or smaller than a threshold value.
    Type: Grant
    Filed: April 8, 2015
    Date of Patent: August 21, 2018
    Assignee: Nissan Motor Co., Ltd.
    Inventors: Takahiko Oki, Haruo Matsuo, Daiki Yamanoi
  • Patent number: 10051283
    Abstract: The invention relates to a method for predicting a movement vector (MVp1) of a partition (P1) of a current image (IN) from a plurality of n reference movement vectors associated respectively with n reference partitions that have been previously encoded and decoded. For a spatial prediction of one such vector, when the geometric shape of the current partition is different from that of k adjacent reference partitions (pr1, pr2, . . . prk), with k?n, the movement vector of the current image partition is determined from a function of at least one reference movement vector belonging to a set of k reference movement vectors associated respectively with k adjacent reference partitions.
    Type: Grant
    Filed: June 25, 2010
    Date of Patent: August 14, 2018
    Assignee: FRANCE TELECOM
    Inventors: Joel Jung, Guillaume Laroche, Jean Marc Thiesse
  • Patent number: 10034012
    Abstract: An inter-predicted image generation section (16) of a moving image decoder (1) includes a weighting factor calculation section (16b) for setting the value of the weighting factor w2 such that a relation 0<|w2?0.5|<|tb/td?0.5| is met, wherein td represents an inter-frame distance between the decoded image P1 and the decoded image P2 and tb represents a distance between the decoded image P1 and the decoded image P.
    Type: Grant
    Filed: April 28, 2011
    Date of Patent: July 24, 2018
    Assignee: Sharp Kabushiki Kaisha
    Inventor: Tomohiro Ikai
  • Patent number: 10031939
    Abstract: Mechanisms to help a computing system respond to a request for information within a data model. After determining that there is insufficient information within the data model to respond to the request, the computing system identifies one or more additional data sources that are external to the data model and that contain information suitable to respond to the request. The computing system then automatically supplements the data model with at least one of such additional data sources. The computing system then responds to the request using the supplemented data model. In some embodiments, the supplementation is performed in advance of the request by analyzing the characteristics of the data model and/or by anticipating possible future requests. Thus, a data model grows automatically in response to particular usage of that data model to satisfy requests.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: July 24, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Pedram Faghihi Rezaei, Amir M. Netz, Adam D. Wilson, Christopher A. Hays, Patrick J. Baumgartner
  • Patent number: 10027890
    Abstract: A motion detector calculates a camera shake matrix H(t) applied for a coordinate conversion for a camera shake correction. At this time, the motion detector calculates a motion vector (MV) for each block obtained by dividing a frame, and excludes an object motion vector (MV-B) from the MV. In addition, when a camera shake matrix H_mv that represents a camera shake between the frames is not calculable based on the MV, the motion detector calculates and adjusts a camera shake matrix H_sensor that represents a camera shake in accordance with a motion of an image picker, and settles this matrix as the camera shake matrix H(t).
    Type: Grant
    Filed: September 26, 2016
    Date of Patent: July 17, 2018
    Assignee: Casio Computer Co., Ltd.
    Inventor: Yoshitsugu Manabe
  • Patent number: 10015511
    Abstract: An image frame motion estimation device and image frame motion estimation method using the same include performing first sampling for generating a first sample source block by performing first-type sampling on pixels of a source block; performing second sampling for generating a first sample reference block by performing first-type sampling on pixels of a reference block; determining a first matching region by comparing pixel values of the first sample source block and the first sample reference block; and determining a second matching region corresponding to the source block by comparing pixel values of a plurality of regions adjacent to the first matching region and the source block.
    Type: Grant
    Filed: August 8, 2014
    Date of Patent: July 3, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Sung-jei Kim, Nyeong-kyu Kwon
  • Patent number: 10007519
    Abstract: A processor includes a core to execute an instruction for conversion between an element array and a packed bit array. The core includes logic to identify one or more bit-field lengths to be used by the packed bit array, identify a width of elements of the element array, and simultaneously for elements of the element array and for bit-fields of the packed bit array, convert between the element array and the packed bit array based upon the bit-field length and the width of elements of the element array.
    Type: Grant
    Filed: December 22, 2015
    Date of Patent: June 26, 2018
    Assignee: Intel IP Corporation
    Inventors: Elmoustapha Ould-Ahmed-Vall, Thomas Willhalm, Robert Valentine
  • Patent number: 10009626
    Abstract: Methods and systems for rate-constrained search ordering algorithms for reducing computational cost of motion estimation in video coding have been provided. Conventional search orderings, such as spiral search, can weaken the filtering criterion of rate-constrained successive elimination algorithms. Simulation results provided herein above demonstrate that, on average, the amount of SAD (sum of absolute differences) operations required to encode the tested sequences, is reduced using embodiments of the invention, when compared to the conventional implementations of spiral search for example. Advantageously, for sequences with unpredictable motion, this reduction may be greater than 5%, and may even exceed 10% when smaller block partitions are evaluated.
    Type: Grant
    Filed: January 29, 2015
    Date of Patent: June 26, 2018
    Assignee: ECOLE DE TECHNOLOGIE SUPERIEURE
    Inventors: Luc Normand Trudeau, Stéphane Coulombe, Christian Desrosiers
  • Patent number: 9977642
    Abstract: The invention relates to an encoder and a decoder and methods therein for supporting screen sharing, where the screen sharing comprises encoding pictures F representing pixels of a shared screen, providing said pictures to a decoder where they are decoded. The method performed by the encoder comprises deriving information related to an object which is moved on the shared screen between two pictures Fn and Fn+1. At least part of the derived information is related to an intermediate position of the object, on the shared screen, between the two pictures Fn and Fn+1. The method further comprises providing said information to the decoder, thereby enabling the decoder to generate intermediate pictures, FIMD, in addition to the pictures, F, based on the provided information, wherein the object is generated in different positions in said intermediate pictures, FIMD, thus reconstructing the movement of the object between two provided pictures Fn and Fn+1.
    Type: Grant
    Filed: January 27, 2015
    Date of Patent: May 22, 2018
    Assignee: Telefonaktiebolaget L M Ericsson (publ)
    Inventors: Martin Pettersson, Jonatan Samuelsson, Ying Wang
  • Patent number: 9955172
    Abstract: A video data processing device includes: a processor; and a memory which stores a plurality of instructions, which when executed by the processor, cause the processor to execute: making, on the basis of first key frames obtained by encoding images in frames included in moving image data, difference frames in each of which a partial image different from an image in a frame corresponding to each first key frame is encoded; and generating, if the number of generated difference frames reaches a first number, in response to detection that a difference between a difference frame generated thereafter and a difference frame preceding in time to the difference frame generated thereafter is not larger than a given value, a second key frame distinguished from the first key frames and obtained by encoding an image in the frame.
    Type: Grant
    Filed: October 22, 2015
    Date of Patent: April 24, 2018
    Assignee: FUJITSU LIMITED
    Inventors: Yousuke Yamaguchi, Shunsuke Kobayashi, Kazuhiro Yamashita, Yasuo Misuda
  • Patent number: 9934582
    Abstract: An image capture apparatus capable of identifying desired time points without using a special device is provided. The image capture apparatus 1 includes a moving image acquiring unit 53, a calculating unit 56, and an identification area analyzing unit 57. The moving image acquiring unit 53 acquires a plurality of images captured consecutively. The calculating unit 56 calculates variation values of pixel values along a time series of the plurality of images acquired by the moving image acquiring unit 53, within a predetermined region common to the plurality of images. The identification area analyzing unit 57 identifies two time points according to a predetermined standard from among a plurality of time points in the time series, on the basis of the variation values of the pixel values calculated by the calculating unit 56.
    Type: Grant
    Filed: September 16, 2015
    Date of Patent: April 3, 2018
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Masanori Ishihara
  • Patent number: 9918085
    Abstract: An improved loss recovery method for coding streaming media classifies each data unit in the media stream as an independent data unit (I unit), a remotely predicted unit (R unit) or a predicted data unit (P unit). Each of these units is organized into independent segments having an I unit, multiple P units and R units interspersed among the P units. The beginning of each segment is the start of a random access point, while each R unit provides a loss recovery point that can be placed independently of the I unit. This approach separates the random access point from the loss recovery points provided by the R units, and makes the stream more impervious to data losses without substantially impacting coding efficiency. The most important data units are transmitted with the most reliability to ensure that the majority of the data received by the client is usable. The I units are the least sensitive to transmission losses because they are coded using only their own data.
    Type: Grant
    Filed: November 24, 2015
    Date of Patent: March 13, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Albert Szu-Chi Wang, Ming-Chieh Lee
  • Patent number: 9912948
    Abstract: A method and device for encoding video including determining objects within a frame at least partially based on movement characteristics of underlying pixels and partitioning the frame into blocks by considering a plurality of partitioning options, such partitioning favoring options that result in different objects being placed in different blocks.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: March 6, 2018
    Assignee: Lyrical Labs Video Compression Technology, LLC
    Inventors: Edward Ratner, Jeffrey Alan Keswin
  • Patent number: 9900665
    Abstract: Exemplary methods for automatically testing closed caption (CC) rendering includes receiving a set of one or more reference audio video (AV) streams from an AV source, and generating reference CC images from the set of one or more reference AV streams starting from a recording start time to a recording stop time. In one embodiment, the method further includes receiving a set of one or more test AV streams from the AV source, and generating test CC images from the set of one or more test AV streams starting from the recording start time to the recording stop time. In one embodiment, the methods further include determining whether the AV source is performing CC rendering properly by automatically comparing the test CC images against the reference CC images.
    Type: Grant
    Filed: April 14, 2016
    Date of Patent: February 20, 2018
    Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
    Inventors: Bhushan Ramnani, Zheng Nie, Xiaosong Zhu, Juan Flores, Aparna Varanasi
  • Patent number: 9883105
    Abstract: In an image processing apparatus, a first motion detector calculates an angular velocity indicating a motion of an imaging apparatus body. A second motion detector calculates a movement amount of a motion of an object based on successively captured images. In addition, a motion vector calculating unit corrects the movement amount of the motion of the object based on the angular velocity, and calculates a motion vector of a main object based on the corrected movement amount.
    Type: Grant
    Filed: July 28, 2016
    Date of Patent: January 30, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kohta Haruna
  • Patent number: 9877040
    Abstract: A predictive coding system can encode motion vectors by determining a motion vector of a target partition in a frame picture of an encoding target; determining a first motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to a left-neighboring region to the target partition; determining a second motion vector predictor candidate from a motion vector or motion vectors of one or more partitions belonging to an above-neighboring region to the target partition; selecting an optimum motion vector predictor and outputting motion vector predictor indication information to specify the selected optimum motion vector predictor, the optimum motion vector predictor selected based on comparison between one or more motion vector predictor candidates including the first motion vector predictor candidate and the second motion vector predictor candidate, and the motion vector of the target partition; and encoding the motion vector predictor indication information.
    Type: Grant
    Filed: December 9, 2016
    Date of Patent: January 23, 2018
    Assignee: NTT DOCOMO, INC.
    Inventors: Akira Fujibayashi, Yoshinori Suzuki, Choong Seng Boon
  • Patent number: 9854167
    Abstract: A frame skipping process suited to a scene is achieved by providing an encoder which encodes input image data, an encoding determination unit which compares image movement information with a threshold to determine whether or not encoding is to be performed, a frame skipping controller which performs a frame skipping control if encoding is not to be performed, and a threshold correction unit which corrects the encoding determination threshold based on the result of the encoding process. The image movement information used in the encoding determination unit is any one or a combination of pixel movement information obtained by a representative point matching scheme performed by a pixel movement calculation unit, angular velocity sensor information obtained from a lens controller, and frequency information obtained from an image processor.
    Type: Grant
    Filed: September 5, 2012
    Date of Patent: December 26, 2017
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Tomokazu Uchida, Masahiro Hojo
  • Patent number: 9843817
    Abstract: The present invention is directed to an image information decoding apparatus adapted for performing infra-image decoding based on resolution of color components and color space of an input image signal. An intra prediction unit serves to adaptively change block size in generating a prediction image based on a chroma format signal indicating whether resolution of color components is one of 4:2:0 format, 4:2:2 format, and 4:4:4 format, and a color space signal indicating whether color space is one of YCbCr, RGB, and XYZ. An inverse orthogonal transform unit and an inverse quantization unit serve to also change orthogonal transform technique and quantization technique in accordance with the chroma format signal and the color space signal. A decoding unit decodes the chroma format signal and the color space signal to generate a prediction image corresponding to the chroma format signal and the color space signal.
    Type: Grant
    Filed: March 9, 2016
    Date of Patent: December 12, 2017
    Assignee: Sony Corporation
    Inventors: Teruhiko Suzuki, Akira Sugiyama, Kyohei Koyabu
  • Patent number: RE46678
    Abstract: Disclosed are an apparatus and a method of encoding/decoding a video, particularly a method and an apparatus for storing a quantization parameter differential value in a largest coding unit (LCU) based on quadtree splitting and adaptively predicting a quantization parameter value based on context information on neighboring CUs. Quadtree-based quantization parameter encoding and decoding methods and apparatuses effectively show information on a block having a quantization parameter differential value based on splitting information on a CU and adaptively predict a quantization parameter value using context information including a block size, block partition and a quantization parameter of a neighboring CU.
    Type: Grant
    Filed: July 31, 2015
    Date of Patent: January 16, 2018
    Assignee: Intellectual Discovery Co., LTD.
    Inventors: Dong Gyu Sim, Jung Hak Nam, Hyung Ho Jo