Interframe Coding (e.g., Difference Or Motion Detection) Patents (Class 382/236)
  • Patent number: 10740431
    Abstract: An apparatus and method of five dimensional (5D) video stabilization with camera and gyroscope fusion. According to one embodiment, an apparatus includes a feature matcher configured to receive an image sequence and determine feature pairs in the image sequence; a residual two-dimensional (2D) translation estimator connected to the feature matcher and configured to determine a raw 2D translation path; a residual 2D translation smoother connected to the residual 2D translation estimator and configured to determine a 2D smoothed translation path; a distortion calculator connected to the residual 2D translation estimator and the residual 2D translation smoother and configured to determine a distortion grid; and a distortion compensator connected to the distortion calculator and configured to compensate for distortion in the image sequence.
    Type: Grant
    Filed: June 22, 2018
    Date of Patent: August 11, 2020
    Assignee: Samsung Electronics Co., Ltd
    Inventors: Binnan Zhuang, Dongwoon Bai, Jungwon Lee
  • Patent number: 10706110
    Abstract: Described in detail herein are systems and methods a data repository for an Electronic Document Interchange (EDI) system. A data repository management system can receive from a party system, at least one EDI document type, information associated with the third party system, a first set of data requests and a first set of data responses. The data repository management system can be operatively coupled to a data repository including a master self-referential table defining a hierarchy for the data repository. The data repository can further include a child table, a first sub-child table and a second sub-child table. The data repository management system can generate a rows in the master self-relational table, child table, first sub-child table and second sub-child table to store the information associated with the third party system and an associated EDI document.
    Type: Grant
    Filed: June 22, 2018
    Date of Patent: July 7, 2020
    Assignee: Walmart Apollo, LLC
    Inventors: Jason Paul McCrory, Ted Sherrill
  • Patent number: 10701387
    Abstract: A motion estimation technique finds first and second candidate bi-directional motion vectors for a first region of an interpolated frame of video content by performing double ended vector motion estimation on the first region. One of these candidate bi-directional motion vectors is selected, and used to identify a remote region of the interpolated frame. This remote region is located at an off-set location from the first region, and is found based on an endpoint of the selected candidate bi-directional motion vector. A remote motion vector for the remote region of the interpolated frame is obtained, and one or more properties of this remote motion vector are used to bias a selection between the first and second candidate vectors.
    Type: Grant
    Filed: April 25, 2019
    Date of Patent: June 30, 2020
    Assignee: Imagination Technologies Limited
    Inventor: Steven Fishwick
  • Patent number: 10694181
    Abstract: An example method of filtering a reconstructed block of video data includes obtaining, by one or more processors, reconstructed samples of a current block of the video data; and selectively bilaterally filtering, by the one or more processors, the reconstructed samples of the current block to generate a filtered current block. In this example, selectively bilaterally filtering the reconstructed samples of the current block comprises refraining from bilaterally filtering at least one reconstructed sample of the current block such that the filtered current block includes at least one non-bilaterally filtered sample.
    Type: Grant
    Filed: January 24, 2018
    Date of Patent: June 23, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Li Zhang, Jianle Chen, Wei-Jung Chien, Marta Karczewicz
  • Patent number: 10656657
    Abstract: Systems and methods for predicting object motion and controlling autonomous vehicles are provided. In one example embodiment, a computer implemented method includes obtaining state data indicative of at least a current or a past state of an object that is within a surrounding environment of an autonomous vehicle. The method includes obtaining data associated with a geographic area in which the object is located. The method includes generating a combined data set associated with the object based at least in part on a fusion of the state data and the data associated with the geographic area in which the object is located. The method includes obtaining data indicative of a machine-learned model. The method includes inputting the combined data set into the machine-learned model. The method includes receiving an output from the machine-learned model. The output can be indicative of a predicted trajectory of the object.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: May 19, 2020
    Assignee: UATC, LLC
    Inventors: Nemanja Djuric, Vladan Radosavljevic, Thi Duong Nguyen, Tsung-Han Lin, Jeff Schneider
  • Patent number: 10638093
    Abstract: A wireless field device for use in an industrial process control or monitoring system includes a controller configured to control operation of the wireless field device. Wireless communication circuitry is configured to wirelessly communicate with a remote location. An internal power source powers the wireless field device. An image capture device is coupled to the controller and configured to capture an image of an environment of the wireless field device. The controller is adapted to receive image information from the image capture device and transmit compressed image information to the remote location.
    Type: Grant
    Filed: September 26, 2013
    Date of Patent: April 28, 2020
    Assignee: ROSEMOUNT INC.
    Inventors: Eric Darrell Rotvold, Chad Michael McGuire, Robert J. Karschnia, Robert Martin Beckmann
  • Patent number: 10631005
    Abstract: A system and method for coding a block of video data in block prediction mode for display stream compression (DSC) is disclosed. In one aspect, the method includes determining a candidate block to be used for predicting a current block in a current slice. The candidate block may be within a range of locations defined by one or more block prediction parameters. The method further includes determining, based on the candidate block and the current block, a prediction vector identifying a location of the candidate block with respect to the current block, and coding the current block in block prediction mode at least in part via signaling the prediction vector identifying the location of the candidate block with respect to the current block.
    Type: Grant
    Filed: April 20, 2015
    Date of Patent: April 21, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Natan Haim Jacobson, Vijayaraghavan Thirumalai, Rajan Laxman Joshi, Min Dai
  • Patent number: 10572004
    Abstract: A head mounted display device includes a head mounted display panel, a motion tracker which tracks a movement of the head mounted display panel according to a head movement of a user and outputs sensing data, an image corrector which shifts and outputs entire image data based on the sensing data when the head mounted display panel rotates, a data driver which converts the entire image data output from the image corrector into a data signal and provides the data signal to the head mounted display panel, and a scan driver which provides a scan signal to the head mounted display panel.
    Type: Grant
    Filed: January 3, 2018
    Date of Patent: February 25, 2020
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventors: Seongkyun Kim, Jonggil Kim
  • Patent number: 10553004
    Abstract: An image processing method and an apparatus are provided. The image processing method includes acquiring first image data including a plurality of target pixels, acquiring synthesis information by which a relationship, between each of the plurality of target pixels included in the first image data and at least one background pixel included in different image data to be synthesized with the first image data, is determined, and synthesizing a target pixel of the first image data with the at least one background pixel of second image data, based on the synthesis information according to determination of the second image data. The second image data includes the different image data to be synthesized with the first image data.
    Type: Grant
    Filed: January 12, 2017
    Date of Patent: February 4, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Piotr Henryk Dabrowski
  • Patent number: 10536711
    Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: January 14, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Antti Olli Hallapuro, Kemal Ugur, Jani Lainema
  • Patent number: 10523961
    Abstract: A motion estimation method for video data including frames and an apparatus therefor are provided. The motion estimation method includes determining whether a current frame unit for which motion estimation is to be performed corresponds to a double block, when the current frame unit corresponds to a double block, acquiring a candidate vector set corresponding to a first single block included in the double block, as a candidate vector set of the double block, individually calculating a confidence function value of each candidate vector included in the candidate vector set of the double block, for the first single block and a second single block included in the double block, and acquiring an estimated motion vector of the first single block and an estimated motion vector of the second single block, based on the calculated confidence function value of each candidate vector.
    Type: Grant
    Filed: August 2, 2018
    Date of Patent: December 31, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Petr Pohl, Alexey Mikhailovich Gruzdev, Igor Mironovich Kovliga, Valery Valerievich Anisimovskiy, Roman Arzumanyan
  • Patent number: 10523957
    Abstract: Systems, methods, and instrumentalities are disclosed for encoder and/or decoder optimization using a multi-threaded parallel processing framework. An encoding and/or decoding device may receive a video sequence that includes a plurality of first-temporal level pictures associated with a first temporal level and a plurality of second-temporal level pictures associated with a second temporal level. The encoding and/or decoding device may allocate a first number of parallel processing threads for encoding and/or decoding the first-temporal level pictures and a second number of parallel processing threads for encoding and/or decoding the second-temporal level pictures. The device may perform this allocation based on temporal level priority, for example. The encoding and/or decoding device may encode and/or decode the first-temporal level pictures and the second-temporal level pictures.
    Type: Grant
    Filed: August 10, 2015
    Date of Patent: December 31, 2019
    Assignee: VID SCALE, Inc.
    Inventors: Srinivas Gudumasu, Yuwen He, Yan Ye, Ralph Neff
  • Patent number: 10516896
    Abstract: An encoding device that performs an encoding process on a moving image by using motion estimation according to the present invention includes: an acquisition unit that acquires a framerate of the moving image; a setting unit that performs setting of the number of reference frames on each frame of the moving image in accordance with the framerate; and an estimation unit that performs the motion estimation by using a frame to be encoded and a reference frame acquired based on the setting, and the setting unit performs the setting such that the number of reference frames is smaller when the framerate is higher.
    Type: Grant
    Filed: April 30, 2018
    Date of Patent: December 24, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Takafumi Murata
  • Patent number: 10515337
    Abstract: Image-based object representation (OR) tracking of users or other objects in a facility may occasionally lose the identity associated with a particular OR. For example, in a crowded aisle the respective ORs for individual users may merge, resulting in a loss of identity of the particular OR. As the crowd dissipates, confidence in the identity of a particular OR may be low. In one implementation, image processing is used to determine OR movement data descriptive of the time(s) when the OR is in motion or stopped. Device movement based on data acquired by sensors on a mobile device carried by a user is descriptive of when the mobile device is in motion or stopped. A match between the particular OR movement data and the particular device movement data allows the identity of the particular OR to be determined as an identity associated with the mobile device.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: December 24, 2019
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Somasundaram Niranjayan, Nathan Pius O'Neill
  • Patent number: 10491927
    Abstract: The present invention relates to a quadtree-based bandwidth compression prediction method and a system thereof. The bandwidth compression prediction method for example includes: dividing a to-be-predicted macroblock; obtaining a first prediction residual and a second prediction residual; judging whether re-dividing is performed on the to-be-predicted macroblock; and outputting the prediction residual and pixel component minimum values of the final sub-macroblocks divided from the to-be-predicted macroblock. According to the quadtree-based bandwidth compression prediction method and system, during the processing of complex texture images, the prediction effect is good, the processing efficiency is high, and the theoretical limit entropy can be reduced.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: November 26, 2019
    Assignee: XI'AN CREATION KEJI CO., LTD.
    Inventors: Ying Zhang, Yu Luo, Wenfang Ran
  • Patent number: 10484691
    Abstract: A coding method including dividing pixels of a chrominance component of an input image into blocks having a predetermined size; selecting one among a direct current prediction method, a vertical prediction method, a horizontal prediction method, and a hybrid prediction method according to a user's input; generating a prediction value of each pixel in a current block to be predictively coded, using at least one pixel value among pixel values in an upper reference block adjacent to the current block and in a side reference block adjacent to the current block, according to the selected prediction method; generating a differential value between the prediction value and a corresponding real pixel value in the current block; and coding the differential value and information on the selected prediction method using a predetermined coding method.
    Type: Grant
    Filed: January 28, 2019
    Date of Patent: November 19, 2019
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Woo-shik Kim, Chang-yeong Kim, Yang-seock Seo
  • Patent number: 10445375
    Abstract: A retrieval information generation device includes a determination unit that determines retrieval document information for retrieving a phrase in an original document from an original document file which is created by reading the original document by an image reading device and is identified on the basis of identification information, an extraction unit that extracts retrieval image information for visually specifying the original document from the original document file, and a generation unit that associates the retrieval document information and the retrieval image information with the identification information of the original document file to generate a retrieval file.
    Type: Grant
    Filed: July 10, 2017
    Date of Patent: October 15, 2019
    Assignee: FUJI XEROX CO., LTD.
    Inventor: Toru Otagaki
  • Patent number: 10448035
    Abstract: Provided is an information compression device or the like which is capable of compressing information required for encoding processing to a smaller size. The information compression device calculates a number of non-zero blocks having a value equal or greater than a predetermined value, determine a position for storing the non-zero blocks in a memory, and store only the non-zero blocks to a memory area in accordance with the determined position.
    Type: Grant
    Filed: November 9, 2016
    Date of Patent: October 15, 2019
    Assignee: NEC CORPORATION
    Inventor: Tatsuji Moriyoshi
  • Patent number: 10440388
    Abstract: This disclosure describes filtering techniques applied by an encoder and a decoder during the prediction stage of a video encoding and/or decoding process. The filtering techniques may enhance the accuracy of predictive data used during fractional interpolation, and may improve predictive data of integer blocks of pixels. There are several aspects to this disclosure, including a useful twelve-pixel filter support that may be used for interpolation, techniques that use coefficient symmetry and pixel symmetry to reduce the amount of data needed to be sent between an encoder and a decoder to configure the filter support for interpolation, and techniques for filtering data at integer pixel locations in a manner that is similar to sub-pixel interpolation. Other aspects of this disclosure concern techniques for encoding information in the bitstream to convey the type of filter used, and possibly the filter coefficients used. Predictive coding of filter coefficients is also described.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: October 8, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Yan Ye, Marta Karczewicz
  • Patent number: 10430959
    Abstract: A method and apparatus for matching stereo images including calculating a data cost of at least one image, calculating a smoothness cost of the image, and matching pixels among pixels of a plurality of images based on the data cost and the smoothness cost.
    Type: Grant
    Filed: November 22, 2016
    Date of Patent: October 1, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Hyun Sung Chang, Hyoseok Hwang
  • Patent number: 10425658
    Abstract: This application provides an image block matching method performed at a computing device, the method including: obtaining a target image block and an image; identifying a candidate image block within the image and multiple search points in the candidate image block; calculating a plurality of differences between the target image block and the candidate image block, each difference corresponding to a respective search point; choosing, among the plurality of differences, a smallest value and a corresponding smallest-value search point; and when the smallest-value search point is at the center of the target image block, choosing the candidate image block as a match of the target image block.
    Type: Grant
    Filed: September 19, 2017
    Date of Patent: September 24, 2019
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Jiawen Huang
  • Patent number: 10419752
    Abstract: Provided are an image encoding method and device. When carrying out image encoding for a block within a slice, at least one block in a restored block of the slice is set as a reference block. When this is done, the encoding parameters of the reference block are distinguished, and the block to be encoded is encoded adaptively based on the encoding parameters.
    Type: Grant
    Filed: December 16, 2010
    Date of Patent: September 17, 2019
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Sung Chang Lim, Jong Ho Kim, Hae Chul Choi, Hui Yong Kim, Ha Hyun Lee, Jin Ho Lee, Se Yoon Jeong, Suk Hee Cho, Jin Soo Choi, Jin Woo Hong, Jin Woong Kim
  • Patent number: 10404959
    Abstract: Logging events in a media file, including: providing a logger tool to allow a user to view media in multiple ways and to capture and validate key events within the media file; and tracking and logging events in the media file by adding information to the media file including locations of bars and tone, slates, content, logos, commercial blacks, quality control issues, subtitles, and captions.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: September 3, 2019
    Assignees: SONY CORPORATION, SONY PICTURES ENTERTAINMENT INC.
    Inventors: Jason Brahms, Ryan Kido, Oleksandr Zhukov, Oleg Sharov
  • Patent number: 10397613
    Abstract: A method for decoding video includes creating a first list of motion vectors from at least one neighboring block in a current frame of the video and creating a second list of motion vectors from at least one previous block in a temporally earlier frame of the video. A third list of motion vectors is created based upon the first list and the second list. Based upon receiving a motion vector competition control parameter selecting one of the motion vectors from the third list, wherein the second list of motion vectors is further based upon a flooring function.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: August 27, 2019
    Assignee: Velos Media, LLC
    Inventor: Christopher A. Segall
  • Patent number: 10360046
    Abstract: Image data representing a desktop image for a client device that is accessing the desktop remotely is compressed according to a method that preserves image fidelity in selected non-text regions. The method, which is carried out in a remote server, includes the steps of generating image data for the remote desktop image and analyzing different regions of the remote desktop image, identifying those regions of the remote desktop image that are text regions, selecting non-text regions of the remote desktop image for lossless compression based on a spatial relationship between the non-text regions and the text regions, compressing the image data using a lossless compression protocol for a portion of the image data corresponding to the selected non-text regions, and transmitting the compressed image data to the client device.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: July 23, 2019
    Assignee: Vmware, Inc.
    Inventors: Lawrence Spracklen, Banit Agrawal, Rishi Bidarkar
  • Patent number: 10356426
    Abstract: Encoding and decoding using advanced motion estimation includes generating a first encoded frame by encoding a first frame from the input video stream, generating a reconstructed frame based on the first encoded frame, generating an encoded reference frame by encoding the reconstructed frame, wherein encoding the reconstructed frame includes storing the encoded reference frame in an external memory such that respective blocks from the encoded reference frame are directly accessible, generating a second encoded frame by encoding a second frame from the input video stream, and transmitting or storing the second encoded frame. Encoding the second frame includes generating reconstructed reference frame data, wherein generating the reconstructed reference frame data includes directly retrieving a block from the encoded reference frame from the external memory, and encoding the second frame using the reconstructed reference frame data.
    Type: Grant
    Filed: August 21, 2017
    Date of Patent: July 16, 2019
    Assignee: GOOGLE LLC
    Inventor: Juha Pekka Maaninen
  • Patent number: 10341682
    Abstract: Methods and devices are disclosed for panoramic video coding and decoding based on multi-mode boundary fill. If a predicted image block of a current image block is obtained by inter-frame prediction. The inter-frame prediction includes a boundary fill step of adaptively selecting a boundary fill method according to coordinates of a reference sample when the reference sample of a pixel in the current image block is outside the boundary of a corresponding reference image, to obtain a sample value of the reference sample. The panoramic video encoding and decoding method and device based on multi-mode boundary fill in the present invention make full use of the characteristic that horizontal image contents in a panoramic video are cyclically connected to optimize an image boundary fill method, such that the encoding can adaptively select a more reasonable boundary fill method according to the coordinates of a reference sample, thereby improving compression efficiency.
    Type: Grant
    Filed: January 19, 2016
    Date of Patent: July 2, 2019
    Assignee: Peking University Shenzhen Graduate School
    Inventors: Zhenyu Wang, Ronggang Wang, Xiubao Jiang, Wen Gao
  • Patent number: 10341665
    Abstract: The invention generally relates to a method of providing random access for video data in which a P-frame of the video data is configured to be random accessible in addition to I-frames. More specifically, the invention relates to a method of providing random access for video data in which a P-frame is configured to be random accessible based on a random access reference frame which is provided via a separate channel such as header area of video data packets or a metadata file, whereby the random access for video data may be effectively provided with overcoming the conventional video random access technology depending on the I-frame only. The invention makes it possible to configure a P-frame random accessible simply by accompanying a random access reference frame of small datasize, whereby video compression ratio may be improved due to smaller numbers of I-frames being included in video data than conventional arts.
    Type: Grant
    Filed: April 12, 2017
    Date of Patent: July 2, 2019
    Assignee: INNODEP Co., LTD.
    Inventors: Hyunseong Bae, Youngju Heo, Sungjin Lee
  • Patent number: 10324363
    Abstract: An image device capable of compensating image variation includes at least one image capturer and a compensator. The compensator is electrically connected to the at least one image capturer for generating a 360 degree image, projecting the 360 degree image according to a view angle to generate a plane image corresponding to the view angle, detecting image position variation of at least one object of the plane image, and compensating the image position variation of the at least one object of the plane image, wherein position variation of the image device makes an image position of the at least one object be changed.
    Type: Grant
    Filed: February 23, 2018
    Date of Patent: June 18, 2019
    Assignee: eYs3D Microelectronics, Co.
    Inventor: Chi-Feng Lee
  • Patent number: 10321149
    Abstract: A motion estimation technique finds first and second candidate bi-directional motion vectors for a first region of an interpolated frame of video content by performing double ended vector motion estimation on the first region. One of these candidate bi-directional motion vectors is selected, and used to identify a remote region of the interpolated frame. This remote region is located at an off-set location from the first region, and is found based on an endpoint of the selected candidate bi-directional motion vector. A remote motion vector for the remote region of the interpolated frame is obtained, and one or more properties of this remote motion vector are used to bias a selection between the first and second candidate vectors.
    Type: Grant
    Filed: June 5, 2015
    Date of Patent: June 11, 2019
    Assignee: Imagination Technologies Limited
    Inventor: Steven Fishwick
  • Patent number: 10311294
    Abstract: Methods of recognizing motions of an object in a video clip or an image sequence are disclosed. A plurality of frames are selected out of a video clip or an image sequence of interest. A text category is associated with each frame by applying an image classification technique with a trained deep-learning model for a set of categories containing various poses of an object within each frame. A “super-character” is formed by embedding respective text categories of the frames as corresponding ideograms in a 2-D symbol having multiple ideograms contained therein. Particular motion of the object is recognized by obtaining the meaning of the “super-character” with image classification of the 2-D symbol via a trained convolutional neural networks model for various motions of the object derived from specific sequential combinations of text categories. Ideograms may contain imagery data instead of text categories, e.g., detailed images or reduced-size images.
    Type: Grant
    Filed: March 2, 2019
    Date of Patent: June 4, 2019
    Assignee: Gyrfalcon Technology Inc.
    Inventors: Lin Yang, Patrick Z. Dong, Baohua Sun
  • Patent number: 10298950
    Abstract: A P frame-based multi-hypothesis motion compensation method includes: taking an encoded image block adjacent to a current image block as a reference image block and obtaining a first motion vector of the current image block by using a motion vector of the reference image block, the first motion vector pointing to a first prediction block; taking the first motion vector as a reference value and performing joint motion estimation on the current image block to obtain a second motion vector of the current image block, the second motion vector pointing to a second prediction block; and performing weighted averaging on the first prediction block and the second prediction block to obtain a final prediction block of the current image block. The method increases the accuracy of the obtained prediction block of the current image block without increasing the code rate.
    Type: Grant
    Filed: January 26, 2016
    Date of Patent: May 21, 2019
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ronggang Wang, Lei Chen, Zhenyu Wang, Siwei Ma, Wen Gao, Tiejun Huang, Wenmin Wang, Shengfu Dong
  • Patent number: 10291899
    Abstract: An image processing apparatus (100) includes a synthesizer (101a) that synthesizes a first image (image A) with a second image (image B) having a parallax relative to the first image to generate a synthetic image, the first image and the second image being based on outputs of a single image sensor (7), and a filter (101b) that performs filtering processing on the synthetic image, the filtering processing being based on a point spread function of an image pickup optical system (1) that is used to generate the first image and the second image.
    Type: Grant
    Filed: November 17, 2016
    Date of Patent: May 14, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Takuma Mikawa, Ryota Shoji
  • Patent number: 10250893
    Abstract: The present disclosure generally relates to a method and device for encoding a frame. The method includes the steps of determining a backlight frame from the frame, calculating a residual frame responsive to the frame and the backlight frame, and predictive-encoding of the residual frame using a predictor of the residual frame calculated from an imposed frame (IMF), where the imposed frame is a low-dynamic version of the frame to be encoded. The disclosure relates also a method and device for decoding at least one bitstream representing a frame.
    Type: Grant
    Filed: June 13, 2016
    Date of Patent: April 2, 2019
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Sebastien Lasserre, Pierre Andrivon, Philippe Bordes
  • Patent number: 10242455
    Abstract: A self-contained, low-cost, low-weight guidance system for vehicles is provided. The guidance system can include an optical camera, a case, a processor, a connection between the processor and an on-board control system, and computer algorithms running on the processor. The guidance system can be integrated with a vehicle control system through “plug and play” functionality or a more open Software Development Kit. The computer algorithms re-create 3D structures as the vehicle travels and continuously updates a 3D model of the environment. The guidance system continuously identifies and tracks terrain, static objects, and dynamic objects through real-time camera images. The guidance system can receive inputs from the camera and the onboard control system. The guidance system can be used to assist vehicle navigation and to avoid possible collisions. The guidance system can communicate with the control system and provide navigational direction to the control system.
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: March 26, 2019
    Assignee: Iris Automation, Inc.
    Inventors: Alexander Harmsen, James Howard
  • Patent number: 10157279
    Abstract: In one respect, there is provided a system for training a neural network adapted for classifying one or more scripts. The system may include at least one processor and at least one memory. The memory may include program code which when executed by the at least one memory provides operations including: receiving a disassembled binary file that includes a plurality of instructions; processing the disassembled binary file with a convolutional neural network configured to detect a presence of one or more sequences of instructions amongst the plurality of instructions and determine a classification for the disassembled binary file based at least in part on the presence of the one or more sequences of instructions; and providing, as an output, the classification of the disassembled binary file. Related computer-implemented methods are also disclosed.
    Type: Grant
    Filed: July 14, 2016
    Date of Patent: December 18, 2018
    Assignee: Cylance Inc.
    Inventors: Andrew Davis, Matthew Wolff, Derek A. Soeder, Glenn Chisholm, Ryan Permeh
  • Patent number: 10140548
    Abstract: An approach is provided to detecting motion using statistical noise analysis. In the approach, reference statistics are calculated that relate to one or more noise characteristics that correspond to pixels in a first set of video images of an area being monitored. Current noise characteristics are received that correspond to the same pixels in a second set of video images of the area being monitored, with the first set of video images being captured before the second set of video images. Motion is detected in the area being monitored by comparing the reference statistics to the current noise characteristics.
    Type: Grant
    Filed: August 15, 2014
    Date of Patent: November 27, 2018
    Assignee: Lenovo (Singapore) Pte. Ltd.
    Inventors: Grigori Zaitsev, Rod D. Waltermann, Joaquin F. Luna, Brian A. Burdette
  • Patent number: 10135952
    Abstract: A method for streaming data corresponding to a video, each of a plurality of frames of the video being divided into n spatial tiles, the method includes transmitting, a description file to a client device, the description file including data about a spatial position of each of the n spatial tiles and including data about at least n URLs corresponding to the n spatial tiles, determining by the client device one or more URLs according to the data about the spatial position included in the description file, receiving from the client device, by a server, one or more request messages for requesting one or more spatial tiles, each request message comprising one of the URLs determined by the client device, and transmitting to the client device, by the server, video data corresponding to the one or more spatial tiles, in response to one or more the request messages.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: November 20, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventors: Franck Denoual, Hervé Le Floch, Frédéric Maze, Jean Le Feuvre, Cyril Concolato
  • Patent number: 10133062
    Abstract: A design method of LED freeform surface illumination system based on XY-polynomial obtains a plurality of data points of a freeform surface, wherein each data point includes a coordinate value Qi and a normal vector Ni. A sum of squares e1(P) of coordinate differences in z direction between the coordinate value Qi and the freeform surface is applied, and by a sum of squares e2(P) between the normal vector Ni of the data points and normal vector ni of the freeform surface a modulus of vector differences is acquired. An evaluation function ƒ(p)=e1(P)+we2(P) is proposed and a plurality of freeform surface shapes obtained by selecting different weightings. The freeform surface shape which has the best imaging quality is achieved as a final shape, and a freeform surface lens based on the final shape is constructed to establish an LED freeform surface illumination system.
    Type: Grant
    Filed: May 12, 2015
    Date of Patent: November 20, 2018
    Assignees: Tsinghua University, HON HAI PRECISION INDUSTRY CO., LTD.
    Inventors: Jun Zhu, Si-Si Xiong, Xiao-Fei Wu, Guo-Fan Jin, Shou-Shan Fan
  • Patent number: 10026181
    Abstract: An object detection method and apparatus are provided. The object detection method may include adaptively generating a pyramid image corresponding to a current frame based on information associated with a target object detected from a previous frame.
    Type: Grant
    Filed: August 15, 2016
    Date of Patent: July 17, 2018
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Changkyo Lee, Jaejoon Han, Wonjun Hwang
  • Patent number: 10003811
    Abstract: A graphics pipeline with components that process frames by portions (e.g., pixels or rows) or slices to reduce end-to-end latency. Components of a pipeline process portions of a same frame at the same time. For example, as graphics data for a frame is being generated and fills a framebuffer, once a certain portion of video data less than the whole frame (slice or sub-frame) becomes available, before the corresponding frame is finished filling the framebuffer, the next pipeline component after the framebuffer, for instance a video processor for color conversion or an encoder, begins to process the portion of the frame. While one portion of a frame is accumulating in the frame buffer, another portion of the same frame is being encoded by an encoder, and another portion of the frame might be being packaged by a multiplexer, and a network socket might start streaming the multiplexed portion.
    Type: Grant
    Filed: September 1, 2015
    Date of Patent: June 19, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Shyam Sadhwani, Sudhakar Prabhu, Carol Greenbaum, Saswata Mandal, Yongjun Wu
  • Patent number: 9971876
    Abstract: An electronic device, a system and a method for diet management based on image analysis are provided. The system includes a computer and a database. The computer comprises a processor for performing the following operations: capturing at least one diet image via an image capture device; pre-processing the at least one diet image so as to obtain at least one diet region from the at least one diet image and obtain at least one detailed food segment from the diet region; extracting at least one diet image feature from the at least one detailed food segment; determining a diet type of the at least one detailed food segment based on the at least one diet image feature; and providing a personal diet characteristic analysis based on the diet type and an area of the at least one detailed food segment.
    Type: Grant
    Filed: August 10, 2016
    Date of Patent: May 15, 2018
    Assignee: Industrial Technology Research Institute
    Inventors: Chuan-Wei Ting, Ching-Yao Wang, Ju-Chin Chen
  • Patent number: 9967590
    Abstract: This disclosure describes filtering techniques applied by an encoder and a decoder during the prediction stage of a video encoding and/or decoding process. The filtering techniques may enhance the accuracy of predictive data used during fractional interpolation, and may improve predictive data of integer blocks of pixels. There are several aspects to this disclosure, including a useful twelve-pixel filter support that may be used for interpolation, techniques that use coefficient symmetry and pixel symmetry to reduce the amount of data needed to be sent between an encoder and a decoder to configure the filter support for interpolation, and techniques for filtering data at integer pixel locations in a manner that is similar to sub-pixel interpolation. Other aspects of this disclosure concern techniques for encoding information in the bitstream to convey the type of filter used, and possibly the filter coefficients used. Predictive coding of filter coefficients is also described.
    Type: Grant
    Filed: April 8, 2009
    Date of Patent: May 8, 2018
    Assignee: QUALCOMM Incorporated
    Inventors: Yan Ye, Marta Karczewicz
  • Patent number: 9955161
    Abstract: Provided is an image processing apparatus including: area determination unit configured to determine whether or not an area of a control block functioning as control unit for filtering of an image includes a processing-target slice area of a plurality of slices formed in a frame of an encoded image; control information creation unit configured to create filter control information representing whether or not the filtering is performed for the area of the control block including a processing-target slice for each area of the control block including the processing-target slice when the area determination unit determines that the area of the control block includes the area of the processing-target slice; and filter unit configured to perform filtering for the image based on the filter control information created by the control information creation unit.
    Type: Grant
    Filed: November 6, 2015
    Date of Patent: April 24, 2018
    Assignee: SONY CORPORATION
    Inventor: Kenji Kondo
  • Patent number: 9948941
    Abstract: A circuit for decoding a video, comprising: at least one entropy transcoder configured to perform at least one entropy transcoding on a received bit stream, to generate transcoded streams, wherein the entropy transcoding includes transcoding syntax for the bit stream; at least one main decoding unit configured to perform at least one transcoded stream decompression and pixel decodings on a frame of the transcoded streams.
    Type: Grant
    Filed: April 20, 2015
    Date of Patent: April 17, 2018
    Assignee: MONTAGE TECHNOLOGY (SHANGHAI) CO., LTD.
    Inventor: Zhimin Qiu
  • Patent number: 9947292
    Abstract: An image processing method and device are provided. The method includes: choosing content-associated sub pixels in an image to be processed; obtaining an initial color level value of each of the content-associated sub pixels in the image to be processed; adding to least one digit to an end of the initial color level value and assigning a preset value to each added digit so as to obtain a processed color level value; and replacing the initial color level value with the processed color level value.
    Type: Grant
    Filed: August 11, 2016
    Date of Patent: April 17, 2018
    Assignee: XIAOMI INC.
    Inventors: Anyu Liu, Guosheng Li, Hui Du
  • Patent number: 9936220
    Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.
    Type: Grant
    Filed: March 25, 2016
    Date of Patent: April 3, 2018
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Antti Olli Hallapuro, Kemai Ugur, Jani Lainema
  • Patent number: RE46924
    Abstract: A motion vector coding unit 117 executes processing including a neighboring block specification step (S100) of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step (Steps S102, S104) of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step (S106, S108) of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step (S110) of coding the motion vector of the current block using the predictive motion vector.
    Type: Grant
    Filed: July 20, 2015
    Date of Patent: June 26, 2018
    Assignee: Dolby International AB
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe
  • Patent number: RE47358
    Abstract: In the method for predicting a bi-predictive block of a moving picture, first and second distinct motion-compensated blocks are obtained using first and second motion vectors respectively. The bi-predictive block of the moving picture is predicted using first and second variable weight factors associated with the first and second distinct motion-compensated blocks, respectively.
    Type: Grant
    Filed: March 26, 2015
    Date of Patent: April 16, 2019
    Assignee: LG ELECTRONICS INC.
    Inventor: Byeong Moon Jeon
  • Patent number: RE48035
    Abstract: A motion vector coding unit 117 executes processing including a neighboring block specification step (S100) of specifying a neighboring block which is located in the neighborhood of a current block; a judgment step (Steps S102, S104) of judging whether or not the neighboring block has been coded using a motion vector of another block; a prediction step (S106, S108) of deriving a predictive motion vector of the current block using a motion vector calculated from the motion vector of the other block as a motion vector of the neighboring block; and a coding step (S110) of coding the motion vector of the current block using the predictive motion vector.
    Type: Grant
    Filed: June 11, 2018
    Date of Patent: June 2, 2020
    Assignee: Dolby International AB
    Inventors: Satoshi Kondo, Shinya Kadono, Makoto Hagai, Kiyofumi Abe