Feature Based Patents (Class 375/240.08)
  • Patent number: 11514613
    Abstract: An decoding device, an encoding device and a method for point cloud encoding is disclosed. The method includes generating, from a three-dimensional point cloud, multiple two-dimensional frames, the two-dimensional frames including at least a first frame representing a geometry of points in the three-dimensional point cloud and a second frame representing texture of points in the three-dimensional point cloud. The method also includes generating an occupancy map indicating locations of pixels in the two-dimensional frames that represent points in the three-dimensional point cloud. The method further includes encoding the two-dimensional frames and the occupancy map to generate a compressed bitstream. The method also includes transmitting the compressed bitstream.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: November 29, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Esmaeil Faramarzi, Tuan Ho
  • Patent number: 11470138
    Abstract: An apparatus for multi-bitrate content streaming includes a receiving module configured to capture media content, a streamlet module configured to segment the media content and generate a plurality of streamlets, and an encoding module configured to generate a set of streamlets. The system includes the apparatus, wherein the set of streamlets comprises a plurality of streamlets having identical time indices and durations, and each streamlet of the set of streamlets having a unique bitrate, and wherein the encoding module comprises a master module configured to assign an encoding job to one of a plurality of host computing modules in response to an encoding job completion bid. A method includes receiving media content, segmenting the media content and generating a plurality of streamlets, and generating a set of streamlets.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: October 11, 2022
    Assignee: DISH Technologies L.L.C.
    Inventors: David F. Brueck, Mark B. Hurst, R. Drew Major
  • Patent number: 11451745
    Abstract: A conference device comprising a first image sensor for provision of first image data, a first image processor configured for provision of a first primary videostream and a first secondary videostream based on the first image data, an intermediate image processor in communication with the first image processor and configured for provision of a field-of-view videostream and a region-of-interest videostream, wherein the field-of-view videostream is based on the first primary videostream, and the region-of-interest videostream is based on the first secondary videostream, and an output processor configured to determine first image control data based on the field-of-view videostream and transmit the first image control data to the first image processor, wherein the first image processor is configured for provision of the first secondary videostream based on the first image control data.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: September 20, 2022
    Inventor: Yashket Gupta
  • Patent number: 11438607
    Abstract: A method for encoding a video sequence in a video encoder is provided that includes adapting a quantization parameter of a block of pixels in a picture of the video sequence based on a transform block size of the block of pixels to determine a final quantization parameter, and quantizing transform coefficients of the block of pixels using the final quantization parameter.
    Type: Grant
    Filed: December 1, 2020
    Date of Patent: September 6, 2022
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Do-Kyoung Kwon, Madhukar Budagavi
  • Patent number: 11430155
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. The encoder is also configured to determine quantized minimum depths and/or maximum depths patch images in the image frames, wherein depth information is signaled relative to the quantized minimum depth.
    Type: Grant
    Filed: October 5, 2019
    Date of Patent: August 30, 2022
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Fabrice A. Robinet, Jungsun Kim, Khaled Mammou, Valery G. Valentin, Yeping Su
  • Patent number: 11430099
    Abstract: Described is a computer-implemented method for determining uncertainties in measurement data from a measurement of an object, wherein a digital representation of the object is generated by the measurement. The object representation has items of image information, which each indicate a value of a measurement variable for the object at a defined position of the object. Statistical noise is superimposed on the image information. The method includes determining the object representation, determining a distance field from the image information relating to the object representation, determining a strength of the statistical noise in the image information, determining an uncertainty of the distance values of the distance field on the basis of the strength of the statistical noise, and determining an uncertainty of the position of at least one point on at least one material boundary surface from the uncertainty of the distance values of the distance field.
    Type: Grant
    Filed: May 8, 2018
    Date of Patent: August 30, 2022
    Inventors: Christoph Poliwoda, Thomas Gunther, Christof Reinhart
  • Patent number: 11431998
    Abstract: Systems and methods for decoding are provided. A method includes receiving a bitstream including at least one coded picture, inferring a value of a first identifier of a video parameter set, based on the first identifier of the video parameter set not being in the bitstream, and decoding the at least one coded picture based on the inferring.
    Type: Grant
    Filed: April 15, 2021
    Date of Patent: August 30, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Ling Li, Xiang Li, Shan Liu
  • Patent number: 11423629
    Abstract: Simulating a 3D audio environment, including receiving a visual representation of an object at a location in a scene, wherein the location represents a point in 3D space, receiving a sound element, and binding the sound element to the visual representation of the object such that a characteristic of the sound element is dynamically modified coincident with a change in location in the scene of the visual representation of the object in 3D space.
    Type: Grant
    Filed: December 7, 2018
    Date of Patent: August 23, 2022
    Assignee: Apple Inc.
    Inventors: Thomas Goossens, Sebastien Metrot
  • Patent number: 11405621
    Abstract: Sampling grid information may be determined for multi-layer video coding systems. The sampling grid information may be used to align the video layers of a coding system. Sampling grid correction may be performed based on the sampling grid information. The sampling grids may also be detected. In some embodiments, a sampling grid precision may also be detected and/or signaled.
    Type: Grant
    Filed: April 22, 2020
    Date of Patent: August 2, 2022
    Assignee: VID SCALE, Inc.
    Inventors: Yan Ye, Yuwen He, Jie Dong
  • Patent number: 11395007
    Abstract: A method of reconstructing in a decoder a coded enhancement layer picture, is performed by at least one processor and includes decoding at least one independent picture header of a coded picture of a reference layer, the coded picture of the reference layer being referenced by the coded enhancement layer picture, and decoding a dependent picture header of the coded enhancement layer picture. The method further includes performing picture header prediction including either one or both of predicting at least one value of at least one syntax element of the dependent picture header from at least one value of at least one corresponding syntax element of the at least one independent picture header; and inferring at least one value of a non-present syntax element of the dependent picture header to be equal to at least one value of a present syntax element of the at least one independent picture header.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: July 19, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Stephan Wenger, Shan Liu
  • Patent number: 11394971
    Abstract: An image decoding method according to the present invention may comprise: splitting a picture into a plurality of tiles; and determining at least one slice on the basis of the plurality of tiles. Here, splitting a picture into a plurality of tiles may comprise: determining the width of a first tile column in the picture; and determining the width of a second tile column neighboring the first tile column.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: July 19, 2022
    Assignee: Apple Inc.
    Inventor: Bae Keun Lee
  • Patent number: 11388431
    Abstract: A modulator has a first grating pattern, and a second grating pattern having a phase shifted from the first grating pattern; a sensor processor receives a first image signal outputted by the first grating pattern, and a second image signal outputted by the second grating pattern; a difference processor calculates a difference between the first image signal and the second image signal; and a compression processor 3005 contains information that indicates a range of the difference to first compression image data. Those make it possible to reduce a data amount of images capable of focus adjustment etc. from later, and to lead to reduction in costs of a storage apparatus.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: July 12, 2022
    Assignee: MAXELL, LTD.
    Inventors: Mayumi Nakade, Yusuke Nakamura, Keisuke Inata
  • Patent number: 11368744
    Abstract: Image data of each of pictures which constitute dynamic image data is classified into a plurality of layers, image data of each of the classified layers is encoded, and a video stream having the encoded image data of the pictures of each of the layers is generated. A container in a predetermined format which includes the generated video stream is transmitted. Decoding timing information, which has been set so that a higher layer has a shorter decoding time interval of the encoded image data of each of the pictures, is added to the encoded image data of the pictures of each of the layers. The operations enable a reception side to perform a favorable decoding process commensurate with its decoding capability.
    Type: Grant
    Filed: March 27, 2019
    Date of Patent: June 21, 2022
    Assignee: SONY CORPORATION
    Inventor: Ikuo Tsukagoshi
  • Patent number: 11310514
    Abstract: Encoding an image using a non-encoding region of the image, a block-based encoding region of the image, and a pixel-based encoding region of the image.
    Type: Grant
    Filed: December 30, 2014
    Date of Patent: April 19, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Dae-sung Cho, Chan-yul Kim, Jeong-hoon Park, Pil-kyu Park, Kwang-pyo Choi, Dai-woong Choi, Woong-il Choi
  • Patent number: 11288844
    Abstract: Systems, methods, and computer program products are described that implement obtaining, at an electronic computing device and for at least one image of a scene rendered in an Augmented Reality (AR) environment, a scene lighting estimation captured at a first time period. The scene lighting estimation may include at least a first image measurement associated with the scene. The implementations may include determining, at the electronic computing device, a second image measurement associated with the scene at a second time period, determining a function of the first image measurement and the second image measurement. Based on the determined function, the implementations may also include triggering calculation of a partial lighting estimation update or triggering calculation of a full lighting estimation update and rendering, on a screen of the electronic computing device and for the scene, the scene using the partial lighting estimation update or the full lighting estimation update.
    Type: Grant
    Filed: October 16, 2019
    Date of Patent: March 29, 2022
    Assignee: Google LLC
    Inventors: Chloe LeGendre, Laurent Charbonnel, Christina Tong, Konstantine Nicholas John Tsotsos, Wan-Chun Ma, Paul Debevec
  • Patent number: 11290746
    Abstract: A method and a device for decoding a data stream representative of a multi-view video. Syntax elements are obtained from at least one part of the stream data, and used to reconstruct at least one image of a view of the video. Then, at least one item of metadata in a predetermined form is obtained from at least one obtained syntax element, and provided to an image processing module. Also provided are a method and a device for processing images configured to read said at least one item of metadata in the predetermined form and use it to generate at least one image of a virtual view from a reconstructed view of the multi-view video.
    Type: Grant
    Filed: April 16, 2019
    Date of Patent: March 29, 2022
    Assignee: ORANGE
    Inventors: Joel Jung, Pavel Nikitin, Patrick Boissonade
  • Patent number: 11283465
    Abstract: A network data prediction method applied to a device that implements an OSI model is provided. The device communicates with a target network device that implements the OSI model. The method includes the following steps: generating a transmission data according to a communication protocol of a first abstraction layer, the transmission data being able to be processed by a first peer abstraction layer of the target network device, and the first peer abstraction layer corresponding to the first abstraction layer and obeying the communication protocol; generating a predicted data according to the communication protocol and the transmission data; and transmitting the transmission data and the predicted data to a second abstraction layer.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: March 22, 2022
    Assignee: REALTEK SEMICONDUCTOR CORPORATION
    Inventor: Chao-Yuan Hsu
  • Patent number: 11265550
    Abstract: The present invention relates to an improved method and apparatus for image compression and particularly to an improved block coding apparatus and method for compression for use with the JPEG2000 standard, although not limited to this. Methods for coding and decoding blocks and subbands samples derived from still images video frames or related media, involving three bit-streams and the partitioning of samples from the blocking to define groups, is provided. A first bit-stream encodes the significance of whole groups. A second bit-stream encodes the significance of individual samples within each group. The second bit-stream also encodes an unsigned residual value for each significant group. A third bit stream provides a sign bit and any additional magnitude bits required to represent the significant sample values. Exponent predictors are computal using both exponent bounds and the additional magnitude bits associated with previous samples in the block.
    Type: Grant
    Filed: April 4, 2019
    Date of Patent: March 1, 2022
    Assignee: KAKADU R & D PTY LTD
    Inventor: David Scott Taubman
  • Patent number: 11259048
    Abstract: An encoding device, a method of encoding, and decoding device for point cloud compression of a 3D point cloud. The encoding device is configured to generate, for the three-dimensional (3D) point cloud, at least a set of geometry frames and a set of occupancy map frames for points of the 3D point cloud. The encoding device is also configured to select an occupancy precision value based on a quantization parameter (QP) associated with at least one generated geometry frame in the set of geometry frames, subsample at least one occupancy map frame in the set of occupancy map frames based on the selected occupancy precision value, and encode the set of geometry frames and the set of occupancy map frames into a bitstream for transmission.
    Type: Grant
    Filed: December 30, 2019
    Date of Patent: February 22, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Hossein Najaf-Zadeh, Rajan Laxman Joshi
  • Patent number: 11252471
    Abstract: A method for managing consumption of a device for processing multimedia content. The method includes the following acts executed on the processing device: receiving a request for processing a multimedia content; analyzing the request in order to extract from it at least one rendering quality of the content; obtaining a power supply state of the device; checking the match between the quality of the content and the power supply state of the device; on the basis of the results of the check, modifying a rendering quality for the content; and processing the multimedia content in order to render it in the quality.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: February 15, 2022
    Assignee: ORANGE
    Inventors: Jean-Bernard Leduby, Martin Conan
  • Patent number: 11233997
    Abstract: An image decoding method according to the present invention may comprise: splitting a picture into a plurality of tiles; and determining at least one slice on the basis of the plurality of tiles. Here, splitting a picture into a plurality of tiles may comprise: determining the width of a first tile column in the picture; and determining the width of a second tile column neighboring the first tile column.
    Type: Grant
    Filed: February 26, 2020
    Date of Patent: January 25, 2022
    Assignee: XRIS CORPORATION
    Inventor: Bae Keun Lee
  • Patent number: 11223839
    Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: January 11, 2022
    Assignees: Electronics and Telecommunications Research Institute, KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
    Inventors: Jong Ho Kim, Hui Yong Kim, Se Yoon Jeong, Sung Chang Lim, Ha Hyun Lee, Jin Ho Lee, Suk Hee Cho, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn, Mun Churl Kim, Bum Shik Lee
  • Patent number: 11215999
    Abstract: An image captured using a sensor on a vehicle is received and decomposed into a plurality of component images. Each component image of the plurality of component images is provided as a different input to a different layer of a plurality of layers of an artificial neural network to determine a result. The result of the artificial neural network is used to at least in part autonomously operate the vehicle.
    Type: Grant
    Filed: June 20, 2018
    Date of Patent: January 4, 2022
    Assignee: Tesla, Inc.
    Inventors: Timofey Uvarov, Brijesh Tripathi, Evgene Fainstain
  • Patent number: 11210815
    Abstract: An apparatus to facilitate real-time playback of point cloud sequence data is disclosed. The apparatus comprises one or more processors to receive point cloud data of a captured scene, decompose the point cloud data into a plurality of point cloud patches, wherein each point cloud patch is associated with an object in the scene and includes contextual information regarding the point cloud patch, encode each of the point cloud patches via a deep-learning based algorithm to generate encoded point cloud patches, receive a viewpoint selection from a client, assign a priority to data chunks within each encoded point cloud patch based on the viewpoint selection and the contextual information and transmit the data chunks to the client based on the assigned priority.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: December 28, 2021
    Assignee: Intel Corporation
    Inventors: Fai Yeung, Wayne Cochran, Pratibha Pandhare
  • Patent number: 11172209
    Abstract: A method and apparatus for encoding surveillance video where one or more regions of interest are identified and the encoding parameter values associated with those regions are specified in accordance with intermediate outputs of a video analytics process. Such an analytics-modulated video compression approach allows the coding process to adapt dynamically based on the content of the surveillance images. In this manner, the fidelity of the region of interest is increased relative to that of a background region such that the coding efficiency is improved, including instances when no target objects appear in the scene. Better compression results can be achieved by assigning different coding priority levels to different types of detected objects.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: November 9, 2021
    Assignee: CheckVideo LLC
    Inventors: Lai-Tee Cheok, Nikhil Gagvani
  • Patent number: 11172213
    Abstract: A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined subarea of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.
    Type: Grant
    Filed: March 24, 2021
    Date of Patent: November 9, 2021
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Yago Sánchez de la Fuente, Thomas Schierl, Cornelius Hellge, Karsten Grueneberg, Thomas Wiegand
  • Patent number: 11166012
    Abstract: A three-dimensional data encoding method encodes a plurality of three-dimensional points, and includes: selecting one of two or more prediction modes for calculating a predicted value of an attribute information item of the first three-dimensional point, in accordance with attribute information items of one or more second three-dimensional points in the vicinity of a first three-dimensional point; calculating the predicted value by the selected prediction mode; calculating, as a prediction residual, a difference between a value of the attribute information item of the first three-dimensional point and the calculated predicted value; and generating a bit stream that includes the one prediction mode and the prediction residual.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: November 2, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventor: Toshiyasu Sugio
  • Patent number: 11146807
    Abstract: A program map table in a transport stream comprising an elementary stream identifier indicating a particular elementary stream, a high dynamic range flag indicating the presence or absence of high dynamic range content within the elementary stream, and a wide color gamut flag indicating the presence or absence of wide color gamut content within the elementary stream.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: October 12, 2021
    Assignee: ARRIS Enterprises LLC
    Inventors: Mandayam Narasimhan, Ajay Luthra
  • Patent number: 11146803
    Abstract: An encoder receives an input enhanced dynamic range (EDR) image to be stored or transmitted using multiple coding formats in a layered representation. A layer decomposer generates a lower dynamic range (LDR) image from the EDR image. One or more base layer (BL) encoders encode the LDR image to generate a main coded BL stream and one or more secondary coded BL streams, where each secondary BL stream is coded in a different coding format than the main coded BL stream. A single enhancement layer (EL) coded stream and related metadata are generated using the main coded BL stream, the LDR image, and the input EDR image. An output coded stream includes the coded EL stream, the metadata, and either the main coded BL stream or one of the secondary coded BL streams. Computation-scalable decoding and display management processes for EDR images are also described.
    Type: Grant
    Filed: February 14, 2014
    Date of Patent: October 12, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Guan-Ming Su, Samir N. Hulyalkar, Tao Chen
  • Patent number: 11145079
    Abstract: An apparatus and method for geometrically correcting an arbitrary shaped input frame and generating an undistorted output frame. The method includes capturing arbitrary shaped input images with multiple optical devices and processing the images, identifying redundant blocks and valid blocks in each of the images, allocating an output frame with an output frame size and dividing the output frame into regions shaped as a rectangle, programming the apparatus and disabling processing for invalid blocks in each of the regions, fetching data corresponding to each of the valid blocks and storing in an internal memory, interpolating data for each of the regions with stitching and composing the valid blocks for the output frame and displaying the output frame on a display module.
    Type: Grant
    Filed: January 24, 2018
    Date of Patent: October 12, 2021
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Rajasekhar Reddy Allu, Niraj Nandan, Mihir Narendra Mody, Gang Hua, Brian Okchon Chae, Shashank Dabral, Hetul Sanghvi, Vikram VijayanBabu Appia, Sujith Shivalingappa
  • Patent number: 11089315
    Abstract: A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined subarea of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: August 10, 2021
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Yago Sánchez de la Fuente, Thomas Schierl, Cornelius Hellge, Karsten Grueneberg, Thomas Wiegand
  • Patent number: 11082696
    Abstract: A reception device including processing circuitry is provided. The processing circuitry is configured to receive a video stream that includes, for each of a plurality of units of N consecutive pictures of a plurality of pictures, an encoded averaged picture and encoded N?1 of the N consecutive pictures of the respective unit. The averaged picture is generated based on an averaging process in which a non-linear average of the N consecutive pictures of the respective unit is calculated with different gains. The video stream includes a first sub-layer having the encoded averaged pictures and a second sub-layer having the encoded N?1 pictures of the plurality of units. The processing circuitry is configured to receive information including averaging process information indicating a method for the averaging process, and process the received video stream in accordance with the averaging process information.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: August 3, 2021
    Assignee: Saturn Licensing LLC
    Inventor: Ikuo Tsukagoshi
  • Patent number: 11080883
    Abstract: A method for detecting and recognizing objects in images includes obtaining a video stream and pre-processing the video stream to obtain an image queue arranged in a frame playing order and storing the image queue into a storage device. An image frame of the image queue from the storage device is read and at least one object in the image frame is detected and recognized. An image recognition device is also provided.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: August 3, 2021
    Assignee: HONGFUJIN PRECISION ELECTRONICS (TIANJIN) CO., LTD.
    Inventor: Cheng-Han Du
  • Patent number: 11055856
    Abstract: A method for detecting events comprises repeatedly registering a value indicating an amount of data generated by an encoder, which is encoding video from a scene by means of temporal compression, determining if a particular event has occurred in the scene represented by the encoded video by comparing characteristics of the registered values with predetermined characteristics, and generating an event signal in response to an event occurrence being determined.
    Type: Grant
    Filed: December 21, 2017
    Date of Patent: July 6, 2021
    Assignee: AXIS AB
    Inventors: Viktor Edpalm, Erik Andersson
  • Patent number: 11043035
    Abstract: An exemplary image simulation system accesses an image depicting imagery captured at a capture resolution from a capture vantage point. The image simulation system partitions the image into a plurality of simulated images, and determines a respective virtual resolution and a respective virtual vantage point for each of the simulated images in the plurality of simulated images. Each virtual resolution determined by the image simulation system is different from the capture resolution and each virtual vantage point determined by the image simulation system is different from the capture vantage point. The image simulation system represents each simulated image of the plurality of simulated images as a distinct image captured at the respective virtual resolution and from the respective virtual vantage point that have been determined for the simulated image. Corresponding methods and systems are also disclosed, including methods and systems for combining captured images to form a single simulated image.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: June 22, 2021
    Assignee: Verizon Patent and Licensing Inc.
    Inventors: Liang Luo, Denny Breitenfeld
  • Patent number: 11012714
    Abstract: Decoding image data using lexicographic coding order with floating block-partitioning includes obtaining, from an encoded bitstream, encoded data for a defined portion of a frame, generating a reconstructed frame by decoding the encoded data, and outputting the reconstructed frame for presentation to a user. Decoding the encoded data using lexicographic coding order with floating block-partitioning includes decoding, from the encoded data, block dimension data for respective blocks from the plurality of blocks in lexicographic coding order, determining block location data for the respective blocks from the plurality of blocks in lexicographic coding order, generating reconstructed block data for the respective blocks from the plurality of blocks using the block dimension data and the block location data by decoding, from the encoded data, image content data for the respective blocks from the plurality of blocks, and including the reconstructed block data in the reconstructed frame.
    Type: Grant
    Filed: June 23, 2020
    Date of Patent: May 18, 2021
    Assignee: GOOGLE LLC
    Inventors: Vincent Rabaud, Pascal Massimino
  • Patent number: 11010627
    Abstract: A computing system automatically detects, within a digital video frame, a video frame region that depicts a textual expression of a scoreboard. The computing system (a) engages in an edge-detection process to detect edges of at least scoreboard image elements depicted by the digital video frame, with at least some of these edges being of the textual expression and defining alphanumeric shapes; (b) applies pattern-recognition to identify the alphanumeric shapes; (c) establishes a plurality of minimum bounding rectangles each bounding a respective one of the identified alphanumeric shapes; (d) establishes, based on at least two of the minimum bounding rectangles, a composite shape that encompasses the identified alphanumeric shapes that were bounded by the at least two minimum bounding rectangles; and (e) based on the composite shape occupying a particular region, deems the particular region to be the video frame region that depicts the textual expression.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: May 18, 2021
    Assignee: Gracenote, Inc.
    Inventors: Jeffrey Scott, Markus Kurt Peter Cremer, Nishit Umesh Parekh, Dewey Ho Lee
  • Patent number: 11004180
    Abstract: A method for generating dynamic images applied to a computer device includes obtaining a depth image of a static image. A preset region of the depth image is converted into a histogram and an average depth value D is calculated therefrom. A first depth value d1 and a second depth value d2 are determined from the histogram according to the average depth value D. M numbers of third depth values d3 are calculated according to the first depth value d1 and the second depth value d2. Once M number of blurred images are generated according to each M number of third depth values d3, the M number of blurred images are played back according to a magnitude of the third depth value d3 corresponding to each of the M number of blurred images.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: May 11, 2021
    Assignee: Chiun Mai Communication Systems, Inc.
    Inventors: Yu-Feng Kuo, Nai-Sheng Syu, Chun-Hsiang Huang
  • Patent number: 11006124
    Abstract: The disclosure provides a sample adaptive offset (SAO) encoder. The SAO encoder includes a statistics collection (SC) block and a rate distortion optimization (RDO) block coupled to the SC block. The SC block receives a set of deblocked pixels and a set of original pixels. The SC block categorizes each deblocked pixel of the set of deblocked pixels in at least one of a plurality of band and edge categories. The SC block estimates an error in each category as difference between a deblocked pixel of the set of deblocked pixels and corresponding original pixel of the set of original pixels. The RDO block determines a set of candidate offsets associated with each category and selects a candidate offset with a minimum RD cost. The minimum RD cost is used by a SAO type block and a decision block to generate final offsets for the SAO encoder.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: May 11, 2021
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Hrushikesh Tukaram Garud, Mihir Narendra Mody, Soyeb Nagori
  • Patent number: 10986383
    Abstract: Adaptive streaming is rendered more efficiently combinable with the usage of an open GOP structure by configuring a device for retrieving a video such that the same schedules a transition phase before switching from a first video stream to the second video stream, and/or by configuring a device for outputting a video in accordance with the adaptive streaming protocol such that the same supports switching outputting the video in form of a layered video stream or an increased spatial resolution stream. A media scene composed of several channels is made more efficiently streamable spending, for each channel, a set of representations of the respective channel which differ in a temporal distribution of random access points. By this measure, a client device may schedule the switching between the representations for optimizing fast tune-in and low bitrate variations.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: April 20, 2021
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Yago Sánchez De La Fuente, Thomas Schierl, Cornelius Hellge, Karsten Grueneberg, Thomas Wiegand
  • Patent number: 10979740
    Abstract: A method for streaming a 360 degree video over a communications network, wherein the video is streamed in a plurality of chunks, includes selecting a prediction window during which to predict a field of view within the video, the field of view is expected to be visible by a viewer at a time of playback of a next chunk of the video, wherein a duration of the prediction window is based on at least one condition within the communications network, selecting a machine learning algorithm to predict the field of view based on a head movement of the viewer, wherein the machine learning algorithm is selected based on the duration of the prediction window, predicting the field of view based on the head movement of the viewer and the machine learning algorithm, identifying a tile of the next chunk that corresponds to the field of view, and downloading the tile.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: April 13, 2021
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventors: Bo Han, Vijay Gopalakrishnan, Tan Xu
  • Patent number: 10963988
    Abstract: An image processing device, an image processing system, an image processing method, and a program capable of suppressing unnaturalness of color of an object extracted from a color image are provided. An image processing device includes an object area determination unit that determines an object area, a mask image generation unit that generates a mask image, an object image generation unit that generates an object image on the basis of the object area, a color determination unit that determines a color to be subtracted from colors to be applied to the object area and sets a smaller number of colors than those of the object area as colors of the object image, and a probability calculation unit that calculates a probability of pixels of the mask image being pixels of the object area, and the object image generation unit sets the colors set using the color determination unit as colors of an edge area of the object image on the basis of the probability.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: March 30, 2021
    Assignee: FUJIFILM Corporation
    Inventor: Shunichiro Nonaka
  • Patent number: 10963674
    Abstract: Processes and systems are directed to training a neural network of an object recognition system. The processes and systems record video streams of people. Sequences of object images are extracted from each video stream, each sequence of object images corresponding to one of the people. A triplet comprising an anchor feature vector and a positive feature vector of the same object and a negative feature vector of a different object of feature vectors are formed for each sequence of object images. The anchor, positive, and negative feature vectors of each triplet are separately input to the neural network to compute corresponding output anchor, positive, and negative vectors. A triplet loss function value computed from the output anchor, positive, and negative vectors. When the triplite loss function value is greater than a threshold, the neural network is retrained using the anchor and positive feature vectors of the sequences of object images.
    Type: Grant
    Filed: January 2, 2018
    Date of Patent: March 30, 2021
    Assignee: NovuMind Limited
    Inventors: Kar Han Tan, Ren Wu
  • Patent number: 10951897
    Abstract: The invention relates to a method and apparatus for image compression, particularly to an improved block-coding apparatus and method for image compression. Image compression systems such as JPEG and JPEG2000 are known and popular standards for image compression. Many of the advantageous features of JPEG2000 derive from the use of the EBCOT algorithm (Embedded Block-Coding with Optimized Truncation). One drawback of the JPEG2000 standards is computational complexity. This application discloses a relatively fast block-coding algorithm, particularly as compared with the standard JPEG2000 EBCOT algorithm. Computational complexity is reduced.
    Type: Grant
    Filed: May 23, 2017
    Date of Patent: March 16, 2021
    Assignee: KAKADU R & D PTY LTD
    Inventors: David Scott Taubman, Reji Kuruvilla Mathew, Aous Thabit Naman
  • Patent number: 10939107
    Abstract: An embedded codec (EBC) circuitry includes a memory to store a plurality of one dimensional (1D) sub-blocks of quantized-transformed residual levels for a 1D image block and encoder circuitry to determine a sub-block category from a set of sub-block categories for each 1D sub-block of the plurality of 1D sub-blocks. The encoder circuitry encodes the plurality of 1D sub-blocks by application of an entropy coding scheme to generate a plurality of encoded 1D sub-blocks. The encoder circuitry allocates a plurality of refinement bits at bit-positions in bit-planes corresponding to encoded quantized-transformed residual levels in an encoded 1D sub-block of the plurality of encoded 1D sub-blocks, based on the determined sub-block category of a corresponding 1D sub-block.
    Type: Grant
    Filed: March 1, 2019
    Date of Patent: March 2, 2021
    Assignee: SONY CORPORATION
    Inventors: Mohammed Golam Sarwer, Ali Tabatabai
  • Patent number: 10924741
    Abstract: A method of determining quantization parameters includes the steps of: receiving a block of image data; calculating a general variance of the block of image data; calculating a plane-based variance of the block of image data by subtracting an image moment of the block of image data from the general variance; and determining a quantization parameter for the block of image data according to the plane-based variance.
    Type: Grant
    Filed: April 15, 2019
    Date of Patent: February 16, 2021
    Assignee: NOVATEK Microelectronics Corp.
    Inventor: Fandi Jou
  • Patent number: 10880570
    Abstract: Techniques and systems are provided for processing video data. For example, a current block of a picture of the video data can be obtained for processing by an encoding device or a decoding device. A parameter of the current block can be determined. Based on the determined parameter of the current block, at least one or more of a number of rows of samples or a number columns of samples in a template of the current block and at least one or more of a number of rows of samples or a number columns of samples in a template of a reference picture can be determined. Motion compensation for the current block can be performed. For example, one or more local illumination compensation parameters can be derived for the current block using the template of the current block and the template of the reference picture.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: December 29, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Hsiao-Chiang Chuang, Jianle Chen, Xiang Li, Kai Zhang, Done Bugdayci Sansli, Marta Karczewicz, Wei-Jung Chien, Yu-Chen Sun
  • Patent number: 10878539
    Abstract: An image-processing method, an apparatus and a device are provided. The method includes: controlling a primary camera to capture a plurality of primary images, and simultaneously controlling a secondary camera to capture a plurality of secondary images; obtaining a reference primary image from the primary images, and obtaining a reference secondary image co-captured with the reference primary image from the secondary images; starting a multithread-based parallel processing mechanism, calling a first thread to perform a multiframe-synthesizing noise-reduction process for the primary images so as to generate a target primary image, and simultaneously calling a second thread to obtain depth information according to the reference primary image and the reference primary image; and performing a blurring process for a background region of the target primary image according to the depth information. Thus, it improves the accuracy of calculating the depth information and the image-processing efficiency thereof.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: December 29, 2020
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventors: Dan Ouyang, Guohui Tan
  • Patent number: 10869033
    Abstract: In a case where a partition mode in which luma signals are partitioned horizontally and vertically is set when an intra prediction of a picture signal is made in units of minimal coding blocks set in advance, an intra prediction unit is configured to make an intra prediction of a chroma signal in units of prediction blocks of the intra prediction of chroma signals within the minimal coding block set in accordance with a chroma format. A second bitstream constructing unit constructs a bitstream of information relating to a luma intra prediction mode of a prediction block of luma signals and information relating to a chroma intra prediction mode of a prediction block of chroma signals.
    Type: Grant
    Filed: August 9, 2018
    Date of Patent: December 15, 2020
    Assignee: JVC KENWOOD Corporation
    Inventors: Hiroya Nakamura, Shigeru Fukushima
  • Patent number: RE49321
    Abstract: A picture coding method of the present invention codes a picture signal and a ratio of a number of luminance pixels and a number of chrominance pixels for the picture signal, and then one coding method out of at least two coding methods is selected depending on the ratio. Next, data related to a picture size is coded in accordance with the selected coding method. The data related to the picture size indicates a size of the picture corresponding to the picture signal or an output area, which is a pixel area to be outputted in decoding in a whole pixel area coded in the picture signal coding.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: November 29, 2022
    Assignee: DOLBY INTERNATIONAL AB
    Inventor: Shinya Kadono