Associated Signal Processing Patents (Class 375/240.26)
  • Patent number: 11029963
    Abstract: A processing unit of an inference engine for machine learning (ML) includes a first data load steamer, a second data load streamer, an operator component, and a store streamer. The first data load streamer streams a first data stream from an on-chip memory (OCM) to the operator component. The second data load streamer streams a second data stream from the OCM to the operator component. The operator component performs a matrix operation on the first data stream and the second data stream. The store streamer receives a data output stream from the operator component and to store the data output stream in a buffer.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: June 8, 2021
    Assignee: Marvell Asia Pte, Ltd.
    Inventors: Avinash Sodani, Ulf Hanebutte, Senad Durakovic, Hamid Reza Ghasemi, Chia-Hsin Chen, Rishan Tan
  • Patent number: 11023556
    Abstract: Designing and previewing web pages includes displaying an identifying image encoded with a first uniform resource locator (URL) of a preview web page on a display of a first computing device, the first URL including a location of the preview web page and a token unique to a web page authoring session for the preview web page; receiving, from a second computing device, a second URL obtained by capturing the identifying image on the display of the first computing device by a camera of the second computing device and decoding the captured identifying image to get the second URL by the second computing device; validating the second URL; and sending the preview web page to the second computing device when the second URL is validated. The preview web page may then be displayed on the second computing device.
    Type: Grant
    Filed: July 10, 2019
    Date of Patent: June 1, 2021
    Assignee: salesforce.com, inc.
    Inventor: Marcus Lenzner
  • Patent number: 11025967
    Abstract: A method for inserting information push into a live video streaming is performed at a computer server, the method including: obtaining a bitstream of the information push, a playing time period of the information push, video identification, and a corresponding bitstream of the video; using the bitstream of the information push to replace a bitstream of the video having the same playing time period with the playing time period of the information push, and inserting the bitstream of the information push and the bitstream of the video into a same path flow; generating an information push insertion mark; and sending the video identification, the information push insertion mark, and the bitstream of the information push to a terminal of the video corresponding to the video identification. The terminal inserts the bitstream of the information push into the video corresponding to the video identification according to the information push insertion mark.
    Type: Grant
    Filed: June 6, 2018
    Date of Patent: June 1, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
    Inventor: Hongtao Zuo
  • Patent number: 11024008
    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: June 1, 2021
    Assignee: GoPro, Inc.
    Inventors: David Newman, Daryl Stimm, Adeel Abbas
  • Patent number: 11025929
    Abstract: An interleaved multi-layered video data stream with interleaved decoding units of different layers is provided with further timing control information in addition to the timing control information reflecting the interleaved decoding unit arrangement. The additional timing control information pertains to either a fallback position according to which all decoding units of an access unit are treated at the decoded buffer access unit-wise, or a fallback position according to which an intermediate procedure is used: the interleaving of the DUs of different layers is reversed according to the additionally sent timing control information, thereby enabling a DU-wise treatment at the decoder's buffer, however, with no interleaving of decoding units relating to different layers. Both fallback positions may be present concurrently. Various advantageous embodiments and alternatives are the subject of the various claims attached herewith.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: June 1, 2021
    Assignee: GE Video Compression, LLC
    Inventors: Karsten Suehring, Thomas Schierl, Detlev Marpe, Robert Skupin, Yago Sanchez De La Fuente, Gerhard Tech
  • Patent number: 11012498
    Abstract: A computer system is provided that includes at least one processor configured to execute a host virtual machine configured to host a session with at least one client computer device. The at least one processor is further configured to execute a web browser application configured to access media content from a remote media source, receive encoded media content from the remote media source in a media container format, and execute a multi-media redirection module configured to intercept the encoded media content from being processed by a decoding module of the web browser application. The multi-media redirection module is configured to redirect the encoded media content to the at least one client computer device.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: May 18, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Neil Rust Hinnant, Sandeep Patnaik, Isuru Chamara Pathirana
  • Patent number: 11012485
    Abstract: A computer system is provided that includes at least one processor configured to execute a host virtual machine configured to host a session with at least one client computer device. The host virtual machine includes an operating system having a multi-media framework for rendering media content. The at least one processor is further configured to execute a media application configured to access media content from a media source, process encoded media content from the media application using the multi-media framework, and execute a multi-media redirection module configured to intercept the encoded media content from being processed by a decoding module of the multi-media framework. The multi-media redirection module is configured to redirect the encoded media content to the at least one client computer device.
    Type: Grant
    Filed: January 2, 2020
    Date of Patent: May 18, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Neil Rust Hinnant, Isuru Chamara Pathirana, Sandeep Patnaik
  • Patent number: 10986353
    Abstract: Methods and devices for decoding a video stream are provided, a method includes storing previously decoded pictures of the video stream in a picture buffer, including a first plurality of pictures of a same temporal sub-layer, the first plurality of pictures including at least one sub-layer reference picture for predicting a current picture of the video stream; determining whether a picture of the first plurality of pictures is a sublayer non-reference (“SLNR”) picture based on an indicator presented in at least one from among a slice header and a picture header; removing, based on the picture being determined as the SLNR picture, the SLNR picture from the picture buffer; and predicting the current picture using one or more of the at least one sub-layer reference picture that is stored within the picture buffer after removing the SLNR picture from the picture buffer.
    Type: Grant
    Filed: March 11, 2020
    Date of Patent: April 20, 2021
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Shan Liu, Stephan Wenger
  • Patent number: 10979729
    Abstract: Provided are methods, apparatus, and computer-readable medium for processing video data using a video coding system that implements ST 2094-10 for modifying the color volume of a video signal. In various implementations, metadata blocks that include color volume transform parameters can be included in an encoded bitstream with an encoded video. Mastering display color volume parameters must also be included in the encoded bitstream when the color volume transform parameters are included in the bitstream. When the mastering display color volume parameters are not also included in the bitstream, all or part of the bitstream is non-conforming.
    Type: Grant
    Filed: November 29, 2017
    Date of Patent: April 13, 2021
    Assignee: Qualcomm Incorporated
    Inventors: Dmytro Rusanovskyy, Adarsh Krishnan Ramasubramonian, Joel Sole Rojals
  • Patent number: 10979684
    Abstract: An information processing apparatus comprises: a capturing information obtaining unit for obtaining capturing information on plural capturing apparatuses for capturing images in plural directions; a model information obtaining unit for obtaining model information on a background shape model indicating a three-dimensional shape of a background of a virtual viewpoint image generated by an image generating unit using the images captured by the capturing apparatuses; and an information generating unit for generating related information associating at least one of the capturing apparatuses with a partial region of the background shape model, based on the obtained capturing information and the obtained model information, wherein the related information is used to determine which one of the capturing apparatuses is to capture the image used by the image generating unit to decide a pixel value corresponding to the partial region in the virtual viewpoint image.
    Type: Grant
    Filed: November 28, 2018
    Date of Patent: April 13, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Tomohiro Yano
  • Patent number: 10972757
    Abstract: Disclosed are a method and apparatus for encoding/decoding images. The image-decoding method comprises the steps of: receiving a bit stream including information regarding an NAL unit type; and checking whether or not the NAL unit in the bit stream is a reference picture based on said information regarding an NAL unit type and decoding the NAL unit. The information regarding an NAL unit type indicates whether the NAL unit is a reference reading picture or not a reference reading picture.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: April 6, 2021
    Assignee: LG ELECTRONICS INC.
    Inventors: Hendry Hendry, Yongjoon Jeon, Chulkeun Kim, Sangoh Jeong, Byeongmoon Jeon, Jungsun Kim
  • Patent number: 10972767
    Abstract: A transmitter for handling multiple formats of a video sequence, comprises a preprocessing module, for receiving a first format of a video sequence, to generate metadata of a second format of the video sequence according to the first format of the video sequence and the second format of the video sequence; and an encoder, couple to the preprocessing module, for transmitting the first format of the video sequence and the metadata in a bit stream to a receiver.
    Type: Grant
    Filed: October 29, 2018
    Date of Patent: April 6, 2021
    Assignee: Realtek Semiconductor Corp.
    Inventors: Lingzhi Liu, Li Liu, Jing Wang, Wujun Chen, Qingxi He, Wei Pu, Weimin Zeng, Chi-Wang Chai
  • Patent number: 10972735
    Abstract: Innovations in use of chroma quantization parameter (“QP”) offsets when determining a control parameter for deblock filtering. For example, as part of encoding, an encoder sets a picture-level chroma QP offset and slice-level chroma QP offset for encoding of a slice of a picture. The encoder also performs deblock filtering of at least part of the slice, where derivation of a control parameter considers only the picture-level chroma QP offset. The encoder outputs at least part of a bitstream including the encoded content. As part of decoding, a corresponding decoder sets a picture-level chroma QP offset and a slice-level chroma QP offset for decoding of a slice of a picture, but derivation of a control parameter for deblock filtering considers only the picture-level chroma QP offset.
    Type: Grant
    Filed: March 27, 2020
    Date of Patent: April 6, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Gary J. Sullivan
  • Patent number: 10958586
    Abstract: Aspects of the subject disclosure may include, for example, obtaining predicted available bandwidths for an end user device, monitoring buffer occupancy of a buffer of the end user device, determining bit rates for portions of media content according to the predicted available bandwidths and according to the buffer occupancy, and adjusting bit rates for portions of media content according to the predicted available bandwidths and according to the buffer occupancy during streaming of the media content to the end user device over a wireless network. Other embodiments are disclosed.
    Type: Grant
    Filed: July 11, 2019
    Date of Patent: March 23, 2021
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Rittwik Jana, Jeffrey Erman, Vijay Gopalakrishnan, Emir Halepovic, Rakesh Sinha, Xuan Kelvin Zou
  • Patent number: 10952014
    Abstract: A system for providing location information and an electronic device supporting the same are provided. The system includes a network interface, at least one processor, and at least one storage device. The storage device may store instructions of enabling the processor to, at its execution, execute receiving, through the network interface, a plurality of photographs including one or more objects, together with position information associated with the photographs, identifying the one or more objects from the plurality of photographs, and transmitting information on the identified one or more objects to an external device, in relation with the position information.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: March 16, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Jong-Eun Yang, Jinho Moon, Ga-Jin Song
  • Patent number: 10944977
    Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to encode and decode multimedia data. A hierarchical track structure for the multimedia data is encoded with at least a first track and a second track, wherein the second track is above the first track. Overlay composition metadata is associated with the second track, wherein the overlay composition metadata comprises offset metadata, layer metadata, source metadata, or some combination thereof. The overlay composition metadata specifies at least part of an overlay composition for media data associated with the first track, wherein the overlay composition can be performed as part of a track derivation operation on media data associated with the first track to generate media data of the second track, such that the second track is a derived track of the first track.
    Type: Grant
    Filed: March 25, 2019
    Date of Patent: March 9, 2021
    Assignee: MEDIATEK Singapore Pte. Ltd.
    Inventors: Lulin Chen, Xin Wang
  • Patent number: 10945038
    Abstract: A method includes receiving media content at a media server and encoding the media content to form a first content stream. The method includes encoding an audio portion of the media content to form a second content stream having a first bit rate. The method includes causing the first content stream to be transmitted to a media device via a satellite distribution system and causing the second content stream to be concurrently transmitted to the media device via a terrestrial distribution system. The method also includes receiving an indication of a disruption of the first content stream at the media device, and , after receiving the indication, causing a change from transmission of the second content stream to transmission of a third content stream of the media content to the media device via the terrestrial distribution system. The third stream has a second bit rate greater than the first bit rate.
    Type: Grant
    Filed: April 21, 2020
    Date of Patent: March 9, 2021
    Assignee: AT&T Intellectual Property I, L.P.
    Inventor: Keith Crowe
  • Patent number: 10931939
    Abstract: A glassless three-dimensional (3D) display apparatus includes a storage configured to store information on a possible depth range providable by the glassless 3D display apparatus and information on a reference output depth range; a display configured to provide a plurality of image views having different viewpoints to a user; and a processor configured to render the plurality of image views having the different viewpoints based on a depth of an input image, to provide a multi-view image, wherein the processor is configured to adjust, based on the depth of the input image, at least one of a minimum value and a maximum value of the reference output depth range, within the possible depth range, to determine an output depth range corresponding to the input image, and render the plurality of image views based on the determined output depth range.
    Type: Grant
    Filed: May 13, 2016
    Date of Patent: February 23, 2021
    Assignee: SAMSUNG ELECTRONICS CO.. LTD.
    Inventors: Seung-ran Park, Ho-young Lee
  • Patent number: 10924766
    Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).
    Type: Grant
    Filed: September 2, 2020
    Date of Patent: February 16, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Gary J. Sullivan
  • Patent number: 10917653
    Abstract: In some embodiments, a method receives an encoded video and decodes blocks in a frame of the encoded video in which replacement content will be inserted. The blocks are analyzed to determine first blocks of the frame that are affected by insertion of the replacement content and second blocks in the frame that are not affected by the insertion. Information from the decoding of the block is saved for the second blocks. The frame is encoded where the replacement content is inserted to replace the first blocks in the encoding of the frame, and wherein the information from the decoding of the second blocks is reused when performing the encoding of the second blocks.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: February 9, 2021
    Assignee: HULU, LLC
    Inventor: Xiaocheng Li
  • Patent number: 10917564
    Abstract: Techniques and systems are provided for processing video data. For example, 360-degree video data can be obtained for processing by an encoding device or a decoding device. The 360-degree video data includes pictures divided into motion-constrained tiles. The 360-degree video data can be used to generate a media file including several tracks. Each of the tracks contain a set of at least one of the motion-constrained tiles. The set of at least one of the motion-constrained tiles corresponds to at least one of several viewports of the 360-degree video data. A first tile representation can be generated for the media file. The first tile representation encapsulates a first track among the several tracks, and the first track includes a first set of at least one of the motion-constrained tiles at a first tile location in the pictures of the 360-degree video data. The first set of at least one of the motion-constrained tiles corresponds to a viewport of the 360-degree video data.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: February 9, 2021
    Assignee: Qualcomm Incorporated
    Inventors: Fnu Hendry, Ye-Kui Wang
  • Patent number: 10911792
    Abstract: Systems, methods, and non-transitory computer readable media are configured to receive a media item. The media item can be split into a plurality of segments. The plurality of segments can be subjected to a plurality of distributed prepublication processing stages. One or more stage progress reports can be received. Each of the one or more stage progress reports can indicate an extent complete of one of the plurality of distributed prepublication processing stages for one of the plurality of segments. An overall extent complete can be calculated with respect to the media item based on the one or more stage progress reports.
    Type: Grant
    Filed: December 22, 2017
    Date of Patent: February 2, 2021
    Assignee: Facebook, Inc.
    Inventor: David Young Joon Pio
  • Patent number: 10911757
    Abstract: Picture processing methods and apparatuses in an image or video encoding or decoding system for processing a picture partitioned into multiple non-overlapped Coding Tree Units (CTUs). Input data of a current CTU is received and split into one or more CUs. A CU entirely inside picture boundaries is split by a splitting type selected from a first set of splitting types, and a CU not entirely inside the picture boundaries is split by a splitting type selected from a second set of splitting types. The second set of splitting type comprises at least two different splitting types to provide flexibility for each out-of-bounds CU to select a splitting type. The current CTU is encoded or decoded when it is partitioned into leaf CUs for prediction and transform processing.
    Type: Grant
    Filed: August 30, 2018
    Date of Patent: February 2, 2021
    Assignee: MEDIATEK INC.
    Inventor: Shih-Ta Hsiang
  • Patent number: 10904577
    Abstract: A video compression system includes a video encoder and a bitstream processing circuit. The video encoder is hardware that performs hardware video encoding upon frames to generate a first bitstream. The first bitstream is output from an entropy encoding circuit of the video encoder. The bitstream processing circuit performs a bitstream post-processing operation upon the first bitstream to produce a second bitstream that is different from the first bitstream, and outputs the second bitstream as a compression output of the frames.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: January 26, 2021
    Assignee: MEDIATEK INC.
    Inventors: Li-Heng Chen, Chung-Hua Tsai, Tung-Hsing Wu, Lien-Fei Chen, Yu-Kun Lin, Yi-Hsin Huang, Han-Liang Chou
  • Patent number: 10893261
    Abstract: Based on viewing tracking data, a viewer's view direction to a three-dimensional (3D) scene depicted by a first video image is determined. The first video image has been streamed in a video stream to the streaming client device before the first time point and rendered with the streaming client device to the viewer at the first time point. Based on the viewer's view direction, a target view portion is identified in a second video image to be streamed in the video stream to the streaming client device to be rendered at a second time point subsequent to the first time point. The target view portion is encoded into the video stream with a higher target spatiotemporal resolution than that used to encode remaining non-target view portions in the second video image.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: January 12, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventor: Ajit Ninan
  • Patent number: 10869091
    Abstract: Systems, methods, and computer-readable media are disclosed for systems and methods for latency detection for streaming video. Example methods may include receiving a request to determine a time to first frame for video content, determining a streaming service and a playback device associated with the request, and determining a time at which playback of the content is initiated. Example methods include capturing a playback sequence of the video content, classifying individual frames of the playback sequence, where each classification is associated with a probability value indicative of a likelihood the frame is a first frame, analyzing classifications of the individual frames, and determining, based at least in part on the analysis of the classifications of the individual frames, the time to first frame for the video content.
    Type: Grant
    Filed: August 6, 2019
    Date of Patent: December 15, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Zongyi Liu, Bruce Ferry, Ayush Goyal, Kun Chen
  • Patent number: 10867185
    Abstract: A system and method for identifying media segments using audio augmented image cross-comparison is disclosed, in which a media segment identifying system analyses both audio and video content, producing a unique identifier to compare with previously identified media segments in a media segment database. The characteristic landmark-linked-image-comparisons are constructed by first identifying pairs of audio landmarks separated by a characteristic, or landmark, time. Digital images associated the audio landmarks are then compared, with the combination providing a characteristic landmark-linked-image-comparison. The audio landmarks are audio peaks that exceed predetermined thresholds. A landmark-time is the time between adjacent pairs of audio peaks. The pair of images associated with the audio peaks are reduced in pixel size and converted to gray scale. Corresponding pixels are compared to form a numeric comparison. One image may be mirrored before comparison to reduce the possibility of null comparisons.
    Type: Grant
    Filed: April 21, 2019
    Date of Patent: December 15, 2020
    Inventors: Samuel Chenillo, Oren Steinfeld
  • Patent number: 10866625
    Abstract: First data is transmitted from a modem of a device to a processor of the device over a point-to-point serial data link at a first one of a plurality of link speeds, where the first data is received at the device over a wireless network connection. The data link transitions to an inactive state following transmission of the first data. Second data is identified that has likewise been received over a wireless network connection, where at least a portion of the second data is received at the device while the data link is in the inactive state. A change from the first speed to a second one of the plurality of link speeds is determined based on historical parameters and predictive parameters. The data link is transitioned to an active state operational at the second link speed to transmit the second data to the processor over the data link.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: December 15, 2020
    Assignee: Intel Corporation
    Inventors: Reinhold Schneider, Pavel Peleska
  • Patent number: 10863159
    Abstract: Systems and methods described that provide for sending a first temporal portion of video to a client, wherein video quality of a first spatial region associated with a first direction of view is sent with higher quality than video data for another spatial region not associated with the first direction of view; sending a second temporal portion of the video to the client; and responsive to determining that a significant event, audio or video or a combination, occurred during the second temporal portion and corresponds with a second direction of view that is associated with a second spatial region, sending higher quality video for the second spatial region than video data for another spatial region. Virtual reality (VR) video, including 360-degree VR video may thus be foveated, based on contextual information in the video data and corresponding audio data, combined with field of view predictions based upon user motion.
    Type: Grant
    Filed: January 11, 2018
    Date of Patent: December 8, 2020
    Assignee: PCMS Holdings, Inc.
    Inventors: Hyun Oh Oh, Jin Sam Kwak, JuHyung Son
  • Patent number: 10863214
    Abstract: The present technology relates to a transmission device, a transmission method, a reception device, and a reception method that can improve transmission efficiency. An encoded signal is generated based on realtime data indicated by a waveform L using a predetermined fixed bit rate as a maximum code amount Sx and the encoded signal into which non-realtime data with an insufficient code amount is inserted is transmitted at the fixed bit rate, as indicated by a range Z12, when a code amount of the generated encoded signal is insufficient for the maximum code amount Sx. The present technology can be applied to broadcasting communication.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: December 8, 2020
    Assignee: SATURN LICENSING LLC
    Inventors: Kazuyuki Takahashi, Lachlan Bruce Michael
  • Patent number: 10854209
    Abstract: A method includes receiving, at an audio encoder, multiple streams of audio data, where N is the number of the received multi streams. The method includes determining a similarity value for each stream of the multiple streams and comparing the similarity value for each stream of the multiple streams with a threshold. The method also includes identifying, based on the comparison, L (L<N) number of streams to be encoded among the N number of the multiple streams. The method includes encoding the identified L number of streams to generate an encoded bitstream.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: December 1, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Venkatraman Atti, Venkata Subrahmanyam Chandra Sekhar Chebiyyam
  • Patent number: 10848270
    Abstract: An optical receiver is configured to receive optical signals representative of digital information over an optical communication link. The optical receiver is further configured to decode symbol estimates from an optical signal received over the optical communication link; to demap first bit estimates and second bit estimates from the symbol estimates; to decode third bit estimates from the first bit estimates using second FEC decoding of a second FEC scheme; and to decode fourth bit estimates from both the second bit estimates and the third bit estimates using first FEC decoding of a first FEC scheme. The optical receiver is further configured to use one or more of the third bit estimates to demap one or more of the second bit estimates. Concatenation of the first and second FEC schemes as described herein may relax design constraints on the second FEC scheme, which may reduce power consumption and design complexity.
    Type: Grant
    Filed: November 29, 2018
    Date of Patent: November 24, 2020
    Assignee: CIENA CORPORATION
    Inventor: Chunpo Pan
  • Patent number: 10848778
    Abstract: The present disclosure relates to image processing device and method that can suppress the deterioration in encoding efficiency. An image processing device includes: a reception unit that receives encoded data in which an image with a plurality of main layers is encoded, and inter-layer prediction control information controlling whether to perform inter-layer prediction, which is prediction between the plurality of main layers, with the use of a sublayer; and a decoding unit that decodes each main layer of the encoded data received by the reception unit by performing the inter-layer prediction on only the sublayer specified by the inter-layer prediction control information received by the reception unit. The present disclosure can be applied to, for example, an image processing device.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: November 24, 2020
    Assignee: SONY CORPORATION
    Inventor: Kazushi Sato
  • Patent number: 10834404
    Abstract: The present invention relates to a method of performing motion compensation by using motion vector prediction. To this end, a method of decoding an image may include: generating multiple motion vector candidate lists according to an inter-prediction direction of a current block; deriving multiple motion vectors for the current block by using the multiple motion vector candidate lists; determining multiple prediction blocks for the current block by using the multiple motion vectors; and obtaining a final prediction block for the current block based on the multiple prediction blocks.
    Type: Grant
    Filed: May 23, 2017
    Date of Patent: November 10, 2020
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Sung Chang Lim, Jung Won Kang, Ha Hyun Lee, Dong San Jun, Hyun Suk Ko, Jin Ho Lee, Seung Hyun Cho, Hui Yong Kim, Jin Soo Choi
  • Patent number: 10827190
    Abstract: A framework for estimating image interpretability degradation associated with image compression is provided. An image compression broker system can determine an image compression setting to achieve an interpretability task in accordance with available communication bandwidth or transmission time objectives. Estimating image interpretability degradation includes detecting edge points of an uncompressed image and determining gradients corresponding to the detected edge points; compressing in accordance with a compression parameter setting the uncompressed image to generate a compressed image and determining gradients corresponding to the edge points in the compressed image; determining from the gradients associated with the edge points gradient ratios; and estimating from the gradient ratios an image interpretability loss of the compressed image.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: November 3, 2020
    Assignee: The United States of America as represented by the Secretary of the Air Force
    Inventors: Erik Philip Blasch, Hua-Mei Harry Chen, Zhonghai Wang, Genshe Chen, Kui Liu, Dan Shen
  • Patent number: 10805640
    Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).
    Type: Grant
    Filed: April 26, 2018
    Date of Patent: October 13, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Gary J. Sullivan
  • Patent number: 10798391
    Abstract: A filtering method according to the present invention is for filtering a plurality of blocks included in an image, and comprises: determining whether each of the blocks is an IPCM block or not; filtering a non-IPCM block that is not an IPCM block among the blocks to generate filtered data; outputting the filtered data as pixel values of the non-IPCM block, and outputting pixel values of the unfiltered IPCM block as pixel values of the IPCM block.
    Type: Grant
    Filed: November 7, 2019
    Date of Patent: October 6, 2020
    Assignee: TAGIVAN II LLC
    Inventors: Chong Soon Lim, Viktor Wahadaniah, Sue Mon Thet Naing, Takahiro Nishi, Youji Shibahara, Hisao Sasai, Toshiyasu Sugio
  • Patent number: 10798386
    Abstract: A processing system having at least one processor may obtain a sequence of frames of a video, and detect a correlation between visual properties of a first frame of the sequence of frames and a second frame of the sequence of frames, where the second frame comprises a next frame following the first frame in the sequence of frames. The processing system may then generate a first difference vector comprising a difference between a latent space representation of the second frame and a latent space representation of the first frame in response to detecting the correlation between the visual properties, where the latent space representation of the first frame and the latent space representation of the second frame are generated via an autoencoder, and store the first difference vector in a first encoding block.
    Type: Grant
    Filed: January 25, 2019
    Date of Patent: October 6, 2020
    Assignee: AT&T Intellectual Property I, L.P.
    Inventor: Abhijeet Bhorkar
  • Patent number: 10798392
    Abstract: A method of video coding using palette coding mode for color video in a non-444 color format is disclosed. The non-444 video data can be converted to the 444 format so that the palette designed for the 444 format can be used for the non-444 video data. For the 4:2:0 color format, each chroma sample collocated with corresponding quad luma samples is padded with three chroma samples to form converted quad chroma samples. For the 4:2:0 color format, if a current pixel does not belong to the color palette, one or more escape values are signaled for the current pixel and the escape value associated with the chroma sample of the current pixel for each color component is not signaled for three of the quad chroma sample locations collocated with corresponding quad luma samples.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: October 6, 2020
    Assignee: HFI INNOVATION INC.
    Inventors: Shan Liu, Jing Ye, Xiaozhong Xu, Jungsun Kim, Wang-Lin Lai, Shaw-Min Lei
  • Patent number: 10798396
    Abstract: A system and method for transmitting compressed video. A transmitter receives uncompressed video data from a video source, and compresses it using one or more reference frames. A receiver receives the compressed video data and decodes it, using the same reference frames, to form display data. The reference frames are stored in compressed form in both the transmitter and the receiver. Each frame of display data becomes a reference frame for the decoding of a subsequent frame.
    Type: Grant
    Filed: December 1, 2016
    Date of Patent: October 6, 2020
    Assignee: Samsung Display Co., Ltd.
    Inventors: Gregory W. Cook, Dale F. Stolitzka
  • Patent number: 10791332
    Abstract: The technology described herein facilitates parallel encoding of two groups of blocks of data of a sequence of blocks of data, whilst also facilitating the use of dependent encoding across the sequence of data blocks. This is achieved by allocating pairs of first and second groups of data blocks to separate encoding units, and determining an encoding parameter value to be used for encoding the first block of each second group of data blocks. For correct reconstruction of the image, it is ensured that a block belonging to the first group of data blocks of a pair of groups of data blocks is encoded with an encoding parameter value that will cause a decoder to use the determined encoding parameter value when decoding the first block of the second group.
    Type: Grant
    Filed: November 23, 2015
    Date of Patent: September 29, 2020
    Assignee: Arm Limited
    Inventors: Reimar Gisbert Döffinger, Thomas Nyberg
  • Patent number: 10791337
    Abstract: The present invention relates to a method for signaling image information and to a decoding method using same. The method for signaling image information according to the present invention comprises: a step of performing inter-prediction for a current picture; and a step of signaling information including the result of said inter-prediction and reference picture information indicating reference pictures usable in said inter prediction, wherein said reference picture information contains pieces of picture order count (POC) information of said usable reference pictures. The POC information of said usable reference pictures in said reference picture information is configured such that POCs for the pictures existing before said current picture in terms of a POC sequence are located at the front, and POCs for the pictures existing after said current picture in terms of a POC sequence are located following the POCs located at the front.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: September 29, 2020
    Assignee: LG Electronics Inc.
    Inventors: Hendry Hendry, Seungwook Park, Jaehyun Lim, Yongjoon Jeon, Chulkeun Kim, Jungsun Kim, Naeri Park, Byeongmoon Jeon, Joonyoung Park
  • Patent number: 10779009
    Abstract: The present disclosure relates to an image decoding device and method through which it is possible to suppress an increase in a load of a decoding process. The present disclosure is provided with a decoding unit configured to generate decoded image data by decoding encoding data obtained by encoding image data for each coding unit (CU) that is recursively divided, and a filter processing unit configured to perform a filter process of the decoded image data generated by the decoding unit according to information set for each data unit corresponding to header information of the encoding data. The present disclosure is applicable, for example, to an image decoding device and the like.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: September 15, 2020
    Assignee: SONY CORPORATION
    Inventor: Yuichi Araki
  • Patent number: 10778982
    Abstract: The disclosure provides a method and system for encoding bit rate control and version selection for a dynamic adaptive video streaming media. The method adopts a dynamic adaptive streaming media encoding technology to encode each original video into a plurality of versions with different bit rates at a server and determines video version subsets to be encoded by the original videos and specific encoding parameters of each video version by taking an encoding complexity-bit rate-distortion model for different original video contents, constraints on an encoding bit rate and a computing resource of the video server, network connection conditions of different users and a video-on-demand probability distribution into consideration, and finally, the video server outputs an optimal video version set through encoding, so as to maximize the overall quality of videos watched by users.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: September 15, 2020
    Inventors: Hongkai Xiong, Chenglin Li
  • Patent number: 10779006
    Abstract: This disclosure describes techniques for signaling 360-degree video information in syntax structures. As one example, this disclosure describes examples for signaling projection types and related information for 360-degree video in syntax structures that include one or more syntax elements. In some examples, the same syntax structures may include non-360-degree video information as well. Accordingly, the syntax structure may be used for encoding and decoding a bitstream carrying only non-360-degree video data, only 360-degree video data, or both non-360-degree video data and 360-degree video data.
    Type: Grant
    Filed: February 13, 2019
    Date of Patent: September 15, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Fnu Hendry, Muhammed Zeyd Coban, Geert Van der Auwera, Marta Karczewicz
  • Patent number: 10771792
    Abstract: When encoding an array of data elements, or a stream of such arrays, using an encoder comprising encoding circuitry operable to encode the array(s) of data elements as a plurality of independent segments, wherein each independent segment can be decoded independently; a header is generated for output with an encoded data stream including the plurality of independent segments wherein the header contains information indicative of the location of each of the plurality of independent segments within the encoded data stream. When an encoded data stream associated with such a header is to be decoded, a decoder may thus read the header to identify the location of the independent segment within the data stream and then read and decode the identified segments from the identified location(s) in the data stream.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: September 8, 2020
    Assignee: Arm Limited
    Inventors: Sven Ola Johannes Hugosson, Tomas Fredrik Edso, Dominic Hugo Symes
  • Patent number: 10769675
    Abstract: Disclosed herein are system and method embodiments for streaming media. An embodiment operates by receiving, at at least one computing device, a request for media from a viewer. At least one program is identified in which at least a portion of the media is available. A presentation is generated to identify the at least the portion of the media based on the at least one program and at least one order, wherein the order comprises at least one order component associated with the at least one program. The embodiment further includes dynamically generating an identification of an advertising clip for the presentation and then transmitting the presentation to the viewer.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: September 8, 2020
    Assignee: SITO Mobile R&D IP, LLC
    Inventor: Charles A. Jennings
  • Patent number: 10771733
    Abstract: Embodiments of the application disclose a method and apparatus for processing video playing, and relate to the technology field of video. The method includes: obtaining an adjustment instruction for a first video being played; determining whether the first video is being recorded; if the first video is being recorded, acquiring and storing a bit stream of the first video based on a current bit stream type of the first video. With the embodiment of the application, the complete recording of a video is ensured.
    Type: Grant
    Filed: August 23, 2017
    Date of Patent: September 8, 2020
    Assignee: Hangzhou Hikvision Digital Technology Co. Ltd.
    Inventors: Yang Wu, Bingquan Han, Xiaojun Chen, Chunyu Xu, Zheng Huang
  • Patent number: 10762122
    Abstract: The present disclosure provides a method and device for assessing quality of multimedia resource, wherein the method includes the steps of: determining a cumulative distribution vector of the multimedia resource according to indicator data for describing user behavior on the multimedia resource; determining an upper boundary vector and a lower boundary vector of the multimedia resource according to the cumulative distribution vector; and determining a quality score of the multimedia resource according to the cumulative distribution vector, the upper boundary vector, and the lower boundary vector. The present disclosure can better describe the quality of multimedia resource, and has a great operability. Moreover, after the quality of multimedia resource is assessed by using the quality assessment method of multimedia resource in the examples of the present disclosure, the feedback of online behaviors can be reflected on the final dynamic and optimized ranking and recommendation of the multimedia resource.
    Type: Grant
    Filed: September 19, 2016
    Date of Patent: September 1, 2020
    Assignee: Alibaba Group Holding Limited
    Inventors: Bo Wei, Zhibing Qi, Yuantu Wang, Guangxu Ma, Yuping Liu, Yuzong Yin, Jian Yao, Baiyu Pan, Ji Wang
  • Patent number: 10764656
    Abstract: Presentation of video highlights is disclosed. A data processing system receives from multiple users, multimedia files with user-generated video(s), the multimedia files being produced and enhanced by the users. The data processing system generates a speckle excitement vector of the multimedia files based on identifying feature(s) of the user-generated video(s). The processing and distribution system determines a cognitive state of each of the users based, in part, on the speckle excitement vector of each of the multimedia files. The processing and distribution system alters characteristic(s) of the user-generated video(s) of the multimedia files based on the cognitive state of each of the users that results in altered video(s). The processing and distribution system compiles the altered video(s) into a digital file that includes automatically-produced multimedia content. The processing and distribution system makes the digital file available for viewing.
    Type: Grant
    Filed: January 4, 2019
    Date of Patent: September 1, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Aaron K. Baughman, Mauro Marzorati, Gray Cannon, Craig M. Trim