Picture (epo) Patents (Class 375/E7.181)
-
Patent number: 12244897Abstract: A method of optimizing playback, the method including: determining whether a player is in a freezing state; obtaining freezing information of the player when the player is in the freezing state; and determining a freezing type based on the freezing information, wherein the freezing type is used to instruct the player to perform a corresponding optimization operation. According to the present application, a freezing classification may be performed based on the freezing information to obtain refined freezing types, and different optimization strategies may be formulated respectively based on the freezing types to implement playback optimization, thereby improving playback optimization effect and optimization efficiency and improving playback experience.Type: GrantFiled: August 9, 2021Date of Patent: March 4, 2025Assignee: SHANGHAI BILIBILI TECHNOLOGY CO., LTD.Inventors: Jianqiang Ding, Zhaoxin Tan
-
Patent number: 12231636Abstract: A method of encoding an input signal is provided, the method comprising: quantizing a set of data based on temporal information associated with said set of data.Type: GrantFiled: July 6, 2020Date of Patent: February 18, 2025Assignee: V-NOVA INTERNATIONAL LIMITEDInventors: Guido Meardi, Simone Ferrara, Lorenzo Ciccarelli
-
Patent number: 12198286Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.Type: GrantFiled: April 27, 2023Date of Patent: January 14, 2025Assignee: SHOPIFY INC.Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
-
Patent number: 12183043Abstract: A computing system may access first alpha values associated with first pixels in a first pixel region of an image and determine a bit budget for encoding the first alpha values. The computing system may then select a first alpha-encoding mode for the first alpha values to reflect a determination that the first alpha values are all fully transparent or all fully opaque, and encode the first alpha values by storing the selected first alpha-encoding mode as part of a metadata without using the bit budget to encode the first alpha values individually. The computing system may then update a record of unallocated bits available for allocation based on the bit budget unused in the encoding of the first alpha values, and allocate, based on the record of unallocated bits, bits to encode a set of alpha values different from the first alpha values.Type: GrantFiled: March 10, 2023Date of Patent: December 31, 2024Assignee: Meta Platforms Technologies, LLCInventors: Cheng Chang, Zhi Zhou, Richard Webb, Richard Lawrence Greene
-
Patent number: 12177436Abstract: Innovations in control and use of chroma quantization parameter (“QP”) values that depend on luma QP values. More generally, the innovations relate to control and use of QP values for a secondary color component that depend on QP values for a primary color component. For example, during encoding, an encoder determines a QP index from a primary component QP and secondary component QP offset. The encoder maps the QP index to a secondary component QP, which has an extended range. The encoder outputs at least part of a bitstream including the encoded content. A corresponding decoder receives at least part of a bitstream including encoded content. During decoding, the decoder determines a QP index from a primary component QP and secondary component QP offset, then maps the QP index to a secondary component QP, which has an extended range.Type: GrantFiled: August 18, 2022Date of Patent: December 24, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Patent number: 12155833Abstract: Provided are a method and apparatus for encoding a video, and a storage medium, which relate to the field of cloud computing, in particular to the video encoding technology. The method includes: acquiring an actual encoding data amount and an encoding frame number of an encoder in a historical time period; calculating a desired encoding data amount in the historical time period according to a code rate of the encoder and the encoding frame number; and comparing the actual encoding data amount and the desired encoding data amount, and adjusting a quantization parameter of the encoder according to a comparison result to instruct the encoder to continue encoding using the adjusted quantization parameter.Type: GrantFiled: June 15, 2022Date of Patent: November 26, 2024Assignee: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.Inventor: Zhao Wan
-
Patent number: 12113716Abstract: Aspects of the subject disclosure may include, for example, obtaining predicted available bandwidths for an end user device, monitoring buffer occupancy of a buffer of the end user device, determining bit rates for portions of media content according to the predicted available bandwidths and according to the buffer occupancy, and adjusting bit rates for portions of media content according to the predicted available bandwidths and according to the buffer occupancy during streaming of the media content to the end user device over a wireless network. Other embodiments are disclosed.Type: GrantFiled: October 20, 2022Date of Patent: October 8, 2024Assignee: AT&T Intellectual Property I, L.P.Inventors: Rittwik Jana, Jeffrey Erman, Vijay Gopalakrishnan, Emir Halepovic, Rakesh Sinha, Xuan Kelvin Zou
-
Patent number: 12088824Abstract: A method for decoding a bitstream comprising a sequence of encoded images. The method includes: obtaining first information from first encoded data contained in the bitstream; determining a list of coding parameters on the basis of the first information and of at least one predefined list of coding parameters; obtaining second information from second encoded data contained in the bitstream, the second information corresponding to a coding parameter among the coding parameters in the list of coding parameters; determining an element of a reconstructed image corresponding to an element of an image in the sequence of images, by means of the coding parameter corresponding to the second information and of encoded data representative of the element of the image in the sequence; wherein the size of the second encoded data depends on the number of coding parameters in the list of coding parameters.Type: GrantFiled: June 26, 2020Date of Patent: September 10, 2024Assignee: S.A. VITECInventors: Jean-Marc Thiesse, David Gommelet, Didier Nicholson, Madhukar Bhat
-
Patent number: 12085425Abstract: In a method for detecting the position of a movable part by a sensor which, as sensor signals coding the position, has a first signal and a second signal, the position detected by the sensor is coded by the first and second signal, an actual variable is determined from the sensor signals in a chronologically recurring manner, the determination of a control value is triggered by a trigger signal, the determination of the control value is executed such that the actual variable is regulated toward a target variable.Type: GrantFiled: October 19, 2020Date of Patent: September 10, 2024Assignee: SEW-EURODRIVE GMBH & CO. KGInventors: Michael Müller, Manuel Heil, Matthias Rümmele
-
Patent number: 12063455Abstract: The present invention is a method and a processing device that allows smoothing of all camera parameters that are changeable while the camera is running through a tasklist component that schedules transitions synchronized with the output video frame rate. A device-native thread runs the scheduler which picks smoothing tasks off a list to meet real-time requirements. Different strategies for smoothing based on Bézier curves, splines and linear interpolation are scheduled on the runtime. The camera, which is automatically able to detect people and frame them based on where they are, uses this module to smoothly change the frame when people move in the camera field of view, among other functions.Type: GrantFiled: April 7, 2020Date of Patent: August 13, 2024Assignee: Huddly ASInventors: Kacper Wysocki, Mats Gabriel Love Johansen, Kai Alexander Wig, Mona Kleven Lauritzen
-
Patent number: 12052449Abstract: Methods, systems, and computing devices are described herein for request and transmission, to a computing device, of media content based on the importance of a portion of the media content. Media content may comprise baseline media content and enhancement data. Based on determining that an importance of a portion of the media content meets a threshold, the computing device may receive the enhancement data. The computing device may receive the enhancement data via a separate interface than the baseline media content. Information about baseline media content, enhancement data, and the importance of a portion of the media content may be contained in a manifest. The threshold for importance may be based on the media content, the enhancement data, an interface to be used, and/or user preferences.Type: GrantFiled: February 14, 2022Date of Patent: July 30, 2024Assignee: Comcast Cable Communications, LLCInventors: Yasser F. Syed, Patrick Ladd, Derik Yarnell
-
Patent number: 12051212Abstract: A method and apparatus image analysis and motion detection using interframe coding, including, e.g., encoding surveillance video where one or more regions of interest are identified and the encoding parameter values associated with those regions are specified in accordance with intermediate outputs of a video analytics process. Such an analytics-modulated video compression approach allows the coding process to adapt dynamically based on the content of the surveillance images. In this manner, the fidelity of the region of interest is increased relative to that of a background region such that the coding efficiency is improved, including instances when no target objects appear in the scene. Better compression results can be achieved by assigning different coding priority levels to different types of detected objects.Type: GrantFiled: May 8, 2023Date of Patent: July 30, 2024Assignee: Check Video LLCInventors: Lai-Tee Cheok, Nikhil Gagvani
-
Patent number: 11955067Abstract: A method of rate control of a display device includes receiving compressed stress data for a slice of a display, decompressing the compressed stress data to obtain reconstructed stress data for the slice, adding additional stress data to the reconstructed stress data to obtain updated stress data for the slice, encoding the updated stress data at a first precision level (pc) to generate first updated compressed stress data for the slice, in response to a size (bc) of the first updated compressed stress data for the slice of the display exceeding a size (bt) of a buffer, determining a second precision level (p) based on the first precision level (pc), a third precision level (ps) of the additional stress data, and a fourth precision level (pb) of the buffer, and encoding the updated stress data at the second precision level (p) to generate second updated compressed stress data.Type: GrantFiled: May 27, 2021Date of Patent: April 9, 2024Assignee: Samsung Display Co., Ltd.Inventor: Gregory W. Cook
-
Patent number: 11949877Abstract: Innovations in adaptive encoding of screen content based on motion type are described. For example, a video encoder system receives a current picture of a video sequence. The video encoder system determines a current motion type for the video sequence and, based at least in part on the current motion type, sets one or more encoding parameters. Then, the video encoder system encodes the current picture according to the encoding parameter(s). The innovations can be used in real-time encoding scenarios when encoding screen content for a screen sharing application, desktop conferencing application, or other application. In some cases, the innovations allow a video encoder system to adapt compression to different characteristics of screen content at different times within the same video sequence.Type: GrantFiled: October 1, 2021Date of Patent: April 2, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Satya Sasikanth Bendapudi, Ming-Chieh Lee, Yan Lu, Bin Li, Jizhe Jin, Jiahao Li, Shao-Ting Wang
-
Patent number: 11917221Abstract: The present technology relates to an encoding device, an encoding method, a reproduction device, a reproduction method, and a program enabling each reproduction equipment to reproduce an appropriate content in a simplified manner. A content data decoding unit decodes encoded metadata and outputs zoom area information, which is included in metadata acquired as a result thereof, designating an area to be zoomed. A zoom area selecting unit selects one or a plurality of pieces of zoom area information from among the zoom area information. A video segmenting unit segments a zoom area represented by the selected zoom area information in a video based on video data and outputs zoom video data acquired as a result thereof. An audio converting unit performs an audio converting process according to the selected zoom area information for audio data and outputs zoom audio data acquired as a result thereof. The present technology can be applied to a reproduction device.Type: GrantFiled: April 26, 2022Date of Patent: February 27, 2024Assignee: Sony Group CorporationInventors: Minoru Tsuji, Toru Chinen, Runyu Shi, Masayuki Nishiguchi, Yuki Yamamoto
-
Patent number: 11910042Abstract: Approaches for dynamically allocating compute capacity for processing a video stream. Video complexity information for two or more digital video streams actively being processed by one or more video encoders is determined at periodic intervals. Video complexity information describes the complexity of digital video carried by the digital video streams across a bounded number of consecutive digital frames which includes digital frames not yet processed by the one or more video encoders. A determination is made as to whether the compute capacity allocated for processing a particular digital video stream should be adjusted in some manner based on the determined video complexity information. The amount of compute capacity allocated for processing the particular digital video stream may be dynamically adjusted in response to maximizing a measure of optimal video quality calculated for the two or more digital video streams using, at least in part, the determined video complexity information.Type: GrantFiled: June 7, 2022Date of Patent: February 20, 2024Assignee: Harmonic, Inc.Inventor: Neven Haltmayer
-
Patent number: 11902543Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.Type: GrantFiled: September 19, 2022Date of Patent: February 13, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Yongjun Wu
-
Patent number: 11902544Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.Type: GrantFiled: September 19, 2022Date of Patent: February 13, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Yongjun Wu
-
Patent number: 11902541Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.Type: GrantFiled: August 17, 2022Date of Patent: February 13, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Yongjun Wu
-
Patent number: 11893963Abstract: Embodiments of the subject matter described herein relate to a wireless programmable media processing system. In the media processing system, a processing unit in a computing device generates a frame to be displayed based on a graphics content for an application running on the computing device. The frame to be displayed is then divided into a plurality of block groups which are compressed. The plurality of compressed block groups are sent to a graphics display device over a wireless link. In this manner, both the generation and the compression of the frame to be displayed may be completed at the same processing unit in the computing device, which avoids data copying and simplifies processing operations. Thereby, the data processing speed and efficiency is improved significantly.Type: GrantFiled: November 14, 2022Date of Patent: February 6, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Yunxin Liu, Jiansong Zhang, Lintao Zhang, Thomas Moscibroda
-
Patent number: 11818509Abstract: A method for processing video comprises storing, at a video data buffer, an input video frame data received from a source, causing the stored video frame data to be output from the video data buffer at an output video frame rate, and varying the output video frame rate based on a comparison of an amount of video frame data stored at the video data buffer to a threshold amount of frame data. The threshold amount of frame data may be based on a target total latency between capture of the input video frame data at the source and display of the stored video frame data output from the video data buffer.Type: GrantFiled: January 24, 2022Date of Patent: November 14, 2023Assignee: INTUITIVE SURGICAL OPERATIONS, INC.Inventors: Brian Edward Miller, Charles Vigue
-
Patent number: 11792469Abstract: A system may receive a plurality of requests to record a plurality of programs. Based on these requests, resources may be provisioned for transcoding variable bit rate streams into constant bit rate streams. Resources may be provisioned based on assigning transcoding tasks to an existing set of deployed devices in which the transcoding tasks correspond to the plurality of requests. Resources may further be provisioned based on incrementally deploying an additional device to the existing set of deployed devices when the transcoding capacity reaches a certain level.Type: GrantFiled: June 16, 2017Date of Patent: October 17, 2023Assignee: Comcast Cable Communications, LLCInventor: Benyuan Zhang
-
Patent number: 11790950Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for film-making using style transfer. One of the methods includes receiving an initial video comprising a sequence of initial video frames; receiving a selection of style images; for each initial video frame in the sequence of initial video frames, processing the initial video frame to generate a final video frame, the processing comprising: segmenting the initial video frame to generate a segmented video frame; generating a plurality of stylized video frames each according to a respective one of the style images; and generating a final video frame comprising, for each segment of the segmented video frame: determining a stylized video frame, extracting the respective segment from the determined stylized video frame, and inserting the extracted segment into the final video frame; and combining each generated final video frame in sequence to generate the final video.Type: GrantFiled: January 14, 2021Date of Patent: October 17, 2023Inventor: Robert Salem Abraham
-
Patent number: 11792407Abstract: A method, apparatus, device and medium for coding a video are provided. An implementation plan includes: determining an initial video frame structure based on a preset threshold for a B-frame number; in response to determining that the initial video frame structure meets a preset condition, shortening the initial video frame structure to obtain a candidate video frame structure set; determining a target video frame structure from the candidate video frame structure set; and performing video coding on video frames in a to-be-coded video frame sequence according to the target video frame structure.Type: GrantFiled: June 21, 2021Date of Patent: October 17, 2023Assignee: Beijing Baidu Netcom Science and Technology Co., Ltd.Inventors: Le Shi, Wenpeng Ding
-
Patent number: 11778224Abstract: Techniques are described for pre-processing frames to apply a temporal filter. A P-frame may be temporally filtered based on neighboring reference frames. The temporal filter may be applied to blocks of the P-frame to improve alignment with dependent frames that are encoded based on blocks of the P-frame.Type: GrantFiled: November 29, 2021Date of Patent: October 3, 2023Assignee: Amazon Technologies, Inc.Inventors: Rahul Vanam, Sriram Sethuraman
-
Patent number: 11722683Abstract: A method of video encoding includes, prior to encoding a first tile of s plurality of tiles of a current picture, initializing a shared row buffer that is shared among multiple processor threads associated with the first tile. The method also includes encoding a first unit of a plurality of units in a first row of the first tile by a first processor thread and using a corresponding first HMVP buffer. The method also includes, when all of the plurality of blocks in the first unit have been encoded, copying contents of the first HMVP buffer into the shared row buffer, copying contents of the shared row buffer into a second HMVP buffer, starting encoding of a unit in a second row of the plurality of rows by the second processor thread using the second HMVP buffer, and resetting the first HMVP buffer.Type: GrantFiled: September 13, 2022Date of Patent: August 8, 2023Assignee: Tencent America LLCInventors: Xiaozhong Xu, Shan Liu, Xiang Li
-
Patent number: 11706463Abstract: The present disclosure provides a video synthesis method, apparatus, computer device and computer-readable storage medium, which the method includes: acquiring a first video; capturing second video data photographed in real time; performing first encoding on the second video data to obtain an encoded video; synthesizing the first video and the encoded video to obtain synthesized video data; and performing second encoding on the synthesized video data to obtain a target video. By means of the method, there is less loss in the obtained target video frames and a relatively high definition of the video frames.Type: GrantFiled: October 24, 2019Date of Patent: July 18, 2023Assignee: BEIJING MICROLIVE VISION TECHNOLOGY CO., LTD.Inventor: Zhixin Tang
-
Patent number: 11700385Abstract: Embodiments of a system and method for secure processing of image data are described. Image data included in image files may be encrypted and compressed in a single step using dynamically identified compression/encryption information such as code word tables.Type: GrantFiled: March 31, 2021Date of Patent: July 11, 2023Assignee: United States Postal ServicesInventor: Ryan J. Simpson
-
Patent number: 11670065Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.Type: GrantFiled: February 3, 2022Date of Patent: June 6, 2023Assignee: SHOPIFY INC.Inventors: Byron Leonel Delgado, Stephan Leroux, Daniel Beauchamp
-
Patent number: 11653009Abstract: Systems and methods are provided for encoding a multi-pixel caching scheme for lossless encoders. The systems and methods can include obtaining a sequence of pixels, determining repeating sub-sequences of the sequence of pixels consisting of a single repeated pixel and non-repeating sub-sequences of the sequence of pixels, responsive to the determination, encoding the repeating sub-sequences using a run-length of the repeated pixel and encoding the non-repeating sub-sequences using a multi-pixel cache, wherein the encoding using a multi-pixel cache comprises, encoding non-repeating sub-sequences stored in the multi-pixel cache as the location of the non-repeating sub-sequences in the multi-pixel cache, and encoding non-repeating sub-sequences not stored in the multi-pixel cache using the value of the pixels in the non-repeating sub-sequences.Type: GrantFiled: October 25, 2021Date of Patent: May 16, 2023Inventor: Muhammad A. Dawood
-
Patent number: 11653003Abstract: A method for processing a stream of images including the steps of obtaining coding information from the stream of images to determine one or more bitrate/distortion models representative of the bitrate/distortion relationship of the stream of images, determining a set of coding parameters arranged for use to encode a stream of images with the one or more bitrate/distortion models, reformulating the bitrate/distortion relationship into a decoupled relationship arranged to be applied to a subset of the stream of images, and using the decoupled relationship and the set of coding parameters to generate an adaptive quantization parameter for encoding the stream of images with the bitrate/distortion relationship.Type: GrantFiled: July 16, 2021Date of Patent: May 16, 2023Assignee: City University of Hong KongInventors: Sam Tak Wu Kwong, Shiqi Wang, Yi Chen
-
Patent number: 11653039Abstract: A computer-implemented method, a system, a video camera, and a server all for dynamically batching a video stream from a video camera. The method comprising the steps of: capturing, by the video camera, a video stream; identifying two or more intended subscribers of the video stream, said subscribers connected to the video camera via the packet-switched network; determining a sensitivity to latency for each subscriber; batching the video stream into a plurality of batches, wherein the size of each batch of the plurality of batches is based on the subscriber determined to be most sensitive to latency; and transmitting the plurality of batches of the video stream to each subscriber.Type: GrantFiled: January 2, 2020Date of Patent: May 16, 2023Assignee: AVA VIDEO SECURITY LIMITEDInventors: Sira Gonzalez, Robert Welin
-
Patent number: 11647153Abstract: Embodiments of the present disclosure relate to a computer-implemented method, a device, and a computer program product. A method includes: determining a first group of frames corresponding to a first scene and a second group of frames corresponding to a second scene different from the first scene in a reference video, respectively. The first group of frames and the second group of frames each have a first resolution. The method further includes determining a first model for the first scene and a second model for the second scene, respectively. The first model and the second model are respectively used to convert frames corresponding to the first scene and the second scene from the first resolution to a second resolution different from the first resolution. The method further includes training the first model and the second model using the first group of frames and the second group of frames, respectively.Type: GrantFiled: February 7, 2022Date of Patent: May 9, 2023Assignee: Dell Products L.P.Inventors: Pedro Fernandez Orellana, Qiang Chen
-
Patent number: 11601650Abstract: Dynamically allocating virtual or physical CPU cycles for use in processing a video stream. Video complexity information for two or more digital video streams actively being processed by one or more video encoders is determined at periodic intervals. Video complexity information describes the complexity of digital video carried by the digital video streams across a bounded number of consecutive digital frames which includes digital frames not yet processed by the one or more video encoders. A determination is made as to whether a number of CPU cycles allocated for processing a particular digital video stream should be adjusted based on the determined video complexity information. The number of CPU cycles allocated for processing the particular digital video stream may be dynamically adjusted by changing an amount of CPU cycles allocated to a virtual machine in which the stream is processed or by processing the stream in a different virtual machine.Type: GrantFiled: January 19, 2021Date of Patent: March 7, 2023Assignee: Harmonic, Inc.Inventors: Neven Haltmayer, Eric Le Bars, Arnaud Mahe, Christophe Berthelot, David Henry, Jeremy C. Rosenberg
-
Patent number: 11575938Abstract: Data may be encoded to minimize distortion after decoding, but the quality required for presentation of the decoded data to a machine and the quality required for presentation to a human may be different. To accommodate different quality requirements, video data may be encoded to produce a first set of encoded data and a second set of encoded data, where the first set may be decoded for use by one of a machine consumer or a human consumer, and a combination of the first set and the second set may be decoded for use by the other of a machine consumer or a human consumer. The first and second set may be produced with a neural encoder and a neural decoder, and/or may be produced with the use of prediction and transform neural network modules. A human-targeted structure and a machine-targeted structure may produce the sets of encoded data.Type: GrantFiled: December 30, 2020Date of Patent: February 7, 2023Assignee: Nokia Technologies OyInventors: Hamed Rezazadegan Tavakoli, Francesco Cricri, Miska Matias Hannuksela, Emre Baris Aksu, Honglei Zhang, Nam Le
-
Patent number: 11563794Abstract: Various embodiments comprise systems, methods, and apparatus for processing a received video stream according to an embodiment comprises: identifying a number of repeated video frames within a sequence of N video frames within the video stream; determining, using a video frame quality assessment mechanism adapted to use repeated frames information, a motion adapted video quality metric (VQM) of the sequence of N video frames; and generating an alarm in response to the motion adapted VQM being less than a threshold level.Type: GrantFiled: October 6, 2021Date of Patent: January 24, 2023Assignee: CHARTER COMMUNICATIONS OPERATING, LLC.Inventors: Mun G Choi, Dhananjay Lal, Andrew Ip
-
Patent number: 11558619Abstract: Decoding a transform block includes decoding a first group of coefficients of the transform block using a first scan order. The first group includes of first coefficients of a first row along a first edge of the transform block and second coefficients of a first column that is along a second edge of the transform block. The first group is used to determine a second scan order for decoding a second group of coefficients of the transform block. The second group includes remaining coefficients of the transform block and does not include any coefficient of the first group. The second group is decoded using the second scan order.Type: GrantFiled: December 7, 2021Date of Patent: January 17, 2023Assignee: GOOGLE LLCInventor: Dake He
-
Patent number: 11546640Abstract: Several systems, methods and integrated circuits capable of reducing blocking artifacts in video data are disclosed. In an embodiment, a system for reducing blocking artifacts in video data includes a processing module and a deblocking module. The deblocking module comprises a luma deblocking filter and a chroma deblocking filter configured to filter an edge between adjacent blocks associated with the video data, where a block of the adjacent blocks corresponds to one of a prediction block and a transform block. The processing module is communicatively associated with the deblocking module and is operable to configure at least one filter coefficient corresponding to the chroma deblocking filter based on one or more filter coefficients corresponding to the luma deblocking filter. The processing module is further configured to cause the chroma deblocking filter to filter the edge between the adjacent blocks based on the configured at least one filter coefficient.Type: GrantFiled: January 19, 2021Date of Patent: January 3, 2023Assignee: TEXAS INSTRUMENTS INCORPORATEDInventor: Mangesh Devidas Sadafale
-
Patent number: 11516515Abstract: An image processing apparatus for performing correction for each frame group including a predetermined number of frames into which video data is divided includes a decoding unit configured to obtain a corrected frame group by correcting a second frame group, which is a frame group continuous with a first frame group in time, using a feature quantity of the first frame group. The decoding unit performs the correction so that subjective image quality based on a relationship between the second frame group and a frame group subsequent to the second frame group in time is increased and so that a predetermined classifier classifies that a frame group in which the second frame group is concatenated with the frame group subsequent to the second frame group in time is the same as a frame group in which the corrected frame group is concatenated with a corrected frame group obtained by correcting the frame group subsequent to the second frame group in time.Type: GrantFiled: September 11, 2019Date of Patent: November 29, 2022Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATIONInventors: Shinobu Kudo, Shota Orihashi, Masaki Kitahara, Atsushi Shimizu
-
Patent number: 11508027Abstract: An example symbol-based watermark detection method disclosed herein includes, in response to a comparison of a first count of occurrences of a first potential symbol value corresponding to a first symbol within a watermark and a second count of occurrences of a second potential symbol value corresponding to the first symbol, (i) determining a first accumulated signal to noise ratio value corresponding to the occurrences of the first potential symbol value, (ii) determining a second accumulated signal to noise ratio value corresponding to the occurrences of the second potential symbol value, and (iii) selecting one of the first or the second potential symbol value having a greatest accumulated signal to noise ratio value as a likely symbol value for the first symbol. The example method also includes concatenating the likely symbol value with other likely symbol values corresponding to other symbols of the watermark to detect the watermark.Type: GrantFiled: October 9, 2020Date of Patent: November 22, 2022Assignee: The Nielsen Company (US), LLCInventor: Christen V. Nielsen
-
Patent number: 11481613Abstract: Executing a deep neural network by obtaining, during deep neural network inference, a binary intermediate feature map in binary representation by converting a floating-point or fixed-point intermediate feature map into a binary vector using a first transformation module; generating a compressed feature map by compressing the binary intermediate feature map using a nonlinear dimensionality reduction layer; storing the compressed feature map into memory; reconstructing the binary intermediate feature map by decompressing the compressed feature map read from the memory using a reconstruction layer corresponding to the nonlinear dimensionality reduction layer; and converting the reconstructed binary intermediate feature map into a floating-point or fixed-point intermediate feature map using a second transformation module.Type: GrantFiled: November 26, 2019Date of Patent: October 25, 2022Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICAInventors: Denis A. Gudovskiy, Luca Rigazio
-
Patent number: 11461882Abstract: Disclosed is an image processing apparatus that generate a plurality of reduced images with different reduction rates from an input image, applies predetermined processing to the reduced images, enlarges the reduced images into their respective original resolutions, and then composes the enlarged images into a composite image. The apparatus applies processing to the input image based on the composite image. The apparatus, depending on a setting, applies the processing to an input image based on the composite image generated from a previous input image.Type: GrantFiled: December 23, 2020Date of Patent: October 4, 2022Assignee: CANON KABUSHIKI KAISHAInventor: Takayuki Yasuda
-
Patent number: 11457212Abstract: Innovations in control and use of chroma quantization parameter (“QP”) values that depend on luma QP values. More generally, the innovations relate to control and use of QP values for a secondary color component that depend on QP values for a primary color component. For example, during encoding, an encoder determines a QP index from a primary component QP and secondary component QP offset. The encoder maps the QP index to a secondary component QP, which has an extended range. The encoder outputs at least part of a bitstream including the encoded content. A corresponding decoder receives at least part of a bitstream including encoded content. During decoding, the decoder determines a QP index from a primary component QP and secondary component QP offset, then maps the QP index to a secondary component QP, which has an extended range.Type: GrantFiled: January 11, 2021Date of Patent: September 27, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Sandeep Kanumuri
-
Patent number: 11451877Abstract: Provided are devices, computer-program products, and methods related to removing redundant data associated with frames. For example, a method can include storing a plurality of reference data sets in a reference database, where a reference data set is associated with a media segment. The method can further include receiving, by a server, cue data for a frame. The cue data includes a plurality of pixel data samples from the frame, and the frame is associated with an unidentified media segment. The method can further include identifying an absence of a pixel data sample from the cue data for the frame, and matching the cue data for the frame to a reference data set. The matching can include using a previous pixel data sample from a previous frame. The previous pixel data sample corresponds to the pixel data sample absent from the frame, and the reference data set is associated with a media segment. The method can further include determining the unidentified media segment is the media segment.Type: GrantFiled: April 21, 2020Date of Patent: September 20, 2022Assignee: INSCAPE DATA, INC.Inventors: Zeev Neumeier, Michael Collette
-
Patent number: 11451795Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.Type: GrantFiled: July 22, 2021Date of Patent: September 20, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Gary J. Sullivan, Yongjun Wu
-
Patent number: 11451793Abstract: Techniques and tools for performing fading compensation in video processing applications are described. For example, during encoding, a video encoder performs fading compensation using fading parameters comprising a scaling parameter and a shifting parameter on one or more reference images. During decoding, a video decoder performs corresponding fading compensation on the one or more reference images.Type: GrantFiled: July 7, 2021Date of Patent: September 20, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Sridhar Srinivasan, Shankar Regunathan
-
Patent number: 11451794Abstract: Techniques and tools for performing fading compensation in video processing applications are described. For example, during encoding, a video encoder performs fading compensation using fading parameters comprising a scaling parameter and a shifting parameter on one or more reference images. During decoding, a video decoder performs corresponding fading compensation on the one or more reference images.Type: GrantFiled: July 7, 2021Date of Patent: September 20, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Sridhar Srinivasan, Shankar Regunathan
-
Patent number: 11416158Abstract: Systems, methods, and computer media are described for memory-efficient unarchiving. Data items can be archived and removed from primary data store over time. An archive block containing both a data item of interest and additional data items can be located. The data item of interest, as well as the additional data, can be loaded into a secondary data store. The data item of interest can then be extracted from the secondary data store and reloaded into the primary data store. The secondary data store can then be cleared. Memory-efficient unarchiving more efficiently uses computing resources and unarchives only the data that is needed.Type: GrantFiled: March 9, 2021Date of Patent: August 16, 2022Assignee: SAP SEInventors: Siddhartha Mishra, Gaurav Kumar Dhankhar, Ankit Rastogi, Shilpi Khanna, Anurag Sharma
-
Patent number: 8897371Abstract: The disclosure is directed to a receiver. The receiver includes a video decoder and a frame throttle configured to receive a video sequence comprising a plurality of video frames. The frame throttle is further configured to drop one or more of the video frames from the video sequence before providing the video sequence to the video decoder.Type: GrantFiled: November 6, 2006Date of Patent: November 25, 2014Assignee: QUALCOMM IncorporatedInventor: Brian William Orr
-
Patent number: 8804825Abstract: A method for encoding pictures within a groups of pictures using prediction, where a first reference picture from a group of pictures and a second reference pictures from the subsequent group of pictures are used in predicting pictures in the group of pictures associated with the first reference picture. A plurality of anchor pictures in the group of pictures associated with the first reference picture may be predicted using both the first and second reference pictures to ensure a smooth transition between different groups of pictures within a video frame.Type: GrantFiled: January 11, 2006Date of Patent: August 12, 2014Assignee: Broadcom CorporationInventors: Ashish Koul, Douglas Chin