Patents by Inventor Edward Harold
Edward Harold has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12413719Abstract: Techniques for implementing adaptive interpolation filter search in video encoding are disclosed. Conventional interpolation filter searching is simplified to implement adaptive interpolation filter search by selecting one or more first filter types to determine one or more initial interpolation costs. After identifying an MV that produces a target interpolation error for one of the one or more first filter types, one or more secondary interpolation costs are calculated for one or more additional filter types based on the identified MV, and one of the one or more first filter type and one or more additional filter types that results in minimal interpolation error is selected as the interpolation filter type.Type: GrantFiled: June 22, 2023Date of Patent: September 9, 2025Assignee: ATI TECHNOLOGIES ULCInventors: Ying Luo, Razvan Florin Dan-Dobre, Min Wang, Edward Harold
-
Patent number: 12184871Abstract: An encoder implements a residual-free palette encoding mode in which a block of pixels is used to derive a palette table having a number of palette colors less than a number of pixel colors in the block of pixels, and to derive a color map representing each pixel of the block with a corresponding index number associated with a palette color that most closely matches the pixel's color. The calculations of residuals representing errors between the predicted palette colors and the actual pixel colors are omitted during the encoding process, thereby facilitating implementation of less complex palette mode encoder hardware at the expense of slight loss of color accuracy. Moreover, when multiple encoding modes are available, the encoder can employ the residual-free palette encoding mode when the rate-distortion cost or other cost of using this mode is determined to be the lowest cost of the plurality of encoding modes.Type: GrantFiled: December 12, 2022Date of Patent: December 31, 2024Assignees: ATI TECHNOLOGIES ULC, ADVANCED MICRO DEVICES, INC.Inventors: Ying Luo, Alvin Duong, Edward Harold, Wei Gao, Shu-Hsien Samuel Wu, Haibo Liu, Ehsan Mirhadi
-
Publication number: 20240430414Abstract: Techniques for implementing adaptive interpolation filter search in video encoding are disclosed. Conventional interpolation filter searching is simplified to implement adaptive interpolation filter search by selecting one or more first filter types to determine one or more initial interpolation costs. After identifying an MV that produces a target interpolation error for one of the one or more first filter types, one or more secondary interpolation costs are calculated for one or more additional filter types based on the identified MV, and one of the one or more first filter type and one or more additional filter types that results in minimal interpolation error is selected as the interpolation filter type.Type: ApplicationFiled: June 22, 2023Publication date: December 26, 2024Inventors: Ying Luo, Razvan Florin Dan-Dobre, Min Wang, Edward Harold
-
Patent number: 12132917Abstract: An encoder encodes an image portion by recursively partitioning the portion into a partitioning hierarchy of levels. The top level has a single block representing the entire portion and each lower level has four smaller blocks representing a corresponding larger block at a higher level. A palette table is generated for each bottom-level block based on the pixels of the associated block. For each successively higher level, the encoder generates a palette table for each current-level block by selecting palette colors based on the palette colors from the four palette tables for the associated four blocks at the next-lowest level. A color index map is then generated based on a final palette table selected from the palette tables generated for the partitioning hierarchy. A representation of the portion is then encoded using the final palette table and the color index map to generate a corresponding segment of an encoded bitstream.Type: GrantFiled: September 23, 2020Date of Patent: October 29, 2024Assignee: ATI TECHNOLOGIES ULCInventors: Wei Gao, Yang Liu, Ihab Amer, Ying Luo, Shu-Hsien Wu, Edward Harold, Feng Pan, Crystal Sau, Gabor Sines
-
Publication number: 20240223768Abstract: The present disclosure provides techniques for implementing a hierarchical and partitional integer motion estimation search (IMES) architecture using a search engine that is configurable based on a content of a plurality of frames in a video sequence. For example, the techniques include identifying, based on the plurality of frames, one or more search parameters for the hierarchical and partitional motion estimation, where the one or more search parameters are based on a content indicative of motion features tracked across the video sequence. The hierarchical and partitional motion estimation, which includes at least one decimated motion estimation search followed by a full-pixel level search, is performed based on the one or more identified search parameters to determine an integer (or pixel-level) motion vector.Type: ApplicationFiled: December 28, 2022Publication date: July 4, 2024Inventors: Yuxin Chen, Ying Luo, Edward Harold, Shu-Hsien Wu, Xinghai Li, Razvan F. Dan-Dobre, Min Wang, Jianbin Xiao, Amal Khailtash, Yin Xia Yang, Kai Sun
-
Publication number: 20240195990Abstract: An encoder implements a residual-free palette encoding mode in which a block of pixels is used to derive a palette table having a number of palette colors less than a number of pixel colors in the block of pixels, and to derive a color map representing each pixel of the block with a corresponding index number associated with a palette color that most closely matches the pixel's color. The calculations of residuals representing errors between the predicted palette colors and the actual pixel colors are omitted during the encoding process, thereby facilitating implementation of less complex palette mode encoder hardware at the expense of slight loss of color accuracy. Moreover, when multiple encoding modes are available, the encoder can employ the residual-free palette encoding mode when the rate-distortion cost or other cost of using this mode is determined to be the lowest cost of the plurality of encoding modes.Type: ApplicationFiled: December 12, 2022Publication date: June 13, 2024Inventors: Ying Luo, Alvin Duong, Edward Harold, Wei Gao, Shu-Hsien Samuel Wu, Haibo Liu, Ehsan Mirhadi
-
Patent number: 11706415Abstract: Still frame detection for single pass video data, including: determining that an average quantization parameter of a frame of video data falls below a quantization parameter threshold; determining whether an amount of skipped macroblocks in the frame meets a skipped macroblock threshold; and responsive to the amount of skipped macroblocks exceeding the skipped macroblock threshold, identifying the frame as a still frame.Type: GrantFiled: December 28, 2020Date of Patent: July 18, 2023Assignees: ADVANCED MICRO DEVICES, INC., ATI TECHNOLOGIES ULCInventors: Mehdi Semsarzadeh, Jiao Wang, Yao Wen Yu, Edward Harold, Richard E. George
-
Patent number: 11477447Abstract: Techniques for encoding and decoding media content, and more specifically to selecting filter coefficients for filtering coding artifacts from the encoded media content are described. The filter coefficients are selected by an encoder for a given frame based on a statistical record of one or more previous frames in a data stream. The statistical record indicates the effectiveness of different sets of filter coefficients in reducing encoding artifacts for the one or more previous frames. By employing the statistical record to select filter coefficients for the next frame in the data stream, the encoder is able to select the filter coefficients relatively quickly, reducing encoding latency while ensuring that a decoder is able to effectively decode the encoded frames.Type: GrantFiled: September 25, 2020Date of Patent: October 18, 2022Assignee: ATI TECHNOLOGIES ULCInventors: Zohair Sahraoui, Edward Harold
-
Publication number: 20220210415Abstract: Still frame detection for single pass video data, including: determining that an average quantization parameter of a frame of video data falls below a quantization parameter threshold; determining whether an amount of skipped macroblocks in the frame meets a skipped macroblock threshold; and responsive to the amount of skipped macroblocks exceeding the skipped macroblock threshold, identifying the frame as a still frame.Type: ApplicationFiled: December 28, 2020Publication date: June 30, 2022Inventors: MEHDI SEMSARZADEH, JIAO WANG, YAO WEN YU, EDWARD HAROLD, RICHARD E. GEORGE
-
Publication number: 20220103814Abstract: Techniques for encoding and decoding media content, and more specifically to selecting filter coefficients for filtering coding artifacts from the encoded media content are described. The filter coefficients are selected by an encoder for a given frame based on a statistical record of one or more previous frames in a data stream. The statistical record indicates the effectiveness of different sets of filter coefficients in reducing encoding artifacts for the one or more previous frames. By employing the statistical record to select filter coefficients for the next frame in the data stream, the encoder is able to select the filter coefficients relatively quickly, reducing encoding latency while ensuring that a decoder is able to effectively decode the encoded frames.Type: ApplicationFiled: September 25, 2020Publication date: March 31, 2022Inventors: Zohair SAHRAOUI, Edward HAROLD
-
Publication number: 20220094951Abstract: An encoder encodes an image portion by recursively partitioning the portion into a partitioning hierarchy of levels. The top level has a single block representing the entire portion and each lower level has four smaller blocks representing a corresponding larger block at a higher level. A palette table is generated for each bottom-level block based on the pixels of the associated block. For each successively higher level, the encoder generates a palette table for each current-level block by selecting palette colors based on the palette colors from the four palette tables for the associated four blocks at the next-lowest level. A color index map is then generated based on a final palette table selected from the palette tables generated for the partitioning hierarchy. A representation of the portion is then encoded using the final palette table and the color index map to generate a corresponding segment of an encoded bitstream.Type: ApplicationFiled: September 23, 2020Publication date: March 24, 2022Inventors: Wei GAO, Yang LIU, Ihab AMER, Ying LUO, Shu-Hsien Samuel WU, Edward HAROLD, Feng PAN, Crystal SAU, Gabor SINES
-
Patent number: 10771818Abstract: An encoder encodes pixels representative of a picture in a multimedia stream, generates a first approximate signature based on approximate values of pixels in a reconstructed copy of the picture, and transmits the encoded pixels and the first approximate signature. A decoder receives a first packet including the encoded pixels and the first approximate signature, decodes the encoded pixels, and transmits a first signal in response to comparing the first approximate signature and a second approximate signature generated based on approximate values of the decoded pixels. If a corrupted packet is detected, the multimedia application requests an intra-coded picture in response to the first approximate signature differing from the second approximate signature. The second signal instructs the decoder to bypass requesting an intra-coded picture and to continue decoding received packets in response to the first approximate signature being equal to the second approximate signature.Type: GrantFiled: May 10, 2019Date of Patent: September 8, 2020Assignee: ATI TECHNOLOGIES, ULCInventors: Ihab Amer, Gabor Sines, Khaled Mammou, Haibo Liu, Edward Harold, Lei Zhang, Fabio Gulino, Ehsan Mirhadi, Ho Hin Lau
-
Patent number: 10708596Abstract: An encoder of a multimedia system encodes data representative of each image in a video stream to form a bitstream that is transmitted over a network to a decoder that decodes the bitstream and provides the decoded information to a multimedia application for display to the user. As consecutive images may have nearly identical pixel values, the multimedia system detects pixel value variations between consecutive images that are below a specified threshold to reduce active processing on such pictures, which includes, for example, encoding, decoding, and post-processing. The multimedia system either selectively encodes or selectively processes the current image that has pixel values that vary from an immediately preceding image within the specified threshold.Type: GrantFiled: November 20, 2017Date of Patent: July 7, 2020Assignee: ATI TECHNOLOGIES ULCInventors: Ihab Amer, Fabio Gulino, Edward Harold, Boris Ivanovic, Haibo Liu, Ho Hin Lau, Gabor Sines, Catalin Beju
-
Publication number: 20200137134Abstract: An encoder of a multimedia system is configured to switch between encoding portions of frames at multiple encoding sessions based on configurable preemption requirements and stored context information. The encoder seamlessly encodes frames at multiple encoding sessions at low latency without introducing artifacts, such that the output bitstream is the same as if it were encoded at once as a single frame. Target bitrate and other encoder tunings also remain the same as if the entire frame were encoded at once.Type: ApplicationFiled: October 31, 2018Publication date: April 30, 2020Inventors: Edward HAROLD, Lei ZHANG
-
Patent number: 10452554Abstract: Systems, apparatuses and methods of adaptively controlling a cache operating voltage are provided that comprise receiving indications of a plurality of cache usage amounts. Each cache usage amount corresponds to an amount of data to be accessed in a cache by one of a plurality of portions of a data processing application. The plurality of cache usage amounts are determining based on the received indications of the plurality of cache usage amounts. A voltage level applied to the cache is adaptively controlled based on one or more of the plurality of determined cache usage amounts. Memory access to the cache is controlled to be directed to a non-failing portion of the cache at the applied voltage level.Type: GrantFiled: April 8, 2016Date of Patent: October 22, 2019Assignees: ADVANCED MICRO DEVICES, INC., ATI TECHNOLOGIES ULCInventors: Ihab Amer, Khaled Mammou, Haibo Liu, Edward Harold, Fabio Gulino, Samuel Naffziger, Gabor Sines, Lawrence A. Bair, Andy Sung, Lei Zhang
-
Publication number: 20190268622Abstract: An encoder encodes pixels representative of a picture in a multimedia stream, generates a first approximate signature based on approximate values of pixels in a reconstructed copy of the picture, and transmits the encoded pixels and the first approximate signature. A decoder receives a first packet including the encoded pixels and the first approximate signature, decodes the encoded pixels, and transmits a first signal in response to comparing the first approximate signature and a second approximate signature generated based on approximate values of the decoded pixels. If a corrupted packet is detected, the multimedia application requests an intra-coded picture in response to the first approximate signature differing from the second approximate signature. The second signal instructs the decoder to bypass requesting an intra-coded picture and to continue decoding received packets in response to the first approximate signature being equal to the second approximate signature.Type: ApplicationFiled: May 10, 2019Publication date: August 29, 2019Inventors: Ihab AMER, Gabor SINES, Khaled MAMMOU, Haibo LIU, Edward HAROLD, Lei ZHANG, Fabio GULINO, Ehsan MIRHADI, Ho Hin LAU
-
Patent number: 10368087Abstract: A processing apparatus is provided that includes an encoder configured to encode current frames of video data using previously encoded reference frames and perform motion searches within a search window about each of a plurality of co-located portions of a reference frame. The processing apparatus also includes a processor configured to determine, prior to performing the motion searches, which locations of the reference frame to reload the search window according to a threshold number of search window reloads using predicted motions of portions of the reference frame corresponding to each of the locations. The processor is also configured to cause the encoder to reload the search window at the determined locations of the reference frame and, for each of the remaining locations of the reference frame, slide the search window in a first direction indicated by the location of the next co-located portion of the reference frame.Type: GrantFiled: September 20, 2016Date of Patent: July 30, 2019Assignees: ATI Technologies ULC, Advanced Micro Devices, Inc.Inventors: Ihab Amer, Gabor Sines, Edward Harold, Jinbo Qiu, Lei Zhang, Yang Liu, Zhen Chen, Ying Luo, Shu-Hsien Wu, Zhong Cai
-
Patent number: 10334276Abstract: An encoder encodes pixels representative of a picture in a multimedia stream, generates a first approximate signature based on approximate values of pixels in a reconstructed copy of the picture, and transmits the encoded pixels and the first approximate signature. A decoder receives a first packet including the encoded pixels and the first approximate signature, decodes the encoded pixels, and transmits a first signal in response to comparing the first approximate signature and a second approximate signature generated based on approximate values of the decoded pixels. If a corrupted packet is detected, the multimedia application requests an intra-coded picture in response to the first approximate signature differing from the second approximate signature. The second signal instructs the decoder to bypass requesting an intra-coded picture and to continue decoding received packets in response to the first approximate signature being equal to the second approximate signature.Type: GrantFiled: December 28, 2015Date of Patent: June 25, 2019Assignee: ATI Technologies ULCInventors: Ihab Amer, Gabor Sines, Khaled Mammou, Haibo Liu, Edward Harold, Lei Zhang, Fabio Gulino, Ehsan Mirhadi, Ho Hin Lau
-
Publication number: 20190158836Abstract: An encoder of a multimedia system encodes data representative of each image in a video stream to form a bitstream that is transmitted over a network to a decoder that decodes the bitstream and provides the decoded information to a multimedia application for display to the user. As consecutive images may have nearly identical pixel values, the multimedia system detects pixel value variations between consecutive images that are below a specified threshold to reduce active processing on such pictures, which includes, for example, encoding, decoding, and post-processing. The multimedia system either selectively encodes or selectively processes the current image that has pixel values that vary from an immediately preceding image within the specified threshold.Type: ApplicationFiled: November 20, 2017Publication date: May 23, 2019Inventors: Ihab AMER, Fabio GULINO, Edward HAROLD, Boris IVANOVIC, Haibo LIU, Ho Hin LAU, Gabor SINES, Catalin BEJU
-
Publication number: 20180084270Abstract: A processing apparatus is provided that includes an encoder configured to encode current frames of video data using previously encoded reference frames and perform motion searches within a search window about each of a plurality of co-located portions of a reference frame. The processing apparatus also includes a processor configured to determine, prior to performing the motion searches, which locations of the reference frame to reload the search window according to a threshold number of search window reloads using predicted motions of portions of the reference frame corresponding to each of the locations. The processor is also configured to cause the encoder to reload the search window at the determined locations of the reference frame and, for each of the remaining locations of the reference frame, slide the search window in a first direction indicated by the location of the next co-located portion of the reference frame.Type: ApplicationFiled: September 20, 2016Publication date: March 22, 2018Applicants: Advanced Micro Devices, Inc., ATI Technologies ULCInventors: Ihab Amer, Gabor Sines, Edward Harold, Jinbo Qiu, Lei Zhang, Yang Liu, Zhen Chen, Ying Luo, Shu-Hsien Wu, Zhong Cai