Patents by Inventor Danny Hong

Danny Hong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250142069
    Abstract: A multi-try encoding operation is implemented to encode one or more game frames into a game stream. The multi-try encoding operation includes determining an initial quantization parameter for a current frame. From the determined initial quantization parameter, one or more alternative quantization parameters are derived. Multiple encoders then perform multiple encodings on the current frame based on the initial quantization parameter and the alternative quantization parameters, respectively, to produce a plurality of encoded frames. An applicable encoded frame is then selected from the plurality of encoded frames according to a streaming application. The applicable encoded frame is then transmitted as part of a game stream to a client system.
    Type: Application
    Filed: September 3, 2021
    Publication date: May 1, 2025
    Inventors: Danny Hong, Yinqing Zhao, Ramachandra Tahasildar, In Suk Chong
  • Publication number: 20250080728
    Abstract: A cloud-based extended reality (XR) system includes a server configured to encode a set of frames each associated with an XR scene to be displayed. To encode the set of frames, the server estimates a total number of encoded output bits for the set of frames based on a set of quantization parameters (QPs). The set of QPs includes a corresponding QP for each frame of the set of frames and one or more predetermined relationships between the corresponding QPs. The server then compares the estimated total number of encoded output bits to a target frame size threshold. Based on the estimated total number of encoded bits being outside the target frame size threshold, the server updates the set of QPs so as to maintain the predetermined relationships between the QPs.
    Type: Application
    Filed: September 1, 2023
    Publication date: March 6, 2025
    Inventors: Danny Hong, Zhuo Chen
  • Publication number: 20240388728
    Abstract: An encoding operation is implemented to encode one or more frames, for example, gaming frames into a gaming stream. The encoding operation includes decomposing a current frame into a base layer and an enhancement layer. The resulting base layer and enhancement layer are then each encoded to produce an encoded base layer and an encoded enhancement layer. The encoded enhancement layer is truncated, for example, according to a comparison of the sum of the size of the encoded base layer and encoded enhancement layer to a threshold value. In an example embodiment, a multiplexer combines the encoded base layer and truncated enhancement layer to produce the encoded frame. The encoded frame may then be transmitted as part of a stream to a client device.
    Type: Application
    Filed: August 18, 2021
    Publication date: November 21, 2024
    Inventors: Richard Xie, Ramachandra Tahasildar, Danny Hong, Jani Huoponen
  • Publication number: 20240226731
    Abstract: A multi-pass encoding operation using a shared reference frame is implemented to encode one or more gaming frames into a game stream. The multi-pass encoding operation includes producing a shared reference frame based upon a second-pass reference frame used by a second pass encoding of the multi-pass encoding operation. The encoding operation also includes performing a first encoding pass on a current frame using the shared reference frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. A second pass encoding is then performed on the current frame according to the second-pass reference frame and the estimated complexity, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.
    Type: Application
    Filed: August 12, 2022
    Publication date: July 11, 2024
    Inventors: Danny Hong, Ramachandra Tahasildar, Alex Sukhanov
  • Publication number: 20240155160
    Abstract: Real-time pre-encoding dithering techniques mitigate or eliminate banding and other graphical artifacts in video frames prior to such video frames being encoded for transmission to and display by one or more client devices. For each of one or more input video frames, one or more random seeds and a frame identifier are received, and a dithering process is initiated for each of one or more pixels of the input video frame. The dithering process includes generating a YUV noise vector based on the random seeds and on the frame identifier, computing a YUV representation of the input pixel based on RGB color information for the input pixel, and generating a dithered output pixel by adding the generated YUV noise vector to the YUV representation of the input pixel.
    Type: Application
    Filed: March 10, 2021
    Publication date: May 9, 2024
    Inventors: Richard Xie, Ramachandra Tahasildar, Danny Hong, Alex Sukhanov, Albert Julius Liu, Beril Erkin
  • Publication number: 20240129468
    Abstract: Pre-encoding noise parameterization techniques mitigate or eliminate banding and other graphical artifacts in video frames for decoding and presentation by a client device. For one or more input video frames, a quantization parameter associated with the input video frames is identified. Noise synthesis parameters are determined based on the identified quantization parameter, and the input video frames are encoded for transmission. The encoded video frames are transmitted to the client device along with the determined noise synthesis parameters, for use by the client device in generating synthetic noise to add to resulting video frames decoded by the client device.
    Type: Application
    Filed: February 12, 2021
    Publication date: April 18, 2024
    Inventors: Danny Hong, Richard Xie, Ramachandra Tahasildar
  • Patent number: 11902547
    Abstract: A two-pass encoding operation is implemented to encode one or more gaming frames into a game stream. The two-pass encoding operation includes a first encoding pass performed on a current frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. The resulting estimated complexity is then modulated according to a quality difference between reference frames used during the first pass encoding and a subsequent second pass encoding. Based on the modulated complexity, a quantization parameter is determined for the current frame that is then used to perform a second pass encoding on the current frame, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.
    Type: Grant
    Filed: July 15, 2021
    Date of Patent: February 13, 2024
    Assignee: GOOGLE LLC
    Inventors: Danny Hong, Ramachandra Tahasildar, Alex Sukhanov
  • Publication number: 20240009556
    Abstract: A cloud-based gaming server renders a set of game frames at a first frame rate for a current client gaming session. An encoder of the server then determines whether the first frame rate is lower than a second frame rate associated with the encoder. In response to the first frame rate being lower, the encoder is configured to generate skip frames, with each skip frame indicating that a game frame of the set of game frames is to be repeated. The encoder also encodes the set of game frames to produce a set of encoded game frames and inserts one or more skip frames between two or more encoded game frames of the set of encoded game frames to produce a game stream. The server then packetizes the game stream and transmits the packetized game stream to a client system associated with the current client system.
    Type: Application
    Filed: July 3, 2023
    Publication date: January 11, 2024
    Inventors: Danny Hong, Sam John
  • Publication number: 20230396766
    Abstract: Techniques for encoding game content for real-time cloud-gaming, and more specifically to using an adaptive statistical model in a moving window of previous frames up to a current frame to adaptively compute a lower-bound of a quantization parameter (QP) that corresponds to a chosen peak signal to noise ratio (PSNR) target. The result of this PSNR-guided encoding is significantly reducing the size of encoded frames (i.e., undershooting a target bit rate when there are no subjective quality losses on those frames using their PSNR as the guidance). These reductions mitigate bandwidth issues and improve the overall user experience because less bits transferred results in faster network transmission and decoding, as well as less platform overhead.
    Type: Application
    Filed: November 25, 2020
    Publication date: December 7, 2023
    Inventors: Richard Xie, Ramachandra Tahasildar, Alex Sukhanov, Danny Hong, Beril Erkin
  • Publication number: 20230013997
    Abstract: A two-pass encoding operation is implemented to encode one or more gaming frames into a game stream. The two-pass encoding operation includes a first encoding pass performed on a current frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. The resulting estimated complexity is then modulated according to a quality difference between reference frames used during the first pass encoding and a subsequent second pass encoding. Based on the modulated complexity, a quantization parameter is determined for the current frame that is then used to perform a second pass encoding on the current frame, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.
    Type: Application
    Filed: July 15, 2021
    Publication date: January 19, 2023
    Inventors: Danny Hong, Ramachandra Tahasildar, Alex Sukhanov
  • Patent number: 10560706
    Abstract: Disclosed are techniques for temporal scalable video coding. By including a temporal_switching_point_flag and/or a temporal_nesting_flag into a normative part of the scalable bitstream, reference picture management in decoder can be simplified, and media-aware network elements and decoder can easily identify those pictures from which onward a higher temporal layer can be added.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: February 11, 2020
    Assignee: Vidyo, Inc.
    Inventors: Jill Boyce, Danny Hong
  • Publication number: 20190166378
    Abstract: Disclosed are techniques for temporal scalable video coding. By including a temporal_switching_point_flag and/or a temporal_nesting_flag into a normative part of the scalable bitstream, reference picture management in decoder can be simplified, and media-aware network elements and decoder can easily identify those pictures from which onward a higher temporal layer can be added.
    Type: Application
    Filed: June 25, 2018
    Publication date: May 30, 2019
    Applicant: VIDYO, INC.
    Inventors: Jill Boyce, Danny Hong
  • Patent number: 10034009
    Abstract: Disclosed are techniques for temporal scalable video coding. By including a temporal_switching_point_flag and/or a temporal_nesting_flag into a normative part of the scalable bitstream, reference picture management in decoder can be simplified, and media-aware network elements and decoder can easily identify those pictures from which onward a higher temporal layer can be added.
    Type: Grant
    Filed: January 4, 2012
    Date of Patent: July 24, 2018
    Assignee: Vidyo, Inc.
    Inventors: Jill Boyce, Danny Hong
  • Patent number: 10027970
    Abstract: Disclosed are techniques for creating, coding, decoding, and using, rotation information related to one or more coded pictures in non-normative parts of a coded video bitstream.
    Type: Grant
    Filed: July 21, 2017
    Date of Patent: July 17, 2018
    Assignee: Vidyo, Inc.
    Inventors: Jill Boyce, Stephen Cipolli, Jonathan Lennox, Stephan Wenger, Danny Hong
  • Publication number: 20170324971
    Abstract: Disclosed are techniques for creating, coding, decoding, and using, rotation information related to one or more coded pictures in non-normative parts of a coded video bitstream.
    Type: Application
    Filed: July 21, 2017
    Publication date: November 9, 2017
    Applicant: VIDYO, INC.
    Inventors: Jill Boyce, Stephen Cipolli, Jonathan Lennox, Stephan Wenger, Danny Hong
  • Patent number: 9787979
    Abstract: Techniques to determine a level id in a layered bitstream are disclosed, such that the same level id can be used for all layers of a scalable bitstream. Also disclosed are techniques to signal level ids for sub bitstreams that can be indicative of lower computational requirements than the level id used for the layered bitstream.
    Type: Grant
    Filed: March 25, 2013
    Date of Patent: October 10, 2017
    Assignee: VIDYO, INC.
    Inventors: Jill Boyce, Danny Hong, Wonkap Jang, Stephan Wenger
  • Patent number: 9743099
    Abstract: Disclosed are techniques for creating, coding, decoding, and using, rotation information related to one or more coded pictures in non-normative parts of a coded video bitstream.
    Type: Grant
    Filed: January 11, 2012
    Date of Patent: August 22, 2017
    Assignee: Vidyo, Inc.
    Inventors: Jill Boyce, Stephen Cipolli, Jonathan Lennox, Stephan Wenger, Danny Hong
  • Publication number: 20160360155
    Abstract: Scalable video codecs are provided for use in videoconferencing systems and applications hosted on heterogeneous endpoints/receivers and network environments. The scalable video codecs provide a coded representation of a source video signal at multiple temporal, quality, and spatial resolutions.
    Type: Application
    Filed: August 22, 2016
    Publication date: December 8, 2016
    Applicant: VIDYO, INC.
    Inventors: Mehmet Reha Civanlar, Alexandros Eleftheriadis, Danny Hong, Ofer Shapiro
  • Patent number: 9426499
    Abstract: Scalable video codecs are provided for use in videoconferencing systems and applications hosted on heterogeneous endpoints/receivers and network environments. The scalable video codecs provide a coded representation of a source video signal at multiple temporal, quality, and spatial resolutions.
    Type: Grant
    Filed: September 17, 2012
    Date of Patent: August 23, 2016
    Assignee: VIDYO, INC.
    Inventors: Mehmet Reha Civanlar, Alexandros Eleftheriadis, Danny Hong, Ofer Shapiro
  • Patent number: 9380313
    Abstract: The disclosed subject matter describes a new pattern description that can be part of an SEI message or a parameter set, and can be used to describe a temporal picture coding structure and associated bitrates and frame rates. The knowledge of the coding structure can benefit transraters, bitstream extractors, and digital video recorders. Decoders can utilize the coding structure information for example, to decode pictures in parallel, using multiple threads/cores.
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: June 28, 2016
    Assignee: VIDYO, INC.
    Inventors: Danny Hong, Jill Boyce