Patents by Inventor Kelvin M. Yong

Kelvin M. Yong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230138708
    Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.
    Type: Application
    Filed: December 27, 2022
    Publication date: May 4, 2023
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20230115947
    Abstract: A method for cloud gaming. The method including generating a plurality of video frames when executing a video game at a cloud gaming server. The method including encoding the plurality of video frames at an encoder bit rate, wherein the plurality of video frames that is compressed is transmitted to a client from a streamer of the cloud gaming server. The method including measuring a maximum receive bandwidth of a client. The method including monitoring the encoding of the plurality of video frames at the streamer. The method including dynamically tuning a parameter of the encoder based on the monitoring of the encoding.
    Type: Application
    Filed: December 13, 2022
    Publication date: April 13, 2023
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20230103010
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.
    Type: Application
    Filed: December 6, 2022
    Publication date: March 30, 2023
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11539960
    Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: December 27, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20220401835
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including scanning-in the video frame to an encoder at the server scanline-by-scanline. The method including encoding one or more encoder slices as one or more encoded slices at the encoder, wherein each encoded slice is delivered to a buffer at an encoder fill rate. The method including draining a first encoded slice from the buffer to stream the first encoded slice at a buffer drain rate over a network to a client, wherein the first encoded slice is streamed over the network before fully encoding the one or more slices of the video frame.
    Type: Application
    Filed: August 23, 2022
    Publication date: December 22, 2022
    Inventors: Kelvin M. Yong, Mark E. Cerny
  • Patent number: 11524230
    Abstract: A method for cloud gaming. The method including generating a plurality of video frames when executing a video game at a cloud gaming server. The method including encoding the plurality of video frames at an encoder bit rate, wherein the plurality of video frames that is compressed is transmitted to a client from a streamer of the cloud gaming server. The method including measuring a maximum receive bandwidth of a client. The method including monitoring the encoding of the plurality of video frames at the streamer. The method including dynamically tuning a parameter of the encoder based on the monitoring of the encoding.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: December 13, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11517817
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: December 6, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11420118
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including scanning-in the video frame to an encoder at the server scanline-by-scanline. The method including encoding one or more encoder slices as one or more encoded slices at the encoder, wherein each encoded slice is delivered to a buffer at an encoder fill rate. The method including draining a first encoded slice from the buffer to stream the first encoded slice at a buffer drain rate over a network to a client, wherein the first encoded slice is streamed over the network before fully encoding the one or more slices of the video frame.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: August 23, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Kelvin M. Yong, Mark E. Cerny
  • Patent number: 11344799
    Abstract: A method for cloud gaming including generating video frames when executing a video game at a cloud gaming server. The method including predicting a scene change for a first video frame for the video game, wherein the scene change is predicted before the first video frame is generated. The method including generating a scene change hint that the first video frame is a scene change. The method including sending the scene change hint to the encoder. The method including delivering the first video frame to an encoder, wherein the first video frame is encoded as an I-frame based on the scene change hint. The method including measuring a maximum receive bandwidth of a client. The method including determining whether to encode or not encode a second video frame received at the encoder based on the maximum receive bandwidth of the client and a target resolution of a client display.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: May 31, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20220152490
    Abstract: A method is disclosed including setting, at a plurality of devices, a plurality of VSYNC signals to a plurality of VSYNC frequencies, wherein a corresponding device VSYNC signal of a corresponding device is set to a corresponding device VSYNC frequency. The method including sending a plurality of signals between the plurality of devices, which are analyzed and used to adjust the relative timing between corresponding device VSYNC signals of at least two devices.
    Type: Application
    Filed: February 1, 2022
    Publication date: May 19, 2022
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11235235
    Abstract: A method is disclosed including setting, at a plurality of devices, a plurality of VSYNC signals to a plurality of VSYNC frequencies, wherein a corresponding device VSYNC signal of a corresponding device is set to a corresponding device VSYNC frequency. The method including sending a plurality of signals between the plurality of devices, which are analyzed and used to adjust the relative timing between corresponding device VSYNC signals of at least two devices.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: February 1, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20210394056
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.
    Type: Application
    Filed: September 7, 2021
    Publication date: December 23, 2021
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20210354031
    Abstract: A method of cloud gaming is disclosed. The method including receiving an encoded video frame at a client, wherein a server executes an application to generate a rendered video frame which is then encoded at an encoder at the server as the encoded video frame, wherein the encoded video frame includes one or more encoded slices that are compressed. The method including decoding the one or more encoded slices at a decoder of the client to generate one or more decoded slices. The method including rendering the one or more decoded slices for display at the client. The method including begin displaying the one or more decoded slices that are rendered before fully receiving the one or more encoded slices at the client.
    Type: Application
    Filed: June 1, 2021
    Publication date: November 18, 2021
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11110349
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: September 7, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20210228983
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.
    Type: Application
    Filed: April 13, 2021
    Publication date: July 29, 2021
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11020661
    Abstract: A method of cloud gaming is disclosed. The method including receiving an encoded video frame at a client, wherein a server executes an application to generate a rendered video frame which is then encoded at an encoder at the server as the encoded video frame, wherein the encoded video frame includes one or more encoded slices that are compressed. The method including decoding the one or more encoded slices at a decoder of the client to generate one or more decoded slices. The method including rendering the one or more decoded slices for display at the client. The method including begin displaying the one or more decoded slices that are rendered before fully receiving the one or more encoded slices at the client.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: June 1, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 10974142
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: April 13, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20210093956
    Abstract: A method of cloud gaming is disclosed. The method including receiving an encoded video frame at a client, wherein a server executes an application to generate a rendered video frame which is then encoded at an encoder at the server as the encoded video frame, wherein the encoded video frame includes one or more encoded slices that are compressed. The method including decoding the one or more encoded slices at a decoder of the client to generate one or more decoded slices. The method including rendering the one or more decoded slices for display at the client. The method including begin displaying the one or more decoded slices that are rendered before fully receiving the one or more encoded slices at the client.
    Type: Application
    Filed: November 26, 2019
    Publication date: April 1, 2021
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20210093955
    Abstract: A method is disclosed including setting, at a plurality of devices, a plurality of VSYNC signals to a plurality of VSYNC frequencies, wherein a corresponding device VSYNC signal of a corresponding device is set to a corresponding device VSYNC frequency. The method including sending a plurality of signals between the plurality of devices, which are analyzed and used to adjust the relative timing between corresponding device VSYNC signals of at least two devices.
    Type: Application
    Filed: November 26, 2019
    Publication date: April 1, 2021
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20210093966
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.
    Type: Application
    Filed: November 26, 2019
    Publication date: April 1, 2021
    Inventors: Mark E. Cerny, Kelvin M. Yong