Patents by Inventor Mark E. Cerny

Mark E. Cerny has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230138708
    Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.
    Type: Application
    Filed: December 27, 2022
    Publication date: May 4, 2023
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20230115947
    Abstract: A method for cloud gaming. The method including generating a plurality of video frames when executing a video game at a cloud gaming server. The method including encoding the plurality of video frames at an encoder bit rate, wherein the plurality of video frames that is compressed is transmitted to a client from a streamer of the cloud gaming server. The method including measuring a maximum receive bandwidth of a client. The method including monitoring the encoding of the plurality of video frames at the streamer. The method including dynamically tuning a parameter of the encoder based on the monitoring of the encoding.
    Type: Application
    Filed: December 13, 2022
    Publication date: April 13, 2023
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20230103010
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.
    Type: Application
    Filed: December 6, 2022
    Publication date: March 30, 2023
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20230100853
    Abstract: A method for graphics processing including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for rendering geometry of the graphics between the GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known to the GPUs. The method including determining a Z-value for a piece of geometry during a pre-pass phase of rendering at a first GPU for an image, wherein the piece of geometry overlaps a first screen region for which the first GPU has a division of responsibility. The method including comparing the Z-value against a Z-buffer value for the piece of geometry. The method including generating information including a result of the comparing the Z-value against the Z-buffer value for use by the GPU when rendering the piece of geometry during a full render phase of rendering.
    Type: Application
    Filed: November 29, 2022
    Publication date: March 30, 2023
    Inventors: Mark E. Cerny, Florian Strauss, Tobias Berghoff
  • Publication number: 20230077407
    Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). The method including dividing responsibility for processing pieces of geometry of an image frame during an analysis pre-pass phase of rendering between the plurality of GPUs, wherein each of the pieces of geometry is assigned to a corresponding GPU. The method including determining in the analysis pre-pass phase overlap of each of the pieces of geometry with each screen regions. The method including generating information at the GPUs regarding the pieces of geometry and their relations to the screen regions based on the overlap of each of the pieces of geometry with each of the screen regions. The method including assigning the screen regions to the GPUs based on the information for purposes of rendering the pieces of geometry during a subsequent phase of rendering.
    Type: Application
    Filed: November 22, 2022
    Publication date: March 16, 2023
    Inventors: Mark E. Cerny, Tobias Berghoff, David Simpson
  • Patent number: 11605148
    Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. First pieces of geometry are rendered at the GPUs during a rendering phase of a previous image frame. Statistics are generated for the rendering of the previous image frame. Second pieces of geometry of a current image frame are assigned based on the statistics to the GPUs for geometry testing. Geometry testing at a current image frame on the second pieces of geometry is performed to generate information regarding each piece of geometry and its relation to each screen region, the geometry testing performed at each of the GPUs based on the assigning. The information generated for the second pieces of geometry is used when rendering the geometry at the GPUs.
    Type: Grant
    Filed: July 29, 2021
    Date of Patent: March 14, 2023
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Florian Strauss, Tobias Berghoff
  • Patent number: 11599967
    Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for the rendering geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs. The method including generating information regarding a piece of geometry with respect to a first screen region for which a first GPU has a first division of responsibility, while rendering the piece of geometry at a second GPU for an image. The method including rendering the piece of geometry at the first GPU using the information.
    Type: Grant
    Filed: April 26, 2022
    Date of Patent: March 7, 2023
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Florian Strauss, Tobias Berghoff
  • Publication number: 20230024723
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including performing a scan-out process to deliver the video frame to an encoder configured to compress the video frame, wherein the scan-out process begins at a flip-time of the video frame. The method including transmitting the video frame that is compressed to a client. The method including determining at the client a target display time for the video frame. The method including scheduling at the client a display time for the video frame based on the target display time.
    Type: Application
    Filed: October 4, 2022
    Publication date: January 26, 2023
    Inventors: Roelof Roderick Colenbrander, Mark E. Cerny
  • Publication number: 20230016903
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including performing a scan-out process by scanning the video frame scanline-by-scanline and one or more user interface features scanline-by-scanline to one or more input frame buffers, and compositing and blending the video frame and the one or more user interface features into a modified video frame. The method including scanning in the scan-out process the modified video frame to an encoder at the server scanline-by-scanline. The method including beginning in the scan-out process scanning the video frame and the one or more user interface features to the one or more input frame buffers at a corresponding flip-time for the video frame.
    Type: Application
    Filed: September 20, 2022
    Publication date: January 19, 2023
    Inventors: Roelof Roderick Colenbrander, Mark E. Cerny
  • Patent number: 11539960
    Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: December 27, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20220401835
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including scanning-in the video frame to an encoder at the server scanline-by-scanline. The method including encoding one or more encoder slices as one or more encoded slices at the encoder, wherein each encoded slice is delivered to a buffer at an encoder fill rate. The method including draining a first encoded slice from the buffer to stream the first encoded slice at a buffer drain rate over a network to a client, wherein the first encoded slice is streamed over the network before fully encoding the one or more slices of the video frame.
    Type: Application
    Filed: August 23, 2022
    Publication date: December 22, 2022
    Inventors: Kelvin M. Yong, Mark E. Cerny
  • Patent number: 11524230
    Abstract: A method for cloud gaming. The method including generating a plurality of video frames when executing a video game at a cloud gaming server. The method including encoding the plurality of video frames at an encoder bit rate, wherein the plurality of video frames that is compressed is transmitted to a client from a streamer of the cloud gaming server. The method including measuring a maximum receive bandwidth of a client. The method including monitoring the encoding of the plurality of video frames at the streamer. The method including dynamically tuning a parameter of the encoder based on the monitoring of the encoding.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: December 13, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11517817
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency. The server VSYNC signal corresponding to generation of video frames during frame periods for the server VSYNC frequency. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending compressed video frames from the server to the client over a network using the server VSYNC signal, wherein the compressed video frames are based on the generated video frames. The method including decoding and displaying, at the client, the compressed video frames. The method including analyzing the timing of one or more client operations to adjust the relative timing between the server VSYNC signal and the client VSYNC signal, as the client receives the compressed video frames.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: December 6, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 11514549
    Abstract: A method for graphics processing including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for rendering geometry of the graphics between the GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known to the GPUs. The method including determining a Z-value for a piece of geometry during a pre-pass phase of rendering at a first GPU for an image, wherein the piece of geometry overlaps a first screen region for which the first GPU has a division of responsibility. The method including comparing the Z-value against a Z-buffer value for the piece of geometry. The method including generating information including a result of the comparing the Z-value against the Z-buffer value for use by the GPU when rendering the piece of geometry during a full render phase of rendering.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: November 29, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Florian Strauss, Tobias Berghoff
  • Patent number: 11508110
    Abstract: A method for graphics processing. The method including rendering graphics for an application using graphics processing units (GPUs). The method including dividing responsibility for processing a plurality of pieces of geometry of an image frame during an analysis pre-pass phase of rendering between the plurality of GPUs, wherein each of the plurality of pieces of geometry is assigned to a corresponding GPU. The method including determining in the analysis pre-pass phase overlap of each the plurality of pieces of geometry with each of a plurality of screen regions. The method including generating information at the plurality of GPUs regarding the plurality of pieces of geometry and their relations to the plurality of screen regions based on the overlap of each the plurality of pieces of geometry with each of the plurality of screen regions.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: November 22, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Tobias Berghoff, David Simpson
  • Publication number: 20220355196
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server, wherein the video frame is stored in a frame buffer. The method including determining a maximum pixel clock for a chip-set including a scan-out block. The method including determining a frame rate setting based on the maximum pixel clock and an image size of a target display of a client. The method including determining a speed setting value for the chip-set. The method including scanning the video frame into the scan-out block from the frame buffer. The method including scanning-out the video frame from the scan-out block to the encoder at the speed setting value.
    Type: Application
    Filed: July 26, 2022
    Publication date: November 10, 2022
    Inventors: Roelof Roderick Colenbrander, Mark E. Cerny
  • Patent number: 11458391
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including performing a scan-out process to deliver the video frame to an encoder configured to compress the video frame, wherein the scan-out process begins at a flip-time of the video frame. The method including transmitting the video frame that is compressed to a client. The method including determining at the client a target display time for the video frame. The method including scheduling at the client a display time for the video frame based on the target display time.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: October 4, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Roelof Roderick Colenbrander, Mark E. Cerny
  • Patent number: 11446572
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including performing a scan-out process by scanning the video frame scanline-by-scanline and one or more user interface features scanline-by-scanline to one or more input frame buffers, and compositing and blending the video frame and the one or more user interface features into a modified video frame. The method including scanning in the scan-out process the modified video frame to an encoder at the server scanline-by-scanline. The method including beginning in the scan-out process scanning the video frame and the one or more user interface features to the one or more input frame buffers at a corresponding flip-time for the video frame.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: September 20, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Roelof Roderick Colenbrander, Mark E. Cerny
  • Patent number: 11420118
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including scanning-in the video frame to an encoder at the server scanline-by-scanline. The method including encoding one or more encoder slices as one or more encoded slices at the encoder, wherein each encoded slice is delivered to a buffer at an encoder fill rate. The method including draining a first encoded slice from the buffer to stream the first encoded slice at a buffer drain rate over a network to a client, wherein the first encoded slice is streamed over the network before fully encoding the one or more slices of the video frame.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: August 23, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Kelvin M. Yong, Mark E. Cerny
  • Publication number: 20220253968
    Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including dividing responsibility for the rendering geometry of the graphics between the plurality of GPUs based on a plurality of screen regions, each GPU having a corresponding division of the responsibility which is known to the plurality of GPUs. The method including generating information regarding a piece of geometry with respect to a first screen region for which a first GPU has a first division of responsibility, while rendering the piece of geometry at a second GPU for an image. The method including rendering the piece of geometry at the first GPU using the information.
    Type: Application
    Filed: April 26, 2022
    Publication date: August 11, 2022
    Inventors: Mark E. Cerny, Florian Strauss, Tobias Berghoff