Patents by Inventor Mark E. Cerny

Mark E. Cerny has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12289452
    Abstract: A method for encoding including executing game logic built on a game engine of a video game at a cloud gaming server to generate video frames. The method including executing scene change logic to predict a scene change in the video frames based on game state collected during execution of the game logic. The method including identifying a range of video frames that is predicted to include the scene change. The method including generating a scene change hint using the scene change logic, wherein the scene change hint identifies the range of video frames, wherein the range of video frames includes a first video frame. The method including delivering the first video frame to an encoder. The method including sending the scene change hint from the scene change logic to the encoder. The method including encoding the first video frame as an I-frame based on the scene change hint.
    Type: Grant
    Filed: December 27, 2022
    Date of Patent: April 29, 2025
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20250124644
    Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). The method including dividing responsibility for processing pieces of geometry of an image frame during an analysis pre-pass phase of rendering between the plurality of GPUs, wherein each of the pieces of geometry is assigned to a corresponding GPU. The method including determining in the analysis pre-pass phase overlap of each of the pieces of geometry with each screen regions. The method including generating information at the GPUs regarding the pieces of geometry and their relations to the screen regions based on the overlap of each of the pieces of geometry with each of the screen regions. The method including assigning the screen regions to the GPUs based on the information for purposes of rendering the pieces of geometry during a subsequent phase of rendering.
    Type: Application
    Filed: December 20, 2024
    Publication date: April 17, 2025
    Inventors: Mark E. Cerny, Tobias Berghoff, David Simpson
  • Publication number: 20250090951
    Abstract: A method for executing a game by a computing system that uses a central processing unit (CPU) and graphics processing unit (GPU) for generating video frames. A draw call is generated for a video frame by the CPU. At bind time, i.e. writing of the GPU commands by the CPU using a GPU API, asset aware data (AAD) is written to the command buffer, and loading of one or more level of detail (LOD) data from an asset store to system memory is requested. The GPU executes the draw call for the frame using LOD data written to the system memory, the GPU using at least a minimum of LOD data based on the AAD. Additionally, the GPU uses information regarding the LOD load state when executing the draw call, in order to avoid access to LODs not yet loaded.
    Type: Application
    Filed: December 2, 2024
    Publication date: March 20, 2025
    Inventor: Mark E. Cerny
  • Publication number: 20250083039
    Abstract: A method is disclosed including setting, at a plurality of devices, a plurality of VSYNC signals to a plurality of VSYNC frequencies, wherein a corresponding device VSYNC signal of a corresponding device is set to a corresponding device VSYNC frequency. The method including sending a plurality of signals between the plurality of devices, which are analyzed and used to adjust the relative timing between corresponding device VSYNC signals of at least two devices.
    Type: Application
    Filed: November 27, 2024
    Publication date: March 13, 2025
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20250083038
    Abstract: A method for cloud gaming. The method including receiving one or more encoded slices of a video frame at a client, wherein the video frame was generated at a server while executing a video game, and encoded by an encoder at the server into the one or more encoded slices. The method including decoding a first encoded slice at a decoder of the client before fully receiving the one or more encoded slices of the video frame.
    Type: Application
    Filed: November 22, 2024
    Publication date: March 13, 2025
    Inventors: Kelvin M. Yong, Mark E. Cerny
  • Publication number: 20250041715
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.
    Type: Application
    Filed: October 21, 2024
    Publication date: February 6, 2025
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20250037230
    Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including using the plurality of GPUs in collaboration to render an image frame including a plurality of pieces of geometry. The method including during a pre-pass phase of rendering, generating information at the GPUs regarding the plurality of pieces of geometry and their relation to a plurality of screen regions. The method including assigning the plurality of screen regions to the plurality of GPUs based on the information for purposes of rendering the plurality of pieces of geometry in a subsequent phase of rendering.
    Type: Application
    Filed: October 15, 2024
    Publication date: January 30, 2025
    Inventors: Mark E. Cerny, Tobias Berghoff, David Simpson
  • Publication number: 20250029202
    Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. A plurality of pieces of geometry of an image frame is assigned to the GPUs for geometry testing. A first GPU state configuring one or more shaders to perform the geometry testing is set. Geometry testing is performed at GPUs on the plurality of pieces of geometry to generate information regarding each piece of geometry and its relation to each of the plurality of screen regions. A second GPU state configuring the one or more shaders to perform rendering is set. The information generated for each of the plurality of pieces of geometry is used when rendering the plurality of pieces of geometry at the GPUs.
    Type: Application
    Filed: October 8, 2024
    Publication date: January 23, 2025
    Inventors: Mark E. Cerny, Florian Strauss, Tobias Berghoff
  • Patent number: 12186658
    Abstract: A method for executing a game by a computing system that uses a central processing unit (CPU) and graphics processing unit (GPU) for generating video frames. A draw call is generated for a video frame by the CPU. At bind time, i.e. writing of the GPU commands by the CPU using a GPU API, asset aware data (AAD) is written to the command buffer, and loading of one or more level of detail (LOD) data from an asset store to system memory is requested. The GPU executes the draw call for the frame using LOD data written to the system memory, the GPU using at least a minimum of LOD data based on the AAD. Additionally, the GPU uses information regarding the LOD load state when executing the draw call, in order to avoid access to LODs not yet loaded.
    Type: Grant
    Filed: August 21, 2023
    Date of Patent: January 7, 2025
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Mark E. Cerny
  • Patent number: 12179096
    Abstract: A method for cloud gaming. The method including receiving one or more encoded slices of a video frame at a client, wherein the video frame was generated at a server while executing a video game, and encoded by an encoder at the server into the one or more encoded slices. The method including decoding a first encoded slice at a decoder of the client before fully receiving the one or more encoded slices of the video frame.
    Type: Grant
    Filed: January 9, 2024
    Date of Patent: December 31, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Kelvin M. Yong, Mark E. Cerny
  • Patent number: 12175585
    Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). The method including dividing responsibility for processing pieces of geometry of an image frame during an analysis pre-pass phase of rendering between the plurality of GPUs, wherein each of the pieces of geometry is assigned to a corresponding GPU. The method including determining in the analysis pre-pass phase overlap of each of the pieces of geometry with each screen regions. The method including generating information at the GPUs regarding the pieces of geometry and their relations to the screen regions based on the overlap of each of the pieces of geometry with each of the screen regions. The method including assigning the screen regions to the GPUs based on the information for purposes of rendering the pieces of geometry during a subsequent phase of rendering.
    Type: Grant
    Filed: November 22, 2022
    Date of Patent: December 24, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Tobias Berghoff, David Simpson
  • Patent number: 12157054
    Abstract: A method is disclosed including setting, at a plurality of devices, a plurality of VSYNC signals to a plurality of VSYNC frequencies, wherein a corresponding device VSYNC signal of a corresponding device is set to a corresponding device VSYNC frequency. The method including sending a plurality of signals between the plurality of devices, which are analyzed and used to adjust the relative timing between corresponding device VSYNC signals of at least two devices.
    Type: Grant
    Filed: October 31, 2023
    Date of Patent: December 3, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Publication number: 20240374996
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including scanning-in the video frame to an encoder at the server scanline-by-scanline. The method including encoding one or more encoder slices as one or more encoded slices at the encoder, wherein each encoded slice is delivered to a buffer at an encoder fill rate. The method including draining a first encoded slice from the buffer to stream the first encoded slice at a buffer drain rate over a network to a client, wherein the first encoded slice is streamed over the network before fully encoding the one or more slices of the video frame.
    Type: Application
    Filed: July 12, 2024
    Publication date: November 14, 2024
    Inventors: Kelvin M. Yong, Mark E. Cerny
  • Publication number: 20240359093
    Abstract: A method including receiving actuation of a universal button on a controller during live game play of a video game, wherein image frames of the live game play are displayed in sequential order, wherein a current image frame is being displayed when the universal button is actuated. The method including receiving selection of a rewind mode from features presented in a user interface displayed simultaneous with the live game play in response to the actuation of the universal button. The method including accessing from storage a subset of captured image frames generated for the game play. The method including entering the rewind mode by automatically switching from displaying the live game play to displaying the subset of captured image frames in reverse beginning from the current image frame. The method including responding to rewind controller inputs for controlling the displaying of the subset of captured image frames in rewind mode.
    Type: Application
    Filed: April 28, 2023
    Publication date: October 31, 2024
    Inventors: Mark E. Cerny, Dustin S. Clingman
  • Publication number: 20240354163
    Abstract: A method for graphics processing, wherein a graphics processing unit (GPU) resource is allocated among applications, such that each application is allocated a set of time slices. Commands of draw calls are loaded to rendering command buffers in order to render an image frame for a first application. The commands are processed by the GPU resource within a first time slice allocated to the first application. The method including determining at least one command has not been executed at an end of the first time slice. The method including halting execution of commands, wherein remaining one or more commands are not processed in the first time slice. A GPU configuration is preserved for the commands after processing a last executed command, the GPU configuration used when processing in a second time slice the remaining commands.
    Type: Application
    Filed: July 2, 2024
    Publication date: October 24, 2024
    Inventor: Mark E. Cerny
  • Patent number: 12121803
    Abstract: A method is disclosed including setting, at a server, a server VSYNC signal to a server VSYNC frequency defining a plurality of frame periods. The server VSYNC signal corresponding to generation of a plurality of video frames at the server during the plurality of frame periods. The method including setting, at a client, a client VSYNC signal to a client VSYNC frequency. The method including sending a plurality of compressed video frames based on the plurality of video frames from the server to the client over a network using the server VSYNC signal. The method including decoding and displaying, at the client, the plurality of compressed video frames. The method including analyzing the timing of one or more client operations to set the amount of frame buffering used by the client, as the client receives the plurality of compressed video frames.
    Type: Grant
    Filed: July 18, 2023
    Date of Patent: October 22, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 12115447
    Abstract: A method for cloud gaming. The method including generating a plurality of video frames when executing a video game at a cloud gaming server. The method including encoding the plurality of video frames at an encoder bit rate, wherein the plurality of video frames that is compressed is transmitted to a client from a streamer of the cloud gaming server. The method including measuring a maximum receive bandwidth of a client. The method including monitoring the encoding of the plurality of video frames at the streamer. The method including dynamically tuning a parameter of the encoder based on the monitoring of the encoding.
    Type: Grant
    Filed: December 13, 2022
    Date of Patent: October 15, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Kelvin M. Yong
  • Patent number: 12118641
    Abstract: A method for graphics processing. The method including rendering graphics for an application using a plurality of graphics processing units (GPUs). The method including using the plurality of GPUs in collaboration to render an image frame including a plurality of pieces of geometry. The method including during a pre-pass phase of rendering, generating information at the GPUs regarding the plurality of pieces of geometry and their relation to a plurality of screen regions. The method including assigning the plurality of screen regions to the plurality of GPUs based on the information for purposes of rendering the plurality of pieces of geometry in a subsequent phase of rendering.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: October 15, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Tobias Berghoff, David Simpson
  • Patent number: 12112394
    Abstract: A method including rendering graphics for an application using graphics processing units (GPUs). Responsibility for rendering of geometry is divided between GPUs based on screen regions, each GPU having a corresponding division of the responsibility which is known. A plurality of pieces of geometry of an image frame is assigned to the GPUs for geometry testing. A first GPU state configuring one or more shaders to perform the geometry testing is set. Geometry testing is performed at GPUs on the plurality of pieces of geometry to generate information regarding each piece of geometry and its relation to each of the plurality of screen regions. A second GPU state configuring the one or more shaders to perform rendering is set. The information generated for each of the plurality of pieces of geometry is used when rendering the plurality of pieces of geometry at the GPUs.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: October 8, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mark E. Cerny, Florian Strauss, Tobias Berghoff
  • Publication number: 20240316452
    Abstract: A method for cloud gaming. The method including generating a video frame when executing a video game at a server. The method including performing a scan-out process to deliver the video frame to an encoder configured to compress the video frame, wherein the scan-out process begins at a flip-time of the video frame. The method including transmitting the video frame that is compressed to a client. The method including determining at the client a target display time for the video frame. The method including scheduling at the client a display time for the video frame based on the target display time.
    Type: Application
    Filed: June 4, 2024
    Publication date: September 26, 2024
    Inventors: Roelof Roderick Colenbrander, Mark E. Cerny