Patents by Inventor Jeffrey Roger Stafford

Jeffrey Roger Stafford has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190118091
    Abstract: A robot, including: a controller that communicates with a computing device, wherein the computing device executes a video game and renders a primary video feed of the video game to a display device, the primary video feed providing a first view into a virtual space that is defined by the executing video game; a camera that captures images of a local environment in which the robot is disposed; a projector; wherein the controller processes the images of the local environment to identify a projection surface in the local environment; wherein the computing device generates a secondary video feed of the video game and transmits the secondary video feed of the video game to the robot, the secondary video feed providing a second view into the virtual space; wherein the controller of the robot activates the projector to project the secondary video feed onto the projection surface in the local environment.
    Type: Application
    Filed: December 18, 2018
    Publication date: April 25, 2019
    Inventors: Michael Taylor, Jeffrey Roger Stafford
  • Publication number: 20190107896
    Abstract: A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.
    Type: Application
    Filed: November 27, 2018
    Publication date: April 11, 2019
    Inventors: Jeffrey Roger Stafford, Richard L. Marks
  • Publication number: 20190101980
    Abstract: Systems and methods for tracking gaze information of a user includes detecting, by a sensor of a head mounted display, that a user is wearing the HMD. An encoded signal indicative of glasses being worn with the HMD, by the user, is detected by the sensor of the HMD. In response to processing the encoded signal, a gaze detection function of the HMD is disabled by the HMD. Encoded gaze data transmitted by the glasses is received by the HMD. The encoded gaze data is processed by an image frame processor and used to adjust image frames produced for rendering on a display screen of the HMD.
    Type: Application
    Filed: December 15, 2017
    Publication date: April 4, 2019
    Inventors: Jeffrey Roger Stafford, Christopher Norden, Patrick Connor
  • Publication number: 20190091572
    Abstract: An autonomous personal companion executing a method of projection including tracking within a reference system a current position and orientation of a gaming controller used for controlling game play of a gaming application played by a user, wherein the personal companion is configured to provide services to the user. The method includes receiving information related to the gaming application from a gaming console supporting the game play. The method includes generating content based on the information related to the gaming application. The method includes moving the autonomous personal companion to a location having a direct line of sight to the controller. The method includes projecting the content from the autonomous personal companion to a surface of the gaming controller.
    Type: Application
    Filed: September 25, 2017
    Publication date: March 28, 2019
    Inventors: Jeffrey Roger Stafford, Javier Fernandez-Rico
  • Patent number: 10228562
    Abstract: Systems and methods include receiving an image for presenting on a display screen of a head mounted display (HMD). The image is provided by an application. The received image is pre-distorted to enable optics provided in a HMD to render the image. An alignment offset is identified for an eye of a user wearing the HMD by determining a position of the eye relative to an optical axis of at least one lens of the optics of the HMD. The pre-distorted image provided by the application is adjusted to define a corrected pre-distorted image that accounts for the alignment offset. The corrected pre-distorted image is forwarded to the display screen of the HMD for rendering, such that the image presented through the optics of the HMD removes aberrations caused by the alignment offset.
    Type: Grant
    Filed: August 25, 2015
    Date of Patent: March 12, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jeffrey Roger Stafford, Eric Larsen
  • Patent number: 10228811
    Abstract: Systems and methods for providing feedback to a user are described. One of the methods includes sending interactive data for rendering on a head mounted display (HMD). The HMD is configured for attachment to a head of a user for playing a game. The method further includes receiving image data associated with a body part of the user while the HMD is worn by the user and the HMD renders interactive content. The method includes tracking a spatial position associated with the body part of the user from the image data of the user. In the method, physical placement of a remote-controlled device at the spatial position associated with the body part of the user is rendered in the HMD as virtual contact with an object in the interactive content.
    Type: Grant
    Filed: July 25, 2017
    Date of Patent: March 12, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Jeffrey Roger Stafford
  • Publication number: 20190070506
    Abstract: Methods and systems for warning a user of a head mounted display (HMD) during game play of a video game. A game is executed causing interactive scenes of the game to be transmitted for rendering on a display portion of the HMD. Coordinates of the HMD are determined in a three-dimensional space of a real-world environment in which the user wearing the HMD is present, to identify a current position of the user. A movement of the HMD is determined during execution of the game by identifying a change in one or more coordinates of the HMD in the three-dimensional space. When it is determined that the user is approaching a boundary of an interaction space in a real-world environment, a warning signal is conveyed to the HMD to indicate proximity of the user to the boundary of the interaction space.
    Type: Application
    Filed: November 5, 2018
    Publication date: March 7, 2019
    Inventor: Jeffrey Roger Stafford
  • Patent number: 10210666
    Abstract: A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: February 19, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jeffrey Roger Stafford, Frederick Umminger, Steven Osman
  • Patent number: 10192528
    Abstract: Foveated rendering based on user gaze tracking may be adjusted to account for the realities of human vision. Gaze tracking error and state parameters may be determined from gaze tracking data representing a user's gaze with respect to one or more images presented to a user. Adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to a user may be generated based on the one or more gaze tracking error or state parameters. Foveated image data representing one or more foveated images may be generated with the adjusted foveation data. The foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest. The foveated images may then be presented to the user.
    Type: Grant
    Filed: March 31, 2016
    Date of Patent: January 29, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Andrew Young, Jeffrey Roger Stafford
  • Patent number: 10169846
    Abstract: Gaze tracking data representing a viewer's gaze with respect to one or more images presented to the viewer is used to generate foveated image data representing one or more foveated images characterized by a higher level of detail within one or more regions of interest and a lower level of detail outside the regions of interest. The image data for portions outside the one or more regions of interest is selectively filtered to reduce visual artifacts due to contrast resulting from the lower level of detail before compositing foveated images for presentation.
    Type: Grant
    Filed: March 31, 2016
    Date of Patent: January 1, 2019
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Jeffrey Roger Stafford, Andrew Young
  • Patent number: 10156908
    Abstract: A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.
    Type: Grant
    Filed: March 15, 2016
    Date of Patent: December 18, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jeffrey Roger Stafford, Richard L. Marks
  • Patent number: 10155166
    Abstract: A system is provided, including the following: a computing device that executes a video game and renders a primary video feed of the video game to a display device, the primary video feed providing a first view into a virtual space; a robot, including, a camera that captures images of a user, a projector, and, a controller that processes the images of the user to identify a gaze direction of the user; wherein when the gaze direction of the user changes from a first gaze direction that is directed towards the display device, to a second gaze direction that is directed away from the display device, the computing device generates a secondary video feed providing a second view into the virtual space; wherein the controller of the robot activates the projector to project the secondary video feed onto the projection surface in the local environment.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: December 18, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Michael Taylor, Jeffrey Roger Stafford
  • Publication number: 20180357752
    Abstract: Methods and systems are provided for enabling foveal adaption of temporal anti-aliasing within a foveated rendering presentation. A method for rendering a multi-resolution scene with anti-aliasing within a head mounted display (HMD) is provided. The method includes an operation for rendering a scene that includes a series of video frames. The method also includes operations for applying anti-aliasing to a first region of the scene using a first jitter offset and applying anti-aliasing to a second region of the scene using a second jitter offset. Further, the method provides for generating a foveated scene that includes the first region and the second region and for sending the foveated scene to be displayed on a display associated with the HMD, wherein the first region is associated with a higher resolution than the second scene and the first jitter offset is smaller than the second jitter offset, according to certain embodiments.
    Type: Application
    Filed: October 24, 2017
    Publication date: December 13, 2018
    Inventors: Chris Ho, Andrew Young, Jeffrey Roger Stafford
  • Publication number: 20180357780
    Abstract: A method for implementing a graphics pipeline. The method includes building a first shadow map of high resolution, and building a second shadow map based on the first shadow map of lower resolution. The method includes determining a light source affecting a virtual scene, and projecting geometries of objects of an image of the virtual scene onto a plurality of pixels of a display from a first point-of-view. The method includes determining a foveal region when rendering the image, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining a first set of geometries is drawn to a first pixel, determining the first set of geometries is in shadow based on the light source, and determining the first set of geometries is outside of the foveal region. The method includes rendering the first set of geometries using the second shadow map.
    Type: Application
    Filed: October 6, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357794
    Abstract: A method for implementing a graphics pipeline. The method includes determining a plurality of light sources affecting a virtual scene. Geometries of objects of an image of the scene is projected onto a plurality of pixels of a display from a first point-of-view. The pixels are partitioned into a plurality of tiles. A foveal region of highest resolution is defined for the image as displayed, wherein a first subset of pixels is assigned to the foveal region, and wherein a second subset of pixels is assigned to a peripheral region that is outside of the foveal region. A first set of light sources is determined from the plurality of light sources that affect one or more objects displayed in a first tile that is in the peripheral region. At least two light sources from the first set is clustered into a first aggregated light source affecting the first tile when rendering the image in pixels of the first tile.
    Type: Application
    Filed: October 6, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357810
    Abstract: A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.
    Type: Application
    Filed: September 29, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357747
    Abstract: A method for implementing a graphics pipeline. The method includes generating a plurality of bones for an object defining positioning relationships between the bones. The method includes determining a subsystem of bones from the plurality of bones for the object. The method includes determining a foveal region when rendering an image of the virtual scene including the object, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the object is located in a peripheral region for the image. The method includes animating the object by applying a transformation to the subsystem of bones.
    Type: Application
    Filed: October 6, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357749
    Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.
    Type: Application
    Filed: February 26, 2018
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180342066
    Abstract: A method for tracking eye movement is provided. One embodiment of the method includes receiving a first measurement from a first sensor configured to detect a gaze location, determining an initial gaze location based at least on the first measurement, receiving at least one of eye motion amplitude and eye motion direction measurement from a second sensor, and determining an estimated gaze location based at least on the initial gaze location and the at least one of eye motion amplitude and eye motion direction. Systems perform similar steps, and non-transitory computer readable storage mediums each store one or more computer programs.
    Type: Application
    Filed: August 2, 2018
    Publication date: November 29, 2018
    Inventors: Dominic Saul Mallinson, Eric James Larsen, Jeffrey Roger Stafford
  • Patent number: 10124257
    Abstract: Methods and systems for warning a user of a head mounted display (HMD) during game play of a video game. A game is executed causing interactive scenes of the game to be transmitted for rendering on a display portion of the HMD. Coordinates of the HMD are determined in a three-dimensional space of a real-world environment in which the user wearing the HMD is present, to identify a current position of the user. A movement of the HMD is determined during execution of the game by identifying a change in one or more coordinates of the HMD in the three-dimensional space. When it is determined that the user is approaching a boundary of an interaction space in a real-world environment, a warning signal is conveyed to the HMD to indicate proximity of the user to the boundary of the interaction space.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: November 13, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Jeffrey Roger Stafford