Patents by Inventor Jeffrey Roger Stafford

Jeffrey Roger Stafford has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20180357752
    Abstract: Methods and systems are provided for enabling foveal adaption of temporal anti-aliasing within a foveated rendering presentation. A method for rendering a multi-resolution scene with anti-aliasing within a head mounted display (HMD) is provided. The method includes an operation for rendering a scene that includes a series of video frames. The method also includes operations for applying anti-aliasing to a first region of the scene using a first jitter offset and applying anti-aliasing to a second region of the scene using a second jitter offset. Further, the method provides for generating a foveated scene that includes the first region and the second region and for sending the foveated scene to be displayed on a display associated with the HMD, wherein the first region is associated with a higher resolution than the second scene and the first jitter offset is smaller than the second jitter offset, according to certain embodiments.
    Type: Application
    Filed: October 24, 2017
    Publication date: December 13, 2018
    Inventors: Chris Ho, Andrew Young, Jeffrey Roger Stafford
  • Publication number: 20180357747
    Abstract: A method for implementing a graphics pipeline. The method includes generating a plurality of bones for an object defining positioning relationships between the bones. The method includes determining a subsystem of bones from the plurality of bones for the object. The method includes determining a foveal region when rendering an image of the virtual scene including the object, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the object is located in a peripheral region for the image. The method includes animating the object by applying a transformation to the subsystem of bones.
    Type: Application
    Filed: October 6, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357749
    Abstract: Methods and systems are provided for using temporal supersampling to increase a displayed resolution associated with peripheral region of a foveated rendering view. A method for enabling reconstitution of higher resolution pixels from a low resolution sampling region for fragment data is provided. The method includes an operation for receiving a fragment from a rasterizer of a GPU and for applying temporal supersampling to the fragment with the low resolution sampling region over a plurality of prior frames to obtain a plurality of color values. The method further includes an operation for reconstituting a plurality of high resolution pixels in a buffer that is based on the plurality of color values obtained via the temporal supersampling. Moreover, the method includes an operation for sending the plurality of high resolution pixels for display.
    Type: Application
    Filed: February 26, 2018
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357780
    Abstract: A method for implementing a graphics pipeline. The method includes building a first shadow map of high resolution, and building a second shadow map based on the first shadow map of lower resolution. The method includes determining a light source affecting a virtual scene, and projecting geometries of objects of an image of the virtual scene onto a plurality of pixels of a display from a first point-of-view. The method includes determining a foveal region when rendering the image, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining a first set of geometries is drawn to a first pixel, determining the first set of geometries is in shadow based on the light source, and determining the first set of geometries is outside of the foveal region. The method includes rendering the first set of geometries using the second shadow map.
    Type: Application
    Filed: October 6, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357794
    Abstract: A method for implementing a graphics pipeline. The method includes determining a plurality of light sources affecting a virtual scene. Geometries of objects of an image of the scene is projected onto a plurality of pixels of a display from a first point-of-view. The pixels are partitioned into a plurality of tiles. A foveal region of highest resolution is defined for the image as displayed, wherein a first subset of pixels is assigned to the foveal region, and wherein a second subset of pixels is assigned to a peripheral region that is outside of the foveal region. A first set of light sources is determined from the plurality of light sources that affect one or more objects displayed in a first tile that is in the peripheral region. At least two light sources from the first set is clustered into a first aggregated light source affecting the first tile when rendering the image in pixels of the first tile.
    Type: Application
    Filed: October 6, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180357810
    Abstract: A method for implementing a graphics pipeline. The method includes generating a system of particles creating an effect in a virtual scene, the system of particles comprising a plurality of particle geometries. The method includes determining a subsystem of particles from the system of particles, the subsystem of particles comprising a subset of particle geometries taken from the plurality of particle geometries. The method includes determining a foveal region when rendering an image of the virtual scene, wherein the foveal region corresponds to where an attention of a user is directed. The method includes determining that at least one portion of the effect is located in the peripheral region for the image. The method includes rendering the subsystem of particles to generate the effect.
    Type: Application
    Filed: September 29, 2017
    Publication date: December 13, 2018
    Inventors: Andrew Young, Chris Ho, Jeffrey Roger Stafford
  • Publication number: 20180342066
    Abstract: A method for tracking eye movement is provided. One embodiment of the method includes receiving a first measurement from a first sensor configured to detect a gaze location, determining an initial gaze location based at least on the first measurement, receiving at least one of eye motion amplitude and eye motion direction measurement from a second sensor, and determining an estimated gaze location based at least on the initial gaze location and the at least one of eye motion amplitude and eye motion direction. Systems perform similar steps, and non-transitory computer readable storage mediums each store one or more computer programs.
    Type: Application
    Filed: August 2, 2018
    Publication date: November 29, 2018
    Inventors: Dominic Saul Mallinson, Eric James Larsen, Jeffrey Roger Stafford
  • Patent number: 10124257
    Abstract: Methods and systems for warning a user of a head mounted display (HMD) during game play of a video game. A game is executed causing interactive scenes of the game to be transmitted for rendering on a display portion of the HMD. Coordinates of the HMD are determined in a three-dimensional space of a real-world environment in which the user wearing the HMD is present, to identify a current position of the user. A movement of the HMD is determined during execution of the game by identifying a change in one or more coordinates of the HMD in the three-dimensional space. When it is determined that the user is approaching a boundary of an interaction space in a real-world environment, a warning signal is conveyed to the HMD to indicate proximity of the user to the boundary of the interaction space.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: November 13, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Jeffrey Roger Stafford
  • Patent number: 10120438
    Abstract: Methods, devices, and computer programs for controlling behavior of an electronic device are presented. A method includes an operation for operating the electronic device in a first mode of operation, and an operation for tracking the gaze of a user interfacing with the electronic device. The electronic device is maintained in a first mode of operation as long as the gaze is directed towards a predetermined target. In another operation, when the gaze is not detected to be directed towards the predetermined target, the electronic device is operated in a second mode of operation, which is different from the first mode of operation.
    Type: Grant
    Filed: May 25, 2011
    Date of Patent: November 6, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Steven Osman, Jeffrey Roger Stafford
  • Patent number: 10122985
    Abstract: The disclosure provides methods and systems for warning a user of a head mounted display that the user approaches an edge of field of view of a camera or one or more tangible obstacles. The warning includes presenting audio and/or displayable messages to the user, or moving the display(s) of the head mounted displays away of the user's eyes. The determination that the user approaches the edge of scene or a tangible obstacle is made by dynamically tracking motions of the users through analysis of images and/or depth data obtained from image sensor(s) and/or depth sensor(s) secured to either the head mounted display, arranged outside of the scene and not secured to the head mounted display, or a combination of both.
    Type: Grant
    Filed: August 7, 2017
    Date of Patent: November 6, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Jeffrey Roger Stafford
  • Publication number: 20180314323
    Abstract: A head mounted display is provided. The head mounted display includes an optics block having a display screen. The optics block has a forward-facing region, a lower-facing region, a top-facing region, an inside-facing region, and side regions that extend from the forward-facing region toward the inside-facing region. The display screen is viewable from the inside-facing region. A band adjustment unit is located opposite the optics block. A headband has a front portion and an adjustable portion. The adjustable portion of the headband is connected to the band adjustment unit to contract a size of the headband or expand the size of the headband. The front portion of the headband has a connection to the top-facing region of the optics block that is proximate to the inside-facing region. A pad is disposed inside of the front portion of the headband. The pad provides for at least partial support of the optics block when the head mounted display is worn by a user.
    Type: Application
    Filed: July 3, 2018
    Publication date: November 1, 2018
    Inventors: Anton Mikhailov, Eric Larsen, Jeffrey Roger Stafford
  • Publication number: 20180292911
    Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.
    Type: Application
    Filed: June 11, 2018
    Publication date: October 11, 2018
    Inventors: Jeffrey Roger Stafford, Todd Tokubo
  • Patent number: 10073516
    Abstract: Inertial sensors within a head mounted display are used to track movement of the head mounted display. The tracked movement of the head mounted display is correlated to an action within a virtual reality scene that is currently displayed to a user wearing the head mounted display. The action within the virtual reality scene is based on a context of the virtual reality scene that is currently displayed. The detected movement of the head mounted display can be combined with other sensor data, such as gaze detection data, to determine the action within the virtual reality scene. In this manner, movements of the user as detected using the inertial sensors within the head mounted display are used as inputs to cause actions within the current context of the virtual reality scene as displayed within the head mounted display to the user.
    Type: Grant
    Filed: June 19, 2015
    Date of Patent: September 11, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Eric Larsen, Frederick Umminger, Xiaoyong Ye, Noam Rimon, Jeffrey Roger Stafford, Xia Lou
  • Patent number: 10043281
    Abstract: A method for tracking eye movement is provided. One embodiment of the method includes receiving a first measurement from a first sensor configured to detect a gaze location, determining an initial gaze location based at least on the first measurement, receiving at least one of eye motion amplitude and eye motion direction measurement from a second sensor, and determining an estimated gaze location based at least on the initial gaze location and the at least one of eye motion amplitude and eye motion direction. Systems perform similar steps, and non-transitory computer readable storage mediums each store one or more computer programs.
    Type: Grant
    Filed: August 6, 2015
    Date of Patent: August 7, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Dominic Saul Mallinson, Eric James Larsen, Jeffrey Roger Stafford
  • Patent number: 10019057
    Abstract: Methods, systems, and computer programs are presented for managing the display of images on a head mounted device (HMD). One method includes an operation for tracking the gaze of a user wearing the HMD, where the HMD is displaying a scene of a virtual world. In addition, the method includes an operation for detecting that the gaze of the user is fixed on a predetermined area for a predetermined amount of time. In response to the detecting, the method fades out a region of the display in the HMD, while maintaining the scene of the virtual world in an area of the display outside the region. Additionally, the method includes an operation for fading in a view of the real world in the region as if the HMD were transparent to the user while the user is looking through the region. The fading in of the view of the real world includes maintaining the scene of the virtual world outside the region.
    Type: Grant
    Filed: March 12, 2014
    Date of Patent: July 10, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Steven Osman, Xiadong Mao, Jeffrey Roger Stafford
  • Publication number: 20180188534
    Abstract: Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
    Type: Application
    Filed: February 20, 2018
    Publication date: July 5, 2018
    Inventors: Jeffrey Roger Stafford, Xiadong Mao, Glenn Black
  • Patent number: 9996166
    Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.
    Type: Grant
    Filed: September 1, 2017
    Date of Patent: June 12, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jeffrey Roger Stafford, Todd Tokubo
  • Patent number: 9987554
    Abstract: A method for enhancing detection of a user's hand relative to a head-mounted display (HMD) is described. The method includes sensing a disrupted portion of energy by sensors integrated within a pad device. The disrupted portion of the energy is generated when the hand of the user interferes with the energy. The plurality of sensors that sense the disrupted portion of the energy produce an energy image that mirrors a current position of the hand. The method includes repeating the sensing continuously to produce a stream of energy images. The method includes communicating the stream of energy images to a game console for processing each of the energy images to produce a model of the hand and movement of the model of the hand. The model of the hand is at least partially rendered as a virtual hand in a virtual environment that is displayed in the HMD.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: June 5, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jeffrey Roger Stafford, Todd Tokubo
  • Patent number: 9984505
    Abstract: A method for presenting text information on a head-mounted display is provided, comprising: rendering a view of a virtual environment to the head-mounted display; tracking an orientation of the head-mounted display; tracking a gaze of a user of the head-mounted display; processing the gaze of the user and the orientation of the head-mounted display, to identify a gaze target in the virtual environment towards which the gaze of the user is directed; receiving text information for rendering on the head-mounted display; presenting the text information in the virtual environment in a vicinity of the gaze target.
    Type: Grant
    Filed: September 30, 2014
    Date of Patent: May 29, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Noam Rimon, Jeffrey Roger Stafford
  • Patent number: 9971401
    Abstract: Methods, systems, and computer programs for interfacing a user with a Graphical User Interface (GUI) are provided. One method includes operations for identifying a point of gaze (POG) of a user, and for detecting initiation of an action by the user to move a position of a selector for selecting objects presented on a graphical user interface (GUI). In addition, the method includes an operation for determining the distance between the current position of the selector and the POG. The displacement speed of the selector is adjusted based on the distance between the current position of the selector and the POG, where the displacement speed is reduced as the distance between the current position of the selector and the POG becomes smaller.
    Type: Grant
    Filed: July 28, 2014
    Date of Patent: May 15, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Jeffrey Roger Stafford