Patents by Inventor Xiadong Mao

Xiadong Mao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20190314719
    Abstract: A method is provided, including the following: presenting gameplay of a video game through a head-mounted display, the head-mounted display being disposed in a local environment; capturing audio from the local environment, and analyzing the captured audio to detect a person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the head-mounted display, the notification providing an option which pauses the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game.
    Type: Application
    Filed: May 14, 2019
    Publication date: October 17, 2019
    Inventors: Steven Osman, Xiadong Mao
  • Patent number: 10369466
    Abstract: Computer implemented methods, apparatus and systems for enabling interactive interfacing with a computer game program are provided. One system includes an input device to accept and transmit user input to the computer game program. The system also includes a computing device for executing the computer game having an interactive component that is responsive to the user input. The computing devices is in communication with the input device for receiving and processing the user input. The computer device is also configured to apply a gearing parameter during processing of the user input, wherein the applied gearing parameter defines a scaling ratio between the user input and a rate at which the interactive component responds during execution of the computer game.
    Type: Grant
    Filed: June 20, 2017
    Date of Patent: August 6, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Gary M. Zalewski, Richard Marks, Xiadong Mao
  • Patent number: 10286299
    Abstract: A method includes the following: presenting gameplay of a video game through a head-mounted display (HMD), the HMD being disposed in a local environment; detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the HMD, and analyzing the captured audio to identify the person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the HMD, the notification providing an option to pause the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the HMD a view through an externally facing camera of the HMD that enables viewing of the person speaking in the local environment.
    Type: Grant
    Filed: December 31, 2017
    Date of Patent: May 14, 2019
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Steven Osman, Xiadong Mao
  • Patent number: 10019057
    Abstract: Methods, systems, and computer programs are presented for managing the display of images on a head mounted device (HMD). One method includes an operation for tracking the gaze of a user wearing the HMD, where the HMD is displaying a scene of a virtual world. In addition, the method includes an operation for detecting that the gaze of the user is fixed on a predetermined area for a predetermined amount of time. In response to the detecting, the method fades out a region of the display in the HMD, while maintaining the scene of the virtual world in an area of the display outside the region. Additionally, the method includes an operation for fading in a view of the real world in the region as if the HMD were transparent to the user while the user is looking through the region. The fading in of the view of the real world includes maintaining the scene of the virtual world outside the region.
    Type: Grant
    Filed: March 12, 2014
    Date of Patent: July 10, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Steven Osman, Xiadong Mao, Jeffrey Roger Stafford
  • Publication number: 20180188534
    Abstract: Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
    Type: Application
    Filed: February 20, 2018
    Publication date: July 5, 2018
    Inventors: Jeffrey Roger Stafford, Xiadong Mao, Glenn Black
  • Publication number: 20180147483
    Abstract: A method includes the following: presenting gameplay of a video game through a head-mounted display (HMD), the HMD being disposed in a local environment; detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the HMD, and analyzing the captured audio to identify the person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the HMD, the notification providing an option to pause the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the HMD a view through an externally facing camera of the HMD that enables viewing of the person speaking in the local environment.
    Type: Application
    Filed: December 31, 2017
    Publication date: May 31, 2018
    Inventors: Steven Osman, Xiadong Mao
  • Patent number: 9897805
    Abstract: Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
    Type: Grant
    Filed: March 12, 2014
    Date of Patent: February 20, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jeffrey Roger Stafford, Xiadong Mao, Glenn Black
  • Patent number: 9878235
    Abstract: A method for transitioning gameplay is provided, the method including: receiving a signal to interrupt gameplay of a video game, the gameplay being presented on a head-mounted display; in response to receiving the signal, transitioning the gameplay from an active state to a paused state; wherein transitioning the gameplay includes identifying an intensity of a gameplay aspect, and progressively reducing the intensity of the gameplay aspect before entering the paused state.
    Type: Grant
    Filed: March 31, 2014
    Date of Patent: January 30, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Steven Osman, Xiadong Mao
  • Publication number: 20170282069
    Abstract: Computer implemented methods, apparatus and systems for enabling interactive interfacing with a computer game program are provided. One system includes an input device to accept and transmit user input to the computer game program. The system also includes a computing device for executing the computer game having an interactive component that is responsive to the user input. The computing devices is in communication with the input device for receiving and processing the user input. The computer device is also configured to apply a gearing parameter during processing of the user input, wherein the applied gearing parameter defines a scaling ratio between the user input and a rate at which the interactive component responds during execution of the computer game.
    Type: Application
    Filed: June 20, 2017
    Publication date: October 5, 2017
    Inventors: Gary M. Zalewski, Richard Marks, Xiadong Mao
  • Patent number: 9682319
    Abstract: Computer implemented methods, apparatus and systems for enabling interactive interfacing with a computer game program are provided. One method provides an input device to accept and transmit user input to the computer game program. The input device enables activation of one or more gearing parameters associated with interactive components of the computer game program. In another operation, the method identifies an interactive component of the computer game program. The interactive component used to receive the transmitted user input to enable the interactive interfacing. In yet another operation the method detects user input to apply one of the gearing parameters to the interactive component if so dictated by the transmitted user input. The applied gearing parameter used to define a scaling ratio between the user input and a rate at which the interactive component reacts during execution of the computer game program.
    Type: Grant
    Filed: June 25, 2007
    Date of Patent: June 20, 2017
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Gary M. Zalewski, Richard Marks, Xiadong Mao
  • Publication number: 20170045941
    Abstract: A method is provided, including the following method operations: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images and the inertial data to determine a current and predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; generating image data depicting a view of a virtual environment for the HMD, wherein regions of the view are differentially rendered; generating audio data depicting sounds from the virtual environment, the audio data being configured to enable localization of the sounds by the user; transmitting the image data and the audio data via the RF transceiver to the HMD.
    Type: Application
    Filed: October 28, 2016
    Publication date: February 16, 2017
    Inventors: Todd Tokubo, Steven Osman, Jeffrey Roger Stafford, Xiadong Mao, Glenn Black
  • Patent number: 9474968
    Abstract: Methods and systems for interactive interfacing with a computer gaming system are provided. The computer gaming system includes a video capture device for capturing image data. One method includes displaying an input device to the video capture device, where the input device has a plurality of lights that are modulated so as to convey positioning of the input device and communication data that is to be interpreted by the computer gaming system based on analysis of the captured image data and a state of the plurality of lights. This method also includes defining movement of an object of a computer game that is to be executed by the computer gaming system, such that the movement of the object may be mapped to movements in position of the input device as detected in the captured image data. The method then establishes a gearing between the movement of the object of the computer game verses the movements in position of the input device.
    Type: Grant
    Filed: May 6, 2006
    Date of Patent: October 25, 2016
    Assignee: Sony Interactive Entertainment America LLC
    Inventors: Gary M. Zalewski, Richard Marks, Xiadong Mao
  • Patent number: 9393487
    Abstract: One embodiment provides a method for use in a game that includes the steps of receiving position information for a controller that is being manipulated by a user, analyzing the position information to determine whether a predetermined movement of the controller associated with a command has been performed, and executing the command if the predetermined movement of the controller associated with the command has been performed.
    Type: Grant
    Filed: May 7, 2006
    Date of Patent: July 19, 2016
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Gary M. Zalewski, Richard Marks, Xiadong Mao
  • Patent number: 9381424
    Abstract: One embodiment provides a method for use in providing input to a system that includes the steps of determining position information for a controller for the system, comparing the determined position information for the controller with predetermined position information associated with commands, and providing a command to the system if the determined position information matches predetermined position information for the command.
    Type: Grant
    Filed: January 11, 2011
    Date of Patent: July 5, 2016
    Assignee: Sony Interactive Entertainment America LLC
    Inventors: Gary Zalewski, Richard Marks, Xiadong Mao
  • Publication number: 20160129346
    Abstract: A system and method for operating a head mounted display (HMD) is provided. The HMD has a head attachment portion and a viewing module coupled to the head attachment portion. The viewing module includes an inner side having a view port into a screen configuring for rendering a virtual reality scene and an exterior housing. A communications module for exchanging data with a computer system is provided and the computer system is configured to generate the virtual reality scene for the screen. A depth camera is integrated into the viewing module and is oriented to capture depth data of an environment in front of the exterior housing. One method includes processing, by the computer system, the depth data captured by the depth camera to identify hands of a user wearing the HMD in the environment. The hands are rendered into the virtual reality scene. The hands are tracked such that movements of the hands appear as movements of virtual hands extending into the virtual reality scene.
    Type: Application
    Filed: January 14, 2016
    Publication date: May 12, 2016
    Inventors: Anton Mikhailov, Xiadong Mao
  • Patent number: 8976265
    Abstract: An apparatus for capturing image and sound during interactivity with a computer game in a game environment is provided. The apparatus includes a housing and a base stand for supporting the housing. An image capture device is defined along a front portion of the housing. Also, an array of microphones is defined along the front portion of the housing. The array of microphones is defined by a single microphone positioned on a first lateral side of the image capture device and two or more microphones positioned on a second lateral side of the image capture device opposite the first side. The apparatus also includes a connector for connecting to a computing device.
    Type: Grant
    Filed: October 26, 2011
    Date of Patent: March 10, 2015
    Assignee: Sony Computer Entertainment Inc.
    Inventors: Richard L. Marks, Xiadong Mao
  • Publication number: 20140361956
    Abstract: A head mounted display is provided. The head mounted display includes a head attachment portion and a viewing module coupled to the head attachment portion. The viewing module includes an inner portion having a view port into a screen configuring for rendering image content, and an exterior housing. Further included are a plurality illuminating elements integrated with the exterior housing of the viewing module. The plurality of illumination elements defined for image tracking of the head mounted display. Illumination logic is provided for controlling the plurality of illumination elements to be active or inactive during use of the head mounted display.
    Type: Application
    Filed: June 4, 2014
    Publication date: December 11, 2014
    Inventors: Anton Mikhailov, Xiadong Mao
  • Publication number: 20140361976
    Abstract: Methods, systems, and computer programs are presented for managing the display of images on a head mounted device (HMD). One method includes an operation for tracking the gaze of a user wearing the HMD, where the HMD is displaying a scene of a virtual world. In addition, the method includes an operation for detecting that the gaze of the user is fixed on a predetermined area for a predetermined amount of time. In response to the detecting, the method fades out a region of the display in the HMD, while maintaining the scene of the virtual world in an area of the display outside the region. Additionally, the method includes an operation for fading in a view of the real world in the region as if the HMD were transparent to the user while the user is looking through the region. The fading in of the view of the real world includes maintaining the scene of the virtual world outside the region.
    Type: Application
    Filed: March 12, 2014
    Publication date: December 11, 2014
    Applicant: Sony Computer Entertainment Inc.
    Inventors: Steven Osman, Xiadong Mao, Jeffrey Roger Stafford
  • Publication number: 20140361977
    Abstract: Methods, systems, and computer programs are presented for rendering images on a head mounted display (HMD). One method includes operations for tracking, with one or more first cameras inside the HMD, the gaze of a user and for tracking motion of the HMD. The motion of the HMD is tracked by analyzing images of the HMD taken with a second camera that is not in the HMD. Further, the method includes an operation for predicting the motion of the gaze of the user based on the gaze and the motion of the HMD. Rendering policies for a plurality of regions, defined on a view rendered by the HMD, are determined based on the predicted motion of the gaze. The images are rendered on the view based on the rendering policies.
    Type: Application
    Filed: March 12, 2014
    Publication date: December 11, 2014
    Applicant: Sony Computer Entertainment Inc.
    Inventors: Jeffrey Roger Stafford, Xiadong Mao, Glenn Black
  • Publication number: 20140364215
    Abstract: A method for executing a game presented on a screen of a head mounted display (HMD) is provided. Execution renders interactive scenes of the game on the screen. The method includes receiving data of the HMD worn by a user to identify an HMD spatial position. The method also includes receiving data of a controller held by the user to identify a controller spatial position. During game play, the method includes rendering a point of view into the interactive scenes of the game on the screen, where the point of view is a volume of space rendered in three-dimensions. The method includes adjusting the point of view as the HMD spatial position is detected to change. The controller can drive interactivity in the game and changes in position of the controller and the HMD are correlated to provide an immersive three-dimensional game play experience.
    Type: Application
    Filed: June 4, 2014
    Publication date: December 11, 2014
    Inventors: Anton Mikhailov, Xiadong Mao