Patents Assigned to Sony Interactive Entertainment Europe Limited
  • Patent number: 10306202
    Abstract: Aspects of the technology encompass image encoding, which includes generating image content according to a viewpoint defined by image viewpoint data. Successive output images are generated such that each output image includes image content generated according to one or more viewpoints, and encoding metadata associated with each output image which indicates each viewpoint relating to image content contained in that output image, and which defines which portions of that output image were generated according to each of those viewpoints. An image display method for generating successive display images from successive input images is also provided, which includes re-projecting portions of each input image to form a respective display image, according to any differences between a desired display viewpoint and a particular viewpoint defined for that portion by metadata associated with a respective input image. The metadata indicating viewpoints relating to image content contained in the respective input images.
    Type: Grant
    Filed: February 25, 2015
    Date of Patent: May 28, 2019
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Sharwin Winesh Raghoebardajal, Ian Henry Bickerstaff
  • Publication number: 20190108668
    Abstract: A virtual reality apparatus comprises an image generator to generate images representing a virtual environment, for display to a user by a head mountable display to be worn by that user. The virtual environment includes an avatar representation of the user positioned within the virtual environment so that the user's viewpoint of the virtual environment substantially corresponds to the viewpoint of the avatar corresponding to that user. One or more user controls are provided with which predetermined inputs may be selected by the user. The image generator is responsive to selection of a predetermined input by the user to correspondingly configure a face of the avatar representing that user. The image generator is arranged to generate respective facial configurations of the avatar for display to other users viewing the virtual environment.
    Type: Application
    Filed: March 10, 2017
    Publication date: April 11, 2019
    Applicant: Sony Interactive Entertainment Europe Limited
    Inventors: Martin Shenton, Martin Echenique, Claire Blackshaw, Elisheva Shapiro
  • Patent number: 10257492
    Abstract: An image encoding method includes, for each of left and right images of an image stereo pair, identifying a region of interest (ROI) in an input image, generating multiple representations of that input image such that one representation is a high field of view (FOV) representation including substantially all of the input image and another representation is a low FOV representation having a lower FOV than the high FOV representation and including at least the ROI. The relationship between pixel resolution and image size for the high and low FOV representations is such that, in relation to the ROI, the low FOV representation provides more image detail than the high FOV representation. The method also includes generating one or more multiplexed images by juxtaposing portions of the left and right, high and low FOV representations so as to include all image content thereof in fewer than four multiplexed images.
    Type: Grant
    Filed: February 25, 2015
    Date of Patent: April 9, 2019
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Sharwin Winesh Raghoebardajal, Ian Henry Bickerstaff
  • Publication number: 20190102928
    Abstract: A virtual reality apparatus is provided, which includes an image generator configured to generate images representing a user of a virtual environment. The image generator is responsive to selection of a predetermined input by the user. The apparatus also includes a video camera for use in image-based tracking of a user by the image generator. The predetermined input selected by the user is a performance of a predetermined physical gesture in view of the video camera. The image generator is arranged to generate a static or animated emote sticker responsive to the predetermined physical gesture of the user for display to other users.
    Type: Application
    Filed: March 10, 2017
    Publication date: April 4, 2019
    Applicant: Sony Interactive Entertainment Europe Limited
    Inventors: Claire Blackshaw, Martin Echenique, Martin Shenton, Elisheva Shapiro
  • Publication number: 20190096106
    Abstract: A virtual reality apparatus includes an image generator configured to generate images representing a user of a virtual environment. The image generator is responsive to selection of a predetermined input by the user. The apparatus also includes a video camera for use in image-based tracking of a user by the image generator. The predetermined input selected by the user is the performing of a predetermined physical gesture in view of the video camera. The image generator is arranged to select a respective emoji responsive to the predetermined physical gesture of the user for display to other users.
    Type: Application
    Filed: March 10, 2017
    Publication date: March 28, 2019
    Applicant: Sony Interactive Entertainment Europe Limited
    Inventors: Elisheva Shapiro, Martin Shenton, Martin Echenique, Claire Blackshaw
  • Publication number: 20190088018
    Abstract: A virtual reality apparatus comprises an image generator to generate images representing a virtual environment. The images are to be displayed to a user via a head mountable. The virtual environment includes an avatar representation of the user within the virtual environment so that the user's viewpoint of the virtual environment substantially corresponds to avatar's viewpoint corresponding to that user. The image generator is responsive to operation of user controls by the user to configure the hands of the avatar representing that user. The image generator is further configured to generate respective facial configurations of the avatar for display to other users viewing the virtual environment as a mapping of the configuration of the hands of the avatar, so that the hand configuration of the avatar corresponding to a user provide an indication, to that user, of the facial configuration of the avatar corresponding to that user.
    Type: Application
    Filed: March 10, 2017
    Publication date: March 21, 2019
    Applicant: Sony Interactive Entertainment Europe Limited
    Inventors: Martin Shenton, Martin Echenique, Claire Blackshaw, Elisheva Shapiro
  • Publication number: 20190075351
    Abstract: A method is provided of processing a primary video stream to which an overlay may be applied, for display by a head mountable display. The method includes identifying one or more suitable regions in the primary video stream for the display of overlay content. A suitable region is a region detected to lack one or more first predetermined features or to include one or more second predetermined features. The method also includes generating metadata indicative of a location and a depth of the suitable regions for the display of the overlay content, and that defines how a change in the detected orientation of the head mountable display, by which the primary video stream is displayed, changes the display of the overlay content. The method further includes providing the metadata in association with the primary video stream.
    Type: Application
    Filed: March 10, 2017
    Publication date: March 7, 2019
    Applicant: Sony Interactive Entertainment Europe Limited
    Inventors: Simon John Hall, Stephen Broadley
  • Patent number: 10198866
    Abstract: A head mountable display (HMD) includes a camera operable to capture images of a peripheral and/or control device in use by a wearer of the HMD. A detector of the HMD is configured to detect occlusions in a captured image of the peripheral and/or control device. And an image renderer of the HMD is configured to render a virtual version of the peripheral and/or control device for display to the HMD wearer and to render a representation of a user's hand at a position of a detected occlusion.
    Type: Grant
    Filed: June 11, 2014
    Date of Patent: February 5, 2019
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Ian Henry Bickerstaff, Simon Mark Benson, Sharwin Winesh Raghoebardajal, Darren Myatt
  • Publication number: 20190033600
    Abstract: A head mountable display (HMD) system comprises a detector and a controller. The detector is configured to detect a first illumination level in a first one of a display image for display to a user via an HMD and an ambient environment around the HMD. The controller is configured to control a second illumination level in a second one of the display image for display to a user via an HMD and the ambient environment around the HMD, according to the detection.
    Type: Application
    Filed: March 10, 2017
    Publication date: January 31, 2019
    Applicant: Sony Interactive Entertainment Europe Limited
    Inventors: Sharwin Winesh Raghoebardajal, Simon John Hall
  • Patent number: 10187633
    Abstract: A method of operation of a head mountable display (HMD) system, in which stereoscopic images are displayed with respect to a virtual display screen (VDS) position, is provided. The method includes setting a VDS position for a stereoscopic image for display in response to a depth parameter of a region of interest (ROI) in respect of the stereoscopic image for display. The method also includes generating the stereoscopic image for display having an image parallax appropriate to the VDS position set by the setting step.
    Type: Grant
    Filed: February 3, 2016
    Date of Patent: January 22, 2019
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Ian Henry Bickerstaff, Sharwin Winesh Raghoebardajal, Simon Mark Benson
  • Patent number: 10140766
    Abstract: A method of generating an internally consistent model of the state of a book captured in a video image is provided. The method comprises obtaining a plurality of pieces of evidence relating to the state of a corresponding plurality of aspects of the book in the video image, associating a quality score with each piece of evidence, generating an initial model of the state of the book wherein the state of the book is constrained by physical properties of the book and at least the highest scoring piece of evidence, and sequentially constraining the model in response to one or more successive pieces of evidence whose scores meet a respective predetermined first threshold value.
    Type: Grant
    Filed: May 23, 2013
    Date of Patent: November 27, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Thomas Edward Lucas-Woodley, Nicholas Andrew Lord, William Oliver Sykes, Adrien Bain
  • Patent number: 10120190
    Abstract: An entertainment device includes a virtual environment generator to generate a virtual environment for display. The device also includes reception means to receive content from a mobile communication device on a local network. Content parsing means is adapted to parse the content for information of one or more predetermined information types. And transmission means is adapted to signal to a mobile communication device that the entertainment device is a wearable device, despite the fact that the entertainment device is not a wearable device. The reception means is adapted to receive selected content from the mobile communication device that has been formatted for use by such a wearable device. In addition, information of one or more predetermined information types is incorporated into the virtual environment for display.
    Type: Grant
    Filed: November 1, 2016
    Date of Patent: November 6, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventor: Mandana Jenabzadeh
  • Patent number: 10095032
    Abstract: A head mountable display (HMD) system in which the size and/or distance from the viewer of a virtual screen for display of video material depends upon one or more of the following: whether the video material is in a 2-D or a 3-D format; the image resolution of the video material; the compression quality and/or data rate of the video material; the aspect ratio of the video material; the origin of the video material; and metadata associated with the video material.
    Type: Grant
    Filed: June 10, 2014
    Date of Patent: October 9, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Ian Henry Bickerstaff, Simon Mark Benson
  • Patent number: 10086283
    Abstract: An entertainment system comprises at least one input for receiving data representative of a reference dance performance, a dance analyzer for generating data descriptive of an aspect of the reference dance, a key-point selector for selecting a plurality of key-points in the reference dance responsive to a property of the reference motion data, and an error tolerance calculator for generating error tolerance values at the plurality of key-points in the dance for use in scoring subsequent performances of the dance. The error tolerance values are responsive to a property of the reference motion data. An input may receive telemetry from one or more game controllers in communication with the entertainment system, in which the reference motion data comprises motion data generated by the dance analyzer from the telemetry received from one or more game controllers while the controller(s) was held during the reference performance of the dance.
    Type: Grant
    Filed: October 12, 2012
    Date of Patent: October 2, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Christopher Trewartha, Jamie William Derbyshire, David John Skilton
  • Patent number: 10078366
    Abstract: A head mountable display (HMD) is provided that has a head motion detection function and one or more operations that depend upon detected head motion. Detected head motion is stored as motion data in memory. The way in which detected head motion is applied to a current operation depends upon the stored motion data. In one embodiment, the HMD includes a gaze detector configured to detect eye orientation of a user of the user so as to detect image regions at which the user is looking, and a detector configured to detect item data indicative of items represented by the detected image regions.
    Type: Grant
    Filed: June 11, 2014
    Date of Patent: September 18, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Jeremy David Ashforth, Simon Mark Benson, Simon John Hall, Darren Myatt
  • Patent number: 10068311
    Abstract: A graphics processing unit (GPU) is configured to receive metadata specifying an active sample configuration for a particular region of a display device among a plurality of regions of the display device and receive pixel data for one or more pixels in the particular region. The pixel data specifies the same number of color samples for each pixel. For each pixel in the particular region, the GPU invokes a pixel shader only for color samples specified to be active samples by the configuration.
    Type: Grant
    Filed: April 5, 2014
    Date of Patent: September 4, 2018
    Assignees: Sony Interacive Entertainment LLC, Sony Interactive Entertainment Europe Limited
    Inventor: Tobias Berghoff
  • Patent number: 10054796
    Abstract: A display method is provided using a display that is operable to display an image to a viewer. The display method includes detecting one or both of an initial position and/or orientation of the viewer's head, and generating an image for display according to the detected position and/or orientation. A current position and/or orientation of the viewer's head are detected at a time at which the image is to be displayed. The method also includes re-projecting the generated image according to any differences between the initial position and/or orientation and the current position and/or orientation of the viewer's head, and displaying the re-projected image using the display.
    Type: Grant
    Filed: March 24, 2014
    Date of Patent: August 21, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Ian Henry Bickerstaff, Simon Mark Benson, Oliver Mark Wright, Sharwin Winesh Raghoebardajal
  • Patent number: 10045030
    Abstract: A method of encoding an input image captured using a wide-angle lens is provided. The method includes, for at least some of a set of image regions, increasing or decreasing the size of those image regions relative to other ones of the set of image regions according to an encoder mapping between image region size in the input image and image region size in an encoded image. And a method of decoding the encoded image includes rendering a given image according to a decoder mapping between selected regions of the encoded image and selected regions of a rendered image. The decoder mapping is complimentary to the encoder mapping.
    Type: Grant
    Filed: March 11, 2015
    Date of Patent: August 7, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventors: Ian Henry Bickerstaff, Sharwin Winesh Raghoebardajal
  • Patent number: D835120
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: December 4, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventor: Francis Che Yeung Pang
  • Patent number: D835121
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: December 4, 2018
    Assignee: Sony Interactive Entertainment Europe Limited
    Inventor: Francis Che Yeung Pang