Patents Assigned to Interaction
  • Publication number: 20240265583
    Abstract: Disclosed herein is an image processing device including an input information acquiring part that receives a user operation relating to an image displayed on a displaying device, and an image displaying part that, when the input information acquiring part receives an operation for specifying a place by a user, causes the displaying device to display thereon an image of the place. The image displaying part further causes an icon for floor number selection for selecting a floor number of a building currently displayed to be displayed and, when the input information acquiring part receives an operation, which is performed on the icon for floor number selection, for selecting another floor, changes display such that an image of the selected floor appears from a direction same as a direction corresponding to the selected floor in a vertical positional relation between the selected floor and a floor currently displayed.
    Type: Application
    Filed: April 19, 2024
    Publication date: August 8, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventor: Junichi MURAMOTO
  • Patent number: 12056899
    Abstract: Methods and/or apparatus provide for obtaining intrinsics and extrinsics of a plurality of cameras arranged to capture a scene and based thereon, generate a voxel representation of the scene; obtaining extrinsics and intrinsics of a virtual camera; mapping the extrinsics and intrinsics of the virtual camera to at least one voxel surface defined in a data structure and to identify at least one camera pair suitable for obtaining depth data for that voxel surface based on the corresponding camera pair identifier; and receiving an input from the mapping unit, and in response obtaining images captured by the cameras in the at least one camera pair identified as being suitable for reconstructing the scene from the viewpoint of the virtual camera, and to generate an image of the scene from the viewpoint of the virtual camera based on the obtained images.
    Type: Grant
    Filed: March 13, 2023
    Date of Patent: August 6, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Nigel John Williams, Andrew William Walker
  • Patent number: 12053699
    Abstract: By using the user head and/or eye tracking capabilities of an extended reality (XR) system, a region of gaze (ROG) of the user towards the virtual screen can be determined and signaled to non-XR games and applications running on the host system connected to the XR system. The existing non-XR games/applications can be patched, upgraded, or remastered to support the application of the ROG and ROG based enhancements of the visuals and user interfaces, using the provided by the system software on the host system that is rendering the game for the XR system.
    Type: Grant
    Filed: April 26, 2022
    Date of Patent: August 6, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jeffrey R. Stafford, Patrick Connor, Andrew Young
  • Patent number: 12057951
    Abstract: [Problem] To provide a web conferencing system that allows a shared material to be easily searched for and shared without disturbing the progress of the web conference. [Solution] A web conferencing system 1 that connects a first terminal 3, a second terminal 5, and a third terminal 7, the web conferencing system 1 comprising: a web conference screen display unit 11 configured to display a web conference screen on the first terminal 3 and the third terminal 7; and a material sharing unit 13 configured to: receive a sharing instruction to share a shared material from the second terminal 5; cause the first terminal and the third terminal to share the shared material.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: August 6, 2024
    Assignee: Interactive Solutions Corp.
    Inventor: Kiyoshi Sekine
  • Patent number: 12058296
    Abstract: Content management for virtual tours including exposing, within a virtual tour, a hotspot, the hotspot having an associated a hyperlink to a third-party content management provider and access code for accessing content from third-party content management provider; receiving an invocation of the hotspot; invoking the hyperlink associated with the hotspot; invoking the access code for accessing content from third-party content management provider; receiving, from the third-party content management provider, content; and displaying the received content within the virtual tour.
    Type: Grant
    Filed: January 11, 2021
    Date of Patent: August 6, 2024
    Assignee: Virtually Anywhere Interactive, LLC
    Inventor: Fontaine Carrington Weems, III
  • Patent number: 12056807
    Abstract: An image rendering method for rendering a pixel at a viewpoint includes, for a first element of a virtual scene, having a predetermined surface at a position within that scene; providing the position and a direction based on the viewpoint to a machine learning system previously trained to predict a factor that, when combined with a distribution function that characterises an interaction of light with the predetermined surface, generates a pixel value corresponding to the first element of the virtual scene as illuminated at the position, combining the predicted factor from the machine learning system with the distribution function to generate the pixel value corresponding to the illuminated first element of the virtual scene at the position, and incorporating the pixel value into a rendered image for display, where the machine learning system was previously trained with a training set based on images comprising multiple lighting conditions.
    Type: Grant
    Filed: March 18, 2022
    Date of Patent: August 6, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Fabio Cappello, Matthew Sanders, Marina Villanueva Barreiro, Timothy Edward Bradley, Andrew James Bigos
  • Patent number: 12053704
    Abstract: A method for processing an artificial intelligence (AI) model for a gaming application. The method includes training the AI model from a plurality of game plays of a scenario of the gaming application using training state data collected from the plurality of game plays of the scenario and associated success criteria of each of the plurality of game plays. The method includes receiving first input state data during a first game play of the scenario. The method includes applying the first input state data to the AI model to generate an output indicating a degree of success for the scenario for the first game play. The method includes performing an analysis of the output based on a predefined objective. The method includes performing an action to achieve the predefined objective based on the output that is analyzed.
    Type: Grant
    Filed: April 1, 2022
    Date of Patent: August 6, 2024
    Assignee: Sony Interactive Entertainment LLC
    Inventors: Justin V. Beltran, Dylan Butler, Kevin Kragenbrink
  • Publication number: 20240252924
    Abstract: An operation information acquisition section 212 acquires operation information indicating movement of an operation apparatus being held by a user's hand. The operation apparatus includes a kinesthetic sense presentation section that presents a kinesthetic sense to the user's hand and a tactile sense presentation section that presents a tactile sense to the user's hand. A control section 230 controls movement of a virtual device corresponding to the operation apparatus in a space where a virtual object exists, according to the operation information. The control section 230 generates first driving data for driving the kinesthetic sense presentation section and second driving data for driving the tactile sense presentation section, on the basis of a relation between the virtual device and the virtual object.
    Type: Application
    Filed: July 12, 2022
    Publication date: August 1, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Makoto Wakabayashi, Hideki Mori
  • Publication number: 20240257514
    Abstract: A captured image obtainment unit in an image processing apparatus obtains multiple sets of polarized images that have been captured while causing image capturing states to differ. For each polarized image, a polarization degree obtainment unit obtains a degree of polarization for an image of a target object. An image selection unit in a material information estimation unit, on the basis of the degree of polarization or additional information, selects an input image and a type thereof. An algorithm switching unit, on the basis of the degree of polarization or additional information, switches an algorithm used in material information estimation. An estimation unit uses the input image to estimate material information using the algorithm that was switched to. An output data generation unit generates an image using the material information and outputs the image to a display apparatus.
    Type: Application
    Filed: June 10, 2021
    Publication date: August 1, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Shinya WADA, Hiroyuki SEGAWA
  • Publication number: 20240255764
    Abstract: Provided is a head-mounted display which can use a spring for adjusting the size of a mounting band to the head of a user while suppressing increase of the size of an adjustment mechanism in a forward and rearward direction. The adjustment mechanism includes an operation dial operated by a user and a link member held in engagement with a rear portion (rack) of a right band portion and a rear portion (rack) of a left band portion, and moves the link member in such a manner that the length of the mounting band changes in response to a movement of the operation dial. The adjustment mechanism includes a spiral spring that applies elastic force to the link member. The spiral spring is arranged in such a manner as to have its center line extending along the forward and rearward direction as viewed in top plan.
    Type: Application
    Filed: May 25, 2022
    Publication date: August 1, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Manabu Ishioka, Toshikazu Arai
  • Publication number: 20240252927
    Abstract: A data processing apparatus includes circuitry configured to: receive a signal indicating a simulated cardiogram of a character in a video game, the simulated cardiogram being generated using one or more attributes of the character; determine one or more heart rate variability, HRV, parameters of the character using the simulated cardiogram; and control an occurrence in the video game using the one or more HRV parameters.
    Type: Application
    Filed: January 15, 2024
    Publication date: August 1, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventor: Lazaros Michailidis
  • Publication number: 20240256056
    Abstract: Disclosed herein is an information processing apparatus including a first device information acquisition section that acquires position and posture information relating to a first device worn on a user, a second device information acquisition section that acquires position information relating to a second device worn on a portion different from the first device on the basis of the position and posture information relating to the first device and a skeleton model of a human, and a sensor data acquisition section that acquires sensor data from a sensor that measures motions of the first device and the second device. The second device information acquisition section changes a degree of following of the skeleton model to the first device on a basis of the sensor data.
    Type: Application
    Filed: January 17, 2024
    Publication date: August 1, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Koki YAMAUCHI, Takanori MINAMINO, Kenzo NISHIKAWA
  • Publication number: 20240257391
    Abstract: Provided is an information processing apparatus including a captured image acquisition unit that acquires an image captured of a device including markers, an extraction unit that extracts a marker image coordinate in the captured image, a position and posture derivation unit that derives position information and posture information of the device from the extracted marker image coordinate and a three-dimensional coordinate of a candidate marker in a three-dimensional model of the device by performing a predetermined calculation, and a sensor data acquisition unit. The position and posture derivation unit places the three-dimensional model in a virtual three-dimensional space, and discards or selects the candidate marker to be used for the calculation, on the basis of a difference between an orientation of a surface on which the candidate marker is provided among surfaces of the three-dimensional model and an orientation of a screen surface of the captured image.
    Type: Application
    Filed: January 22, 2024
    Publication date: August 1, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Kosuke OMORI, Takanori MINAMINO, Ryotaro YADA
  • Patent number: 12051011
    Abstract: Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model.
    Type: Grant
    Filed: April 1, 2020
    Date of Patent: July 30, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Mahdi Azmandian, Xiaoyong Ye, Todd Tokubo
  • Patent number: 12048881
    Abstract: A game guide system, method, and apparatus are provided. A system for providing computer simulated game guidance content, comprising a game guide database, a game objectives database, a network connector configured to communicate with a plurality of user devices over a network, and a control circuit. The control circuit is configured to receive a game guide request from a user, receive an audio segment recorded from a game by a user device associated with the user, identify the game and a game objective from the game objectives database based on the audio segment, select a content item in the game guide database based on the game objective, and provide the content item to the user.
    Type: Grant
    Filed: May 3, 2022
    Date of Patent: July 30, 2024
    Assignee: Sony Interactive Entertainment LLC
    Inventor: Alvin J. Daniel
  • Patent number: 12048868
    Abstract: A plurality of motion sensors capable of capturing IR video, depth video, and RGB images. Periodically emitting IR pulses. Capturing IR video, depth video, and RGB images of a user. Generating a point cloud of the user. Generating a 3D model of the user including the point cloud of the user. Inputting the IR video, depth video, and RGB images into a machine learning model. Estimating a set of joints of the user in the 3D model. Tracking, based on the estimated set of joints of the user in the 3D model, the user's motion over a period of time. Determining a number of repetitions of an exercise performed by the user. Determining a feedback value. Calculating, based on the number of repetitions and the feedback value, a user exercise score. Providing, via a graphical user interface, the user exercise score and the feedback value to the user.
    Type: Grant
    Filed: February 2, 2022
    Date of Patent: July 30, 2024
    Assignee: Tempo Interactive Inc.
    Inventors: Joshua Augustin, Moawia Eldeeb
  • Patent number: 12050316
    Abstract: Methods and apparatus include providing a head-mounted display to be worn by the user and presenting a video to the user through the head-mounted display; measuring outside world information; detecting whether or not the outside world information contains any notification information to be notified to the user, including detection of at least one reference position, which is set by the user as notification information; and notifying the user when notification information is detected.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: July 30, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Morio Usami
  • Publication number: 20240248837
    Abstract: Disclosed is an information processing apparatus for acquiring a plurality of display screens that are displayed chronologically while a target program is executed, identifying, on the basis of the plurality of display screens, a plurality of scenes presented by the target program and transition relations between the scenes, and generating a transition diagram that indicates a transition between the scenes.
    Type: Application
    Filed: May 26, 2021
    Publication date: July 25, 2024
    Applicant: Sony Interactive Entertainment Inc.
    Inventors: Tomokazu KAKE, Daichi ONO, Yutaro MIYAUCHI, Satoshi NAKAJIMA, Korechika TAMURA
  • Publication number: 20240249507
    Abstract: A method of dataset generation is described. The method comprises steps including receiving user image data and generating personalised training data based on the received user image data. Generating personalised training data comprises generating a computational model based at least in part on the received user data and generating the personalised training data based on the computational model.
    Type: Application
    Filed: January 17, 2024
    Publication date: July 25, 2024
    Applicants: Sony Interactive Entertainment Europe Limited, Sony Interactive Entertainment LLC
    Inventors: Lloyd Preston STEMPLE, Aron Giuseppe VISCIGLIA, Daisuke KAWAMURA, Ramanath BHAT, Pedro Federico Quijada LEYTON, David Erwan Damien UBERTI
  • Publication number: 20240245989
    Abstract: Disclosed herein is an information processing device that is connected, in a wireless or wired manner, to an input device including a left-side holding part having a left-side vibrator and a right-side holding part having a right-side vibrator, the information processing device including one or more processors having hardware. The one or more processors arrange a focus in a screen, receive directional input transmitted from the input device, move the focus on the basis of the received directional input, and cause the left-side vibrator and/or the right-side vibrator to vibrate according to the movement of the focus.
    Type: Application
    Filed: January 18, 2024
    Publication date: July 25, 2024
    Applicants: Sony Interactive Entertainment Inc., Sony Interactive Entertainment LLC
    Inventors: Charles WANG, Yurika MULASE, Shingo KUROKAWA, Satish UPPULURI, Fumiaki HISAMATSU, Takashi SAWADA, Midori UENO, Brian PARSONS, Max LOEB, Dmitrijs JONINS