Patents by Inventor Xiaoyong Ye
Xiaoyong Ye has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12210674Abstract: A tracking system uses one or more light sources to direct light toward one or more of a user's eyes. A dynamic vision sensor (DVS) operably coupled to a processor is configured to view the user's eyes. The DVS has an array of light-sensitive elements in a known configuration. The DVS outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light from the light sources reflecting from a portion of the user's eyes. The output signals include information corresponding to locations of the corresponding light-sensitive elements in the array. The processor determines an association between each event and a corresponding particular light source and fits an orientation of the user's eyes using the determined association, the relative location of the light sources with respect to the user's eyes and the locations of the corresponding light-sensitive elements in the array.Type: GrantFiled: June 10, 2022Date of Patent: January 28, 2025Assignee: Sony Interactive Entertainment Inc.Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Publication number: 20240386298Abstract: Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model.Type: ApplicationFiled: July 30, 2024Publication date: November 21, 2024Inventors: Mahdi Azmandian, Xiaoyong Ye, Todd Tokubo
-
Patent number: 12064682Abstract: A position and orientation of a controller are determined from a known configuration of two or more light sources with respect to each other and with respect to a controller body and from output signals from a dynamic vision sensor (DVS) generated in response to changes in light output from the light sources. The output signals indicate times events at corresponding light-sensitive elements in an array in the DVS and array locations of the light-sensitive elements. A position and orientation of one or more objects are determined from signals generated by two or more light-sensitive elements resulting from other light reaching the two or more light-sensitive elements.Type: GrantFiled: June 10, 2022Date of Patent: August 20, 2024Assignee: SONY INTERACTIVE ENTERTAINMENT INC.Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Patent number: 12059609Abstract: A tracking system uses a dynamic vision sensor (DVS) operably coupled to the processor. The DVS has an array of light-sensitive elements in a known configuration. The DVS outputs signals corresponding to two or more events at two or more corresponding light-sensitive elements in the array in response to changes in light output from two or more light sources mounted in a known configuration with respect to each other and with respect to a controller. The output signals indicate times of the events and locations of the corresponding light-sensitive elements. The processor determines an association between each event and two or more corresponding light sources and fits a position and orientation of the controller using the determined association, the known configuration of the light sources and the locations of the corresponding light-sensitive elements in the array.Type: GrantFiled: June 10, 2022Date of Patent: August 13, 2024Assignee: SONY INTERACTIVE ENTERTAINMENT INC.Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Patent number: 12051011Abstract: Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model.Type: GrantFiled: April 1, 2020Date of Patent: July 30, 2024Assignee: Sony Interactive Entertainment Inc.Inventors: Mahdi Azmandian, Xiaoyong Ye, Todd Tokubo
-
Patent number: 12029971Abstract: A DVS has an array of light-sensitive elements in a known configuration and outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light output from two or more light sources in a known configuration with respect to each other and with respect to a controller body. The signals indicate times of the events and array locations of the corresponding light-sensitive elements. Filters selectively transmit light from the light sources to light-sensitive elements in the array and selectively block other light from reaching those elements and vice versa. A processor determines a position and orientation of the controller from times of the events, array locations of corresponding light-sensitive elements, and the known light source configuration and determines a position and orientation of one or more objects from signals generated by two or more light-sensitive elements resulting from other light.Type: GrantFiled: June 10, 2022Date of Patent: July 9, 2024Assignee: SONY INTERACTIVE ENTERTAINMENT LLCInventors: Xiaoyong Ye, Yuichiro Nakamura
-
Patent number: 11995226Abstract: A tracking system includes a processor, a controller, two or more light sources and a dynamic vision sensor (DVS). The light sources are of known configuration with respect to each other the controller and turn on and off in a predetermined sequence. The DVS includes an array of light-sensitive elements of known configuration. The DVS outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light from the light sources. The signals indicate times of the events and locations of the corresponding light-sensitive elements. The processor determines an association between each event and one or more of the light sources and, from that association, determines an occlusion of one or more of the light sources. The processor estimates a location of an object using the determined occlusion, the known light source configuration, and the locations of the corresponding light-sensitive elements in the array.Type: GrantFiled: June 10, 2022Date of Patent: May 28, 2024Assignee: Sony Interactive Entertainment Inc.Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Patent number: 11967087Abstract: To track certain difficult facial features during speech such as the corners of the mouth and the teeth, a camera sensor system generates RGB/IR images and the system also uses light intensity change signals from an event driven sensor (EDS), as well as voice analysis. In this way, the camera sensor system enables improved performance tracking (equivalent to using very high-speed camera) at lower bandwidth and power consumption.Type: GrantFiled: October 14, 2022Date of Patent: April 23, 2024Assignee: Sony Interactive Entertainment Inc.Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Publication number: 20240048799Abstract: Detection of whether a video is a fake video derived from an original video and altered is undertaken using a block chain that either forbids adding to the block chain copies of original videos that have been altered or indicating in the block chain that an altered video has been altered. Image fingerprinting techniques are described for determining whether video sought to be added to block chain has been altered.Type: ApplicationFiled: July 2, 2023Publication date: February 8, 2024Inventors: Xiaoyong Ye, Warren Benedetto
-
Publication number: 20230400911Abstract: A tracking system includes a processor, a controller, two or more light sources and a dynamic vision sensor (DVS). The light sources are of known configuration with respect to each other the controller and turn on and off in a predetermined sequence. The DVS includes an array of light-sensitive elements of known configuration. The DVS outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light from the light sources. The signals indicate times of the events and locations of the corresponding light-sensitive elements. The processor determines an association between each event and one or more of the light sources and, from that association, determines an occlusion of one or more of the light sources. The processor estimates a location of an object using the determined occlusion, the known light source configuration, and the locations of the corresponding light-sensitive elements in the array.Type: ApplicationFiled: June 10, 2022Publication date: December 14, 2023Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Publication number: 20230398432Abstract: A tracking system uses a dynamic vision sensor (DVS) operably coupled to the processor. The DVS has an array of light-sensitive elements in a known configuration. The DVS outputs signals corresponding to two or more events at two or more corresponding light-sensitive elements in the array in response to changes in light output from two or more light sources mounted in a known configuration with respect to each other and with respect to a controller. The output signals indicate times of the events and locations of the corresponding light-sensitive elements. The processor determines an association between each event and two or more corresponding light sources and fits a position and orientation of the controller using the determined association, the known configuration of the light sources and the locations of the corresponding light-sensitive elements in the array.Type: ApplicationFiled: June 10, 2022Publication date: December 14, 2023Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Publication number: 20230398434Abstract: A position and orientation of a controller are determined from a known configuration of two or more light sources with respect to each other and with respect to a controller body and from output signals from a dynamic vision sensor (DVS) generated in response to changes in light output from the light sources. The output signals indicate times events at corresponding light-sensitive elements in an array in the DVS and array locations of the light-sensitive elements. A position and orientation of one or more objects are determined from signals generated by two or more light-sensitive elements resulting from other light reaching the two or more light-sensitive elements.Type: ApplicationFiled: June 10, 2022Publication date: December 14, 2023Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Publication number: 20230401723Abstract: A tracking system and method, comprising a processor; and a controller operably coupled to the processor. Two or more light sources are mounted in a known configuration with respect to each other and with respect to the controller body and the two or more light sources are configured to flash a predetermined time sequence. A dynamic vision sensor is configured to output signals corresponding to two or more events at two or more corresponding light-sensitive elements in an array in response to changes in light output from the two or more light sources and corresponding to times of the two or more events and locations of the events in the light-sensitive elements in the array. The processor determines a position and orientation of the controller from the times and location of the two or more events, and the known information.Type: ApplicationFiled: June 10, 2022Publication date: December 14, 2023Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Publication number: 20230400915Abstract: A tracking system uses one or more light sources to direct light toward one or more of a user's eyes. A dynamic vision sensor (DVS) operably coupled to a processor is configured to view the user's eyes. The DVS has an array of light-sensitive elements in a known configuration. The DVS outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light from the light sources reflecting from a portion of the user's eyes. The output signals include information corresponding to locations of the corresponding light-sensitive elements in the array. The processor determines an association between each event and a corresponding particular light source and fits an orientation of the user's eyes using the determined association, the relative location of the light sources with respect to the user's eyes and the locations of the corresponding light-sensitive elements in the array.Type: ApplicationFiled: June 10, 2022Publication date: December 14, 2023Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Publication number: 20230398433Abstract: A DVS has an array of light-sensitive elements in a known configuration and outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light output from two or more light sources in a known configuration with respect to each other and with respect to a controller body. The signals indicate times of the events and array locations of the corresponding light-sensitive elements. Filters selectively transmit light from the light sources to light-sensitive elements in the array and selectively block other light from reaching those elements and vice versa. A processor determines a position and orientation of the controller from times of the events, array locations of corresponding light-sensitive elements, and the known light source configuration and determines a position and orientation of one or more objects from signals generated by two or more light-sensitive elements resulting from other light.Type: ApplicationFiled: June 10, 2022Publication date: December 14, 2023Inventors: Xiaoyong Ye, Yuichiro Nakamura
-
Patent number: 11736763Abstract: Detection of whether a video is a fake video derived from an original video and altered is undertaken using a block chain that either forbids adding to the block chain copies of original videos that have been altered or indicating in the block chain that an altered video has been altered. Image fingerprinting techniques are described for determining whether video sought to be added to block chain has been altered.Type: GrantFiled: June 15, 2021Date of Patent: August 22, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Xiaoyong Ye, Warren Benedetto
-
Patent number: 11719850Abstract: A method includes using an electromagnetic (EM) tracking system to track a tangible object, detecting a presence of interference with a magnetic field generated by the EM tracking system, and compensating for the interference. A system includes an EM tracking transmitter, an EM tracking receiver, and a processor based apparatus in communication with the EM tracking transmitter and the EM tracking receiver. The processor based apparatus is configured to execute steps including using the EM tracking transmitter and the EM tracking receiver to implement an EM tracking system. A storage medium storing one or more computer programs is also provided.Type: GrantFiled: June 9, 2020Date of Patent: August 8, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Dennis D. Castleman, Xiaoyong Ye
-
Patent number: 11717759Abstract: Methods and systems for enhancing viewing experience of a spectator includes receiving a request for viewing game play of a video game executing at a game cloud server. Responsive to the request, the spectator is initially provided with one of a player camera view or an active spectator camera view generated for the game play. The system dynamically switches between the player camera view and the active spectator camera view based on context of action occurring in the player camera view and the active spectator camera view. The dynamic switching correlates with time of action occurring in the game scene of the video game.Type: GrantFiled: March 1, 2022Date of Patent: August 8, 2023Assignee: Sony Interactive Entertainment Inc.Inventor: Xiaoyong Ye
-
Patent number: 11635802Abstract: To facilitate control of an AR HMD, a camera unit in a camera sensor system generates RGB/IR images and the system also extrapolates images for times in the future based on light intensity change signals from an event detection sensor (EDS) for HMD pose tracking, hand tracking, and eye tracking. The times in the future are provided by an HMD application which defines the future times, and the RGB/IR images and extrapolated images are sent back to the application. In this way, the camera sensor system enables improved performance tracking (equivalent to using very high-speed camera) at lower bandwidth and power consumption.Type: GrantFiled: January 13, 2020Date of Patent: April 25, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Jeffrey R. Stafford, Xiaoyong Ye, Yutaka Yokokawa
-
Publication number: 20230068416Abstract: To track certain difficult facial features during speech such as the corners of the mouth and the teeth, a camera sensor system generates RGB/IR images and the system also uses light intensity change signals from an event driven sensor (EDS), as well as voice analysis. In this way, the camera sensor system enables improved performance tracking (equivalent to using very high-speed camera) at lower bandwidth and power consumption.Type: ApplicationFiled: October 14, 2022Publication date: March 2, 2023Inventors: Xiaoyong Ye, Yuichiro Nakamura