Patents by Inventor Tsubasa Tsukahara

Tsubasa Tsukahara has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240051147
    Abstract: An entertainment system includes a user terminal, a robot, and a control device. The user terminal causes a display unit to display contents which allow a user to select any one character from a plurality of characters for which personalities different from one another are defined. The control device determines an operation mode of the robot on the basis of a parameter corresponding to a personality of the character selected on the user terminal.
    Type: Application
    Filed: December 24, 2021
    Publication date: February 15, 2024
    Applicants: Sony Group Corporation, Sony Interactive Entertainment Inc., Sony Interactive Entertainment LLC
    Inventors: Yasushi OKUMURA, Fumihiko IIDA, Ryuichi SUZUKI, Yukari KONISHI, Kotaro IMAMURA, Tsubasa TSUKAHARA, Daisuke KAWAMURA, Naoki OGISHITA, Bhat Ramanath UDUPI, Mari YASUDA
  • Patent number: 11899673
    Abstract: An electronic device and method for providing a user interface for a cognitive search in content is provided. The electronic device controls a display device to render an application interface that includes UI elements. The UI elements include a UI element to select media items, a UI element to select input data to be used for search inside content of each media item, and interactive UI elements to configure parameters that control the search inside the content or a metasearch within results of the search. The electronic device receives an input via the UI elements and transmits a search request to a search engine system. The electronic device receives a search result that identifies, from within the content or associated metadata, content elements that match the input data and satisfy the parameters. The display device is controlled to render the search result onto the application interface.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: February 13, 2024
    Assignee: SONY GROUP CORPORATION
    Inventors: Rajesh Vadranapu, Jaison Joseph, Tsubasa Tsukahara, Miyuki Takazono
  • Patent number: 11890534
    Abstract: A method for predefining an entryway at a virtual boundary of an XR space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing vertical surfaces and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset; and selecting one group as defining the entryway. The defining of the entryway is carried out in advance of user interaction with any virtual elements in the XR environment.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: February 6, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11759711
    Abstract: A method for quasi-random placement of a virtual item in an XR space includes: accessing a previously generated spatial mapping mesh (SMM) of the XR space; compiling a record from the SMM of open spaces between surfaces of physical elements in the XR space, with corresponding positions and dimensions; selecting from the open spaces: a spawn position for a virtual character, and a random set of other positions, filtering the random set to form a subset. The method then performs a collision analysis to assign a score to each position in the subset partly based on accessibility to that position for the virtual character beginning from the spawn position; and places the virtual item at a position in the subset having a score as high or higher than all other positions in the subset. The method is carried out before user interaction with any virtual element in the XR space.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: September 19, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11684848
    Abstract: A method for providing a user with an improved understanding of an XR space in which the user is playing a video game includes: continuously tracking a user-controlled character in the video game; accessing a previously generated spatial mapping mesh (SMM) of surfaces of real elements present in the XR space, with corresponding positions and dimensions; analyzing information from the SMM on one or more real surfaces within a predetermined distance of the user-controlled character; carrying out an action based on a tracked position of the user-controlled character and, at least in part, on a result of the analysis; and making a consequence of the action visible to the user.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: June 27, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230195732
    Abstract: An electronic device and method for providing a user interface for a cognitive search in content is provided. The electronic device controls a display device to render an application interface that includes UI elements. The UI elements include a UI element to select media items, a UI element to select input data to be used for search inside content of each media item, and interactive UI elements to configure parameters that control the search inside the content or a metasearch within results of the search. The electronic device receives an input via the UI elements and transmits a search request to a search engine system. The electronic device receives a search result that identifies, from within the content or associated metadata, content elements that match the input data and satisfy the parameters. The display device is controlled to render the search result onto the application interface.
    Type: Application
    Filed: December 20, 2021
    Publication date: June 22, 2023
    Inventors: RAJESH VADRANAPU, JAISON JOSEPH, TSUBASA TSUKAHARA, MIYUKI TAKAZONO
  • Publication number: 20230110506
    Abstract: A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: April 13, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11617949
    Abstract: A method predefines a virtual staircase connecting real platforms in an XR space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record from the SMM of available surfaces; identifying available platforms provided by the physical elements and available open spaces therebetween; selecting a first platform at a first level and a second platform at a significantly lower level; selecting a staircase start location at a first edge of the first platform, partly based on predetermined criteria; stacking virtual blocks linearly to form a virtual staircase, with a first virtual block contacting and extending outwards from the first platform, and a last virtual block contacting the second platform at a staircase end location; and performing a collision analysis. If the staircase end location satisfies the predetermined criteria, and if no collisions are detected, the current virtual staircase is displayed in subsequent user interactions with the XR space.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: April 4, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230103166
    Abstract: A method predefines a virtual staircase connecting real platforms in an XR space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record from the SMM of available surfaces; identifying available platforms provided by the physical elements and available open spaces therebetween; selecting a first platform at a first level and a second platform at a significantly lower level; selecting a staircase start location at a first edge of the first platform, partly based on predetermined criteria; stacking virtual blocks linearly to form a virtual staircase, with a first virtual block contacting and extending outwards from the first platform, and a last virtual block contacting the second platform at a staircase end location; and performing a collision analysis. If the staircase end location satisfies the predetermined criteria, and if no collisions are detected, the current virtual staircase is displayed in subsequent user interactions with the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230096913
    Abstract: A method for regulating falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game includes compiling a record from a previously generated spatial mapping mesh (SMM) of the XR space of surfaces of real elements present in that space, with corresponding positions and dimensions; and, after the game begins, determining whether, if the character approaches a substantially vertical gap between an edge of a first surface at a first level and a second surface, at a second level lower than the first level, continuing motion of the character to fall through the vertical gap will be permitted or prevented. A similar method for regulating jumps rather than falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game is also described.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230101913
    Abstract: A method for providing a user with an improved understanding of an XR space in which the user is playing a video game includes: continuously tracking a user-controlled character in the video game; accessing a previously generated spatial mapping mesh (SMM) of surfaces of real elements present in the XR space, with corresponding positions and dimensions; analyzing information from the SMM on one or more real surfaces within a predetermined distance of the user-controlled character; carrying out an action based on a tracked position of the user-controlled character and, at least in part, on a result of the analysis; and making a consequence of the action visible to the user.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230097571
    Abstract: A method for quasi-random placement of a virtual item in an XR space includes: accessing a previously generated spatial mapping mesh (SMM) of the XR space; compiling a record from the SMM of open spaces between surfaces of physical elements in the XR space, with corresponding positions and dimensions; selecting from the open spaces: a spawn position for a virtual character, and a random set of other positions, filtering the random set to form a subset. The method then performs a collision analysis to assign a score to each position in the subset partly based on accessibility to that position for the virtual character beginning from the spawn position; and places the virtual item at a position in the subset having a score as high or higher than all other positions in the subset. The method is carried out before user interaction with any virtual element in the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230102270
    Abstract: A method for predefining an entryway at a virtual boundary of an XR space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing vertical surfaces and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset; and selecting one group as defining the entryway. The defining of the entryway is carried out in advance of user interaction with any virtual elements in the XR environment.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230099016
    Abstract: A method to generate an appropriate reaction, by an NPC in an XR game, to a significant event in the game includes: compiling a record from a previously generated SMM of surfaces in the XR space, categorizing the surfaces; after the game begins, tracking in real time physical surroundings of the NPC, allowing 3D positions of the NPC relative to nearby physical surfaces to be continuously determined; and events occurring in the game, allowing detection of any event deemed to be significant. For each detected event deemed significant, occurring at a corresponding event time, an appropriate action is determined for the NPC to carry out in response, partly based on whether the NPC is positioned close to a physical surface at the event time, and the NPC is directed to carry out the appropriate action.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230096959
    Abstract: A method for predefining an entryway, corresponding to a real entryway, for an object entering or leaving an extended reality (XR) space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing real boundary walls and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset based on proximity; and selecting one group as defining the entryway. The entryway is predefined in advance of user interaction with any virtual elements in the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11612817
    Abstract: A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: March 28, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11596866
    Abstract: A method to generate an appropriate reaction, by an NPC in an XR game, to a significant event in the game includes: compiling a record from a previously generated SMM of surfaces in the XR space, categorizing the surfaces; after the game begins, tracking in real time physical surroundings of the NPC, allowing 3D positions of the NPC relative to nearby physical surfaces to be continuously determined; and events occurring in the game, allowing detection of any event deemed to be significant. For each detected event deemed significant, occurring at a corresponding event time, an appropriate action is determined for the NPC to carry out in response, partly based on whether the NPC is positioned close to a physical surface at the event time, and the NPC is directed to carry out the appropriate action.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: March 7, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230030442
    Abstract: A robot has a generally cubic body portion on propulsion elements. The robot turns its head in accordance with a remote person turning his head, and also presents, on a display representing the face of the robot, a full-face image representing the person even when the person is being imaged in profile.
    Type: Application
    Filed: July 31, 2021
    Publication date: February 2, 2023
    Inventors: NAOKI OGISHITA, TSUBASA TSUKAHARA, FUMIHIKO IIDA, RYUICHI SUZUKI, KAREN MURATA, JUN MOMOSE, KOTARA IMAMURA, Yasushi Okumura, Ramanath Bhat, Daisuke Kawamura
  • Patent number: 11393079
    Abstract: There is provided an image processing apparatus including an input device configured to receive a stroke input, and a display controller configured to control a displaying of a modified stroke, wherein the modified stroke is synthesized based on characteristic parameters of the received stroke input and characteristic parameters of a reference stroke that has been matched to the received stroke input.
    Type: Grant
    Filed: January 19, 2018
    Date of Patent: July 19, 2022
    Assignee: SONY CORPORATION
    Inventors: Yoshihito Ohki, Yasuyuki Koga, Tsubasa Tsukahara, Ikuo Yamano, Hiroyuki Mizunuma, Miwa Ichikawa
  • Patent number: 11340560
    Abstract: There is provided an information processing apparatus, control method, and program that allow for recognition of a state of an arm on the basis of determination of whether the information processing apparatus is worn on the left arm or the right arm, the information processing apparatus including: a determination unit configured to determine whether the information processing apparatus is worn on a user's right arm or left arm; a recognition unit configured to recognize a state of the arm; and a control unit configured to perform predetermined control on a device included in the information processing apparatus according to the recognized state of the arm. The recognition unit switches settings of a parameter which is used in the recognition of the state of the arm, according to a result of the determination by the determination unit.
    Type: Grant
    Filed: April 28, 2021
    Date of Patent: May 24, 2022
    Assignee: SONY CORPORATION
    Inventors: Hiroyuki Mizunuma, Yuhei Taki, Tsubasa Tsukahara, Ikuo Yamano