Patents Assigned to Sony Corporation of America
  • Publication number: 20230117842
    Abstract: A buffer status reporting mechanism, such as within a buffer status request poll (BSRP), in which the Access Point (AP) communicates the specific type of information that the non-AP station (STA) is to communicate back, such as within a buffer status report (BSR), about the buffers. The AP specified requirements for the BSR being characteristics of: access categories (ACs), traffic identifiers (TIDs), traffic streams, traffic directions, and/or types of traffic and quality of service (QoS) requirements which allow the AP to properly arrange transmissions to satisfy QoS requirements.
    Type: Application
    Filed: September 29, 2022
    Publication date: April 20, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Publication number: 20230110506
    Abstract: A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: April 13, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11617949
    Abstract: A method predefines a virtual staircase connecting real platforms in an XR space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record from the SMM of available surfaces; identifying available platforms provided by the physical elements and available open spaces therebetween; selecting a first platform at a first level and a second platform at a significantly lower level; selecting a staircase start location at a first edge of the first platform, partly based on predetermined criteria; stacking virtual blocks linearly to form a virtual staircase, with a first virtual block contacting and extending outwards from the first platform, and a last virtual block contacting the second platform at a staircase end location; and performing a collision analysis. If the staircase end location satisfies the predetermined criteria, and if no collisions are detected, the current virtual staircase is displayed in subsequent user interactions with the XR space.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: April 4, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230097571
    Abstract: A method for quasi-random placement of a virtual item in an XR space includes: accessing a previously generated spatial mapping mesh (SMM) of the XR space; compiling a record from the SMM of open spaces between surfaces of physical elements in the XR space, with corresponding positions and dimensions; selecting from the open spaces: a spawn position for a virtual character, and a random set of other positions, filtering the random set to form a subset. The method then performs a collision analysis to assign a score to each position in the subset partly based on accessibility to that position for the virtual character beginning from the spawn position; and places the virtual item at a position in the subset having a score as high or higher than all other positions in the subset. The method is carried out before user interaction with any virtual element in the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230099016
    Abstract: A method to generate an appropriate reaction, by an NPC in an XR game, to a significant event in the game includes: compiling a record from a previously generated SMM of surfaces in the XR space, categorizing the surfaces; after the game begins, tracking in real time physical surroundings of the NPC, allowing 3D positions of the NPC relative to nearby physical surfaces to be continuously determined; and events occurring in the game, allowing detection of any event deemed to be significant. For each detected event deemed significant, occurring at a corresponding event time, an appropriate action is determined for the NPC to carry out in response, partly based on whether the NPC is positioned close to a physical surface at the event time, and the NPC is directed to carry out the appropriate action.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230096913
    Abstract: A method for regulating falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game includes compiling a record from a previously generated spatial mapping mesh (SMM) of the XR space of surfaces of real elements present in that space, with corresponding positions and dimensions; and, after the game begins, determining whether, if the character approaches a substantially vertical gap between an edge of a first surface at a first level and a second surface, at a second level lower than the first level, continuing motion of the character to fall through the vertical gap will be permitted or prevented. A similar method for regulating jumps rather than falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game is also described.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230096959
    Abstract: A method for predefining an entryway, corresponding to a real entryway, for an object entering or leaving an extended reality (XR) space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing real boundary walls and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset based on proximity; and selecting one group as defining the entryway. The entryway is predefined in advance of user interaction with any virtual elements in the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230102270
    Abstract: A method for predefining an entryway at a virtual boundary of an XR space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing vertical surfaces and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset; and selecting one group as defining the entryway. The defining of the entryway is carried out in advance of user interaction with any virtual elements in the XR environment.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230103166
    Abstract: A method predefines a virtual staircase connecting real platforms in an XR space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record from the SMM of available surfaces; identifying available platforms provided by the physical elements and available open spaces therebetween; selecting a first platform at a first level and a second platform at a significantly lower level; selecting a staircase start location at a first edge of the first platform, partly based on predetermined criteria; stacking virtual blocks linearly to form a virtual staircase, with a first virtual block contacting and extending outwards from the first platform, and a last virtual block contacting the second platform at a staircase end location; and performing a collision analysis. If the staircase end location satisfies the predetermined criteria, and if no collisions are detected, the current virtual staircase is displayed in subsequent user interactions with the XR space.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230101913
    Abstract: A method for providing a user with an improved understanding of an XR space in which the user is playing a video game includes: continuously tracking a user-controlled character in the video game; accessing a previously generated spatial mapping mesh (SMM) of surfaces of real elements present in the XR space, with corresponding positions and dimensions; analyzing information from the SMM on one or more real surfaces within a predetermined distance of the user-controlled character; carrying out an action based on a tracked position of the user-controlled character and, at least in part, on a result of the analysis; and making a consequence of the action visible to the user.
    Type: Application
    Filed: September 28, 2021
    Publication date: March 30, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11612817
    Abstract: A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: March 28, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230081745
    Abstract: A wireless local area network (WLAN) having stations (STAs) using Carrier Sense Multiple Access/Collision Avoidance (CSMA/CA) in which at least some stations support Full Duplex (FD) transmission. Mechanisms are described in which a STA can send a preemption request to a station performing ongoing transmissions. The preempted STA detects a preemption request of this preempting STA. The preempted STA interrupts its ongoing transmission; if it has determined to accept the preemption request. Thus, the preempting STA preempts the transmission of the preempted STA, to send a preemptive transmission, after receiving notification that the preempted STA has interrupted its ongoing transmission.
    Type: Application
    Filed: August 17, 2022
    Publication date: March 16, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Publication number: 20230070940
    Abstract: A preamble-based collision detection mechanism for use in wireless local area networks (WLANS), having one or more full-duplex (FD) stations. In addition, a new collision resolution estimation and scheduling mechanism is described for prioritized communication. These techniques can allow for more rapid collision detection and resolution, without the need of performing self-interference (SI) estimation. The techniques includes use of orthogonal preambles, in the time domain and/or frequency domain, into which FD stations embed priority information.
    Type: Application
    Filed: August 11, 2022
    Publication date: March 9, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Xia, Li-Hsiang Sun, Mohamed Abouelseoud, Liangxiao Xin
  • Patent number: 11596866
    Abstract: A method to generate an appropriate reaction, by an NPC in an XR game, to a significant event in the game includes: compiling a record from a previously generated SMM of surfaces in the XR space, categorizing the surfaces; after the game begins, tracking in real time physical surroundings of the NPC, allowing 3D positions of the NPC relative to nearby physical surfaces to be continuously determined; and events occurring in the game, allowing detection of any event deemed to be significant. For each detected event deemed significant, occurring at a corresponding event time, an appropriate action is determined for the NPC to carry out in response, partly based on whether the NPC is positioned close to a physical surface at the event time, and the NPC is directed to carry out the appropriate action.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: March 7, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20230058871
    Abstract: An IEEE 802.11 protocol in which the necessity and issues surrounding separately setting up SCS and reserving target wait time (R-TWT) are eliminated. In the present disclosure new data structures and processes are performed in which a station (STA) can request scheduling R-TWT for the traffic transmission of a stream classification service (SCS) during the setup procedure of that SCS. In using the teachings of the present disclosure, a STA can exchange a TWT setup frame on one link to schedule R-TWT on multiple links.
    Type: Application
    Filed: July 21, 2022
    Publication date: February 23, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Publication number: 20230055895
    Abstract: Full-duplex (FD) enhancements for three scenarios with multiple APs/BSSs. (1) Multiple-AP joint transmissions on a WLAN. Toward eliminating self-interferences and other issues, certain pilot signals in the PPDU are transmitted only by the primary AP. One or more secondary APs participating in the joint transmission receive the pilots to correct their clock in the following symbols. (2) Communications are performed with extended OFDM symbols sent on a second channel which facilitate NAV decoding for stations transmitting on a first channel. (3) More than one AP can perform a joint Ack/BA to a UL PPDU. The secondary AP may utilize its full duplex capability to determine the difference of receiving status between itself and the primary AP, and forward data to the primary which it had not received.
    Type: Application
    Filed: July 22, 2022
    Publication date: February 23, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Li-Hsiang Sun, Mohamed Abouelseoud, Liangxiao Xin, Qing Xia
  • Publication number: 20230047705
    Abstract: A wireless communication protocol using CSMA/CA, EDCA and R-TWT to prioritize RTA traffic transmissions. During an R-TWT SP, the RTA traffic is prioritized for transmission and mechanisms are provided for assuring proper indications and termination of the R-TWT SP. During this process, member STAs communicate with the R-TWT scheduling AP when they have no more frames to send. The R-TWT scheduling AP can also terminate the R-TWT SP before its scheduled end time, allowing non-member STAs to immediately contend for the channel. In addition, the R-TWT scheduling AP can exchange frames with STAs, that have an R-TWT feature but are not R-TWT member STAs, after frame exchanges with the R-TWT member STAs during the R-TWT SP have been completed.
    Type: Application
    Filed: June 20, 2022
    Publication date: February 16, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Li-Hsiang Sun, Qing Xia, Mohamed Abouelseoud
  • Publication number: 20230050992
    Abstract: Implementations generally perform robust multi-view multi-target action recognition using reconstructed 3-dimensional (3D) poses. In some implementations, a method includes obtaining a plurality of videos of a plurality of subjects in an environment, where at least one target subject of the plurality of subjects performs one or more actions in the environment. The method further includes tracking the at least one target subject across at least two cameras. The method further includes reconstructing a 3-dimensional (3D) model of the at least one target subject based on the plurality of videos and the tracking of the at least one target subject. The method further includes recognizing the one or more actions of the at least one target subject based on the reconstructing of the 3D model.
    Type: Application
    Filed: December 22, 2021
    Publication date: February 16, 2023
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventors: Wanxin Xu, Ko-Kai Albert Huang
  • Publication number: 20230029957
    Abstract: A wireless communications protocol in which multiple-link operations provide enhanced efficiency in particular for non-simultaneous transmit receive (NSTR) communications between stations (STAs) of multiple-link devices (MLDs). When MLD1 is the TXOP holder of Link1 and the channel is accessed on Link2 by MLD2 for transmitting to MLD1; MLD2 immediately transmits over Link2 to MLD1, if MLD1 is receiving on Link1. MLD2 transmits a frame over Link2 to occupy the channel if MLD1 is transmitting on Link1, then when MLD1 is receiving on Link1 then MLD2 transmits another frame to MLD1.
    Type: Application
    Filed: June 23, 2022
    Publication date: February 2, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Patent number: 11557086
    Abstract: An electronic device and method for 3D modeling based on 2D warping is disclosed. The electronic device acquires a color image of a face of a user, depth information corresponding to the color image, and a point cloud of the face. A 3D mean-shape model of a reference 3D face is acquired, and rigid aligned with the point cloud. A 2D projection of the aligned 3D mean-shape model is generated. The 2D projection includes a set of landmark points associated with the aligned 3D mean-shape model. The 2D projection is warped such that the set of landmark points in the 2D projection is aligned with a corresponding set of feature points in the color image. A 3D correspondence between the aligned 3D mean-shape model and the point cloud is determined for a non-rigid alignment of the aligned 3D mean-shape model, based on the warped 2D projection and the depth information.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: January 17, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Jie Hu, Mohammad Gharavi-Alkhansari