Patents Assigned to Sony Corporation of America
  • Publication number: 20230262770
    Abstract: Wireless IEEE 802.11 communication mechanisms are described for a member STA of a R-TWT SP to gain TXOP channel access before the R-TWT SP, which does not need to end before the start time of the R-TWT SP. On trigger based R-TWT SP, the TXOP time is shared to overlap the R-TWT SP; allowing the AP to behave as the TXOP holder for the frame exchange of latency sensitive traffic during the R-TWT SP. Thus, the R-TWT scheduling AP and member STAs of a R-TWT SP can contend for the channel together before the scheduled start time of the R-TWT SP. When one of these STAs gains channel access, it can reserve a TXOP until the scheduled end time of the R-TWT SP, which may extend beyond the normal TXOP limit.
    Type: Application
    Filed: February 7, 2023
    Publication date: August 17, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Li-Hsiang Sun, Mohamed Abouelseoud, Qing Xia
  • Publication number: 20230254897
    Abstract: An enhanced method of handling block Acks, such as for latency sensitive traffic streams, for which a separate block Ack mechanism is established, which is separate from other traffic in the same TID. With this separate block Ack mechanism the recipient STA can have an independent receive reordering buffer control for latency sensitive traffic, so that the MSDU or A-MSDU of latency sensitive traffic can be passed to the next MAC process in order of increasing sequence number of the MSDUs or A-MSDUs since those MSDUs and A-MSDUs have the same QoS requirement, such as the latency time. This mechanism reduces the chances of latency sensitive traffic being stuck in a receive reordering buffer behind other traffic in the TID and having its traffic expire.
    Type: Application
    Filed: January 6, 2023
    Publication date: August 10, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Li-Hsiang Sun, Mohamed Abouelseoud, Qing Xia
  • Patent number: 11717756
    Abstract: Procedurally generating live experiences for a virtualized music-themed world, including: providing a headless content management system supporting management of back end; coupling a virtual world client to the back end of the content management system using an interface that provides a content packaging framework to enable customized event scheduling and destination management; and procedurally generating a plurality of content elements in a real-time game engine for live experiences in the virtualized music-themed world.
    Type: Grant
    Filed: September 8, 2021
    Date of Patent: August 8, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventor: David Lee
  • Patent number: 11721030
    Abstract: A method for optimizing image capture of a scene by a swarm of drones including a root drone and first and second level-1 drones involves the root drone following a predetermined trajectory over the scene, capturing one or more root keyframe images, at a corresponding one or more root drone orientations and root drone-to-scene distances. For each root keyframe image: the root drone generates a ground mask image for that root keyframe image, and applies that ground mask image to the root keyframe image to generate a target image. The root drone then analyzes the target image to generate first and second scanning tasks for the first and second level-1 drones to capture a plurality of images of the scene at a level-1 drone-to-scene distance smaller than the root drone-to-scene distance; and the first and second level-1 drones carry out the first and second scanning tasks respectively.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: August 8, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventor: Cheng-Yi Liu
  • Patent number: 11716760
    Abstract: A wireless communication protocol for an access point (AP) multi-link device (MLD) using carrier-sense multiple-access collision avoidance (CSMA/CA) with multi-link operations. Transmit opportunities (TXOPs) are obtained by setting a random number of backoff slots, as a random backoff, for channel contention on each link, and counting down the random backoff on each link independently. When the backoff for the link reaches zero, channel access is obtained and a TXOP duration of reserved on a link whose end time cannot occur later than the latest existing TXOPs of the AP MLD. Numerous variations are described for setting the random number of backoff slots and for reserving the TXOP duration on a link.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: August 1, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud
  • Patent number: 11704829
    Abstract: Implementations generally perform pose reconstruction by tracking for video analysis. In some implementations, a method includes obtaining a plurality of videos of at least one subject performing at least one action in an environment. The method further includes tracking the at least one subject across at least two cameras. The method further includes reconstructing a 3-dimensional (3D) model of the at least one subject based on the plurality of videos and the tracking of the at least one subject.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: July 18, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Wanxin Xu, Ko-Kai Albert Huang
  • Patent number: 11694385
    Abstract: A system and method for three-dimensional (3D) microgeometry and reflectance modeling is provided. The system receives images comprising a first set of images of a face and a second set of images of the face. The faces in the first set of images and the second set of images are exposed to omni-directional lighting and directional lighting, respectively. The system generates a 3D face mesh based on the received images and executes a set of skin-reflectance modeling operations by using the generated 3D face mesh and the second set of images, to estimate a set of texture maps for the face. Based on the estimated set of texture maps, the system texturizes the generated 3D face mesh. The texturization includes an operation in which texture information, including microgeometry skin details and skin reflectance details, of the estimated set of texture maps is mapped onto the generated 3D face mesh.
    Type: Grant
    Filed: June 8, 2021
    Date of Patent: July 4, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Chen Fu, Mohammad Gharavi-Alkhansari
  • Patent number: 11684848
    Abstract: A method for providing a user with an improved understanding of an XR space in which the user is playing a video game includes: continuously tracking a user-controlled character in the video game; accessing a previously generated spatial mapping mesh (SMM) of surfaces of real elements present in the XR space, with corresponding positions and dimensions; analyzing information from the SMM on one or more real surfaces within a predetermined distance of the user-controlled character; carrying out an action based on a tracked position of the user-controlled character and, at least in part, on a result of the analysis; and making a consequence of the action visible to the user.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: June 27, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11688116
    Abstract: An electronic device and method of preservation of geometry details in tracked meshes is provided. A set of three-dimensional (3D) scans and a sequence of tracked meshes of an object of interest are acquired. The sequence of tracked meshes comprises a set of tracked meshes which temporally corresponds to the set of 3D scans. Based on differences between the set of tracked meshes and the set of 3D scans, a set of displacement maps is generated. A plurality of vectors is computed, each of which includes surface tension values associated with mesh vertices of a corresponding tracked mesh. Based on the set of displacement maps and a corresponding set of vectors, a neural network is trained on a task of displacement map generation. The trained neural network model is applied on the plurality of vectors to generate displacement maps. Each tracked mesh is updated based on a corresponding displacement map.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: June 27, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Hiroyuki Takeda, Kendai Furukawa, Mohammad Gharavi-Alkhansari
  • Patent number: 11688117
    Abstract: Methods, systems, and computer-readable storage media providing banner representations in a computer system that provides a virtual environment, including: accessing an avatar record, where the avatar record indicates an avatar representation that includes data to provide a visual representation of an avatar; receiving a selection of a banner representation made by a user; accessing a representation record, wherein the representation record indicates a banner representation that includes data to provide a visual representation of a banner; associating the banner representation with the avatar representation; receiving avatar movement input that indicates movement of the avatar within the virtual environment; and generating visual data representing the movement of the avatar and banner in the virtual environment using the avatar representation and the banner representation, where the banner is placed in the virtual environment following the avatar as the avatar moves in the virtual environment.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: June 27, 2023
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Thomas Sachson, Eric Benjamin Fruchter, James Marcus
  • Publication number: 20230199846
    Abstract: A wireless communication apparatus, method or protocol for wireless STAs using CSMA/CA on a wireless local area network (WLAN). A receiver STA receives MSDUs or A-MSDUs which include an expiration time, from a transmitter STA. The receiver STA stores the MSDUs or A-MSDUs with expiration time in its receive reordering buffer of the corresponding high-throughput (HT)-immediate block acknowledgement (Ack) agreement. The receiver STA passes the MSDU or A-MSDU to a next MAC process before an expiration time of the MSDU or A-MSDU. Thus, the percentage of latency sensitive traffic packets being communicated prior to expiration is increased.
    Type: Application
    Filed: December 19, 2022
    Publication date: June 22, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Publication number: 20230199845
    Abstract: A wireless communication protocol which operates with multi-link devices (MLDs) having simultaneous transmit and receive (STR) link pairs to allow transmitting a long MU PPDU by an originator on a first link, which is acknowledged (Ack) by a recipient on a second link. The Ack on the second link may be on a single resource unit (RU) which may be shared by multiple stations. The Ack may be received during the MP PPDU on the first link, making it a quick Ack. In many cases this allows the originator to perform a retransmission within the same PPDU, thus especially benefitting real-time traffic which is latency sensitive.
    Type: Application
    Filed: December 19, 2022
    Publication date: June 22, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Li-Hsiang Sun, Mohamed Abouelseoud, Liangxiao Xin, Qing Xia
  • Publication number: 20230199844
    Abstract: A wireless IEEE 802.11 communication protocol under CSMA/CA for enhanced full duplex (FD) station (STA) operations. PPDU preambles are configured to incorporate STA identification and corresponding resource unit (RU) or multiple resource unit (MRU) information. An FD AP indicates STA identification and corresponding RU/MRU index of a transmission destination in the FD preamble of a downlink (DL) PPDU; while a FD non-AP STA indicates its own STA identification and corresponding RU/MRU index in the FD preamble of a uplink (UL) PPDU. The disclosed technology mitigates many issues in regard to fake collisions, partial RU fake collisions, and real collisions, toward improving communications and efficiency and reducing latencies.
    Type: Application
    Filed: December 12, 2022
    Publication date: June 22, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Xia, Mohamed Abouelseoud, Li-Hsiang Sun, Liangxiao Xin
  • Publication number: 20230199647
    Abstract: New reverse direction (RD) protocols for EHT devices during reserved target wait time (R-TWT) service periods (SPs). In this protocol the R-TWT scheduling AP does not have to trigger the RD initiator when it performs as the RD responder, and can trigger TB PPDU(s). In addition, the RD initiator is enabled to inform the RD initiator to inform its non-AP peer STA about the R-TWT information in the transmitted RD PPDU. The RD initiator is enabled to send a new MU RD PPDU to both the R-TWT scheduling AP and the non-AP peer STA, which allows the AP to quickly takeover scheduling if the non-AP peer STA is a non-RTWT member and has limited access the in current ongoing R-TWT SP.
    Type: Application
    Filed: November 17, 2022
    Publication date: June 22, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Xia, Mohamed Abouelseoud, Li-Hsiang Sun, Liangxiao Xin
  • Publication number: 20230199847
    Abstract: Enhanced R-TWT scheduling is performed in which the R-TWT scheduling AP can perform scheduling quickly to react quickly to changes in the network environment and optimize R-TWT scheduling for efficiency and stability. The R-TWT scheduling AP transmits R-TWT trigger frames and is able to collect information from R-TWT scheduled STAs which may affect R-TWT scheduling. The scheduling can take into account that some member STAs may be dozing (asleep) for several beacon intervals and do not wake up for the beacon, then the R-TWT scheduling AP initiates the update of parameters when needed to check on those STAs to determine if any updates are needed. The R-TWT trigger frame can allocate resource units (RU) for R-TWT scheduled STAs to communicate back to the R-TWT scheduling AP.
    Type: Application
    Filed: December 19, 2022
    Publication date: June 22, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Patent number: 11682234
    Abstract: An electronic device and method for texture map generation are disclosed. A set of color images from a set of viewpoints and depth information of a subject's face are acquired. A 3D model is generated based on a color image and the depth information. A set of viewpoint-specific projections of the 3D model are generated along the set of viewpoints. The 3D model is refined based on minimization of difference between each viewpoint-specific projection and a corresponding color image. A set of texture maps corresponding to the set of viewpoints is generated, based on the refined 3D model, and set of color images. A dynamic programming workflow is executed to determine seams along which respective portions of the set of texture maps are to be stitched and the respective portions are stitched along the seams to generate a final texture map for the refined 3D model of the subject's face.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: June 20, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Jie Hu, Mohammad Gharavi-Alkhansari
  • Patent number: 11657573
    Abstract: The mesh tracking described herein involves mesh tracking on 3D face models. In contrast to existing mesh tracking algorithms which generally require user intervention and manipulation, the mesh tracking algorithm is fully automatic once a template mesh is provided. In addition, an eye and mouth boundary detection algorithm is able to better reconstruct the shape of eyes and mouths.
    Type: Grant
    Filed: May 6, 2021
    Date of Patent: May 23, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Yuelong Li, Mohammad Gharavi-Alkhansari
  • Publication number: 20230156687
    Abstract: A non-AP STA, which is a scheduled STA having membership in an R-TWT scheduled STA, having an enqueued urgent burst of RTA traffic for the AP during an ongoing R-TWT SP of which it does not have R-TWT membership, is enabled to initiate R-TWT negotiation with the scheduling AP inside the ongoing R-TWT SP to either request a temporary or a long-term membership of the current ongoing R-TWT SP or request to setup a new temporary or long-term R-TWT SP after the current SP, but before the SP it originally had membership in, or to contend for an RA-RU in the current R-TWT SP if UORA feature is enabled. Thus, a non-R-TWT member STA is granted access for its burst traffic transmissions.
    Type: Application
    Filed: November 4, 2022
    Publication date: May 18, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Xia, Mohamed Abouelseoud, Li-Hsiang Sun, Liangxiao Xin
  • Publication number: 20230139168
    Abstract: A wireless protocol CSMA/CA and scheduling SPs of a R-TWT for RTA frame exchange. In addition to link level scheduling, R-TWTs can be scheduled from an MLD level. An R-TWT scheduling MLD is configured to schedule a Multi-Link (ML) R-TWT with SP scheduled on multiple links. These ML R-TWTs can be one or more SL R-TWTs, and a ML R-TWT can be an independent R-TWT from the SL R-TWT. The R-TWT scheduling MLD can: (a) assign a unique ML level R-TWT ID to identify a ML R-TWT, and if a ML R-TWT consists of SL R-TWTs each SL R-TWT is assigned to a unique link level R-TWT ID to identify it on its link; and (b) complete ML R-TWT signaling on one link for the ML R-TWT management on multiple links.
    Type: Application
    Filed: October 24, 2022
    Publication date: May 4, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Publication number: 20230122711
    Abstract: Method and apparatus for supporting simultaneous MultiUser (MU) Multiple-Input Multiple-Output (MIMO) operations utilizing Orthogonal Frequency Division Multiple Access (OFDMA) with Uplink OFDMA Random Access (UORA). Access Points (APs) trigger and obtain short PPDUs from the stations to learn spatial filtering patterns that are utilized in adjusting antenna phase differences to obtain minimum/maximum energy from this BSR. The APs determine favored and unfavored directions of communication, which are conveyed to non-AP UORA stations as channel estimation signals. The UORA stations base broadcasting on strengths of channel estimation signals to determine eligible UORA resource units. The UORA procedure to secondary APs allows a primary AP to trigger a UL-MU MIMO transmission with the number of spatial streams exceeding the number of antennas at the primary AP.
    Type: Application
    Filed: September 29, 2022
    Publication date: April 20, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Li-Hsiang Sun, Mohamed Abouelseoud, Liangxiao Xin, Qing Xia