Patents Assigned to Sony Corporation of America
  • Patent number: 12033281
    Abstract: An integrated photo-video volumetric capture system for 3D/4D scanning acquires 3D scans and 4D scans by acquiring images and videos simultaneously. The volumetric capture system for high-quality 4D scanning and mesh-tracking is used to establish topology correspondences across a 4D scanned mesh sequence for generating corrective shapes which will be used in shape interpolation and skeleton driven deformation. The volumetric capture system aids mesh-tracking for maintaining mesh registration (topology consistency) along with ease of extreme pose modeling. Major upper body and lower body joints are able to be identified that are important for generating deformation and capturing the same using a wide range of motion for all movement types across all joint categories. By using the volumetric capture system and mesh tracking, the topology changes are tracked. Each pose captured will have the same topology which makes blending between multiple poses easier and more accurate.
    Type: Grant
    Filed: March 29, 2022
    Date of Patent: July 9, 2024
    Assignees: SONY GROUP CORPORATION, Sony Corporation of America
    Inventors: Suren Deepak Rajasekaran, Hiroyuki Takeda, Kenji Tashiro
  • Publication number: 20240224323
    Abstract: A Central Unit (CU) is connected to multiple Remote Radio Heads (RRHs) over a backhaul. The spatial separation of units creates long round-trip times, which are addressed in the present disclosure. The enhanced operation allows for counting down a BackOff (BO) on either the RRH side or on the CU side. RRHs that perform the BO procedure can resolve the issue of insufficient InterFrame Space (IFS) time for the RRH to obtain Data from the CU and to invoke a BO. In addition, RRHs that perform the BO procedures are able to reduce channel access contention when multiple RRHs are performing BOs, while utilization efficiency for the medium can also be increased by the improved synchronization of BO and Clear Channel Assessment (CCA) status between the CU and RRHs.
    Type: Application
    Filed: October 31, 2023
    Publication date: July 4, 2024
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventor: Qing Xia
  • Patent number: 12026917
    Abstract: A method of 3D motion reconstruction of outdoor, highly flexible moving subjects with multiple cameras on drones is described herein. A multi-drone capturing system is used to remove the restriction of a dedicated virtual reality shooting place, “the hot seat,” so that the actor/target is able to perform agile or long-distance activities outdoor. The subject's 3D pose parameters are estimated by the captured multi-view images by the drones, and the sequence of poses becomes the motion in time to control the animation of a pre-built 3D model. The method is able to be directly integrated into an existing Virtual Reality/Augmented reality (VR/AR) production chain, and the subject is able to be extended to animals that are difficult to be contained in a VR camera mesh space.
    Type: Grant
    Filed: March 23, 2022
    Date of Patent: July 2, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Alexander Berestov, Cheng-Yi Liu
  • Patent number: 12008825
    Abstract: An image-based classification workflow uses unsupervised clustering to help a user identify subpopulations of interest for sorting. Labeled cell images are used to fine-tune the supervised classification network for a specific experiment. The workflow allows the user to select the populations to sort in the same manner for a variety of applications. The supervised classification network is very fast, allowing it to make real-time sort decisions as the cell travels through a device. The workflow is more automated and has fewer user steps, which improves the ease of use. The workflow uses machine learning to avoid human error and bias from manual gating. The workflow does not require the user to be an expert in image processing, thus increasing the ease of use.
    Type: Grant
    Filed: November 19, 2021
    Date of Patent: June 11, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Ming-Chang Liu, Michael Zordan, Ko-Kai Albert Huang, Su-Hui Chiang, Liyu Gong
  • Patent number: 11961266
    Abstract: A neural human performance capture framework (MVS-PERF) captures the skeleton, body shape and clothes displacement, and appearance of a person from a set of calibrated multiview images. It addresses the ambiguity of predicting the absolute position in monocular human mesh recovery, and bridges the volumetric representation from NeRF to animation-friendly performance capture. MVS-PERF includes three modules to extract feature maps from multiview images and fuse them to a feature volume, regress the feature volume to a naked human parameters vector, generating an SMPL-X skin-tight body mesh with a skeletal pose, body shape, and expression, and leverage a neural radiance field and a deformation field to infer the clothes as the displacement on the naked body using differentiable rendering. Clothed body mesh is obtained by adding the interpolated displacement vectors to the SMPL-X skin-tight body mesh vertices. The obtained radiance field is used for free-view volumetric rendering of the input subject.
    Type: Grant
    Filed: March 23, 2022
    Date of Patent: April 16, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Zhang, Hanyuan Xiao
  • Patent number: 11963224
    Abstract: A wireless local area network (WLAN) protocol having a non-zero backoff procedure which is bounded by setting a backoff counter to a random value greater than or equal to at least one backoff slot in starting to contend for a channel. This is preferably utilized in combination with setting the Arbitration Inter-Frame Spacing (AIFS) time to an amount less than that utilized for a legacy backoff. The parameters controlling the non-zero backoff may be set by the station performing the contention, or by an associated Access Point (AP), or in response to negotiation between the station and the AP. In some cases the station can switch between enabling and disabling the non-zero backoff procedure during different periods of time.
    Type: Grant
    Filed: October 24, 2021
    Date of Patent: April 16, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
  • Patent number: 11951399
    Abstract: Methods, systems, and computer-readable storage media for providing footprints in a computer system that provides a virtual environment, including: accessing an avatar record, where the avatar record indicates an avatar representation that includes data to provide a visual representation of an avatar; receiving a selection of a footprint; accessing a footprint record, where the footprint record includes footprint representations that include data to provide a visual representation of the selected footprint as a footprint representation; associating the footprint representation with the avatar representation; receiving avatar movement input that indicates movement of the avatar within the virtual environment; and generating visual data representing the movement of the avatar and footprints in the virtual environment using the avatar representation and the footprint representation, where the footprints are placed in the virtual environment following the avatar as the avatar moves in the virtual environment.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: April 9, 2024
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Thomas Sachson, James Marcus, Eric Benjamin Fruchter
  • Patent number: 11944905
    Abstract: A method for regulating falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game includes compiling a record from a previously generated spatial mapping mesh (SMM) of the XR space of surfaces of real elements present in that space, with corresponding positions and dimensions; and, after the game begins, determining whether, if the character approaches a substantially vertical gap between an edge of a first surface at a first level and a second surface, at a second level lower than the first level, continuing motion of the character to fall through the vertical gap will be permitted or prevented. A similar method for regulating jumps rather than falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game is also described.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: April 2, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Publication number: 20240080891
    Abstract: Protocol enhancements for IEEE 802.11 handling of Buffer Status Reports (BSRs) to provide real-time information on Quality of Service (QoS) requirements. A non-AP STA can report QoS status about portions of a buffer, which then allows the AP to schedule transmissions for those buffers toward satisfying their QoS requirements. The non-AP STA can also change parameters of the QoS characteristics element of an existing SCS to allow the AP to schedule transmission for the SCS traffic with the new parameters immediately. The non-AP STA can also report on buffers that should soon arrive to allow the AP to trigger the transmission before those buffers arrive. Additional benefits are also provided.
    Type: Application
    Filed: August 17, 2023
    Publication date: March 7, 2024
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Li-Hsiang Sun, Qing Xia
  • Patent number: 11890534
    Abstract: A method for predefining an entryway at a virtual boundary of an XR space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing vertical surfaces and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset; and selecting one group as defining the entryway. The defining of the entryway is carried out in advance of user interaction with any virtual elements in the XR environment.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: February 6, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Robert M. McCain, Tsubasa Tsukahara
  • Patent number: 11890545
    Abstract: An artificial intelligence (AI) based method for calibration of a gaming ecosystem and to maximize satisfaction of a player involved in a gaming session such as single-player gaming session, multi-player online gaming session, and a videogame recommendation system is provided. The system detects the gaming session that includes an execution of a video game for a first gameplay and acquires sensor data associated with a player involved in the first gameplay. The sensor data corresponds to a duration of the detected gaming session. The system determines one or more indicators of a dissatisfaction of the player with the first gameplay based on application of one or more Artificial Intelligence (AI) models on the sensor data. The system controls the execution of the video game to modify one or more aspects associated with the first gameplay or a second gameplay of the video game that is different from the first gameplay.
    Type: Grant
    Filed: February 14, 2022
    Date of Patent: February 6, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Alexandre Zaghetto, Ali Tabatabai, Danillo B Graziosi
  • Patent number: 11889556
    Abstract: A communication circuit and protocol for a wireless local area network (WLAN) using CSMA/CA and single EDCA and/or Multiple-User (MU) EDCA. EDCA functions are configured to operate with multiple sets of operating parameters providing a range of priority levels for altering on the fly the nominal access time for a STA sending prioritized packets. The STA then must switch to a lower-priority set of parameters as recompense so that channel usage remains fair.
    Type: Grant
    Filed: September 8, 2021
    Date of Patent: January 30, 2024
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Mohamed Abouelseoud
  • Publication number: 20240031670
    Abstract: An apparatus includes one or more processors and logic encoded in one or more non-transitory media for execution by the one or more processors and when executed operable to receive sensor data from a drone that travels around a target object. The logic is further operable to generate, based on the sensor data, a first three-dimensional (3D) reconstruction of the target object. The logic is further operable to estimate a direction of sunlight and a direction of spectral reflection. The logic is further operable to plan a trajectory of sensor capturing positions for the drone to capture images of the target object that reduce an amount of sunlight and an amount of specular reflection.
    Type: Application
    Filed: July 22, 2022
    Publication date: January 25, 2024
    Applicants: Sony Group Corporation, Sony Corporation of America
    Inventor: Cheng-Yi Liu
  • Publication number: 20240008081
    Abstract: A wireless protocol allowing an AP to allocate time within a transmit opportunity (TXOP) to non-AP stations. The allocations are made under condition that the non-AP STA(s) will satisfy Access Class (AC) requirements communicated in a frame sent by the AP STA, such as within an MU RTS TXS Trigger frame. Upon receiving the frame, the non-AP responds on whether it can meet the conditions, such as within a Clear-To-Send (CTS) message. If the non-AP can meet the conditions, then it proceeds to transmit data (to the AP, or a peer non-AP). Otherwise, if it cannot meet the conditions, then the AP can communicate the allocation to another non-AP STA. There are also conditions for how the non-AP can aggregate data units into A-MSDUs.
    Type: Application
    Filed: May 16, 2023
    Publication date: January 4, 2024
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Xia, Li-Hsiang Sun, Liangxiao Xin
  • Publication number: 20240007852
    Abstract: Using this described protocol an AP can control multiple STAs to allow them to utilize the same scrambling seed to scramble the data in identical data units being sent on the wireless network. The AP sends a scrambling seed indication within a frame communicated to other STAs on the network. These other STAs, then use this scrambling seed indication to scramble a data field of a data unit with an identical scrambling seed, and to transmit these packets using the same modulation and coding scheme (MCS).
    Type: Application
    Filed: May 24, 2023
    Publication date: January 4, 2024
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Li-Hsiang Sun, Qing Xia
  • Publication number: 20240007860
    Abstract: Enhanced wireless protocols are described for stations (STAs) which are associated with Multiple-Link Devices (MLD). One embodiment describes overcoming replay attacks (with or without a modified Sequence Number (SN) even when protected by a Group Temporal Key (GTK) or similar. Other embodiments describe MLP operating enhancements associated with utilizing a Robust Security Network Element (RSNE), or NSTR Mobile AP MLD, or Target Beacon Transmission Time (TBTT) Information fields with Reduced Neighbor Reports (RNR), or Quiet Channel elements in an Association/Reassociation, or that use PPDU end alignment are all subject to specific shortcomings when applied to MLDs.
    Type: Application
    Filed: June 7, 2023
    Publication date: January 4, 2024
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Li-Hsiang Sun, Liangxiao Xin, Qing Xia
  • Publication number: 20240008086
    Abstract: Methods are described for overcoming contention issues during R-TWT SPs. In particular, enhanced mechanisms are defined in prioritizing transmissions of R-TWT TIDs during corresponding R-TWT SPs. In addition, enhanced access mechanisms are described for overcoming issues with stations accessing the channel after sensing an idle channel after a DIFS or AIFS time period.
    Type: Application
    Filed: June 8, 2023
    Publication date: January 4, 2024
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Li-Hsiang Sun, Qing Xia
  • Patent number: 11856606
    Abstract: A wireless local area network (WLAN) protocol allowing a Transmit Opportunity (TXOP) holder to share the TXOP with other stations (STAs) residing in either the same Basic Service Set (BSS) of the TXOP holder, or in an other BSS (OBSS). An intent to share the TXOP is communicated to the Access Point (AP), and/or directly to other STAs. Scheduling information (time and duration) are shared with the STAs either directly, or through one or more APs. When the TXOP occurs, the STAs can access the channel at the time and for the duration specified, thus providing increased use of the TXOP to improve efficiency.
    Type: Grant
    Filed: July 31, 2021
    Date of Patent: December 26, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Xia, Mohamed Abouelseoud, Liangxiao Xin
  • Publication number: 20230403741
    Abstract: An enhanced protocol for addressing communication issues arising from using a Remote Radio Head (RRH). An Access Point (AP), denoted as Remote Radio Head (RRH) AP, consists of a Central Unit (CU) and at least one RRH that can be located remotely. The functionalities of the Medium Access Control (MAC) and the Physical (PHY) layers of the RRH AP are split between the CU and RRH; with the CU exchanging frames between the MAC layers, and the RRH transmitting and receiving the physical signals through the channel.
    Type: Application
    Filed: May 16, 2023
    Publication date: December 14, 2023
    Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Liangxiao Xin, Li-Hsiang Sun, Qing Xia
  • Patent number: 11838957
    Abstract: Enhanced Multi-Link Operation (MLO) is performed in this protocol in which non-simultaneous transmit/receive (NSTR) Multi-Link Devices (MLDs) cooperate with each other in sharing a portion of their available Transmit Opportunity (TXOP) toward reducing contention and competition for channel access across the group of cooperating MLDs. The shared TXOP is performed at an MLD level after all links for an NSTR MLD are obtained by stations which do not need to be in part of the same NSTR MLD, thus synchronized transmissions and receptions are performed which eliminate in-device coexistence (IDC) interference in any single NSTR MLD. The time gap while awaiting for all links to be obtained, is also made use of for performing transmission(s) toward increasing data throughput.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: December 5, 2023
    Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICA
    Inventors: Qing Xia, Mohamed Abouelseoud, Liangxiao Xin