Patents Assigned to Sony Corporation of America
-
Publication number: 20230117842Abstract: A buffer status reporting mechanism, such as within a buffer status request poll (BSRP), in which the Access Point (AP) communicates the specific type of information that the non-AP station (STA) is to communicate back, such as within a buffer status report (BSR), about the buffers. The AP specified requirements for the BSR being characteristics of: access categories (ACs), traffic identifiers (TIDs), traffic streams, traffic directions, and/or types of traffic and quality of service (QoS) requirements which allow the AP to properly arrange transmissions to satisfy QoS requirements.Type: ApplicationFiled: September 29, 2022Publication date: April 20, 2023Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
-
Publication number: 20230110506Abstract: A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.Type: ApplicationFiled: September 28, 2021Publication date: April 13, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Patent number: 11617949Abstract: A method predefines a virtual staircase connecting real platforms in an XR space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record from the SMM of available surfaces; identifying available platforms provided by the physical elements and available open spaces therebetween; selecting a first platform at a first level and a second platform at a significantly lower level; selecting a staircase start location at a first edge of the first platform, partly based on predetermined criteria; stacking virtual blocks linearly to form a virtual staircase, with a first virtual block contacting and extending outwards from the first platform, and a last virtual block contacting the second platform at a staircase end location; and performing a collision analysis. If the staircase end location satisfies the predetermined criteria, and if no collisions are detected, the current virtual staircase is displayed in subsequent user interactions with the XR space.Type: GrantFiled: September 28, 2021Date of Patent: April 4, 2023Assignees: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230097571Abstract: A method for quasi-random placement of a virtual item in an XR space includes: accessing a previously generated spatial mapping mesh (SMM) of the XR space; compiling a record from the SMM of open spaces between surfaces of physical elements in the XR space, with corresponding positions and dimensions; selecting from the open spaces: a spawn position for a virtual character, and a random set of other positions, filtering the random set to form a subset. The method then performs a collision analysis to assign a score to each position in the subset partly based on accessibility to that position for the virtual character beginning from the spawn position; and places the virtual item at a position in the subset having a score as high or higher than all other positions in the subset. The method is carried out before user interaction with any virtual element in the XR space.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230099016Abstract: A method to generate an appropriate reaction, by an NPC in an XR game, to a significant event in the game includes: compiling a record from a previously generated SMM of surfaces in the XR space, categorizing the surfaces; after the game begins, tracking in real time physical surroundings of the NPC, allowing 3D positions of the NPC relative to nearby physical surfaces to be continuously determined; and events occurring in the game, allowing detection of any event deemed to be significant. For each detected event deemed significant, occurring at a corresponding event time, an appropriate action is determined for the NPC to carry out in response, partly based on whether the NPC is positioned close to a physical surface at the event time, and the NPC is directed to carry out the appropriate action.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230096913Abstract: A method for regulating falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game includes compiling a record from a previously generated spatial mapping mesh (SMM) of the XR space of surfaces of real elements present in that space, with corresponding positions and dimensions; and, after the game begins, determining whether, if the character approaches a substantially vertical gap between an edge of a first surface at a first level and a second surface, at a second level lower than the first level, continuing motion of the character to fall through the vertical gap will be permitted or prevented. A similar method for regulating jumps rather than falls of a user-controlled character through gaps between surfaces in an extended reality (XR) space in which the user is playing a game is also described.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230096959Abstract: A method for predefining an entryway, corresponding to a real entryway, for an object entering or leaving an extended reality (XR) space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing real boundary walls and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset based on proximity; and selecting one group as defining the entryway. The entryway is predefined in advance of user interaction with any virtual elements in the XR space.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230102270Abstract: A method for predefining an entryway at a virtual boundary of an XR space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing vertical surfaces and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset; and selecting one group as defining the entryway. The defining of the entryway is carried out in advance of user interaction with any virtual elements in the XR environment.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230103166Abstract: A method predefines a virtual staircase connecting real platforms in an XR space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record from the SMM of available surfaces; identifying available platforms provided by the physical elements and available open spaces therebetween; selecting a first platform at a first level and a second platform at a significantly lower level; selecting a staircase start location at a first edge of the first platform, partly based on predetermined criteria; stacking virtual blocks linearly to form a virtual staircase, with a first virtual block contacting and extending outwards from the first platform, and a last virtual block contacting the second platform at a staircase end location; and performing a collision analysis. If the staircase end location satisfies the predetermined criteria, and if no collisions are detected, the current virtual staircase is displayed in subsequent user interactions with the XR space.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230101913Abstract: A method for providing a user with an improved understanding of an XR space in which the user is playing a video game includes: continuously tracking a user-controlled character in the video game; accessing a previously generated spatial mapping mesh (SMM) of surfaces of real elements present in the XR space, with corresponding positions and dimensions; analyzing information from the SMM on one or more real surfaces within a predetermined distance of the user-controlled character; carrying out an action based on a tracked position of the user-controlled character and, at least in part, on a result of the analysis; and making a consequence of the action visible to the user.Type: ApplicationFiled: September 28, 2021Publication date: March 30, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Patent number: 11612817Abstract: A method predefines activity zones in an extended reality (XR) space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record of all exposed surfaces of the physical elements in the XR space, with positions, dimensions, and categories; for each recorded surface, performing a collision analysis at representative positions around its perimeter to determine an available adjacent open space; filter determined open spaces according to one or more predetermined criteria to determine one or more activity zones at corresponding locations; and assigning each activity zone to an activity category based in part on the categorization of the available adjacent surface or surfaces. The method is carried out in advance of user interaction with any virtual element in the XR space.Type: GrantFiled: September 28, 2021Date of Patent: March 28, 2023Assignees: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230081745Abstract: A wireless local area network (WLAN) having stations (STAs) using Carrier Sense Multiple Access/Collision Avoidance (CSMA/CA) in which at least some stations support Full Duplex (FD) transmission. Mechanisms are described in which a STA can send a preemption request to a station performing ongoing transmissions. The preempted STA detects a preemption request of this preempting STA. The preempted STA interrupts its ongoing transmission; if it has determined to accept the preemption request. Thus, the preempting STA preempts the transmission of the preempted STA, to send a preemptive transmission, after receiving notification that the preempted STA has interrupted its ongoing transmission.Type: ApplicationFiled: August 17, 2022Publication date: March 16, 2023Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
-
Publication number: 20230070940Abstract: A preamble-based collision detection mechanism for use in wireless local area networks (WLANS), having one or more full-duplex (FD) stations. In addition, a new collision resolution estimation and scheduling mechanism is described for prioritized communication. These techniques can allow for more rapid collision detection and resolution, without the need of performing self-interference (SI) estimation. The techniques includes use of orthogonal preambles, in the time domain and/or frequency domain, into which FD stations embed priority information.Type: ApplicationFiled: August 11, 2022Publication date: March 9, 2023Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Qing Xia, Li-Hsiang Sun, Mohamed Abouelseoud, Liangxiao Xin
-
Patent number: 11596866Abstract: A method to generate an appropriate reaction, by an NPC in an XR game, to a significant event in the game includes: compiling a record from a previously generated SMM of surfaces in the XR space, categorizing the surfaces; after the game begins, tracking in real time physical surroundings of the NPC, allowing 3D positions of the NPC relative to nearby physical surfaces to be continuously determined; and events occurring in the game, allowing detection of any event deemed to be significant. For each detected event deemed significant, occurring at a corresponding event time, an appropriate action is determined for the NPC to carry out in response, partly based on whether the NPC is positioned close to a physical surface at the event time, and the NPC is directed to carry out the appropriate action.Type: GrantFiled: September 28, 2021Date of Patent: March 7, 2023Assignees: Sony Group Corporation, Sony Corporation of AmericaInventors: Robert M. McCain, Tsubasa Tsukahara
-
Publication number: 20230058871Abstract: An IEEE 802.11 protocol in which the necessity and issues surrounding separately setting up SCS and reserving target wait time (R-TWT) are eliminated. In the present disclosure new data structures and processes are performed in which a station (STA) can request scheduling R-TWT for the traffic transmission of a stream classification service (SCS) during the setup procedure of that SCS. In using the teachings of the present disclosure, a STA can exchange a TWT setup frame on one link to schedule R-TWT on multiple links.Type: ApplicationFiled: July 21, 2022Publication date: February 23, 2023Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
-
WIRELESS LOCAL AREA NETWORK FULL-DUPLEX ENHANCEMENTS FOR SCENARIOS WITH MULTIPLE ACCESS-POINTS / BSS
Publication number: 20230055895Abstract: Full-duplex (FD) enhancements for three scenarios with multiple APs/BSSs. (1) Multiple-AP joint transmissions on a WLAN. Toward eliminating self-interferences and other issues, certain pilot signals in the PPDU are transmitted only by the primary AP. One or more secondary APs participating in the joint transmission receive the pilots to correct their clock in the following symbols. (2) Communications are performed with extended OFDM symbols sent on a second channel which facilitate NAV decoding for stations transmitting on a first channel. (3) More than one AP can perform a joint Ack/BA to a UL PPDU. The secondary AP may utilize its full duplex capability to determine the difference of receiving status between itself and the primary AP, and forward data to the primary which it had not received.Type: ApplicationFiled: July 22, 2022Publication date: February 23, 2023Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Li-Hsiang Sun, Mohamed Abouelseoud, Liangxiao Xin, Qing Xia -
Publication number: 20230047705Abstract: A wireless communication protocol using CSMA/CA, EDCA and R-TWT to prioritize RTA traffic transmissions. During an R-TWT SP, the RTA traffic is prioritized for transmission and mechanisms are provided for assuring proper indications and termination of the R-TWT SP. During this process, member STAs communicate with the R-TWT scheduling AP when they have no more frames to send. The R-TWT scheduling AP can also terminate the R-TWT SP before its scheduled end time, allowing non-member STAs to immediately contend for the channel. In addition, the R-TWT scheduling AP can exchange frames with STAs, that have an R-TWT feature but are not R-TWT member STAs, after frame exchanges with the R-TWT member STAs during the R-TWT SP have been completed.Type: ApplicationFiled: June 20, 2022Publication date: February 16, 2023Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Liangxiao Xin, Li-Hsiang Sun, Qing Xia, Mohamed Abouelseoud
-
Publication number: 20230050992Abstract: Implementations generally perform robust multi-view multi-target action recognition using reconstructed 3-dimensional (3D) poses. In some implementations, a method includes obtaining a plurality of videos of a plurality of subjects in an environment, where at least one target subject of the plurality of subjects performs one or more actions in the environment. The method further includes tracking the at least one target subject across at least two cameras. The method further includes reconstructing a 3-dimensional (3D) model of the at least one target subject based on the plurality of videos and the tracking of the at least one target subject. The method further includes recognizing the one or more actions of the at least one target subject based on the reconstructing of the 3D model.Type: ApplicationFiled: December 22, 2021Publication date: February 16, 2023Applicants: Sony Group Corporation, Sony Corporation of AmericaInventors: Wanxin Xu, Ko-Kai Albert Huang
-
Publication number: 20230029957Abstract: A wireless communications protocol in which multiple-link operations provide enhanced efficiency in particular for non-simultaneous transmit receive (NSTR) communications between stations (STAs) of multiple-link devices (MLDs). When MLD1 is the TXOP holder of Link1 and the channel is accessed on Link2 by MLD2 for transmitting to MLD1; MLD2 immediately transmits over Link2 to MLD1, if MLD1 is receiving on Link1. MLD2 transmits a frame over Link2 to occupy the channel if MLD1 is transmitting on Link1, then when MLD1 is receiving on Link1 then MLD2 transmits another frame to MLD1.Type: ApplicationFiled: June 23, 2022Publication date: February 2, 2023Applicants: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Liangxiao Xin, Mohamed Abouelseoud, Li-Hsiang Sun, Qing Xia
-
Patent number: 11557086Abstract: An electronic device and method for 3D modeling based on 2D warping is disclosed. The electronic device acquires a color image of a face of a user, depth information corresponding to the color image, and a point cloud of the face. A 3D mean-shape model of a reference 3D face is acquired, and rigid aligned with the point cloud. A 2D projection of the aligned 3D mean-shape model is generated. The 2D projection includes a set of landmark points associated with the aligned 3D mean-shape model. The 2D projection is warped such that the set of landmark points in the 2D projection is aligned with a corresponding set of feature points in the color image. A 3D correspondence between the aligned 3D mean-shape model and the point cloud is determined for a non-rigid alignment of the aligned 3D mean-shape model, based on the warped 2D projection and the depth information.Type: GrantFiled: December 17, 2020Date of Patent: January 17, 2023Assignees: SONY GROUP CORPORATION, SONY CORPORATION OF AMERICAInventors: Jie Hu, Mohammad Gharavi-Alkhansari