Abstract: Providing an online music experience, including: a music venue system; a game device; wherein a game processor uses game data to provide a mini-game experience and present the mini-game experience through a display, wherein the game processor uses venue data to modify the mini-game experience and present the modified mini-game experience through the display, wherein the game processor receives user input and sends gameplay, wherein a system processor uses music data, video data, and the gameplay data to create a data representation of a music performance, wherein the system processor sends the data representation of the music performance to the game device, and wherein the game processor uses the data representation of the music performance to present the music performance through the display.

Abstract: Ways to simplify connectivity data for patches are described herein. The patches are generated considering the high-resolution mesh information. The connectivity data is simplified at the patch level, while the geometry image is still preserved. For the connectivity simplification, only triangles inside the patch are simplified. If the border is still preserved, the reconstruction in 3D will not suffer from artifacts. The high-resolution geometry image can be used to reverse the simplification and improve the connectivity at the decoder side. Three embodiments of patch mesh simplification are described: quadric error edge collapse, border distance edge collapse, and border triangles only.

Abstract: An electronic device is provided that determines initial three-dimensional (3D) coordinates of a lighting device. The electronic device controls an emission of light from the lighting device based on control signals. The emitted light includes at least one of a pattern of alternating light pulses or a continuous light pulse. The electronic device controls a plurality of imaging devices to capture a first plurality of images that include information about the emitted light. Based on the determined initial 3D coordinates and the information about the emitted light included in the first plurality of images, the electronic device estimates a plurality of rotation values and a plurality of translation values of each imaging device. Based on the plurality of rotation values and the plurality of translation values, the electronic device applies a simultaneous localization and mapping process for each imaging device, for spatial synchronization of the plurality of imaging devices.

Abstract: Systems and methods are used to adapt the coefficients of a proportional-integral-derivative (PID) controller through reinforcement learning. The approach for adapting PID coefficients can include an outer loop of reinforcement learning where the PID coefficients are tuned to changes in the environment and an inner loop of PID control for quickly reacting to changing errors. The outer loop can learn and adapt as the environment changes and be configured to only run at a predetermined frequency, after a given number of steps. The outer loop can use summary statistics about the error terms and any other information sensed about the environment to calculate an observation. This observation can be used to evaluate the next action, for example, by feeding it into a neural network representing the policy. The resulting action is the coefficients of the PID controller and the tunable parameters of things such as the filters.

Abstract: A method for predefining an entryway, corresponding to a real entryway, for an object entering or leaving an extended reality (XR) space contained within a real environment includes: accessing a spatial mapping mesh (SMM) for the real environment, and a sealed space mesh (SSM) for the XR space; analyzing polygons in the SMM and SSM to identify first subsets representing real boundary walls and virtual wall boundaries respectively; filtering the first subsets according to first criteria to yield second subsets; colliding polygons across the second subsets to yield a third subset of SSM polygons; defining groups of connected SSM polygons within the third subset based on proximity; and selecting one group as defining the entryway. The entryway is predefined in advance of user interaction with any virtual elements in the XR space.

Abstract: A method for removing extraneous content in a first plurality of images, captured at a corresponding plurality of poses and a corresponding first plurality of times, by a first drone, of a scene in which a second drone is present includes the following steps, for each of the first plurality of captured images. The first drone predicts a 3D position of the second drone at a time of capture of that image. The first drone defines, in an image plane corresponding to that captured image, a region of interest (ROI) including a projection of the predicted 3D position of the second drone at a time of capture of that image. A drone mask for the second drone is generated, and then applied to the defined ROI, to generate an output image free of extraneous content contributed by the second drone.

Abstract: Managing access to digital content in a virtual environment using virtual content rights, including: providing a virtual content rights database comprising data associating a user of the virtual environment with the virtual content rights acquired with respect to the digital content; receiving, at a processor, a request from a device of the user for assignment of the virtual content rights of the digital content, wherein the user uses the device to interface with the processor; updating the virtual content rights database to indicate the assignment of the virtual content rights to the user; receiving, at the processor, data from the device of the user holding the virtual content rights to digital content including songs to create a virtual user-configured music room having at least one of the songs; and updating the virtual content rights database to indicate sharing of the virtual user-configured music room by the user within the virtual environment.

Abstract: Present TID-to-link (T2L) mapping is limited in to only mapping the UL and/or DL direction. Mechanisms are taught for providing T2L mapping for TDLS link, while R-TWT features can be extended to setup R-TWT membership on a TDLS link. Using the T2L mapping for a TDLS link, different traffic with different priorities can be differentiated and directed on different TDLS direct links to reduce interference on any single link and to allocate the RTA traffic to channels which have wider bandwidths and less traffic congestion.

Abstract: Wireless protocol enhancements are provided for allowing inter-BSS stations/APs to support, negotiate and participate in cooperative R-TWT SPs that are overlapped in time and are scheduled on different links or different channels to avoid the inter-BSS interference of prioritized traffic that has been scheduled to transmitted during the corresponding R-TWT SPs. The protocol makes use of new subfield elements toward informing, negotiating and supporting the cooperative R-TWT SPs.

Abstract: A framework that includes a feature extractor and a cluster component for clustering is described herein. The framework supports (1) offline image-based unsupervised clustering that replaces time-consuming manual gating; (2) online image-based single cell sorting. During training, one or multiple cell image datasets with or without ground truth are used to train feature extractor, which is based on a neural network including several convolutional layers. Once trained, the feature extractor is used to extract features of cell images for unsupervised cell clustering and sorting. In addition, additional datasets may be used to further refine the feature extractor after it has been trained.

Abstract: A wireless local area network (WLAN) protocol allowing a Transmit Opportunity (TXOP) holder, whether its an AP or non-AP STA, to share the TXOP with other stations, that are either AP or non-AP STAs. An intent to share the TXOP is communicated by the TXOP holder either directly or indirectly with other STAs and/or AP, after which scheduling information (time and duration) are shared with the STAs and/or AP. When the TXOP occurs, the STAs and/or AP can access the channel at the time and for the duration specified, thus providing increased use of the TXOP to improve efficiency.

Abstract: An efficient and robust high-speed neural networks for cell image classification is described herein. The neural networks for cell image classification utilize a difference between soft-max scores to determine if a cell is ambiguous or not. If the cell is ambiguous, then the class is classified in a pseudo class, and if the cell is not ambiguous, the cell is classified in the class corresponding to the highest class score. The neural networks for cell image classification enable a high speed, high accuracy and high recall implementation.

Abstract: Implementations generally recognize clinical activity using multiple cameras. In some implementations, a method includes obtaining a plurality of videos of a plurality of objects in an environment. The method further includes determining one or more key points for each object of the plurality of objects. The method further includes recognizing activity information based on the one or more key points. The method further includes computing workflow information based on the activity information.

Abstract: A method for automatically estimating cellularity in a digital pathology slide image includes: extracting patches of interest from the digital pathology slide image; operating on each patch using a trained first deep convolutional neural network (DCNN) to classify that patch as either normal, having an estimated cellularity of 0%, or suspect, having a cellularity roughly estimated to be greater than 0%; operating on each suspect patch using a second DCNN, trained using a deep ordinal regression model, to determine an estimated cellularity score for that suspect patch; and combining the estimated cellularity scores of the patches of interest to provide an estimated cellularity for the digital pathology slide image at a patch-by-patch level.

Abstract: An integrated photo-video volumetric capture system for 3D/4D scanning acquires 3D scans and 4D scans by acquiring images and videos simultaneously. The volumetric capture system for high-quality 4D scanning and mesh-tracking is used to establish topology correspondences across a 4D scanned mesh sequence for generating corrective shapes which will be used in shape interpolation and skeleton driven deformation. The volumetric capture system aids mesh-tracking for maintaining mesh registration (topology consistency) along with ease of extreme pose modeling. Major upper body and lower body joints are able to be identified that are important for generating deformation and capturing the same using a wide range of motion for all movement types across all joint categories. By using the volumetric capture system and mesh tracking, the topology changes are tracked. Each pose captured will have the same topology which makes blending between multiple poses easier and more accurate.

Abstract: A Central Unit (CU) is connected to multiple Remote Radio Heads (RRHs) over a backhaul. The spatial separation of units creates long round-trip times, which are addressed in the present disclosure. The enhanced operation allows for counting down a BackOff (BO) on either the RRH side or on the CU side. RRHs that perform the BO procedure can resolve the issue of insufficient InterFrame Space (IFS) time for the RRH to obtain Data from the CU and to invoke a BO. In addition, RRHs that perform the BO procedures are able to reduce channel access contention when multiple RRHs are performing BOs, while utilization efficiency for the medium can also be increased by the improved synchronization of BO and Clear Channel Assessment (CCA) status between the CU and RRHs.

Abstract: A method of 3D motion reconstruction of outdoor, highly flexible moving subjects with multiple cameras on drones is described herein. A multi-drone capturing system is used to remove the restriction of a dedicated virtual reality shooting place, “the hot seat,” so that the actor/target is able to perform agile or long-distance activities outdoor. The subject's 3D pose parameters are estimated by the captured multi-view images by the drones, and the sequence of poses becomes the motion in time to control the animation of a pre-built 3D model. The method is able to be directly integrated into an existing Virtual Reality/Augmented reality (VR/AR) production chain, and the subject is able to be extended to animals that are difficult to be contained in a VR camera mesh space.

Abstract: An image-based classification workflow uses unsupervised clustering to help a user identify subpopulations of interest for sorting. Labeled cell images are used to fine-tune the supervised classification network for a specific experiment. The workflow allows the user to select the populations to sort in the same manner for a variety of applications. The supervised classification network is very fast, allowing it to make real-time sort decisions as the cell travels through a device. The workflow is more automated and has fewer user steps, which improves the ease of use. The workflow uses machine learning to avoid human error and bias from manual gating. The workflow does not require the user to be an expert in image processing, thus increasing the ease of use.

Abstract: A neural human performance capture framework (MVS-PERF) captures the skeleton, body shape and clothes displacement, and appearance of a person from a set of calibrated multiview images. It addresses the ambiguity of predicting the absolute position in monocular human mesh recovery, and bridges the volumetric representation from NeRF to animation-friendly performance capture. MVS-PERF includes three modules to extract feature maps from multiview images and fuse them to a feature volume, regress the feature volume to a naked human parameters vector, generating an SMPL-X skin-tight body mesh with a skeletal pose, body shape, and expression, and leverage a neural radiance field and a deformation field to infer the clothes as the displacement on the naked body using differentiable rendering. Clothed body mesh is obtained by adding the interpolated displacement vectors to the SMPL-X skin-tight body mesh vertices. The obtained radiance field is used for free-view volumetric rendering of the input subject.

Abstract: A wireless local area network (WLAN) protocol having a non-zero backoff procedure which is bounded by setting a backoff counter to a random value greater than or equal to at least one backoff slot in starting to contend for a channel. This is preferably utilized in combination with setting the Arbitration Inter-Frame Spacing (AIFS) time to an amount less than that utilized for a legacy backoff. The parameters controlling the non-zero backoff may be set by the station performing the contention, or by an associated Access Point (AP), or in response to negotiation between the station and the AP. In some cases the station can switch between enabling and disabling the non-zero backoff procedure during different periods of time.