Abstract: Systems and methods are provided herein for streaming immersive content to a device. This may be accomplished by a system displaying a piece of media on a display in a first format and determining that the piece of media is approaching a segment of the piece of media that is available in a second format (e.g., light field content). In response to determining that the upcoming segment is available in the second format, the system can use one or more sensors to determine a position of a user in relation to the display. The system can then send a request for the piece of media in the second format, wherein the request comprises the position of the user. The system can then receive and display the segment of the piece of media in the second format, wherein the segment is customized according to the position of the user.

Abstract: Systems and methods for bandwidth-adaptive light field video transmission on mobile and portable devices is disclosed. An upstream bandwidth is estimated. A request for a service tier for capture and transmission of light field content is received, wherein the light field content comprises an image array of a plurality of sub-aperture images. When the requested service tier is greater than the estimated upstream bandwidth, a reduced service tier is determined based on the estimated upstream bandwidth. A number of sub-aperture images comprising a reduced image array is determined based on the reduced service tier. The image array is reduced to the reduced image array based on feature saliency and adjacency of sub-aperture images. Resources corresponding to the reduced service tier are provided for capture and transmission of the reduced image array.

Abstract: Systems and methods are described for selecting a 3D object for display in an extended reality environment. A space in an extended reality environment is determined for placement of a 3D object. A set of space parameters are determined comprising: an amount of memory available for generating the display of the extended reality environment and an amount of computing power available for generating the display of the extended reality environment. The 3D object is selected for display in the space based on the amount of memory and the amount of computing power available.

Abstract: Systems and methods are provided for dynamically adjusting a personal boundary of an avatar in an XR environment. The system identifies a first avatar in an extended reality (XR) environment based on rule data stored in a storage. In response to the system detecting that the first avatar has entered a portion of the XR environment at a communicable distance from a second avatar, the system does the following steps. The system determines an offensiveness rating of the first avatar. The system retrieves, from the storage, an offensiveness tolerance of the second avatar. The system compares the offensiveness rating of the first avatar and offensiveness tolerance of the second avatar. In response to determining, based on the comparing, that the offensiveness rating of the first avatar exceeds the offensiveness tolerance of the second avatar, the system automatically censors one or more messages from the first avatar to the second avatar.

Abstract: Systems and methods for obtaining metrics relating to an extended reality experience and using the obtained metrics to perform remedial actions, such as managing user motion sickness, determining user performance relating to a designed game difficulty, and performing home automation are disclosed. The methods include determining a starting and ending checkpoint in an extended reality experience. Data from a plurality of users as they navigate between the determined checkpoints is obtained and used to determine a metric, such as a median, average, or other representative data. The current user's navigation through the same checkpoints is monitored and compared with the metric. The results from the comparison are used to enhance extended reality experience, which includes customizing the experience for motion sickness, game difficulty level, and home automation.

Abstract: Systems and methods for obtaining metrics relating to an extended reality experience and using the obtained metrics to perform remedial actions, such as managing user motion sickness, determining user performance relating to a designed game difficulty, and performing home automation are disclosed. The methods include determining a starting and ending checkpoint in an extended reality experience. Data from a plurality of users as they navigate between the determined checkpoints is obtained and used to determine a metric, such as a median, average, or other representative data. The current user's navigation through the same checkpoints is monitored and compared with the metric. The results from the comparison are used to enhance extended reality experience, which includes customizing the experience for motion sickness, game difficulty level, and home automation.

Abstract: Systems and methods for obtaining metrics relating to an extended reality experience and using the obtained metrics to perform remedial actions, such as managing user motion sickness, determining user performance relating to a designed game difficulty, and performing home automation are disclosed. The methods include determining a starting and ending checkpoint in an extended reality experience. Data from a plurality of users as they navigate between the determined checkpoints is obtained and used to determine a metric, such as a median, average, or other representative data. The current user's navigation through the same checkpoints is monitored and compared with the metric. The results from the comparison are used to enhance extended reality experience, which includes customizing the experience for motion sickness, game difficulty level, and home automation.

Abstract: Systems and methods for generating a CAPTCHA challenge in a virtual environment are disclosed. The methods display a spatially anchored virtual 3D object in a virtual environment where certain features of the 3D object are hidden or occluded. The methods provide general, specific, or no instructions to a user for manipulating the displayed 3D virtual object. Upon determining that the manipulations performed follow the instructions, the occluded feature is revealed. Varying degrees of CAPTCHA challenges are provided that include moving real life objects, leveraging user background in generating customized CAPTCHA challenges, and camouflaging the virtual objects to make solving the CAPTCHA more challenging. The methods query the user to provide an input that reflects the revealed occluded feature, and, if the response to the query meets the predetermined response, access to the secured data requested in granted.

Abstract: Data describing broadband internet usage is collected from a user equipment device associated with each respective user account. The data are then input into a machine learning model that is trained on broadband internet usage data of a plurality of user accounts in a single geographic area. An n-dimensional metric for each user account is then obtained as output from the machine learning model. Using the n-dimensional metric, at least one candidate user account suspected of being engaged in broadband internet access sharing is identified, and a list of candidate user accounts is generated.

Abstract: Systems and methods are provided for allocating computation capability. A network compute orchestrator (NCO) receives a request for service from a requester device. The NCO determines a required compute grade requirement for the service, and a maximum acceptable latency for the service. The NCO accesses a data structure that stores for each of a network arrangement of network devices: a number and type of available compute units, and latency to the requester device. The NCO selects a network device of the network arrangement of network devices that has an available compute unit meeting the required compute grade requirement, and has latency to the requester device that is lower than the maximum acceptable latency for the service. The NCO causes the selected network device of the network arrangement of network devices to perform the requested service for the requester device.

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.

Abstract: A domain management resource monitors a behavior of a user controlling multiple resources disposed in a domain of a network environment. Based on the monitored behavior, the domain management resource identifies a repeated pattern of control in which the user controls a particular resource in the domain. The domain management resource derives a proposed control rule based on the repeated pattern of control. The proposed control specifies how to control the particular resource. The domain management resource presents the control rule for review and possible editing prior to programming the domain management resource to execute the control rule.

Abstract: An augmented reality (AR) device captures a first image frame of a first scene in a real world. The AR device compresses the first image frame using a same bitrate across an entirety of the first image frame to generate a first compressed image frame. The AR device wirelessly sends, to a server, the first compressed image frame. The AR device receives, from the server, object detection results that identify locations of objects depicted in the first image frame.

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Various embodiments comprise systems, methods, and apparatus for processing a received video stream according to an embodiment comprises: identifying a number of repeated video frames within a sequence of N video frames within the video stream; determining, using a video frame quality assessment mechanism adapted to use repeated frames information, a motion adapted video quality metric (VQM) of the sequence of N video frames; and generating an alarm in response to the motion adapted VQM being less than a threshold level.

Abstract: Providing selectable virtual reality (VR) viewpoints within a VR environment is disclosed. In one embodiment, a network computing device provides downloadable VR content that defines a VR environment comprising a plurality of viewpoints. The plurality of viewpoints may include, as non-limiting examples, one or more viewpoints corresponding to one or more VR participants within the VR environment, and/or one or more predefined non-participant viewpoints. The network computing device receives a viewpoint selection indication from a client computing device of a spectator of the VR environment, wherein the viewpoint selection indication corresponds to a selected viewpoint of the plurality of viewpoints. The network computing device then transmits, to the client computing device, a pose data stream comprising pose data corresponding to the selected viewpoint. The client computing device may then display the VR environment based on the VR content and the pose data corresponding to the selected viewpoint.

Abstract: Delivering pre-rendered holographic content over a network is disclosed. A first camera view segment of a plurality of camera view segments that compose a holographic video is selected. Each camera view segment corresponds to a different camera view perspective of a scene and includes rendered holographic content that depicts a plurality of concurrent different viewer perspectives of the scene. The first camera view segment is streamed toward a holographic display for presentation of the first camera view segment on the holographic display.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.