Abstract: A localization and mapping system and method for a motor vehicle is disclosed and includes at least one camera configured to obtain images of an environment surrounding the motor vehicle, at least one sensor configured to obtain location information for objects surrounding the motor vehicle and a controller configured to receive the images captured by the at least one camera and the location information obtained by the at least one sensor. The controller enhances the captured images utilizing a neural network and combines the enhanced images with the location information to localize the vehicle within the mapped environment.

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Various embodiments comprise systems, methods, and apparatus for processing a received video stream according to an embodiment comprises: identifying a number of repeated video frames within a sequence of N video frames within the video stream; determining, using a video frame quality assessment mechanism adapted to use repeated frames information, a motion adapted video quality metric (VQM) of the sequence of N video frames; and generating an alarm in response to the motion adapted VQM being less than a threshold level.

Abstract: Providing selectable virtual reality (VR) viewpoints within a VR environment is disclosed. In one embodiment, a network computing device provides downloadable VR content that defines a VR environment comprising a plurality of viewpoints. The plurality of viewpoints may include, as non-limiting examples, one or more viewpoints corresponding to one or more VR participants within the VR environment, and/or one or more predefined non-participant viewpoints. The network computing device receives a viewpoint selection indication from a client computing device of a spectator of the VR environment, wherein the viewpoint selection indication corresponds to a selected viewpoint of the plurality of viewpoints. The network computing device then transmits, to the client computing device, a pose data stream comprising pose data corresponding to the selected viewpoint. The client computing device may then display the VR environment based on the VR content and the pose data corresponding to the selected viewpoint.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Delivering pre-rendered holographic content over a network is disclosed. A first camera view segment of a plurality of camera view segments that compose a holographic video is selected. Each camera view segment corresponds to a different camera view perspective of a scene and includes rendered holographic content that depicts a plurality of concurrent different viewer perspectives of the scene. The first camera view segment is streamed toward a holographic display for presentation of the first camera view segment on the holographic display.

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

Abstract: Virtual reality content (VR content) streaming based on quality of experience level is disclosed. In response to a request from a head-mounted display device (HMDD) to serve a VR content, a computing device determines a head motion quantifier (HMQ) associated with the VR content. The computing device is configured to dynamically provide to the HMDD imagery from the VR content based on head movements of a user of the HMDD. The computing device determines a latency value associated with a round-trip time of data between the computing device and the HMDD. The computing device determines a quality of experience level of a plurality of different quality of experience levels based on the HMQ and the latency value, and performs an action based on the quality of experience level.

Abstract: Providing selectable virtual reality (VR) viewpoints within a VR environment is disclosed. In one embodiment, a network computing device provides downloadable VR content that defines a VR environment comprising a plurality of viewpoints. The plurality of viewpoints may include, as non-limiting examples, one or more viewpoints corresponding to one or more VR participants within the VR environment, and/or one or more predefined non-participant viewpoints. The network computing device receives a viewpoint selection indication from a client computing device of a spectator of the VR environment, wherein the viewpoint selection indication corresponds to a selected viewpoint of the plurality of viewpoints. The network computing device then transmits, to the client computing device, a pose data stream comprising pose data corresponding to the selected viewpoint. The client computing device may then display the VR environment based on the VR content and the pose data corresponding to the selected viewpoint.

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

Abstract: A router device in a subscriber domain receives communications from a communication device. The communications are destined for delivery over a first network operated by a corresponding service provider to a destination in a second network such as the Internet. To convey communications, the router device maps a network address obtained from the first communications to a corresponding marker assigned to the communication device. The router device then tags the communications from the communication device with the corresponding marker and forwards the tagged communications (with the marker) over the first network to the second network. The first network operated by the service provider conveys the tagged communications in accordance with a data delivery policy as indicated by the corresponding marker in the forwarded communications.

Abstract: A router device in a subscriber domain receives communications from a communication device. The communications are destined for delivery over a first network operated by a corresponding service provider to a destination in a second network such as the Internet. To convey communications, the router device maps a network address obtained from the first communications to a corresponding marker assigned to the communication device. The router device then tags the communications from the communication device with the corresponding marker and forwards the tagged communications (with the marker) over the first network to the second network. The first network operated by the service provider conveys the tagged communications in accordance with a data delivery policy as indicated by the corresponding marker in the forwarded communications.