Abstract: A scanning display device includes a MEMS scanner, a controller, light source drivers, light sources and an image processor. The controller controls rotation of MEMS mirror(s) of the MEMS scanner. Each light source driver selectively drives a respective one of the light sources to thereby produce a respective light beam that is directed towards and incident on a MEMS mirror of the MES scanner. The image processor causes two of the light source drivers to drive two of the light sources to thereby produce two light beams, when a first portion of an image is being raster scanned by the MEMS scanner. The image processor causes only one of the light source drivers to drive only one of the light sources to thereby produce only one light beam, when a second portion of the image is being raster scanned by the MEMS scanner. Related methods and systems are also disclosed.

Abstract: A scanning display device includes a MEMS scanner having a biaxial MEMS mirror or a pair of uniaxial MEMS mirrors. A controller communicatively coupled to the MEMS scanner controls rotation of the biaxial MEMS mirror or uniaxial MEMS mirrors. A first light source is used to produce a first light beam, and second light source is used to produce a second light beam. The first and second light beams are simultaneously directed toward and incident on the biaxial MEMS mirror, or a same one of the pair of uniaxial MEMS mirrors, at different angles of incidence relative to one another. The controller controls rotation of the biaxial MEMS mirror or the uniaxial MEMS mirrors to simultaneously raster scan a first portion of an image using the first light beam and a second portion of the image using the second light beam. Related methods and systems are also disclosed.

Abstract: The subject disclosure is directed towards a technology that may be used in an audio processing environment. Nodes of an audio flow graph are associated with virtual mix buffers. As the flow graph is processed, commands and virtual mix buffer data are provided to audio fixed-function processing blocks. Each virtual mix buffer is mapped to a physical mix buffer, and the associated command is executed with respect to the physical mix buffer. One physical mix buffer mix buffer may be used as an input data buffer for the audio fixed-function processing block, and another physical mix buffer as an output data buffer, for example.

Abstract: A scanning display device includes a MEMS scanner, a controller, light source drivers, light sources and an image processor. The controller controls rotation of MEMS mirror(s) of the MEMS scanner. Each light source driver selectively drives a respective one of the light sources to thereby produce a respective light beam that is directed towards and incident on a MEMS mirror of the MES scanner. The image processor causes two of the light source drivers to drive two of the light sources to thereby produce two light beams, when a first portion of an image is being raster scanned by the MEMS scanner. The image processor causes only one of the light source drivers to drive only one of the light sources to thereby produce only one light beam, when a second portion of the image is being raster scanned by the MEMS scanner. Related methods and systems are also disclosed.

Abstract: A scanning display device includes a MEMS scanner having a biaxial MEMS mirror or a pair of uniaxial MEMS mirrors. A controller communicatively coupled to the MEMS scanner controls rotation of the biaxial MEMS mirror or uniaxial MEMS mirrors. A first light source is used to produce a first light beam, and second light source is used to produce a second light beam. The first and second light beams are simultaneously directed toward and incident on the biaxial MEMS mirror, or a same one of the pair of uniaxial MEMS mirrors, at different angles of incidence relative to one another. The controller controls rotation of the biaxial MEMS mirror or the uniaxial MEMS mirrors to simultaneously raster scan a first portion of an image using the first light beam and a second portion of the image using the second light beam. Related methods and systems are also disclosed.

Abstract: An apparatus includes one or more MEMS mirrors, a light source driver and a controller. The light source driver selectively drives one or more light emitting elements of a light source to thereby produce a light beam that is directed towards a same MEMS mirror. The controller controls rotation of the MEMS mirror(s) in a fast-axis direction and a slow-axis direction in order to raster scan an image using the light beam reflected from the MEMS mirror(s). In order to achieve a first line density in a first portion of the image being raster scanned and to achieve a second line density, that is less than the first line density, in a second portion of the image being raster scanned, the controller dynamically adjusts a speed at which one of the MEMS mirror(s) is rotated in the slow-axis direction. Related systems and methods are also disclosed herein.

Abstract: Systems and methods are disclosed for generating stereoscopic images for a user based on one or more images captured by one or more scene-facing cameras or detectors and the position of the user's eyes or other parts relative to a component of the system as determined from one or more images captured by one or more user-facing detectors. The image captured by the scene-facing detector is modified based on the user's eye or other position. The resulting image represents the scene as seen from the perspective of the eye of the user. The resulting image may be further modified by augmenting the image with additional images, graphics, or other data. Stereoscopic mechanisms may also be adjusted or configured based on the location or the user's eyes or other parts.

Abstract: A system that includes a head mounted display device and a processing unit connected to the head mounted display device is used to fuse virtual content into real content. In one embodiment, the processing unit is in communication with a hub computing device. The processing unit and hub may collaboratively determine a map of the mixed reality environment. Further, state data may be extrapolated to predict a field of view for a user in the future at a time when the mixed reality is to be displayed to the user. This extrapolation can remove latency from the system.

Abstract: The subject disclosure is directed towards a technology that may be used in an audio processing environment. Nodes of an audio flow graph are associated with virtual mix buffers. As the flow graph is processed, commands and virtual mix buffer data are provided to audio fixed-function processing blocks. Each virtual mix buffer is mapped to a physical mix buffer, and the associated command is executed with respect to the physical mix buffer. One physical mix buffer mix buffer may be used as an input data buffer for the audio fixed-function processing block, and another physical mix buffer as an output data buffer, for example.

Abstract: The subject disclosure is directed towards a technology that may be used in an audio processing environment. Nodes of an audio flow graph are associated with virtual mix buffers. As the flow graph is processed, commands and virtual mix buffer data are provided to audio fixed-function processing blocks. Each virtual mix buffer is mapped to a physical mix buffer, and the associated command is executed with respect to the physical mix buffer. One physical mix buffer mix buffer may be used as an input data buffer for the audio fixed-function processing block, and another physical mix buffer as an output data buffer, for example.

Abstract: A system and method to present a user wearing a head mounted display with supplemental information when viewing a live event. A user wearing an at least partially see-through, head mounted display views the live event while simultaneously receiving information on objects, including people, within the user's field of view, while wearing the head mounted display. The information is presented in a position in the head mounted display which does not interfere with the user's enjoyment of the live event.

Abstract: A method for providing three-dimensional audio is provided. The method includes receiving a depth map imaging a scene from a depth camera and recognizing a human subject present in the scene. The human subject is modeled with a virtual skeleton comprising a plurality of joints defined with a three-dimensional position. A world space ear position of the human subject is determined based on the virtual skeleton. Furthermore, a target world space ear position of the human subject is determined. The target world space ear position is the world space position where a desired audio effect can be produced via an acoustic transducer array. The method further includes outputting a notification representing a spatial relationship between the world space ear position and the target world space ear position.

Abstract: A system and method to present a user wearing a head mounted display with supplemental information when viewing a live event. A user wearing an at least partially see-through, head mounted display views the live event while simultaneously receiving information on objects, including people, within the user's field of view, while wearing the head mounted display. The information is presented in a position in the head mounted display which does not interfere with the user's enjoyment of the live event.

Abstract: A system that includes a head mounted display device and a processing unit connected to the head mounted display device is used to fuse virtual content into real content. In one embodiment, the processing unit is in communication with a hub computing device. The processing unit and hub may collaboratively determine a map of the mixed reality environment. Further, state data may be extrapolated to predict a field of view for a user in the future at a time when the mixed reality is to be displayed to the user. This extrapolation can remove latency from the system.

Abstract: A system that includes a head mounted display device and a processing unit connected to the head mounted display device is used to fuse virtual content into real content. In one embodiment, the processing unit is in communication with a hub computing device. The processing unit and hub may collaboratively determine a map of the mixed reality environment. Further, state data may be extrapolated to predict a field of view for a user in the future at a time when the mixed reality is to be displayed to the user. This extrapolation can remove latency from the system.

Abstract: A system and method to present a user wearing a head mounted display with supplemental information when viewing a live event. A user wearing an at least partially see-through, head mounted display views the live event while simultaneously receiving information on objects, including people, within the user's field of view, while wearing the head mounted display. The information is presented in a position in the head mounted display which does not interfere with the user's enjoyment of the live event.

Abstract: A processor-implemented method, system and computer readable medium for intelligently controlling the power level of an electronic device in a multimedia system based on user intent, is provided. The method includes receiving data relating to a first user interaction with a device in a multimedia system. The method includes determining if the first user interaction corresponds to a user's intent to interact with the device. The method then includes setting a power level for the device based on the first user interaction. The method further includes receiving data relating to a second user interaction with the device. The method then includes altering the power level of the device based on the second user interaction to activate the device for the user.

Abstract: A computer implemented method for performing sign language translation based on movements of a user is provided. A capture device detects motions defining gestures and detected gestures are matched to signs. Successive signs are detected and compared to a grammar library to determine whether the signs assigned to gestures make sense relative to each other and to a grammar context. Each sign may be compared to previous and successive signs to determine whether the signs make sense relative to each other. The signs may further be compared to user demographic information and a contextual database to verify the accuracy of the translation. An output of the match between the movements and the sign is provided.

Abstract: A computer implemented method for synchronizing information from a scene using two heterogeneous sensing devices. Scene capture information is provided by a first sensor and a second sensor. The information comprises video streams including successive frames provided at different frequencies. Each frame is separated by a vertical blanking interval. A video output comprising a stream of successive frames each separated by a vertical blanking interval is rendered based on information in the scene. The method determines whether an adjustment of the first and second video stream relative to the video output stream is required by reference to the video output stream. A correction is then generated to at least one of said vertical blanking intervals.

Abstract: A method for overlaying first and second images in a common focal plane of a viewer comprises forming the first image and guiding the first and second images along an axis to a pupil of the viewer. The method further comprises adjustably diverging the first and second images at an adaptive diverging optic to bring the first image into focus at the common focal plane, and, adjustably converging the second image at an adaptive converging optic to bring the second image into focus at the common focal plane.