Abstract: A method for estimating human body temperature includes receiving, via a thermal camera, one or more thermal images captured of a real-world environment, the one or more thermal images including thermal intensity values for each of a plurality of pixels. Positions of a plurality of human faces are identified in the one or more thermal images. A distribution of thermal intensity values of the plurality of human faces is determined. A position of a test human face of a test human subject is identified within a subsequent thermal image. One or more test thermal intensity values of one or more pixels corresponding to the test human face are identified. An indication of a body temperature of the test human subject is reported based on a comparison of the one or more test thermal intensity values and the distribution of thermal intensity values of the plurality of human faces.

Abstract: A method for estimating human body temperature includes receiving, via a thermal camera, a thermal image captured of a real-world environment, the thermal image including thermal intensity values for each of a plurality of pixels of the thermal image. A position of a first human face is identified within the thermal image, the first human face corresponding to a first human subject. A skin tone of the first human face is identified. Based on the identified skin tone, a skin tone correction factor is applied to one or more thermal intensity values of one or more pixels corresponding to the first human face to give one or more tone-corrected thermal intensity values. Based on the one or more tone-corrected thermal intensity values an indication of a body temperature of the first human subject is reported.

Abstract: Systems are configured for generating temporally corrected pass-through images. In some instances, the systems obtain depth maps of an environment at a first timepoint, generate a 3D representation of the environment by unprojecting the depth information represented in the depth map, and obtain one or more first images of the environment captured at a second timepoint. The systems may also be configured to perform a first intermediate projection to identify first texture information from the one or more first images, identify a display pose associated with the system, generate a display projection of the 3D representation, and creating a composite image based on the display projection and the first texture information.

Abstract: A system for dense depth computation aided by sparse feature matching generates a first image using a first camera, a second image using a second camera, and a third image using a third camera. The system generates a sparse disparity map using the first image and the third image by (1) identifying a set of feature points within the first image and a set of corresponding feature points within the third image, and (2) identifying feature disparity values based on the set of feature points and the set of corresponding feature points. The system also applies the first image, the second image, and the sparse disparity map as inputs for generating a dense disparity map.

Abstract: A method for estimating human body temperature includes receiving, via a thermal camera, a thermal image captured of a real-world environment, the thermal image including thermal intensity values for each of a plurality of pixels of the thermal image. A position of a human face is identified within the thermal image, the human face corresponding to a human subject. An indication of a distance between the human subject and the thermal camera is received. Based on the distance, a distance correction factor is applied to one or more thermal intensity values of one or more pixels corresponding to the human face to give one or more distance-corrected thermal intensity values. Based on the one or more distance-corrected thermal intensity values an indication of a body temperature of the human subject is reported.

Abstract: Improved HMDs are described. The HMD is configured to provide higher resolution image content within a central area of a display of the HMD and to provide lower resolution image content within peripheral areas of the display. The HMD includes a higher resolution camera, a first lower resolution camera, and a second lower resolution camera. The FOV of the first lower resolution camera minimally overlaps the FOV of the higher resolution camera, and the FOV of the second lower resolution camera minimally overlaps the FOV of the higher resolution camera. The minimal overlap is less than 10 degrees. By structuring the HMD in this manner, the HMD can generate merged images that mimic a user's foveal vision acuity.

Abstract: Systems having rolling shutter sensors with a plurality of sensor rows are configured for compensating for rolling shutter artifacts that result from different sensor rows in the plurality of sensor rows outputting sensor data at different times. The systems compensate for the rolling shutter artifacts by identifying readout timepoints for the plurality of sensor rows of the rolling shutter sensor while the rolling shutter sensor captures an image of an environment and identifying readout poses each readout timepoint, as well as obtaining a depth map based on the image. The depth map includes a plurality of different rows of depth data that correspond to the different sensor rows. The system further compensates for the rolling shutter artifacts by generating a 3D representation of the environment while unprojecting the rows of depth data into 3D space using the readout poses.

Abstract: Improved techniques for generating images are disclosed herein. A first image is generated by an integrated camera. The pose of the computer system is determined based on the image, and a timestamp is determined. A detached camera generates a second image. The second image is aligned with the first image. An overlaid image is generated by overlaying the second image onto the first image based on the alignment. A pose difference is then identified between a current pose of the computer and the initial pose. Consequently, late stage reprojection (LSR) is performed on the overlaid image to account for the pose difference. The LSR-corrected overlaid image is then displayed.

Abstract: Techniques for generating a unified map and for determining a pose evolution are disclosed. A HMD generates images of an environment. Feature points can be identified from those images. The images and/or the feature points are used to generate a map of a previously unmapped environment. The images and/or feature points are also used to generate a pose evolution of the HMD. It may be the case that another map converges with the first map. If that is the case, then a unified map is generated by linking the two maps at the convergence point. The pose evolutions may also be linked. After action reviews are improved through the use of the unified map and pose evolution.

Abstract: A head-mounted display device includes a near-eye display configured to present virtual imagery. A storage machine holds instructions executable by a logic machine to concurrently output first and second position estimates via first and second navigation modalities of the device. Based on determining that the first position estimate has a higher confidence value than the second position estimate, the first position estimate is reported. As the device moves away from the first reported position, first and second subsequent position estimates are concurrently output. Based on determining that the second subsequent position estimate has a higher confidence value than the first subsequent position estimate, the second subsequent position estimate is reported. Position-specific virtual imagery is presented to a user eye via the near-eye display, the position-specific virtual imagery dynamically updating as the head-mounted display device moves.

Abstract: A method of automatically geolocating a visual target. The method comprises operating a flying vehicle in a search region including the visual target. The method further includes affirmatively identifying a visual target in an aerial photograph of the search region captured by the flying vehicle. The method further includes automatically correlating the aerial photograph of the search region to a geo-tagged photograph of the search region, wherein the geo-tagged photograph is labelled with pre-defined geospatial coordinates. Based on such automatic correlation, a geospatial coordinate is determined for the visual target in the search region.

Abstract: Systems and methods are provided for facilitating computer vision tasks (e.g., simultaneous location and mapping) and pass-through imaging include a head-mounted display (HMD) that includes a first set of one or more cameras configured for performing computer vision tasks and a second set of one or more cameras configured for capturing image data of an environment for projection to a user of the HMD. The first set of one or more cameras is configured to detect at least a visible spectrum light and at least a particular band of wavelengths of infrared (IR) light. The second set of one or more cameras includes one or more detachable IR filters configured to attenuate IR light, including at least a portion of the particular band of wavelengths of IR light.

Abstract: Systems and methods are provided for performing temporally consistent depth map generation by implementing acts of obtaining a first stereo pair of images of a scene associated with a first timepoint and a first pose, generating a first depth map of the scene based on the first stereo pair of images, obtaining a second stereo pair of images of the scene associated with at a second timepoint and a second pose, generating a reprojected first depth map by reprojecting the first depth map to align the first depth map with the second stereo pair of images, and generating a second depth map that corresponds to the second stereo pair of images using the reprojected first depth map.

Abstract: Systems and methods are provided for upsampling low temporal resolution depth maps. This upsampling is performed by obtaining a stereo pair of images of a scene captured at a first timepoint, generating a first depth map of the scene for the first timepoint by performing stereo matching on the stereo pair of images, obtaining a subsequent stereo pair of images captured at a subsequent timepoint to the first timepoint, and generating a subsequent depth map that corresponds to the subsequent timepoint by applying an edge-preserving filter using the first depth map without performing stereo matching on the subsequent stereo pair of images.

Abstract: Systems and methods are provided performing for low compute depth map generation by implementing acts of obtaining a stereo pair of images of a scene, downsampling the stereo pair of images, generating a depth map by stereo matching the downsampled stereo pair of images, and generating an upsampled depth map based on the depth map using an edge-preserving filter for obtaining at least some data of at least one image of the stereo pair of images.

Abstract: Improved techniques for re-localizing Internet-of-Things (IOT) devices are disclosed herein. Sensor data digitally representing one or more condition(s) monitored by an IOT device is received. In response, a sensor readings map is accessed, where this map is associated with the IOT device. The map also digitally represents the IOT device's environment and includes data representative of a location of the IOT device within the environment. The map also includes data representative of the conditions monitored by the IOT device. Additionally, the map is updated by attaching the sensor data to the map. In some cases, a coverage map can also be computed. Both the sensors readings map and the coverage map can be automatically updated in response to the TOT device being re-localized.

Abstract: Systems and methods for providing a mixed-reality pass-through experience include implement acts of obtaining a texture map of a real-world environment, obtaining a depth map of the real-world environment, obtaining an updated texture map of the real-world environment subsequent to the obtaining of the depth map and the texture map, and rendering a virtual representation of the real-world environment utilizing both the depth map and the updated texture map that was obtained subsequent to the depth map. The texture map and the depth map may be based on a same image pair obtained from a pair of stereo cameras, the depth map being obtained by performing stereo matching on the same image pair. Additionally, the acts may further include detecting a predicted pose of a user and reprojecting a portion of the depth map to conform to a user perspective associated with the predicted pose.

Abstract: Optimizations are provided for a high dynamic range (HDR) sensor. This sensor is a spatially multiplexed image sensor that includes at least two sets of red, green, and blue (RGB) pixels. Each red pixel in the second set of RGB pixels is positioned proximately and sometimes, adjacently, to at least one red pixel in the first set of RGB pixels. Each green pixel in the second set of RGB pixels is positioned proximately to at least one green pixel in the first set of RGB pixels. Each blue pixel in the second set of RGB pixels is positioned proximately to at least one blue pixel in the first set of RGB pixel. This spatially multiplexed image sensor is able to generate a digital image with reduced motion blurring artifacts.

Abstract: A head-mounted display is presented. The head-mounted display includes an inertial measurement unit (IMU), one or more displays and a controller. The controller is configured to establish a reprojection plane for displaying imagery on the one or more displays. Based on output from the IMU, the position and orientation of the HMD relative to the reprojection plane is determined. Image data is then reprojected to the displays. A depth treatment is applied to each of a plurality of locations on the displays based on the determined position and orientation of the HMD relative to the reprojection plane.

Abstract: Enhanced passthrough images are generated and displayed. A current visibility condition of an environment is determined. Based on the current visibility condition, a first camera or a second camera, which detect light spanning different ranges of illuminance, is selected to generate a passthrough image of the environment. The selected camera is then caused to generate the passthrough image. Additionally, a third camera, which is structured to detect long wave infrared radiation, is caused to generate a thermal image of the environment. Parallax correction is performed by aligning coordinates of the thermal image with corresponding coordinates identified within the passthrough image. Subsequently, the parallax-corrected thermal image is overlaid onto the passthrough image to generate a composite passthrough image, which is then displayed.