Abstract: Embodiments of the present disclosure relate to a camera device with optical image stabilization (OIS) having a range of motion that is asymmetric along two spatial dimensions. The camera device includes an image sensor, a lens assembly in an optical series with the image sensor, and an OIS assembly. The OIS assembly initiates a first motion of at least one of the image sensor and the lens assembly along a first direction parallel to a first axis, the first motion having a first range. The OIS assembly further initiates a second motion of at least one of the image sensor and the lens assembly along a second direction parallel to a second axis orthogonal to the first axis, the second motion having a second range different than the first range.

Abstract: Systems and methods are provided for operating image modules via an artificial reality (AR) device. In various exemplary embodiments, an artificial reality device may initiate a first camera of the AR device to identify a picture region and may track at least one gaze via a second camera of the AR device or at least one gesture via the first camera. The AR device may be a head-mounted device, for example, including a plurality of inward and outward facing cameras. The AR device may determine a region of interest within the picture region based on the at least one tracked gaze or gesture and may focus on the region of interest via the first camera. The focusing operations may include at least one of an auto-exposure operation, an auto-focus operation, or a stabilizing operation.

Abstract: Embodiments of the present disclosure relate to power saving mechanisms for a wearable camera device. The camera device comprises an image sensor and lens assembly in an optical series with the image sensor. At a first orientation of the camera device, an offset is between a center axis of the image sensor and an optical axis of the lens assembly. At a second orientation of the camera device, at least one of the image sensor and the lens assembly sag due to gravity such that the center axis and the optical axis substantially overlap while the camera device is in a neutral state. The lens assembly and the image sensor can further allow a dynamic amount of sag relative to each other.

Abstract: Embodiments of the present disclosure relate to a camera device assembled to reduce an auto-focusing actuation power for the most typical use case. The camera device comprises an image sensor and a lens assembly in an optical series with the image sensor. During assembling of the camera device, the lens assembly is assembled within the camera device to have an optical axis parallel to gravity and positioned to have an offset along the optical axis relative to a support assembly. The offset is determined during assembling of the camera device such that, when the camera device is oriented with a rotated optical axis orthogonal to gravity, the lens assembly is positioned at a neutral position relative to the image sensor without activation applied to the lens assembly.

Abstract: Video presence systems are described that detect an area of interest (e.g., facial region) within captured image data and analyze the area of interest using known color information of the content currently being presented by a display, along with measured ambient light color information from a color sensor, to determine whether the area of interest (e.g., face) is currently illuminated by the display or whether the AOI is not affected by the display and instead only illuminated by the ambient light. Upon determining that the display casts color shade on the AOI, the video presence system pre-processes the image data of the detected area of interest to correct the color back to skin color under ambient light prior to performing general white balance correction.

Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Abstract: The disclosed camera system may include a primary camera and a plurality of secondary cameras that each have a maximum horizontal FOV that is less than a maximum horizontal FOV of the primary camera. Two of the plurality of secondary cameras may be positioned such that their maximum horizontal FOVs overlap in an overlapped horizontal FOV and the overlapped horizontal FOV may be at least as large as a minimum horizontal FOV of the primary camera. The camera system may also include an image controller that simultaneously activates two or more of the primary camera and the plurality of secondary cameras when capturing images from a portion of an environment included within the overlapped horizontal FOV. Various other systems, devices, assemblies, and methods are also disclosed.

Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Abstract: A display assembly generates environmentally matched virtual content for an electronic display. The display assembly includes a display controller and a display. The display controller is configured to estimate environmental matching information for a target area within a local area based in part on light information received from a light sensor. The target area is a region for placement of a virtual object. The light information describes light values. The display controller generates display instructions for the target area based in part on a human vision model, the estimated environmental matching information, and rendering information associated with the virtual object. The display is configured to present the virtual object as part of artificial reality content in accordance with the display instructions. The color and brightness of the virtual object is environmentally matched to the portion of the local area surrounding the target area.

Abstract: Imaging systems may be provided with stacked-chip image sensors and adjustable lens systems. A stacked-chip image sensor may include a vertical chip stack that includes an array of image pixels and processing circuitry. The adjustable lens system may pass light from a scene onto the image pixels at a number of focus positions. The image pixels may capture a focus bracket of image frames at a capture frame rate for light passed by the adjustable lens system at two or more of the focus positions. The processing circuitry may combine a set of image frames in the focus bracket to generate a focused image. The focused image may have one or more portions of the captured scene in focus. The processing circuitry may output the focused image to off-chip image processing circuitry at an output frame rate that is less than the capture frame rate.

Abstract: Imaging systems may be provided with stacked-chip image sensors. A stacked-chip image sensor may include a vertical chip stack that includes an array of image pixels and processing circuitry. The image pixel array may be coupled to the processing circuitry through an array of vertical metal interconnects. The image pixel array may be partitioned into image pixel sub-arrays configured to capture image data using one or more integration times. The processing circuitry may determine motion information for the image data captured by each pixel sub-array and may determine integration times for each pixel sub-array. The pixel sub-arrays may capture additional image data using the determined integration times. The additional image data may be combined to generate final image frames having short integration pixel values and long integration pixel values. The processing circuitry may output the final image frames to off-chip image processing circuitry.

Abstract: Apparatus and a method for matching contrast between images of a stereo image pair. A first contrast value corresponding to first pixel information of first image is determined and a second contrast value corresponding to second pixel information of second image is determined. The first and second contrast values are compared and the image having the lower contrast value is selected for compensation. A tone mapping function is generated and applied to the pixel information corresponding to the selected image for generating compensated image pixel information corresponding to the selected image.

Abstract: Systems and approaches are provided for obtaining high quality image data from lower resolution and/or lower quality image data. An electronic device can be calibrated comprehensively prior to being provided to a user. The calibrated electronic device can be used to capture image data, image metadata, and other sensor data substantially simultaneously. Super-resolution processing can be applied to the captured image data to obtain higher quality image data than the captured image data, such as image data that corresponds to a higher resolution, has less blur, has less noise, has fewer photometric imperfections, and/or has fewer artifacts.

Abstract: Stereoscopic imaging devices may include stereoscopic imagers, stereoscopic displays, and processing circuitry. The processing circuitry may be used to collect auto white balance (AWB) statistics for each image captured by the stereoscopic imager. A stereoscopic imager may include two image modules that may be color calibrated relative to each other or relative to a standard calibrator. AWB statistics may be used by the processing circuitry to determine global, local and spatial offset gain adjustments to provide intensity matched stereoscopic images for display. AWB statistics may be combined by the processing circuitry with color correction offsets determined during color calibration to determine color-transformation matrices for displaying color matched stereoscopic images using the stereoscopic display.

Abstract: Imaging systems may be provided with stacked-chip image sensors. A stacked-chip image sensor may include a vertical chip stack that includes an array of image pixels and processing circuitry. The image pixel array may be coupled to the processing circuitry through an array of vertical metal interconnects. The image pixel array may be partitioned into image pixel sub-arrays configured to capture image data using one or more integration times. The processing circuitry may determine motion information for the image data captured by each pixel sub-array and may determine integration times for each pixel sub-array. The pixel sub-arrays may capture additional image data using the determined integration times. The additional image data may be combined to generate final image frames having short integration pixel values and long integration pixel values. The processing circuitry may output the final image frames to off-chip image processing circuitry.

Abstract: Apparatus and a method for matching contrast between images of a stereo image pair. A first contrast value corresponding to first pixel information of first image is determined and a second contrast value corresponding to second pixel information of second image is determined. The first and second contrast values are compared and the image having the lower contrast value is selected for compensation. A tone mapping function is generated and applied to the pixel information corresponding to the selected image for generating compensated image pixel information corresponding to the selected image.

Abstract: Stereoscopic imaging devices may include stereoscopic imagers, stereoscopic displays, and processing circuitry. The processing circuitry may be used to collect auto white balance (AWB) statistics for each image captured by the stereoscopic imager. A stereoscopic imager may include two image modules that may be color calibrated relative to each other or relative to a standard calibrator. AWB statistics may be used by the processing circuitry to determine global, local and spatial offset gain adjustments to provide intensity matched stereoscopic images for display. AWB statistics may be combined by the processing circuitry with color correction offsets determined during color calibration to determine color-transformation matrices for displaying color matched stereoscopic images using the stereoscopic display.