Abstract: An extended reality (XR) system receives capture information from a first camera with a first image sensor that faces a first direction, for instance facing an environment. The capture information is associated with capture of first image data by the first image sensor, for instance including the first image data and/or first image capture settings used to capture the first image data. The XR system determines an image capture setting, such as an exposure setting, for a second image sensor based on the capture information. The second image sensor faces second direction, for instance facing a user of the XR system. In some examples, the XR system determines the image capture setting also based on information from a display buffer for a display that faces the second direction. The XR system causes a second image sensor to capture second image data according to the image capture setting.

Abstract: Methods, systems, computer-readable media, and apparatuses for region-of-interest (ROI) automatic gain or exposure control are presented. In one example, a method includes receiving a first image from an image sensor captured with a first field of view (FOV) and comprising a first plurality of pixels, receiving a second image from the image sensor captured with a second FOV and comprising a second plurality of pixels, determining an ROI in the second image, the ROI comprising a subset of the second plurality of pixels in the second image, determining an ROI weight for the ROI in the second image, determining statistics based on the first plurality of pixels in the first image, the subset of the second plurality of pixels in the second image, and the ROI weight for the ROI in the second image, and adjusting a gain or exposure setting for the image sensor based on the statistics.

Abstract: An extended reality (XR) system receives capture information from a first camera with a first image sensor that faces a first direction, for instance facing an environment. The capture information is associated with capture of first image data by the first image sensor, for instance including the first image data and/or first image capture settings used to capture the first image data. The XR system determines an image capture setting, such as an exposure setting, for a second image sensor based on the capture information. The second image sensor faces second direction, for instance facing a user of the XR system. In some examples, the XR system determines the image capture setting also based on information from a display buffer for a display that faces the second direction. The XR system causes a second image sensor to capture second image data according to the image capture setting.

Abstract: Methods, systems, computer-readable media, and apparatuses for region-of-interest automatic gain or exposure control are presented. One example method includes receiving an image from an image sensor, the image comprising a plurality of pixels, determining a region of interest (“ROI”) in the image, the ROI comprising a subset of the plurality of pixels in the image, determining a ROI weight for pixels in the subset of the plurality of pixels, determining statistics for the image based on the plurality of pixels in the image and the ROI weight, and adjusting a gain or exposure setting for the image sensor based on the statistics.

Abstract: An under-display camera is positioned underneath a display of a mobile device. The under-display camera captures an image using light passing through a portion of the display. The mobile device displays a display image on the display, the display image based on the image. The mobile device displays an indicator overlaid over the display image on an indicator area of the display that overlaps with the portion of the display. The indicator may identify the position of the camera. The mobile device can compensate for occlusion of the camera by continuing to display a previous display image if a more recently captured image includes an occlusion. The mobile device can give users alternate ways to select areas of the display image to avoid camera occlusion, for instance using hardware buttons and/or touchscreen interface elements.

Abstract: Systems, methods, and non-transitory media are provided for automatic exposure control. An example method can include receiving pixel values captured by a photosensor pixel array (PPA) of an image sensor, wherein one or more pixel values from the pixel values correspond to one or more sensitivity-biased photosensor (SBP) pixels in the PPA and one or more saturated pixel values from the pixel values correspond to one or more other photosensor pixels in the PPA; determining, based on the one or more pixel values, an actual pixel value for the one or more pixel values and/or the one or more saturated pixel values; determining an adjustment factor for at least one of the pixel values based on the actual pixel value and a target exposure value; and based on the adjustment factor, correcting an exposure setting associated with the image sensor and/or at least one of the pixel values.

Abstract: An under-display camera is positioned underneath a display of a mobile device. The under-display camera captures an image using light passing through a portion of the display. The mobile device displays a display image on the display, the display image based on the image. The mobile device displays an indicator overlaid over the display image on an indicator area of the display that overlaps with the portion of the display. The indicator may identify the position of the camera. The mobile device can compensate for occlusion of the camera by continuing to display a previous display image if a more recently captured image includes an occlusion. The mobile device can give users alternate ways to select areas of the display image to avoid camera occlusion, for instance using hardware buttons and/or touchscreen interface elements.

Abstract: Methods, systems, and devices for in-display camera activation are described. The method includes receiving a request to activate a camera of the device, identifying a start of frame marker associated with activating the camera in response to the request, and emitting a signal to a display of the device in response to the identified start of frame marker, where the emitted signal triggers the display to transition a set of liquid crystal elements of the display from a display mode to a camera mode for camera operation.

Abstract: An extended reality (XR) system receives capture information from a first camera with a first image sensor that faces a first direction, for instance facing an environment. The capture information is associated with capture of first image data by the first image sensor, for instance including the first image data and/or first image capture settings used to capture the first image data. The XR system determines an image capture setting, such as an exposure setting, for a second image sensor based on the capture information. The second image sensor faces second direction, for instance facing a user of the XR system. In some examples, the XR system determines the image capture setting also based on information from a display buffer for a display that faces the second direction. The XR system causes a second image sensor to capture second image data according to the image capture setting.

Abstract: An example image capture device includes memory configured to store display content and image information received from a camera sensor, the camera sensor being configured to receive light through at least a portion of a display. The image capture device includes one or more processors coupled to the memory. The one or more processors are configured to determine a camera sensor blanking period. The one or more processors are configured to control the display to display content via one or more of a plurality of pixels in the at least a portion of the display during the camera sensor blanking period. The one or more processors are configured to control the display to not display content via the one or more of the plurality of pixels outside of the camera sensor blanking period.

Abstract: Methods, systems, and devices for in-display camera activation are described. The method includes receiving a request to activate a camera of the device, identifying a start of frame marker associated with activating the camera in response to the request, and emitting a signal to a display of the device in response to the identified start of frame marker, where the emitted signal triggers the display to transition a set of liquid crystal elements of the display from a display mode to a camera mode for camera operation.

Abstract: Methods, systems, and devices for asymmetric exposure time adjustments for multi-frame (MF) high dynamic range (HDR) imaging in low light conditions are described. In some implementations, a device may receive a set of frames including short exposure frames associated with a first exposure time and long exposure frames associated with a second exposure time and may adjust the second exposure time associated with the long exposure frames to obtain a third exposure time for the long exposure frames based on detecting a low light condition associated with the set of frames. The device may adjust the second exposure time associated with the long exposure frames to obtain the third exposure time for the long exposure frames based on adding, at an image sensor of the device, an additional set of blanking lines to a set of visible lines associated with the short exposure frames.

Abstract: Methods and devices are described for image or video capture while in a manual mode. In some aspects, a device includes one or more processors. The device also includes a memory coupled to the one or more processors. The memory includes instructions that, when executed by the one or more processors, causes the device to generate a first image frame of a scene using manual mode settings and generate a second image frame of the scene using automatic mode settings different from the manual mode settings.

Abstract: An under-display camera is positioned underneath a display of a mobile device. The under-display camera captures an image using light passing through a portion of the display. The mobile device displays a display image on the display, the display image based on the image. The mobile device displays an indicator overlaid over the display image on an indicator area of the display that overlaps with the portion of the display. The indicator may identify the position of the camera. The mobile device can compensate for occlusion of the camera by continuing to display a previous display image if a more recently captured image includes an occlusion. The mobile device can give users alternate ways to select areas of the display image to avoid camera occlusion, for instance using hardware buttons and/or touchscreen interface elements.

Abstract: An example image capture device includes memory configured to store display content and image information received from a camera sensor, the camera sensor being configured to receive light through at least a portion of a display. The image capture device includes one or more processors coupled to the memory. The one or more processors are configured to determine a camera sensor blanking period. The one or more processors are configured to control the display to display content via one or more of a plurality of pixels in the at least a portion of the display during the camera sensor blanking period. The one or more processors are configured to control the display to not display content via the one or more of the plurality of pixels outside of the camera sensor blanking period.

Abstract: A method of communication includes determining, at a mobile device, a speech quality metric for an incoming speech signal associated with a voice call. The speech quality metric is based on an environment of the mobile device. The method also includes converting incoming speech associated with the incoming speech signal to text in response to a determination that the speech quality metric fails to satisfy a speech quality metric threshold. The method further includes displaying the text at a display screen of the mobile device during the voice call.

Abstract: Methods and devices are described for image or video capture while in a manual mode. In some aspects, a device includes one or more processors. The device also includes a memory coupled to the one or more processors. The memory includes instructions that, when executed by the one or more processors, causes the device to generate a first image frame of a scene using manual mode settings and generate a second image frame of the scene using automatic mode settings different from the manual mode settings.

Abstract: Methods, systems, computer-readable media, and apparatuses for region-of-interest automatic gain or exposure control are presented. One example method includes receiving an image from an image sensor, the image comprising a plurality of pixels, determining a region of interest (“ROI”) in the image, the ROI comprising a subset of the plurality of pixels in the image, determining a ROI weight for pixels in the subset of the plurality of pixels, determining statistics for the image based on the plurality of pixels in the image and the ROI weight, and adjusting a gain or exposure setting for the image sensor based on the statistics.

Abstract: Methods, systems, and devices for image processing at a device are described. The present disclosure may relate to capturing a first frame of image samples and a second frame of image samples of an image sensor after capturing the first frame of image samples, determining that a white balance confidence level of the second frame does not satisfy a confidence threshold, retrieving the first frame of image samples based on determining that the white balance confidence level of the second frame does not satisfy the confidence threshold, combining at least a portion of the image samples of the first frame with the image samples of the second frame, and determining a white balance setting for the second frame based on combining at least the portion of the image samples of the first frame with the image samples of the second frame.

Abstract: Among other things, the present disclosure relates to image searching. With a depth map, image pixels of an image having depth values intersecting a desired optical field can be identified. A territory can be set based on locations of the identified image pixels. Feature detection can be performed on the image within the set territory. The feature detection can be limited to the set territory.