Abstract: In one implementation, an event sensor includes a plurality of pixels, an external readout line shared among the plurality of pixels, and an external processing circuit. Each pixel is configured to output pixel data indicative of an intensity of incident illumination. The external processing circuit is configured to output a stream of pixel events. Each respective pixel event is generated when a comparator of the external processing circuit obtains a sample of pixel data from a particular pixel via the external readout line that breaches a threshold value.

Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

Abstract: Methods and apparatus for using polarized light (e.g., infrared (IR) light) to improve eye-related functions such as iris recognition. An eye camera system includes one or more IR cameras that capture images of the user's eyes that are processed to perform iris recognition, gaze tracking, or other functions. At least one polarizing element may be located in the path of the light which is used to capture images of the user's eye. The user's eye may be illuminated by IR light emitted by one or more LEDs. At least one of the LEDs may be an LED with a polarizing filter. Instead or in addition, at least one polarizer may be located at the eye camera sensor, in the eye camera optics, or as or in an additional optical element located on the light path between the eye camera and the user's eye.

Abstract: In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.

Abstract: Methods and apparatus for stray light mitigation in optical systems that include two or more illumination sources (e.g., point light sources such as light-emitting diodes (LEDs)) that illuminate an object to be imaged, and a camera configured to capture images of light from the point light sources reflected by the object when illuminated. To mitigate “occlusions” or artifacts caused by, for example, stray light or reflections of the illumination sources off of other components of the system, multiple images of the object are captured with different groups of the illumination sources enabled. The captured images can then be processed and merged to generate an output image with the occlusions or artifacts caused by stray light or reflections mitigated or eliminated.

Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user’s eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

Abstract: A pulse-width modulation (PWM) image sensor is described herein. The PWM image sensor may have a stacked configuration. A top wafer of the PWM image sensor may have a charge-to-time converter and a logic wafer, stacked with the top wafer, may include a time-to-digital converter. The PWM image sensor may utilize variable transfer functions to avoid highlight compression and may utilize non-linear time quantization. A threshold voltage, as input to a charge-to-time converter, may additionally be controlled to affect light detection, dynamic range, and other features associated with the PWM image sensor.

Abstract: Various implementations disclosed herein include devices, systems, and methods that buffer events in device memory during synchronous readout of a plurality of frames by a sensor. Various implementations disclosed herein include devices, systems, and methods that disable a sensor communication link until the buffered events are sufficient for transmission by the sensor. In some implementations, the sensor using a synchronous readout may select a readout mode for one or more frames based on how many of the pixels are detecting events. In some implementations, a first mode that reads out only data for a low percentage of pixels that have events uses the device memory and a second mode bypasses the device memory based on accumulation criteria such as high percentage of pixels detecting events. In the second mode, less data per pixel may be readout.

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a control signal before synchronous readout of a frame (or part of the frame) is performed by a sensor. Various implementations disclosed herein include devices, systems, and methods that determine event density (e.g., a dense row signal or a dense frame signal) before synchronous readout is performed by the sensor. In some implementations, the event camera is capable of operating in a first readout mode and a second readout mode based on a number of events. In the second readout mode, less data per pixel may be readout.

Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

Abstract: Methods and apparatus for fabricating light-emitting diodes (LEDs) that include polarizing or wavefront-altering optical components are described in which additional optical components are added to the LED package to filter or modify the polarization of the emitted photons. Packaged LEDs that include polarizing or wavefront-altering optical components are also described. The packaged LEDs may emit infrared light that is polarized or otherwise altered by the optical components added during the fabrication process.

Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain information from a first electronic device (e.g., to improve interactions for a CGR environment). In some implementations at a second electronic device having a processor, event camera data is obtained corresponding to modulated light (e.g., light including an information signal in its modulation) emitted by an optical source on the first electronic device and received at an event camera. The second electronic device is able to identify information from the first electronic device based on detecting a modulation pattern of the modulated light based on the event camera data. In some implementations, second electronic device is the same electronic device that has the event camera (e.g., laptop) or a different electronic device that receives the event data (e.g., a server receiving the event data from a laptop computer).

Abstract: Various implementations disclosed herein include devices, systems, and methods implemented by an electronic device with an imaging sensor including a plurality of pixels (e.g., a matrix of pixels) that each are capable of detecting illumination intensity or contrast change using at least one shared photosensor. In some implementations, the imaging sensor is capable of operating in a first illumination intensity detecting mode (e.g., in a frame-based camera mode) or in a second contrast change detecting mode (e.g., in an event camera mode). In some implementations, the first illumination intensity detecting mode and the second contrast change detecting mode are mutually exclusive. In some implementations, pixels at an imaging sensor include two transfer transistors (e.g., gates) where a first transfer transistor allows intensity detection, and a second transfer transistor allows contrast change detection.

Abstract: A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

Abstract: In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.

Abstract: In one implementation, an event sensor includes a plurality of pixels, an external readout line shared among the plurality of pixels, and an external processing circuit. Each pixel is configured to output pixel data indicative of an intensity of incident illumination. The external processing circuit is configured to output a stream of pixel events. Each respective pixel event is generated when a comparator of the external processing circuit obtains a sample of pixel data from a particular pixel via the external readout line that breaches a threshold value.

Abstract: Imaging apparatus (100, 200) includes a photosensitive medium (302) configured to convert incident photons into charge carriers. A bias electrode (304) overlies the photosensitive medium and applies a bias potential to the photosensitive medium. One or more pixel circuits (306) are formed on a semiconductor substrate. Each pixel circuit defines a respective pixel (300) and includes first and second pixel electrodes (316, 318) coupled to collect the charge carriers from the photosensitive medium at respective first and second locations, and first and second transfer gates (326, 328) in respective proximity to the first and second pixel electrodes. Circuitry (700) is coupled to apply different, respective first and second potentials to the first and second transfer gates and to vary the first and second potentials so as to control relative proportions of the charge carriers that are collected by the first and second electrodes.

Abstract: Various embodiments comprise apparatuses and methods including a light sensor. In one embodiment, an integrated circuit includes an image sensing array region, a first photosensor having a light-sensitive region outside of the image sensing array region, and control circuitry. The control circuitry is arranged in a first mode to read out image data from the image sensing array region, where the data provide information indicative of an image incident on the image sensing array region of the integrated circuit. The control circuitry is arranged in a second mode to read out a signal from the first photosensor indicative of intensity of light incident on the light-sensitive region of the first photosensor. Electrical power consumed by the integrated circuit during the second mode is at least ten times lower than electrical power consumed by the integrated circuit during the first mode. Additional methods and apparatuses are described.

Abstract: A sensor stack is described. The sensor stack includes first and second electromagnetic radiation sensors. The first electromagnetic radiation sensor has a high quantum efficiency for converting a first range of electromagnetic radiation wavelengths into a first set of electrical signals. The second electromagnetic radiation sensor is positioned in a field of view of the first electromagnetic radiation sensor and has a high quantum efficiency for converting a second range of electromagnetic radiation wavelengths into a second set of electrical signals and a low quantum efficiency for converting the first range of electromagnetic radiation wavelengths into the second set of electrical signals. The first range of wavelengths does not overlap the second range of wavelengths, and the second electromagnetic radiation sensor is at least partially transmissive to the first range of electromagnetic radiation wavelengths.

Abstract: Imaging apparatus (1300, 1400, 1500) includes a semiconductor substrate (1302), which includes at least first and second sensing areas (1306, 1308, 1502, 1514) with a predefined separation between the sensing areas. First and second arrays of pixel circuits (1312) are formed respectively on the first and second sensing areas and define respective first and second matrices of pixels. First and second photosensitive films (1314, 1316, 1402) are disposed respectively over the first and second arrays of pixel circuits, and are configured to output photocharge to the pixel circuits in response to radiation incident on the apparatus in different, respective first and second spectral bands.