Abstract: Convolutional neural networks have, over the last decade, risen to state-of-the-art for computer vision tasks such as image classification. Oftentimes these are implemented on specialized digital processors, which target high throughput operation. This is efficient when analyzing batches of images loaded from memory but is lacking when analyzing freshly-captured images on a sensor. Latency is an issue since image acquisition alone can take as long as the processing. Second, streams of images captured from sensors can result in highly redundant processing if only specific signatures needs to be recognized, leading to a high amount of wasted power. Disclosed is a way to perform convolutional processing on the image plane where the image is captured, which allows the device to only complete readout and processing when required. This reduces latency and power consumption, enabling new applications such as augmented reality and edge processing that are not possible with current technology.

Abstract: A reconfigurable thin-film photonic filter weight bank comprises at least one photodetector and at least one optical filtering device comprising a pair of reflective thin film stacks with an interstitial medium cavity therebetween forming an optical cavity. Operation of a bank occurs when the reflective film is more selectively reflective to a range of frequencies and is more translucent to frequencies outside the range. The bank can reconfigurably weight signals by varying the cavity sizes or complex indices of refraction, with one photodetector integrating the weighted signals. Detectors can also be embedded inside the individual cavities to output unweighted, but demultiplexed, electrical signals. A neuromorphic opto-electronic system comprises a plurality of interconnected artificial optical neurons, each including at least one thin film neuromorphic opto-electronic device with a reconfigurable thin-film photonic filter weight bank. Related methods are also disclosed.

Abstract: A High Bandwidth Individual Channel Control via Optical Reference Interferometry (HICCORI) system actively controls the phase and/or polarization of the optical emission of each element in a tiled optical array. It can also actively align any high-frequency broadening waveform applied to the array beams for spectral broadening or data transmission. By maintaining consistent polarization and manipulating the phase relationships of the beams emitted by the array elements, the HICCORI system can manipulate the spatial pattern of constructive and destructive interference formed as the individual emissions coherently combine. Active feedback control allows the desired phase, polarization, and/or spectral broadening alignment to be maintained in the presence of external disturbances.