Abstract: NetCast is an optical neural network architecture that circumvents constraints on deep neural network (DNN) inference at the edge. Many DNNs have weight matrices that are too large to run on edge processors, leading to limitations on DNN inference at the edge or bandwidth bottlenecks between the edge and server that hosts the DNN. With NetCast, a weight server stores the DNN weight matrix in local memory, modulates the weights onto different spectral channels of an optical carrier, and distributes the weights to one or more clients via optical links. Each client stores the activations, or layer inputs, for the DNN and computes the matrix-vector product of those activations with the weights from the weight server in the optical domain. This multiplication can be performed coherently by interfering the spectrally multiplexed weights with spectrally multiplexed activations or incoherently by modulating the weight signal from the weight server with the activations.

Abstract: A reflective spatial light modulator (SLM) made of an electro-optic material in a one-sided Fabry-Perot resonator can provide phase and/or amplitude modulation with fine spatial resolution at speeds over a Gigahertz. The light is confined laterally within the electro-optic material/resonator layer stack with microlenses, index perturbations, or by patterning the layer stack into a two-dimensional (2D) array of vertically oriented micropillars. Alternatively, a photonic crystal guided mode resonator can vertically and laterally confine the resonant mode. In phase-only modulation mode, each SLM pixel can produce a ? phase shift under a bias voltage below 10 V, while maintaining nearly constant reflection amplitude. This high-speed SLM can be used in a wide range of new applications, from fully tunable metasurfaces to optical computing accelerators, high-speed interconnects, true 2D phased array beam steering, beam forming, or quantum computing with cold atom arrays.

Abstract: Deep learning performance is limited by computing power, which is in turn limited by energy consumption. Optics can make neural networks faster and more efficient, but current schemes suffer from limited connectivity and the large footprint of low-loss nanophotonic devices. Our optical neural network architecture addresses these problems using homodyne detection and optical data fan-out. It is scalable to large networks without sacrificing speed or consuming too much energy. It can perform inference and training and work with both fully connected and convolutional neural-network layers. In our architecture, each neural network layer operates on inputs and weights encoded onto optical pulse amplitudes. A homodyne detector computes the vector product of the inputs and weights. The nonlinear activation function is performed electronically on the output of this linear homodyne detection step.

Abstract: Component errors prevent linear photonic circuits from being scaled to large sizes. These errors can be compensated by programming the components in an order corresponding to nulling operations on a target matrix X through Givens rotations X?T†X, X?XT†. Nulling is implemented on hardware through measurements with feedback, in a way that builds up the target matrix even in the presence of hardware errors. This programming works with unknown errors and without internal sources or detectors in the circuit. Modifying the photonic circuit architecture can reduce the effect of errors still further, in some cases even rendering the hardware asymptotically perfect in the large-size limit. These modifications include adding a third directional coupler or crossing after each Mach-Zehnder interferometer in the circuit and a photonic implementation of the generalized FFT fractal.

Abstract: Programmable photonic circuits of reconfigurable interferometers can be used to implement arbitrary operations on optical modes, providing a flexible platform for accelerating tasks in quantum simulation, signal processing, and artificial intelligence. A major obstacle to scaling up these systems is static fabrication error, where small component errors within each device accrue to produce significant errors within the circuit computation. Mitigating errors usually involves numerical optimization dependent on real-time feedback from the circuit, which can greatly limit the scalability of the hardware. Here, we present a resource-efficient, deterministic approach to correcting circuit errors by locally correcting hardware errors within individual optical gates. We apply our approach to simulations of large-scale optical neural networks and infinite impulse response filters implemented in programmable photonics, finding that they remain resilient to component error well beyond modern day process tolerances.

Abstract: Deep learning performance is limited by computing power, which is in turn limited by energy consumption. Optics can make neural networks faster and more efficient, but current schemes suffer from limited connectivity and the large footprint of low-loss nanophotonic devices. Our optical neural network architecture addresses these problems using homodyne detection and optical data fan-out. It is scalable to large networks without sacrificing speed or consuming too much energy. It can perform inference and training and work with both fully connected and convolutional neural-network layers. In our architecture, each neural network layer operates on inputs and weights encoded onto optical pulse amplitudes. A homodyne detector computes the vector product of the inputs and weights. The nonlinear activation function is performed electronically on the output of this linear homodyne detection step.

Abstract: A reflective spatial light modulator (SLM) made of an electro-optic material, such as barium titanate, in a one-sided Fabry-Perot resonator can provide phase and/or amplitude modulation with fine spatial resolution at speeds over a Gigahertz. The light is confined laterally within the electro-optic material/resonator layer stack with microlenses, index perturbations, or by patterning the layer stack into a two-dimensional (2D) array of vertically oriented micropillars. Alternatively, a photonic crystal guided mode resonator can provide vertical and lateral confinement of the resonant mode. In phase-only modulation mode, each pixel in the SLM can produce a ? phase shift under a bias voltage below 10 V, while maintaining nearly constant reflection amplitude. The methodology for designing this SLM could also be used to design other SLMs (for example, amplitude-only SLMs).