Abstract: A method and an apparatus for camera-free light field video processing with all-optical neural network are disclosed. The method includes: mapping the light field video by a digital micro-mirror device (DMD) and an optical fiber coupler, a two-dimensional 2D spatial optical signal into a one-dimensional 1D input optical signal; realizing a multiply-accumulate computing model in a structure of all-optical recurrent neural network structure, and processing the 1D input signal to obtain the processed signal; and receiving the processed signal and outputting an electronic signal by a photodetector, or receiving the processed signal by a relay optical fiber for relay transmission of the processed signal. The method and system here realize light field video processing without the use of a camera and the whole system is all-optical, thus possessing the advantage in computing speed and energy-efficiency.

Abstract: A method for intelligent light field depth classification based on optoelectronic computing includes capturing and identifying binocular images of a scene within a depth range through a pair of binocular cameras; mapping each depth value in the depth range to a disparity value between the binocular images, to obtain a disparity range of the scene within the depth range; labeling training data based on the disparity range to obtain a pre-trained diffraction neural network model; loading a respective weight for each layer of a network obtained after training into a corresponding optical element based on the pre-trained diffraction neural network model; and after the respective weight for each layer of the network is loaded, performing forward propagation inference on new input data of the scene, and outputting a depth classification result corresponding to each pixel in the binocular images of the scene.

Abstract: A method and an apparatus for camera-free light field imaging with optoelectronic intelligent computing are provided. The method includes: obtaining an optical computing result by an optical computing module in response to receiving a light signal of an object to be imaged, in which the optical computing result includes light field imaging of the object to be imaged; computing by an electronic computing module the optical computing result to obtain an electronic computing result; and in response to determining based on the electronic computing result that cascading is required, forming a cascade structure by taking the electronic computing result at a previous level as an input of the optical computing module at a current level, and in response to determining that cascading is not required, outputting a final result.

Abstract: An optical diffractive processing unit includes input nodes, output nodes; and neurons. The neurons are connected to the input nodes through optical diffractions. Weights of connection strength of the neurons are determined based on diffractive modulation. Each optoelectronic neuron is configured to perform an optical field summation of weighted inputs and generate a unit output by applying a complex activation to an optical field occurring naturally in a photoelectronic conversion. Each neuron is a programmable device.