Abstract: The present disclosure provides a multi-image-based image enhancement method and device, an electronic device and a non-transitory computer readable storage medium. The method includes: aligning a low-resolution target image and a reference image in an image domain; performing, an alignment in a feature domain; and synthesizing features corresponding to the low-resolution target image and features corresponding to the reference image to generate a final output.

Abstract: Provided are a three-dimensional reconstruction method, apparatus and system of a dynamic scene, a server and a medium. The method includes: acquiring multiple continuous depth image sequences of the dynamic scene, where the multiple continuous depth image sequences are captured by an array of drones equipped with depth cameras; fusing the multiple continuous depth image sequences to establish a three-dimensional reconstruction model of the dynamic scene; obtaining target observation points of the array of drones through calculation according to the three-dimensional reconstruction model and current poses of the array of drones; and instructing the array of drones to move to the target observation points to capture, and updating the three-dimensional reconstruction model according to multiple continuous depth image sequences captured by the array of drones at the target observation points.

Abstract: A super-resolution lattice light field microscopic imaging system includes: a microscope configured to magnify a sample and image the sample onto a first image plane of the microscope; a first relay lens configured to match a numerical aperture of an objective with that of a microlens array; a 2D scanning galvo configured to rotate an angle of a light path in the frequency domain plane; an illuminating system configured to provide uniform illumination on the microlens array to generate SIM pattern illumination; the microlens array, configured to modulate a light beam with a preset angle to a target spatial position at a back focal plane of the microlens array to obtain a modulated image; an image sensor configured to record the modulated image; and a reconstruction module configured to reconstruct a 3D structure of the sample based on the modulated image.

Abstract: The present disclosure provides a rapid three-dimensional imaging system based on a multi-angle 4Pi microscope. The system includes: an illumination module, configured to obtain a parallel light of which a size covering a projection surface of a spatial light modulator; a wavefront modulation module, configured to place the LCOS device on a Fourier plane of an illumination end; a two-dimensional scanning module, configured to control a light beam to realize a two-dimensional scanning on an object plane; an illumination interference module, configured to generate point spread function PSFs of a 4Pi through an illumination interference to irradiate a fluorescent sample; an imaging module, configured to acquire interference images of two fluorescent signals; and a controller, configured to control the wavefront modulation module to adjust a polarization direction of the light to generate PSFs of the 4Pi with different inclination angles.

Abstract: The present disclosure discloses a nonlinear all-optical deep-learning system and method with multistage space-frequency domain modulation. The system includes an optical input module, configured to convert input information to optical information, a multistage space-frequency domain modulation module, configured to perform multistage space-frequency domain modulation on the optical information generated by the optical input module so as to generate modulated optical information, and an information acquisition module, configured to transform the modulated optical information onto a Fourier plane or an image plane, and to acquire the transformed optical information so as to generate processed optical information.

Abstract: The present disclosure relates to a method for multi-color fluorescence imaging under a single exposure, an imaging method and system. The imaging system includes: a fluorescence microscope, configured to obtain a real image of the sample; a spatial mask, disposed behind the fluorescence microscope, and configured to perform mask modulation on the real image of the sample; a 4f system, disposed behind the spatial mask, in which the real image of the sample passes through the spatial mask to the 4f system; an optical granting, disposed on a Fourier plane in middle of the 4f system, and configured to split the real image of the sample to obtain a split real image; and an image sensor, configured to obtain the split real image to obtain an image of the sample. The present disclosure advantages of improving imaging rate in multi-spectrum fluorescence microscopy.

Abstract: A scanning light field microscopic imaging system includes: a microscope configured to magnify a sample and image the sample onto a first image plane of the microscope; a relay lens configured to magnify or minify the first image plane; a 2D scanning galvo configured to rotate an angle of a light path in the frequency domain plane; the microlens array configured to modulate a beam with a preset angle to a target spatial position at a back focal plane of the microlens array and modulate the first image plane to obtain a modulated image; an image sensor configured to record the modulated image; and a reconstruction module configured to reconstruct a 3D structure of the sample based on the modulated image acquired from the image sensor.

Abstract: Provided are a microscopic imaging system and a microscopic imaging method. The system includes: an illumination module configured to generate a laser illumination, an LCOS device located in a Fourier plane of the laser illumination and configured to modulate a phase of the laser illumination, a 4-F system configured to adjust a size of a light beam of the laser illumination, an excitation lens group configured to generate a point illumination focused in a sample plane, a detecting lens group configured to capture an image of a PSF of the point illumination, a camera sensor, and a controller configured to synchronously control a change in a phase pattern of the LCOS device and an image capture of the camera sensor.

Abstract: A super-resolution lattice light field microscopic imaging system includes: a microscope configured to magnify a sample and image the sample onto a first image plane of the microscope; a first relay lens configured to match a numerical aperture of an objective with that of a microlens array; a 2D scanning galvo configured to rotate an angle of a light path in the frequency domain plane; an illuminating system configured to provide uniform illumination on the microlens array to generate SIM pattern illumination; the microlens array, configured to modulate a light beam with a preset angle to a target spatial position at a back focal plane of the microlens array to obtain a modulated image; an image sensor configured to record the modulated image; and a reconstruction module configured to reconstruct a 3D structure of the sample based on the modulated image.

Abstract: Provided are a 3D microscopic imaging method and a 3D microscopic imaging system. The method includes: acquiring a first PSF of a 3D sample from an object plane to a plane of a main camera sensor and a second PSF of the 3D sample from the object plane to a plane of a secondary camera sensor, and generating a first forward projection matrix corresponding to the first PSF and a second forward projection matrix corresponding to the second PSF; acquiring a light field image captured by the main camera sensor and a high resolution image captured by the secondary camera sensor; generating a reconstruction result of the 3D sample by reconstructing the light field image, the first forward projection matrix, the high resolution image and the second forward projection matrix according to a preset algorithm.

Abstract: Microscopic imaging system and method with three-dimensional refractive index tomography are provided. The microscopic imaging system includes: an illumination providing module, configured to provide a beam of parallel lights with a modulated intensity; a microscopic sample, arranged at downstream of the illumination providing module, and configured to modulate a phase of the beam of parallel lights, such that emergent lights passing through the microscopic sample carry information of a three-dimensional refractive index field of the microscopic sample; a microscopic imaging module, arranged at downstream of the microscopic sample, and configured to form an image by using the emergent lights; and a controlling module, configured to process the image to reconstruct three-dimensional refractive index information of the microscopic sample.

Abstract: An imaging system is provided, which includes: a microscope; a field diaphragm; a one-dimensional beam-splitting grating, configured to duplicate a beam after passing through the first 4f system into beams with different angles; a phase modulation component, configured to perform different phase modulations to the beams with different angles respectively; a blazed grating, configured to perform dispersion to the beams with different angles passing through the phase modulation component at a dimension orthogonal to the beam-splitting grating; a micro lens array, configured to make the beams with different angles passing through the blazed grating to map to different locations on a back focal plane of the micro lens array; an image sensor, configured to image the back focal plane of the micro lens array. The system may recover three-dimensional information and multispectral information of the sample simultaneously from a single image.

Abstract: A microscopy imaging system is disclosed.

Abstract: A distance estimation method based on a handheld light field camera is disclosed and includes: S1: extracting parameters of the light field camera; S2: setting a reference plane and a calibration point; S3: refocusing a collected light field image on the reference plane, to obtain a distance between a main lens and a microlens array of the light field camera, and recording an imaging diameter of the calibration point on the refocused image; and S4: inputting the parameters of the light field camera, the distance between the main lens and the microlens array, and the imaging diameter of the calibration point on the refocused image to a light propagation mathematical model, and outputting a distance of the calibration point. The present application has high efficiency and relatively high accuracy.

Abstract: A phase microscopy system and method are provided in the present disclosure. The system includes: an optical source, configured to generate collimated light; an object arrangement component, configured to provide a mask and a sample; a microscopic imaging component, including a microscope and a sensor, the microscope being configured to project light that passes successively through the mask and the sample into the sensor to capture an image; and a control component, configured to reconstruct phase information of the sample based on the image through both the sample and the mash and a pre-stored reference image of the mask, in which the pre-stored reference image is pre-acquired by the phase microscopy system without providing the sample under a same light condition. With the present disclosure, dynamic phase information of the microscopic sample can be acquired accurately and rapidly with high resolution.

Abstract: The three-dimensional microscopic imaging system includes: a microscope; a field diaphragm; a narrow-band filter, configured to perform narrow-band filtering; a beam-splitting grating, configured to duplicate a beam into beams with different angles; a lens array with different focal length, configured to perform different phase modulation to each beam with different angles; a micro lens array, configured to modulate the beams with different angles that pass through the lens array with different focal length respectively to different spatial locations at a back focal plane of the micro lens array respectively; and an image sensor configured to record an image corresponding to the modulated beams at the back focal plane of the micro lens array. The system has a simple structure, a cheap cost, and a relatively weak exciting light, and is suit for living samples, and has the adjustable intervals of imaging depths.

Abstract: A depth estimation method based on light-field data distribution includes the following steps: S1. adjusting pixel distribution of input light-field images to generate a series of refocused light-field images having different focal lengths; S2. for a spatial point, corresponding to a macro-pixel, extracting intensity ranges for the macro-pixel from the refocused light-field images, and then selecting one refocused light-field image corresponding to a minimum intensity range, the focal length of the selected refocused light-field image being taken as a scene depth of the macro-pixel; the macro-pixel corresponding to one point in an actual scene, the intensity range of the macro-pixel being a variation range of intensity values of all points within the macro-pixel; and repeating the step S2 to obtain scene depths of all macro-pixels.

Abstract: Disclosed is a method for predicting depth map coding distortion of a two-dimensional free viewpoint video, including: inputting sequences of texture maps and depth maps of two or more viewpoint stereoscopic videos; synthesizing a texture map of a first intermediate viewpoint of a current to-be-coded viewpoint and a first adjacent viewpoint, and synthesizing a texture map of a second intermediate viewpoint of the current to-be-coded viewpoint and a second adjacent viewpoint by using a view synthesis algorithm; recording a synthetic characteristic of each pixel according to the texture map and generating a distortion prediction weight; and calculating to obtain total distortion according to the synthetic characteristic and the distortion prediction weight.

Abstract: A distance estimation method based on a handheld light field camera is disclosed and includes: S1: extracting parameters of the light field camera; S2: setting a reference plane and a calibration point; S3: refocusing a collected light field image on the reference plane, to obtain a distance between a main lens and a microlens array of the light field camera, and recording an imaging diameter of the calibration point on the refocused image; and S4: inputting the parameters of the light field camera, the distance between the main lens and the microlens array, and the imaging diameter of the calibration point on the refocused image to a light propagation mathematical model, and outputting a distance of the calibration point. The present application has high efficiency and relatively high accuracy.

Abstract: A method and an apparatus for calibrating an image sensor array in a microscopic imaging system are provided. The method includes: performing a vignetting effect calibration and correction on the image sensor array, such that pixels acquired by all sub-field-of-view image sensors for capturing a scene with a same radiant exitance have a same gray level; performing a light encoding on a temporal-spatial union structure using a spatial light modulator, to establish correspondences of a plurality of feature points between an image space and a physical space; performing a light decoding on the temporal-spatial union structure, to acquire pixel coordinates of the plurality of feature points in an image plane and physical coordinates of the plurality of feature points in a plane of the spatial light modulator; acquiring a homography relationship according to the pixel coordinates and the physical coordinates, acquiring a global coordinate mapping according to the homography relationship.