Abstract: A system and method for multi-channel fluorescence surgical microscopy are disclosed. A compact fluorescence multi-camera array includes more than two micro-cameras positioned behind a primary objective lens, with subsets of the micro-cameras configured for bright-field imaging and for different fluorescence emission channels. The system simultaneously captures multiple fluorescence channels together with multi-perspective image data, which are processed to generate quantitative three-dimensional information at video rates and high spatial resolution. An illumination system provides concurrent bright-field illumination and multi-channel fluorescence excitation. The resulting three-dimensional and multi-spectral information is displayed in real time and may be used to guide surgical visualization, navigation, or robotic-assisted procedures.

Abstract: Disclosed is a digital imaging system comprising an array of more than one digital image sensor arranged on a single printed circuit board at a tight inter-sensor spacing that is less than the width of two adjacent image sensors. Each sensor comprises an array of light sensitive pixels that detect incident electromagnetic radiation and convert it into a digital signal. Further, a first digital processing unit is operatively connected to the electrical traces and is positioned at a finite distance from the digital image sensors to mitigate heat transfer. The first digital processing unit receives the digital signals from the sensors, aggregates them into a set of digital image data, and pre-processes the data. Moreover, a second digital processing unit then receives the pre-processed data for further processing and digital storage. Such an architecture offers enhanced image quality through improved thermal management and synchronized data aggregation.

Abstract: A system can be used for imaging volumetric samples using a camera array to capture images under different illumination patterns at different axial planes of focus, and at optionally varying lateral fields of view. The sequence of images taken under the different illumination patterns and optional varying lateral fields of view can be processed to generate an image representation of the sample at a focus plane of the sample. Multiple image representations at different focus planes are assembled to form a 3D volumetric representation of the sample.

Abstract: An arrangement of one or more micro cameras are used in conjunction with computer controlled illumination to create a high-throughput microscope able to operate without the need of expensive scanning stages. A single unit contains a plurality of sensors, lenses tiled in such a way to cover a significant fraction of the desired field of view in a digital single acquisition. Mechanical stages and patterned illumination can then be used in conjunction with the system to enhanced the imaged depth of field, or create an acquisition stack to enhance the information acquired. Multiple units can be combined to obtain images of a single sample from different angles. The absence of mechanical stages makes the imaging system ideal for use in scenarios that require the sample to be in a climate and/or environmentally controlled chamber.

Abstract: An array of more than one digital micro-camera, along with the use of patterned illumination and a digital post-processing operation, jointly create a multi-camera patterned illumination (MCPI) microscope. Each micro-camera includes its own unique lens system and detector. The field-over-view of each micro-camera unit at least partially overlaps with the field-of-view of one or more other micro-camera units within the array. The entire field-of-view of a sample of interest is imaged by the entire array of micro-cameras in a single snapshot. In addition, the MCPI system uses patterned optical illumination to improve its effective resolution. The MCPI system captures one or more images as the patterned optical illumination changes its distribution across space and/or angle at the sample. Then, the MCPI system digitally combines the acquired image sequence using a unique post-processing algorithm.

Abstract: A system and method to verify the authenticity of a physical object, based on the efficient acquisition and digital post-processing of a large amount of optical data. An optical system, comprised of an array of microscope-type “micro-cameras” and a patterned illumination source, acquires spatial, spectral and angular information about the physical object in the form of micro-camera images. The set of all acquired images comprise one object dataset, which a post-processing system then digitally transforms into a multi-gigabyte set of semi-random keys. Authentication takes place at a later date following a challenge-and-response protocol. The high resolution (<15 ?m) of the acquired data presents a significant challenge to attempted duplication of the physical object, and the large size (>1 Gigabyte) of the key set similarly prevents both physical and digital forgery attempts.

Abstract: A system and method for high-resolution polarimetric imaging can include an array of micro-cameras to simultaneously capture polarized optical information from a wide area. Polarized illumination sources can be placed below and/or above the sample to direct polarized light to the sample during image capture. Post processing can be performed on the captured images to obtain polarimetric properties of the sample.

Abstract: An imaging system is configured with an autofocus operation that refocuses multiple cameras of the imaging system on detected features of interest, instead of on the whole image of the sample. Focus measures are calculated on the detected features, and then aggregated to focus distances of actuator moving the camera array, the sample stage, or individual cameras based on a maximization of detected features to be in focus. After the refocus, the imaging system recaptures new images and analyzes features on the new images to generate statistical characterization of the sample based on the classification of the features.

Abstract: An arrangement of one or more micro cameras are used in conjunction with computer controlled illumination to create a high-throughput microscope able to operate without the need of expensive scanning stages. A single unit contains a plurality of sensors, lenses tiled in such a way to cover a significant fraction of the desired field of view in a digital single acquisition. Mechanical stages and patterned illumination can then be used in conjunction with the system to enhanced the imaged depth of field, or create an acquisition stack to enhance the information acquired. Multiple units can be combined to obtain images of a single sample from different angles. The absence of mechanical stages makes the imaging system ideal for use in scenarios that require the sample to be in a climate and/or environmentally controlled chamber.

Abstract: An arrangement of one or more micro cameras are used in conjunction with computer controlled illumination to create a high-throughput microscope able to operate without the need of expensive scanning stages. A single unit contains a plurality of sensors, lenses tiled in such a way to cover a significant fraction of the desired field of view in a digital single acquisition. Mechanical stages and patterned illumination can then be used in conjunction with the system to enhanced the imaged depth of field, or create an acquisition stack to enhance the information acquired. Multiple units can be combined to obtain images of a single sample from different angles. The absence of mechanical stages makes the imaging system ideal for use in scenarios that require the sample to be in a climate and/or environmentally controlled chamber.

Abstract: Image features are extracted from multiple variably-illuminated images, with the images acquired from a multi-camera array microscope. A sequence of images per camera is captured, with the illumination pattern varied between each image capture. After image capture, a post-processing algorithm finds keypoints of interest within the images captured by each camera. These features can be used to assist with stitching together images from the multi-camera array, in addition to image compression, object tracking or other automated tasks.

Abstract: An imaging system having multiple cameras providing a large field of view with sufficient resolution can be used for tracking movements of cells from their positions in a tissue sample into multiple isolated areas such as into individual microwells in a well plate. By determining the beginning and the end of the movements of each cell, the imaging system can associate the microwell locations to the original cell positions in the sample. Together with an analysis of the cells in the microwells, either individually or together with barcode beads, the analysis can achieve the spatial information needed for constructing a map of the molecular information with respect to the positions of the cells in the sample.

Abstract: An array of more than one digital micro-camera, along with the use of patterned illumination and a digital post-processing operation, jointly create a multi-camera patterned illumination (MCPI) microscope. Each micro-camera includes its own unique lens system and detector. The field-over-view of each micro-camera unit at least partially overlaps with the field-of-view of one or more other micro-camera units within the array. The entire field-of-view of a sample of interest is imaged by the entire array of micro-cameras in a single snapshot. In addition, the MCPI system uses patterned optical illumination to improve its effective resolution. The MCPI system captures one or more images as the patterned optical illumination changes its distribution across space and/or angle at the sample. Then, the MCPI system digitally combines the acquired image sequence using a unique post-processing algorithm.

Abstract: A system can be used for imaging volumetric samples using a camera array to capture images under different illumination patterns at different axial planes of focus, and at optionally varying lateral fields of view. The sequence of images taken under the different illumination patterns and optional varying lateral fields of view can be processed to generate an image representation of the sample at a focus plane of the sample. Multiple image representations at different focus planes are assembled to form a 3D volumetric representation of the sample.

Abstract: A system and method for high resolution multi-fluorescence imaging with synchronized image acquisition amongst sensors can be used to simultaneously capture fluorescence signals from multiple fluorophores over extremely large fields of view. The system can include an array of micro-cameras, along with a particular arrangement of fluorescent filters that can be fixed in one location or moved to new locations.

Abstract: A microscopy includes multiple cameras working together to capture image data of a sample having a group of organisms distributed over a wide area, under the influence of an excitation instrument. A first processor is coupled to each camera to process the image data captured by the camera. Outputs from the multiple first processors are aggregated and streamed serially to a second processor for tracking the organisms. The presence of the multiple cameras capturing images from the sample, configured with 50% or more overlap, can allow 3D tracking of the organisms through photogrammetry.

Abstract: An array of more than one digital micro-camera, along with the use of patterned illumination and a digital post-processing operation, jointly create a multi-camera patterned illumination (MCPI) microscope. Each micro-camera includes its own unique lens system and detector. The field-over-view of each micro-camera unit at least partially overlaps with the field-of-view of one or more other micro-camera units within the array. The entire field-of-view of a sample of interest is imaged by the entire array of micro-cameras in a single snapshot. In addition, the MCPI system uses patterned optical illumination to improve its effective resolution. The MCPI system captures one or more images as the patterned optical illumination changes its distribution across space and/or angle at the sample. Then, the MCPI system digitally combines the acquired image sequence using a unique post-processing algorithm.

Abstract: A system and method for high resolution multi-fluorescence imaging with synchronized image acquisition amongst sensors can be used to simultaneously capture fluorescence signals from multiple fluorophores over extremely large fields of view. The system can include an array of micro-cameras, along with a particular arrangement of fluorescent filters that can be fixed in one location or moved to new locations.

Abstract: A method to capture microscopy images from multiple image sensors and to relay them to one or more central processing units while minimizing delay in image capture can include the co-optimization of image acquisition hardware, data aggregation digital logic, firmware, and integration with data post processing on the central processing units. The methods can include organizing the incoming image data into data packets containing partial image frames, together with configuring the central processing units to be capable of analyzing the received partial image frames. The quick analysis of the images, e.g., on the partial image frames, can allow the computational system to rapidly respond to the captured images, such as to provide feed back on the captured images before the next images are to be captured.

Abstract: A method to capture microscopy images from multiple image sensors and to relay them to one or more central processing units while minimizing delay in image capture can include the co-optimization of image acquisition hardware, data aggregation digital logic, firmware, and integration with data post processing on the central processing units. The methods can include organizing the incoming image data into data packets containing partial image frames, together with configuring the central processing units to be capable of analyzing the received partial image frames. The quick analysis of the images, e.g., on the partial image frames, can allow the computational system to rapidly respond to the captured images, such as to provide feed back on the captured images before the next images are to be captured.