Abstract: A multispectral sensor array can include a combination of ranging sensor channels (e.g., LIDAR sensor channels) and ambient-light sensor channels tuned to detect ambient light having a channel-specific property (e.g., color). The sensor channels can be arranged and spaced to provide multispectral images of a field of view in which the multispectral images from different sensors are inherently aligned with each other to define an array of multispectral image pixels. Various optical elements can be provided to facilitate imaging operations. Light ranging/imaging systems incorporating multispectral sensor arrays can operate in rotating and/or static modes.

Abstract: A stereo camera array system includes: a first camera array at a first viewpoint including: a first camera configured to capture images in a first modality, the first modality being viewpoint-independent; and a second camera configured to capture images in a second modality different from the first modality; and a second camera array at a second viewpoint spaced apart along a first baseline from the first camera array at the first viewpoint, the second camera array including: a first camera configured to capture images in the first modality; and a second camera configured to capture images in the second modality.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for searching an autonomous vehicle sensor data repository. One of the methods includes maintaining a collection of sensor samples and one or more embeddings of each sensor sample. Each sensor sample is generated from sensor data at multiple time steps and characterizes an environment at each of the multiple time steps. Each embedding corresponds to a respective portion of the sensor sample and has been generated by an embedding neural network. A query specifying a query portion of a query sensor sample is received. A query embedding corresponding to the query portion of the query sensor sample is generated through the embedding neural network. A plurality of relevant sensor samples that have embeddings that are closest to the query embedding are identified as characterizing similar scenarios to the query portion of the query sensor sample.

Abstract: The invention relates to a projector module. In particular, the invention relates to a projector module for the use in mobile devices, wherein a most compact, stable and reliable module structure with high module efficiency can be achieved. A projector module according to the invention comprises a beam path with a laser source, designed to emit coherent electromagnetic radiation with a divergent beam profile; a collection optics, designed to collimate or focus the divergent radiation emitted by the laser source convergently into an image plane; and a diffractive optical element, DOE, designed to generate a projection pattern from the radiation collimated or focused by the collection optics; wherein a deflector, designed to deflect the divergent radiation emitted by the laser source from a first direction into a second direction deviating from the first direction, is arranged in front of the collection optics or is designed as a collection optics.

Abstract: An image processing apparatus in an embodiment includes a FIFO memory, a plurality of line buffers, an image processing circuit, and a control circuit. The plurality of line buffers store data inputted from a plurality of cameras. The image processing circuit performs predetermined image processing on the data stored in the plurality of line buffers. The control circuit performs control, according to an output control signal, such that output of data to the plurality of line buffers is stopped and the data stopped from being outputted is stored in the FIFO memory.

Abstract: A method for recovering an image passing through a display and taken by an image sensor disposed on a rear side of the display, the method includes acquiring the image taken by the image sensor, obtaining a plurality of point spread functions corresponding one-to-one to a plurality of dots arranged in a predetermined pattern on a calibration chart, and recovering the image by performing a de-convolution of the image based on the plurality of point spread functions.

Abstract: An electronic device may have a flexible housing formed from flexible fabric, flexible polymer, or other flexible materials. Cameras may be mounted on the housing. The housing may be bent into different configurations such as a configuration in which the housing has a convex surface facing an exterior region and a configuration in which the housing has a concave surface facing the exterior region. The cameras may have respective camera image capture directions. By reorienting the cameras by bending the housing, the cameras can be used to capture panoramic images or three-dimensional images.

Abstract: In an aspect, camera sensor component receives, during a multi-virtual channel (VC) configuration session, a first configuration of a first VC associated with a first binning mode (e.g., full, 4×4, 8×8, etc.) and a second configuration of a second VC, the second configuration associated with a second binning mode (e.g., full, 4×4, 8×8, etc.). The camera sensor component detects trigger(s) to initiate streaming of activity frames associated with the first VC and the second VC. In response to the trigger(s), the camera sensor component streams first activity frames associated with the first VC in accordance with the first binning mode, and streams second activity frames associated with the second VC in accordance with the second binning mode.

Abstract: An imaging device includes a pre-processing module that generates a first image by performing a binning operation in a first mode and generates a second image by performing a remosaic operation in a second mode; a calibration module that generates calibration data based on a first image and a second image, the calibration data including a code level difference of the first image and the second image for each of a plurality of colors by a grid unit; and a compensation module that generates a calibration image by decoding the calibration data, and generates a compensated second image associated with a raw image by summing the second image associated with the raw image and the calibration image to compensate for a color tone difference between the first mode and the second mode by the grid unit.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for searching an autonomous vehicle sensor data repository. One of the methods includes maintaining a collection of sensor samples and, for each sensor sample, an embedding of the sensor sample; receiving a request specifying a query sensor sample, wherein the query sensor sample characterizes a query environment region; and identifying, from the collection of sensor samples, a plurality of relevant sensor samples that characterize similar environment regions to the query environment region, comprising: processing the query sensor sample through the embedding neural network to generate a query embedding; and identifying, from sensor samples in a subset of the sensor samples in the collection, a plurality of sensor samples that have embeddings that are closest to the query embedding.

Abstract: A system for generating depth information from low-resolution images is configured to access a plurality of image frames capturing an environment, identify a first group of image frames from the plurality of image frames, and generate a first image comprising a first composite image of the environment using the first group of image frames as input. The first composite image has an image resolution that is higher than an image resolution of the image frames of the first group of image frames. The system is also configured to obtain a second image of the environment, where parallax exists between a capture perspective associated with the first image and a capture perspective associated with the second image. The system is also configured to generate depth information for the environment based on the first image and the second image.

Abstract: In an operation by line-of-sight input, a position (designated position) designated by a gaze point is easier to view after a determination operation is performed by a user than before the determination operation is performed. An electric device includes a detector configured to detect a gaze point on a display unit, and a control unit configured to display an indicator indicating the gaze point on the display unit, wherein, in a case where a setting to keep displaying the indicator even in a case where an operation is performed on an operation unit by the user is set, the control unit performs control, in response to an operation performed on the operation unit by the user, to display a display item at the gaze point and to display the indicator and the display item in a changed display order.

Abstract: Disclosed is a system and associated methods for generating a consistently sharp, detailed, and in-focus three-dimensional (“3D”) model of an object from two-dimensional (“2D”) images that collectively capture all sides of the object with multiple depths-of-field. The system receives a set of 2D images that capture a particular part of the object with different depths-of-field. The system determines a first pixel from a first 2D image and a second pixel from a second 2D image that represent a common point of the object, determines that the first pixel is out of focus based on the first 2D image depth-of-field and that the second pixel is in focus based on the second 2D image depth-of-field, and defines a 3D construct, that represents the common point in a 3D model of the object, using data of the in-focus second pixel instead of data of the out-of-focus first pixel.

Abstract: An imaging element comprises a first communication interface that is incorporated in the imaging element and outputs first image data based on image data obtained by imaging a subject to an external processor, a memory that is incorporated in the imaging element and stores the image data, and a second communication interface that is incorporated in the imaging element and outputs second image data based on the image data stored in the memory to the external processor, in which an output method of the first communication interface and an output method of the second communication interface are different.

Abstract: Provided is an image restoration method of restoring an image obtained through an array camera, the image restoration method including obtaining a plurality of images through lens elements included in the array camera, obtaining a global parameter of the plurality of images, generating first processed images by transforming a viewpoint of each of the plurality of images based on the obtained global parameter, obtaining a local parameter for each pixel corresponding to each of the first processed images, generating second processed images by transforming the first processed images based on the obtained local parameter, and generating a synthesized image of a target viewpoint based on synthesizing the second processed images.

Abstract: Embodiments relate to the field of terminals and disclose a camera switching method for a terminal, and the terminal. In those embodiments, when the terminal is installed with a plurality of cameras, automatic and dynamic switching between the cameras may be implemented based on a to-be-photographed object, thereby improving a photographing effect of the to-be-photographed object. In those embodiment, the terminal may display, in response to a first operation of enabling a photographing function by a user, a first photographing picture captured by a first camera, where the first photographing picture includes a to-be-photographed object. If the to-be-photographed object cannot be displayed completely in the first photographing picture, the terminal may switch from the first photographing picture to a second photographing picture captured by the second camera, and disabling the first camera, where an FOV of the second camera is larger than an FOV of the first camera.

Abstract: A lighting module which provides adjustably controllable illumination of a camera field of view of a camera module includes an adjustable collimator which can be adjustably positioned such that the emitted light beam is adjustably directed to illuminate various regions of various camera fields of view. The collimator can be adjusted via an actuator which adjustably positions the collimator relative to static components of the lighting module, including the light emitter. The light beam can be directed to illuminate a selected limited region of a camera field of view, based on identification of a subject within the limited region. The light beam can be adjustably directed based on user interactions with a user interface, including adjusting the light beam according to user-commanded beam angle, intensity, and direction. The light beam can be adjustably directed to illuminate a region according to different fields of view of different camera modules.

Abstract: A method for predicting a condition of living-being in an environment, the method including capturing image-data associated with the at-least one person and based thereupon determining a current-condition of the person; receiving content from a plurality of content-sources with respect to said at least one person being imaged, said content defined by at least one of text and statistics; defining one or more weighted parameters based on allocating a plurality of weights to at least one of the captured image data and the received content based on the current-condition; and predicting, by a predictive-analysis module, a condition of the at-least one person based on analysis of the one or more weighted parameters.

Abstract: A method of forming a visual representation of an object from a plurality of image frames acquired using a portable electronic device, the method comprising the steps of determining at least one parameter of motion of the portable electronic device; determining at least one capture condition for at least one first image frame of the plurality of image frames; computing, based on the at least one parameter of motion and the at least one capture condition, an indication of blur in the image frame; based on the indication of blur, conditionally taking a corrective action.

Abstract: A processing apparatus is configured to process image data from an image pickup apparatus that includes a first imaging unit and a second imaging unit. The processing apparatus includes an acquisition unit configured to acquire information on first image data acquired by the first imaging unit, and a processing unit configured to process second image data acquired by the second imaging unit so that the information on the first image data is collateral with the second image data.

Abstract: A capture device and method, the capture device comprising: a camera ensemble, comprising one or more cameras, the camera ensemble adapted to obtain high resolution images and low resolution images; one or more processors configured to receive the high resolution images and the low resolution images from the camera ensemble and process the high resolution images and the low resolution images, and to output images or metadata; and a three-way switch, having an “off” state, an “auto” state and a “stream” state, wherein when the three-way switch is in “Off” state, no image or metadata is output by the processor, when the three-way switch is in “Auto” state, only metadata is output by the processor, and when the three-way switch is in “Stream” state, metadata and high resolution images can be output by the processor.

Abstract: An ultra-wide angle camera lens is provided. The lens includes, from an object side to an image side: a first lens with negative refractive power, an image-side face of the first lens being concave; a second lens with negative refractive power, an image-side face of the second lens being concave; a third lens with positive refractive power, an object-side face of the third lens being convex; a fourth lens with positive refractive power, an image-side face of the fourth lens being convex; and a fifth lens with negative refractive power, an image-side face of the fifth lens being concave. The lens satisfies: ?0.05<f/f1<0; and 1.2<ImgH/f<2, in which, f represents an effective focus length of the ultra-wide angle camera lens, f1 represents an effective focus length of the first lens L1, and ImgH is half of a diagonal line of an effective pixel region on an imaging face.

Abstract: A digital imaging device includes: a monochromatic sensor including a plurality of photosensitive elements distributed in an array, the plurality of photosensitive elements configured to convert light falling on the monochromatic sensor into electronic signals; and a plurality of filters, each filter configured to be moved into a position in front of the monochromatic sensor, wherein each filter, when moved into the position in front of the monochromatic sensor, covers substantial portion of the monochromatic sensor. Key words include imaging sensor and layered filter.

Abstract: A hybrid modular appliance or electronic device allows a user to plug a number of snap-together component modules of different types into a base device, so that the resulting assembly performs a custom-designed functionality. With no attached component modules, the base device functions as a standalone consumer or office appliance. At least one component module has its functionality not supporting the functionality of the base device, thereby allowing the resulting assembly a hybrid device. Examples of the hybrid modular devices include a TV-Wi-Fi-router, and a TV-storage-DVR-Wi-Fi-router. A hybrid modular device can serve as a videoconference device, a music jukebox, or a home theater unit.

Abstract: A playback apparatus loaded with a data recording medium including image data includes a first determining unit configured to determine whether a user stopped playing back the image data, a storage control unit configured to control a storage process so that a first set of information indicating a position where the playback of the image data was stopped is stored when the first determining unit determines that the user stopped playback of the image data, and a display control unit configured to control a screen to display a list of thumbnail images with an icon superposed on a thumbnail image corresponding to the image data stopped on the basis of the first set of information when the first determining unit determines that the user stopped playback of the image data, the icon indicating that playback of the image data is resumed from the position where the playback of the image data was stopped.

Abstract: System and method to (1) directly capture data-volume-reduced or compressed color images or video image frames by a camera system compared to those from conventional color camera systems with the same image resolution, and (2) retrieve uncompressed color images or video image frames for display, visualization, or other image/video processing at the end user side.

Abstract: Multiple capture assist marks (markers for capture assistance) to be synthesized with video captured by a camera unit 10 is generated by an OSD unit 20 through the control of a control unit 100. These capture assist marks are synthesized with the video from the camera unit 10 by synthesis means and displayed. In this case, an operation unit 110 is used to accept input of an instruction about the capture assist mark from a user. Based on this instruction input, the control unit 100 controls the OSD unit 20 and a baseband processing unit 30 to synthesize the capture assist mark corresponding to the instruction with a video signal from the camera unit 10.

Abstract: A method for AWB (Automatic White Balance) compensation, performed by a processing unit, the method at least containing acquiring a frame 0; dividing the frame 0 into blocks; obtaining block statistics information of each block of the frame 0; labeling each block of the frame 0 as one type according to its block statistics information; employing a first AWB compensation to the frame 0 with an input of first-type blocks of the frame 0, wherein the first-type blocks of the frame 0 are blocks labeled as a first type; employing a second AWB compensation to a frame 1 with an input of blocks of the frame 1 at the same locations as that of second-type blocks of the frame 0, wherein the second-type blocks of the frame 0 are blocks labeled as a second type; and fusing the compensated frame 0 with the compensated frame 1.

Abstract: A optoelectronic photo sensor to obtain single mosaic digital photographic images. Photo sensor is designed as a plurality of identical lenses having rows of staggered identical matrices arranged on a common focal surface with the gaps between adjacent matrices not exceeding the length of the effective number of pixels oriented along the row. Said arrangement provides a single large survey field from a plurality of individual matrices. Said design contemplates the use of several small individual lenses instead of one large and expensive lens, as well as many small matrices instead of one large and expensive matrix. The lenses are arranged at an angle to each other with a strictly defined dependence on the focal distance and the length of the gap between matrices in the row, which ensures continuous imaging by individual matrices over the surface surveyed with preset overlapping for subsequent cross-linking of images into one single film.

Abstract: The present invention discloses a method of capturing images and an image capturing device using the method. The image capturing device has a first lens module and a second lens module having a view angle which is smaller than that of the first lens module. The method comprises: increasing an exposure time and reducing a light sensitivity value of the first lens module and capturing a first image by using the first lens module; reducing the exposure time and increasing the light sensitivity value of the first lens module and capturing a second image by using the second lens module; extracting a plurality of image features from the first image and the second image respectively and determining a region corresponding to the second image in the first image; and merging the second image into the region in the first image to generate an output image.

Abstract: A number of brightness samples are taken outside a shape to compensate for blooming of the shape in an image generated by a digital camera. The brightness of each of the samples is determined and averaged, and the size of the shape is adjusted based on the difference between the brightness of the shape and the average of the brightness samples.

Abstract: An image-capturing device including: an imaging optical system which is configured to capture an optical image of a subject; an imaging optical system retaining member which retains the imaging optical system; an imaging element which is configured to convert the optical image into an electrical signal; a substrate which is arranged on a back side of the imaging optical system retaining member and retains the imaging element; and a plurality of substrate joint pieces each of which extends from the imaging optical system retaining member toward the substrate, wherein tip parts of the plurality of substrate joint pieces on a substrate side and the substrate are joined by an indirect bond structure using at least one joint intermediate member which is adhered to at least one of the tip parts of the plurality of substrate joint pieces and the substrate with an adhesive, and a fixation structure.

Abstract: The invention concerns image processing that includes the estimation of the optical depths of points in image data in order to enhance the image data. In particular but not limited to, from the optical depth noise present in the image due to aerosol in the scene, such as fog or haze, can be reduced. The invention concerns determining a first cost for each point independently based on a determined metric (60) and then a second cost based on an expected correlation in neighboring points (70). The two costs are then optimized (80) to determine an estimated optical depth for each point (80) that is then used to reduce the effect of aerosol in the image (84). Applications of the invention include, but is not limited to, surveillance systems so that objects in the scene of the image can be better identified once the image data has been enhanced to reduce the estimated noise. Aspects of the invention include a method, software, computer apparatus and a field programmable gate array.

Abstract: An action plan data structure for one or more selected rendered documents is described. The data structure contains information specifying an action to perform automatically in response to a text capture from any of the selected rendered documents.

Abstract: An imager array may be provided as part of an imaging system. The imager array may include a plurality of sensor arrays (e.g., also referred to as lenslets or optical elements). Each sensor array may include a plurality of sensors (e.g., pixels) associated with a lens. The sensor arrays may be oriented, for example, substantially in a plane facing the same direction and configured to detect images from the same scene (e.g., target area). Such images may be processed in accordance with various techniques to provide images of electromagnetic radiation. The sensor arrays may include filters or lens coatings to selectively detect desired ranges of electromagnetic radiation. Such arrangements of sensor arrays in an imager array may be used to advantageous effect in a variety of different applications.

Abstract: Methods, apparatus and systems for determining a power spectral density (PSD) of a signal, in which modulation of the signal is employed to facilitate determination of one or more PSD values over a wide range of frequencies. In some implementations, the signal may represent a wide-sense stationary random process. In one example, the signal is measured/sampled during a plurality of measurement windows, during which an intensity of the signal is modulated at one or more modulation frequencies. A variance of a set of quantities determined from the signal samples is calculated and used to determine respective values of the power spectral density (PSD) for the signal at the one or more modulation frequencies. The one or more modulation frequencies may be chosen in excess of the Nyquist frequency of the sampling process, such that the signal may be characterized for one or more frequencies above the Nyquist limit.

Abstract: A stereoscopic image with a predetermined parallax can be automatically taken, and a stereoscopic image with an arbitrary parallax can also be taken based on selection made by a photographer. An imaging apparatus includes two or more imaging systems. First, a guidance indicating that a first imaging system is used to take a first image and that a second imaging system is used to take a second image, is displayed on a monitor of the imaging apparatus. After the first image is shot by the first imaging system, a live view image shot by the second imaging system is displayed in a semi-transparent manner with the shot first image on the monitor, and a guidance is also displayed on the monitor. When the release switch is depressed, the second image is shot by the right imaging system.

Abstract: Systems and methods are provided for selecting one or more of several images captured in sequence and stored in a buffer in response to receiving a user instruction to store a captured image. An electronic device can capture information describing the movement of the device at the time each of the several images was captured, such that each image can be associated with specific device movement information. The electronic device can then select the one of the captured and buffered images for which the movement information of the device satisfies particular criteria. This can ensure that the particular image stored is not blurry due to device movement at the time the image was captured.

Abstract: An image editing apparatus includes a subject information extracting unit configured to extract subject information of a subject from an image, and a subject frame setting unit configured to set a subject frame based on the subject information extracted by the subject information extracting unit. The image editing apparatus also includes a region instructions detecting unit configured to detect a user's instructions as to a region of the subject frame set by the subject frame setting unit, and a region instructions frame setting unit configured to set a region instructions frame based on the user's instructions detected by the region instructions detecting unit. The image editing apparatus further includes a storage processing unit configured to store the subject frame set by the subject frame setting unit, and the region instructions frame set by the region instructions frame setting unit, in a correlated manner.

Abstract: A system and method for obtaining images having an ultra-wide field of view angle. A panoramic camera includes two subsystems: an optical subsystem and an image sensor. The optical subsystem includes at least a three-aspheric mirrors for producing an image of objects in the ultra-wide field of view. The produced images are correctable by a standard optical element to produce on an image plane an image having an optical resolution approximately equal or exceeding the Nyquist sampling criterion for the image sensor. A first mirror provides a sharp, compressed, virtual image using a convex paraboloidal or hyperboloidal mirror. Second and third mirrors redirect light onto the correction element through a folded optical path. The standard optical element projects a virtual image onto the image sensor. Image processing software can be used to decompress and unwrap the ultra-wide angle image captured by the image sensor.

Abstract: A method for photographing a panoramic picture includes the steps of checking motion of a corresponding photographing apparatus compares currently input images and previous images in real time through a motion estimation technique employing exposure compensation. Respective images constituting a panoramic picture are photographed, and image photography information is checked that includes focus distance and optical magnification to calculate actual photography range distance of the images. A pre-set threshold is set in consideration of a calculated actual photography range distance of the images. The checked motion is confirmed as to whether the pre-set threshold has been reached, and photography time points of the respective images are determined. The respective images are photographed according to a manual mode or an automatic mode at the photography time point of the respective images.

Abstract: Provided are an apparatus and a method for tracking movements of objects to infer a topology of a network of multiple cameras. The apparatus infers the topology of the network formed of the multiple cameras that sequentially obtain images and includes an object extractor, a haunting data generator, and a haunting database (DB), and a topology inferrer. The object extractor extracts at least one from each of the obtained images, for the multiple cameras. The haunting data generator generates appearing cameras and appearing times at which the moving objects appear, and disappearing cameras and disappearing times at which the moving objects disappear, for the multiple cameras. The haunting DB stores the appearing cameras and appearing times and the disappearing cameras and disappearing times of the moving object, for the multiple cameras. The topology inferrer infers the topology of the network using the appearing cameras and appearing times and the disappearing cameras and disappearing times of moving objects.

Abstract: A data reader comprises a camera that has an adjustable resolution and acquisition speed. The camera is maintained at a low level resolution and fast speed and is periodically actuated to acquire images. When an acquired image indicates that an object is present, the resolution of the camera is increased, and a higher resolution image is acquired and decoded. The imaging system of the camera is therefore used to trigger data acquisitions, thereby eliminating the need for external triggers and sensor devices.

Abstract: An image acquisition system for capturing images of a scene is provided. The system includes a stationary image acquisition device that receives optical images. A light-directing device directs images toward the image acquisition device. The light-directing device pivots about a pivot axis over a scan range that is less than 360 degrees.