Abstract: Disclosed are image data acquisition methods and systems that utilizes selective temporal co-adding of detector integration samples to construct improved high-resolution output imagery for arrays with selectable line rates. Configurable TDI arrays are used to construct output imagery of various resolutions dependent upon array commanding, the acquisition geometry, and temporal sampling. The image acquisition techniques may be applied to any optical sensor system and to optical systems with multiple sensors at various relative rotations which enable simultaneous image acquisitions of two or more sensors. Acquired image data may be up-sampled onto a multitude of image grids of various resolution.

Abstract: Disclosed are image data acquisition methods and systems that utilizes selective temporal co-adding of detector integration samples to construct improved high-resolution output imagery for arrays with selectable line rates. Configurable TDI arrays are used to construct output imagery of various resolutions dependent upon array commanding, the acquisition geometry, and temporal sampling. The image acquisition techniques may be applied to any optical sensor system and to optical systems with multiple sensors at various relative rotations which enable simultaneous image acquisitions of two or more sensors. Acquired image data may be up-sampled onto a multitude of image grids of various resolution.

Abstract: A camera focusing method, apparatus, and device for a terminal, and relate to the field of electronic device technologies to improve focusing precision of a terminal in a camera focusing process. The method includes obtaining a first confidence and a second confidence, determining a target ranging manner and a target object distance when the first confidence and the second confidence meet a preset condition, and determining a target position in a lens position interval to help a first camera and a second camera complete focusing.

Abstract: In a measurement apparatus, a first pupil is capable of transmitting first light of a first wavelength band, and a second pupil is capable of transmitting second light of a second wavelength band. An imaging device includes a plurality of first pixels generating first pixel signals based on third light of a third wavelength band transmitted through a first optical filter that is capable of transmitting the third light. The imaging device further includes a plurality of second pixels generating second pixel signals based on fourth light of a fourth wavelength band transmitted through a second optical filter that is capable of transmitting the fourth light. A light source outputs illumination light including only fifth light of a fifth wavelength band and sixth light of a sixth wavelength band not overlapping the fifth wavelength band.

Abstract: An imaging apparatus includes an image sensor including a common sensor element, the common sensor element having a plurality of output systems therefrom, and a signal processing circuit that generates an image signal from outputs of the image sensor, wherein the plurality of output systems individually include a transistor, a capacitor that stores charge in accordance with a current flowing through the sensor element via the transistor, and output circuitry that outputs a sensor signal in accordance with a voltage of the capacitor, wherein the transistors individually allow the current to flow in time periods different with each other, and the signal processing circuit does not use the sensor signals if the sensor signals do not match with each other, and the signal processing circuit uses the sensor signals for generating the image signal if the sensor signals match with each other.

Abstract: The present subject matter provides a technical solution for various technical problems associated with precision agriculture imagery. One solution to improving precision agriculture imagery includes identification and use of ground control points. A ground control point may include the association of a visible feature in an image of an agricultural field with a geospatial coordinate. A ground control point may be used as a common reference point between two aerial images, thereby improving alignment between the two images during stitching. The ground control points may be generated using planting prescription data or as-planted data, which may include one or more intentionally unplanted regions within an agricultural filed. Multiple aerial images may be stitched together using these ground control points to generate a precisely georeferenced output image, thereby improving the accuracy of the precision agriculture output image.

Abstract: A system and method for processing a daytime IR image to discriminate between solar glints and hotspots, where the latter represent man-made activity. Two spectrally distinct thermal wavelength bands are defined and respective spectral intensities are detected for a corresponding pixel in an image. A figure of merit is calculated as a function of the detected spectral intensities. The calculated figure of merit is compared to a predetermined rule to determine whether the corresponding pixel is a glint or a hotspot.

Abstract: Imaging systems and methods are disclosed that use locally flat scenes to adjust image data. An imaging system includes an array of photodetectors configured to produce an array of intensity values corresponding to light intensity at the photodetectors. The imaging system can be configured to acquire a frame of intensity values, or an image frame, and analyze the image frame to determine if it is locally flat. If the image frame is locally flat, then that image data can be used to determine gradients present in the image frame. An offset mask can be determined from the image data and that offset mask can be used to adjust subsequently acquired image frames to reduce or remove gradients.

Abstract: A system includes an optical waveguide configured to receive multispectral radiation from a scene, a first optical component and a second optical component. The first optical component is configured to cause a first portion of the multispectral radiation with wavelengths in a first range to exit the optical waveguide at a first position, and a second portion of the multispectral radiation with wavelengths in a second range to travel through the optical waveguide from the first position to a second position via total internal reflection. The second optical component is configured to cause the second portion of the multispectral radiation to exit the optical waveguide at the second position.

Abstract: A seeker includes a detection array having at least 2500 sensing pixels arranged in rows by row request lines and in columns by column request lines. At least one pixel includes an electromagnetic radiation sensor to trigger the pixel in response to sensing a triggering quantity of electromagnetic radiation, a row request circuit to send a row request after the pixel triggers, and a column request circuit to send a column request after the pixel triggers. The seeker further includes a row receiver to receive the row requests, a column receiver to receive the column requests, and a sequencer to receive, for each triggering pixel, the row of the row request and the column of the column request, and to generate an event including the received row and column of the pixel. The seeker also includes a time stamper to generate a time stamp for the generated event.

Abstract: Systems and methods can be used for analyzing image data to determine an amount of vibration and/or misalignment in an object under analysis. In some instances, as operating equipment heats up during operation, temperature changes of various portions of the operating equipment leads to changes in dimensions of such portions, leading to misalignment. Multiple sets of data representative of the operating equipment in multiple operating conditions can be used to determine an amount of misalignment due to thermal offsets. Hot and cold temperatures of the equipment can be used to calculate thermal growth of various portions of the equipment, which can be used to determine an amount a misalignment due to thermal offsets. Additionally or alternatively, image data representing the equipment can be used to observe changes in alignment between states.

Abstract: A video image processing device uses a plurality of video data captured by a plurality of cameras to generate a wide range video data of the entire celestial sphere having a 360-degree range around an area where the plurality of cameras is installed and to transmit the generated wide range video data of the entire celestial sphere to a video display device. The video display device detects a direction of the video display device as a direction of a sight line of the user, receives the transmitted wide range video data of the entire celestial sphere, segments a predetermined area of video data including a detection result of a sensor from the wide range video data of the entire celestial sphere, adjusts a luminosity of the extracted predetermined area of video data to fall in a certain range of luminosity, and displays the adjusted predetermined area of video data.

Abstract: A surgical vision system for imaging heat capacity and cooling rate of tissue has an infrared source configured to provide infrared light to tissue, the infrared light sufficient to heat tissue, and an infrared camera configured to provide images of tissue at infrared wavelengths. The system also has an image processing system configured to determine, from the infrared images of tissue, a cooling or heating rate at pixels of the images of tissue at infrared wavelengths and to display images derived from the cooling rate at the pixels.

Abstract: Multispectral cameras may be used for aerial imaging, such as in precision agriculture aerial imaging applications. In particular, multispectral camera mounted on an aerial vehicle may be used to determine vegetative indices of the plants being photographed. A multispectral imaging method may include optically filtering a plurality of images through a plurality of optical image filters within a swappable filter cartridge, receiving the filtered plurality of images at a plurality of image sensors within a multiple image sensor module, each of the plurality of image sensors corresponding to each of the plurality of optical image filters, and storing the received plurality of images at a memory within the multiple image sensor module.

Abstract: The present technology relates to an imaging apparatus, an imaging method, and a program capable of obtaining a color image even in a case where photographing is performed in a dark place.

Abstract: A distance measurement device includes an imaging unit, an emission unit which emits directional light as light having directivity to emit the directional light along an optical axis direction of an imaging optical system, a light receiving unit which receives reflected light of the directional light from a subject, a derivation unit which derives a distance to the subject based on a timing at which the directional light is emitted by the emission unit and a timing at which the reflected light is received by the light receiving unit, and a control unit which performs control such that the emission unit sets a timing, at which the directional light is emitted, to a predetermined period during which the influence of the emission of the directional light on an image signal is suppressed.

Abstract: Techniques are disclosed for measurement devices and methods to obtain physical parameters and thermal images associated with a scene in an integrated manner. In one embodiment, a measurement device includes an infrared (IR) imaging module configured to capture thermal images of a scene; a moisture sensor configured to detect a moisture parameter associated with an external article; a housing configured to be hand-held by a user and at least partially enclosing the IR imaging module; a display fixed relative to the housing and configured to display user-viewable thermal images; and a logic device configured to freeze a user-viewable thermal image on the display, overlay information to indicate a first detection of the moisture parameter onto the frozen user-viewable thermal image on the display, and update the overlaid information to indicate a second detection of the moisture parameter.

Abstract: A distance measurement device includes an imaging unit which captures a subject image formed by an imaging optical system, an emission unit which emits directional light as light having directivity along an optical axis direction of the imaging optical system, a light receiving unit which receives reflected light of the directional light from the subject, a derivation unit which derives a distance to the subject based on the timing at which the directional light is emitted and the timing at which the reflected light is received, a display unit which displays the subject image, and a control unit which performs control such that, in a case of performing a distance measurement, the display unit displays the subject image as a motion image and transition is made to a state where actual exposure by the imaging unit is possible at the timing of the end of the distance measurement.

Abstract: An imaging device comprising an image sensor, an imaging lens, an infrared light source to illuminate a scene, and an infrared autofocus system for providing an autofocus function, wherein the image sensor comprises an array of sensor pixels each arranged as dual pixel comprising two separate pixel sensors per dual pixel to record the image data as a sum signal from both pixel sensors and providing infrared data as individual signals from each of the two pixel sensors for phase contrast autofocusing, wherein an infrared filter arranged between an aperture of the imaging device and an imaging sensor and is adapted to locally transmit only a portion of the infrared light to the imaging sensor by comprising at least one first area arranged as infrared blocking area and at least one second area arranged as infrared bandpass area. The invention further relates to a method to automatically focusing this device.

Abstract: An imaging system for a smartphone includes a housing configured to rigidly attach to a handheld smartphone device. The system further includes an arm extending from the housing, wherein the arm is configured to be adjustable such that the arm is movable toward and away from the housing. Additionally, the system includes a sample mounting portion attached to the arm, the mounting portion having a retaining device, wherein the retaining device is configured to secure a target sample, the mounting portion configured to direct an image of the target sample to a first camera in the handheld smartphone device.

Abstract: An infrared (IR) cut filter includes an absorption type filter, a first coating layer, and a second coating layer. The absorption type filter absorbs IR light of a first wavelength band. The first coating layer is formed on a first side of the absorption type filter and passes visible light and reflects a part of the IR light. The second coating layer is formed on a second side of the absorption type filter and reflects a remaining part of the IR light that passes through the first coating layer and enters the absorption type filter. The absorption type filter further absorbs the IR light of a second wavelength band within the absorption type filter. In addition, a camera module having the IR cut filter is provided and an electronic device having the camera module also is provided.

Abstract: A first imaging unit detects far-infrared rays and captures a first image. A second imaging unit detects light having a wavelength range shorter than a wavelength range of the far-infrared rays and captures a second image. An unevenness correction unit performs unevenness correction processing on the first image. A correction data acquisition unit acquires correction data for correcting unevenness. A light irradiation determination unit determines whether or not the second imaging unit is irradiated with light having a wavelength range captured by the second imaging unit. A control unit causes the correction data acquisition unit to acquire the correction data in a case where the light irradiation determination unit determines that light irradiation is not performed on the second imaging unit.

Abstract: A dual-band refractive optical system having an eyepiece-type arrangement and configured for mid-wave infrared and long-wave infrared operation. In one example the optical system includes a plurality of lenses, each constructed from a material that is optically transparent in the mid-wave infrared and long-wave infrared spectral bands. The lenses are arranged to receive infrared electromagnetic radiation in an operating waveband that includes at least a portion of the mid-wave infrared and at least a portion of the long-wave infrared spectral bands via a front external aperture stop and to focus the infrared electromagnetic radiation onto a rear image plane, the lenses being positioned between the front external aperture stop and rear image plane. The optical system can further include a corrector plate positioned coincident with the front aperture stop.

Abstract: A living body detection device (1) includes: an image acquisition unit (171), a determination unit (173) and a detection unit (174). The image acquisition unit (171) acquires a first image in which a subject irradiated by light in a first wavelength range is imaged, and a second image in which the subject irradiated by light in a second wavelength range is imaged, the second wavelength range being different from the first wavelength range. The determination unit (173) determines whether a relation expressed by luminance of the subject imaged in the first image and luminance of the subject imaged in the second image is a relation exhibited by a living body. The detection unit (174) detects that the subject is a living body in a case where the determination unit (173) has determined that it is the relation exhibited by the living body.

Abstract: The present disclosure relates to an image pickup apparatus, an image pickup method, a program, and an image processing apparatus that enable a color image to be generated on the basis of an infrared image and a visible image captured using an image pickup device that uses a focal plane reading system.

Abstract: An electronic device includes a housing that includes a first surface, a second surface, and a side surface, a display exposed through a first region of the first surface, an optical module disposed below a second region of the first surface that is adjacent to the first region of the first surface, and a processor. The first surface includes a glass layer, a film layer disposed under a rear surface of the glass layer and including an opening that overlaps at least part of the optical module and has a dimension corresponding to at least part of the optical module, and a visible-light-absorbing member comprising a visible-light-absorbing material disposed under the rear surface of the glass layer and overlapping at least part of the opening. The visible-light-absorbing member is configured to light in a first wavelength range and to allow light in a second wavelength range to pass through the visible-light-absorbing member.

Abstract: Statistically representing point-to-point photovoltaic power estimation and area-to-point conversion of satellite pixel irradiance data are described. Accuracy on correlated overhead sky clearness is bounded by evaluating a mean and standard deviation between recorded irradiance measures and the forecast irradiance measures. Sky clearness over the two locations is related with a correlation coefficient by solving an empirically-derived exponential function of the temporal distance. Each forecast clearness index is weighted by the correlation coefficient to form an output set of forecast clearness indexes and the mean and standard deviation are proportioned. Additionally, accuracy on correlated satellite imagery is bounded by converting collective irradiance into point clearness indexes. A mean and standard deviation for the point clearness indexes is evaluated. The mean is set as an area clearness index for the bounded area.

Abstract: In a case where IR data of a near-infrared light image is data in which a visible light component and a near-infrared light component coexist, a point image restoration process is performed on the IR data using a first point image restoration filter based on a first point spread function for visible light of the optical system and a second point image restoration filter based on a second point spread function for near-infrared light of the optical system. An appropriate point image restoration process is performed on the IR data that is captured in a time zone of twilight or dawn by performing weighted averaging on a point image restoration process using the first point image restoration filter and a point image restoration process using the second point image restoration filter using a first gain ? and a second gain ? according to a light amount ratio between visible light and near-infrared light at the time of capturing the IR data.

Abstract: A camera system includes non-volatile memory, a lens, an image sensor to capture images of a scene within view of the lens, an IR illuminator, and a processing system. The processing system transitions the camera system from day mode to night mode when the scene is dark, and in the night mode, two operations are performed. The first operation uses the IR illuminator, the image sensor, and the memory to capture a first IR image or video of the scene and store the first IR image or video in the non-volatile memory. The second operation uses the IR illuminator, the image sensor, and the memory to identify a specular surface in the scene. This includes capturing a second IR image or video, identifying a first region of low intensity pixels, and storing, in the non-volatile memory, position parameters of the first region and designating the first region as specular.

Abstract: This watching system is provided with: a watching detection device that is provided with a cartilage conduction vibration source, a mastication sensor, and a bone conduction microphone and that is configured to be mounted on an ear such that the entry of the ear canal is opened; and a mobile phone or an in-home monitoring unit that receives watching detection signals from the mastication sensor and the bone conduction microphone by means of short-range communication and issues a notification to the outside. The watching detection device has an air conduction microphone and also functions as a hearing aid. When detection signals cannot be received from the mastication sensor or the bone conduction microphone for a predetermined time period, a notification is issued. The mobile phone and the in-home monitoring unit crosscheck watching detection information. The mobile phone also issues a notification of information indicating that there is no abnormality.

Abstract: A system, method, and computer program product for generating a digital image is disclosed. The system includes a first image sensor configured to capture a first image that includes a plurality of chrominance values, a second image sensor configured to capture a second image that includes a plurality of luminance values, and an image processing subsystem configured to generate a resulting image by combining the plurality of chrominance values with the plurality of luminance values. The first image sensor and the second image sensor may be distinct image sensors optimized for capturing chrominance images or luminance images.

Abstract: The invention relates generally to edge detection and presentation in thermal images. Infrared and visible light images comprising at least partially overlapping target scenes are analyzed. An edge detection process is performed on the visible light image to determine which pixels represent edges in the target scene. A display image is generated in which some pixels include infrared image data and in which pixels corresponding to edges in the visible light image include a predetermined color and do not include corresponding infrared image data to emphasize edges. Edge pixels in the display image can include exclusively the predetermined color, or in some examples, a blend of a predetermined color and visible light image data. Methods can include replacing one or the other of visible light edge pixels or corresponding infrared pixels with the predetermined color before combining the visible light and infrared image data to create a display image.

Abstract: Various techniques are provided to combine visible and thermal image data. In one example, a method includes receiving visible image data and thermal image data for a scene. The method also includes extracting high spatial frequency content from the visible image data to provide filtered visible image data. The method also includes applying a corresponding gain to the filtered visible image data to provide weighted visible image data. The method also includes merging the weighted visible image data and the thermal image data to provide combined image data. Additional methods, systems, and other implementations are also provided.

Abstract: The invention relates to a visible light image and infrared image fusion processing system and a fusion method. The fusion processing system comprises an image acquisition module, an image fusion module and an image display module, wherein the image fusion module is connected with the image acquisition module and the image display module. By adoption of the fusion method, the fusion ratio of a visible light image to an infrared image can be adjusted according to requirements, and detailed images are filtered and compared and then enhanced, so that detail information of a fused image is improved, and noise interference is avoided. Furthermore, fusion weights of the visible light image and the infrared image and the detail enhancement degree can be flexibly controlled through external parameter adjustment, and thus various display requirements are met.

Abstract: An image processing device and an image processing method capable of satisfactorily performing a point image restoration process of a visible light image and a point image restoration process of a near-infrared light image are provided. A point image restoration process is performed on luminance data Y indicating a visible light image and IR data indicating a near-infrared light image using a first point image restoration filter based on a first point spread function with respect to visible light of an optical system and a second point image restoration filter based on a second point spread function with respect to near-infrared light of the optical system. An appropriate point image restoration process is performed on the IR data so that restoration strength (second gain ?) in the point image restoration process for the IR data captured with radiation of near-infrared light is higher than restoration strength (first gain ?) in the point image restoration process for the luminance data Y.

Abstract: The present invention provides an image processing device, an imaging device, an image processing method, and a program which are capable of accurately correcting blurring caused in first image data of an image using a near-infrared ray as a light source and, accurately performing a point image restoration process on second image data of an image using visible light and a near-infrared ray as a light source.

Abstract: An optical imaging system includes a first lens having a positive refractive power, a second lens having a negative refractive power, a third lens having a positive refractive power, a fourth lens having a positive refractive power, a fifth lens having a negative refractive power, and a sixth lens having a negative refractive power. The first to sixth lenses are sequentially disposed from an object side to an imaging plane. An Abbe number of the second lens is 21 or less.

Abstract: An image processing device includes an input unit which inputs ordinary frames in a state in which an object is irradiated with ordinary light, and a special frame in a state in which the object is irradiated with special light, which are imaged consecutively at a predetermined ratio according to a predetermined frame period; a detection unit which detects motion vectors of the object from a plurality of the ordinary frames with different imaging timing; a motion correction unit which subjects the special frame to motion correction corresponding to the imaging timing of the ordinary frames based on the detected motion vectors; and a compositing unit which subjects the ordinary frames to an image compositing process based on the special frame.

Abstract: A method of image sensor fabrication includes forming a second semiconductor layer on a back side of a first semiconductor layer. The method also includes forming one or more groups of pixels disposed in a front side of the first semiconductor layer. The one or more groups of pixels include a first portion of pixels separated from the second semiconductor layer by a spacer region, and a second portion of pixels, where a first doped region of the second portion of pixels is in contact with the second semiconductor layer. Pinning wells are also formed and separate individual pixels in the one or more groups of pixels, and the pinning wells extend through the first semiconductor layer. Deep pinning wells are also formed and separate the one or more groups of pixels.

Abstract: An apparatus for detecting eyes comprises a camera configured to acquire an eye image using optical coding; and an image processor configured to perform signal processing on the eye image, wherein the signal processing comprises removing noise from the eye image caused by a glasses reflection point.

Abstract: An image processing apparatus includes an input unit configured to input a first image generated based on an electromagnetic wave other than visible light, an output unit configured to output a second image as an image obtained by emulating a displayed image using a night vision apparatus or a thermal imaging apparatus based on the first image, and a display processing unit configured to perform processing to cause a display unit to display the second image, wherein the output unit outputs, as the second image, an image obtained by performing at least one of processing to limit a spatial frequency band of the first image, processing to output the first image after storing the first image for a predetermined time, and processing to limit an amount of light of at least a partial region of the first image.

Abstract: An audio processing apparatus comprises a signal processing unit configured to process an input audio signal by applying a gain to the input audio signal to generate an audio signal for monitoring by a user. The signal processing unit is configured to increase the gain applied to the input audio signal, in a case where the audio signal for monitoring becomes low, in two stages by first increasing a gain applied to the audio signal at first rate during a first stage and subsequently increasing the gain applied to the audio signal at a second rate during a second stage.

Abstract: The present disclosure provides a multispectral imaging device and imaging system. The multispectral imaging device comprises: a substrate; a plurality of semiconductor layers, stacked on the substrate and arranged in a direction perpendicular to the substrate, different semiconductor layers converting visible light photons and NIR light photons to electrons, respectively; and a filtering layer, arranged on one side of the plurality of semiconductor layers away from the substrate, comprising a plurality of filtering sections arranged as a matrix, to separate the incident light to multiple wavebands on a plane parallel to the substrate. The multispectral imaging device and imaging system separate the incident light by waveband in a direction perpendicular to the substrate and a direction parallel to the substrate, then multispectral images can be acquired at the same time.

Abstract: A system includes an optical waveguide configured to receive multispectral radiation from a scene, a first optical component and a second optical component. The first optical component is configured to cause a first portion of the multispectral radiation with wavelengths in a first range to exit the optical waveguide at a first position, and a second portion of the multispectral radiation with wavelengths in a second range to travel through the optical waveguide from the first position to a second position via total internal reflection. The second optical component is configured to cause the second portion of the multispectral radiation to exit the optical waveguide at the second position.

Abstract: A method of imaging includes monitoring a field of view with a first imaging sensor of a multiple channel imaging system and activating a second component of the imaging system from a stand by state to an active state upon detection of a change in the field of view of the first imaging sensor. The second component can include a second imaging sensor. The second imaging sensor can have a field of view overlapping with the field of view of the first imaging sensor. The first imaging sensor can be configured for imaging in a first spectral range, wherein the second imaging sensor is configured for imaging in a second spectral range that is different from the first spectral range. The first and second spectral ranges can be overlapping or non-overlapping.

Abstract: In a camera which electronically realizes panning, tilting, and zooming, on the basis of the luminance detected in each frame period (n?1), a condition of exposure for two frame periods thereafter (n+1), and digital gain for three frame periods thereafter (n+2) are set. When an instruction for changing the extracted region is received in a certain frame period (n?1), the region extracted from the image is changed three frame periods thereafter. It is possible to achieve a stable exposure control by which the luminance of the image varies little even when the region extracted from the image is switched.

Abstract: Novel methods and systems to map the structure of blood vessels and monitor the flow of blood through these vascular networks using thermal imaging techniques. To obtain high contrast thermal images of the vascular structure in tissue, there must be a temperature difference between the blood/blood vessels and surrounding tissue. If the blood and blood vessels are warmer than the surrounding tissue, the vessels will appear brighter in thermal infrared images. A temperature contrast between blood vessels and the surrounding tissue can be achieved through selective heating of the blood. Hemoglobin has major absorption peaks near 420 and 530 nm, while absorption due to water (the dominant component of soft tissue) is significantly lower at these wavelengths. Irradiation of blood and tissue at these wavelengths produces selective heating of the blood compared to the surrounding soft tissue.

Abstract: A device and method for analyzing thermal images, a configuration device and method relates to fields of thermal image detection. In the prior art, when configuring orders of analysis areas are different, parts of photographed objects to which the analysis areas correspond with the same number may be different, thereby causing a series of problems. In this invention, a reference image is controlled to be displayed in an infrared thermal image, the reference image reflects specified morphological characters of a photographed object, and a configured analysis area is associated with information related to part information. Thus, the configured analysis area is normative and easy to be understood.

Abstract: A measurement apparatus includes: a first illumination unit configured to illuminate the surface with first light having a first wavelength having a light intensity distribution in a pattern shape; a second illumination unit configured to illuminate, with second light having a second wavelength, a region wider than an illumination region illuminated with the first light; an image sensing unit configured to sense an image of the surface; and a processor. The processor is configured to obtain a first image of the first wavelength and a second image of the second wavelength of the surface unit while illuminating the surface by using the first and second illumination units, correct the first image based on the second image, and obtain information of a shape of the surface by using the corrected first image.

Abstract: Haptic feedback is generated on a headphone to indicate contexts of ambient sound. In this way, noise-canceling headphones can alert the wearer to audible cues of potentially dangerous situations that otherwise would be suppressed by the noise cancellation feature of the headphones.