Abstract: Face detection in a spherical image is performed using overcapture. Multiple views of a spherical image are separately processed using face detection, and results of the face detection for those views are projected to a format for further processing of the spherical image.

Abstract: Device (1) particularly for detecting and potentially identifying at least one target inside a determined volume (V), the device (1) comprising an image acquisition system (2). The image acquisition system (2) comprises, —at least one infrared camera (3) that is sensitive to waves with a wavelength between 780 and 1400 nm, —a thermal camera (4) that is sensitive to waves between 3000 and 14000 nanometers and —a camera (5), referred to as visible, that is sensitive to waves between 350 and 780 nm. The cameras (3, 4, 5) are mounted on a common support (6) in the form of an elongate, beam-type body. The cameras (3, 4, 5) are arranged on the common support (6), with the fields of view of the cameras (3, 4, 5) having an intersection area (8) that corresponds to the volume (V) to be observed. The optical axes of the cameras (3, 4, 5) arranged on the common support (6) are not aligned and the distance (D) between the optical centers of at least two of the cameras (3, 4, 5) is between 10 cm and 2 m.

Abstract: A system and/or method for imaging system calibration, including: determining a dense correspondence map matching features in a first image to features in a second image, and determining updated calibration parameters associated with the image acquisition system based on the matching features.

Abstract: A method for calibrating at least one of the six-degrees-of-freedom of all or part of cameras in a formation positioned for scene capturing, the method comprising a step of initial calibration before the scene capturing. The step comprises creating a reference video frame which comprises a reference image of a stationary reference object. During scene capturing the method further comprises a step of further calibration wherein the position of the reference image of the stationary reference object within a captured scene video frame is compared to the position of the reference image of the stationary reference object within the reference video frame, and a step adapting the at least one of the six-degrees-of-freedom of a multiple cameras of the formation if needed in order to get an improved scene capturing after the further calibration.

Abstract: An ultra-small thermal imaging core, or micro-core. The design of the micro-core may include substrates for mounting optics and electronic connectors that are thermally matched to the imaging Focal Plane Array (FPA). Test fixtures for test and adjustment that allow for operation and image acquisition of multiple cores may also be provided. Tooling may be included to position the optics to set the core focus, either by moving the lens and lens holder as one or by pushing and/or pulling the lens against a lens positioning element within the lens holder, while observing a scene. Test procedures and fixtures that allow for full temperature calibration of each individual core, as well as providing data useful for uniformity correction during operation may also be included as part of the test and manufacture of the core.

Abstract: Multi-aperture zoom digital cameras comprising first and second scanning cameras having respective first and second native fields of view (FOV) and operative to scan a scene in respective substantially parallel first and second planes over solid angles larger than the respective native FOV, wherein the first and second cameras have respective centers that lie on an axis that is perpendicular to the first and second planes and are separated by a distance B from each other, and a camera controller operatively coupled to the first and second scanning cameras and configured to control the scanning of each camera.

Abstract: An information processing apparatus has an identification unit, an obtaining unit, and an output unit. The identification unit identifies, in a virtual viewpoint image generated using shape data representing a three-dimensional shape of an object, a target for which to generate data for modeling a three-dimensional object, based on time information related to the virtual viewpoint image as well as a position of a virtual viewpoint and a direction of a line of sight from the virtual viewpoint related to the virtual viewpoint image. The obtaining unit obtains shape data on a first object in the virtual viewpoint image, the first object corresponding to the identified target. The output unit outputs data for modeling a three-dimensional object generated based on the obtained shape data.

Abstract: Systems and methods for depth estimation in accordance with embodiments of the invention are illustrated. One embodiment includes a method for estimating depth from images. The method includes steps for receiving a plurality of source images captured from a plurality of different viewpoints using a processing system configured by an image processing application, generating a target image from a target viewpoint that is different to the viewpoints of the plurality of source images based upon a set of generative model parameters using the processing system configured by the image processing application, and identifying depth information of at least one output image based on the predicted target image using the processing system configured by the image processing application.

Abstract: Disclosed is a stereophotogrammetric method based on binocular vision, including the following steps: image acquisition, image correction and stereo matching are performed; cost matching and cost aggregation are performed on images of different sizes after correction; image segmentation is performed on the corrected image to determine edge pixel points of the object to be measured; and a pixel distance at an edge of the object to be measured is calculated to measure the size of the object. The method of the present invention enhances the matching accuracy of contour pixels of the object to be measured and improves the measurement accuracy.

Abstract: Disclosed is a high-precision dynamic real-time 360-degree omnidirectional point cloud acquisition method based on fringe projection. The method comprises: firstly, by means of the fringe projection technology based on a stereoscopic phase unwrapping method, and with the assistance of an adaptive dynamic depth constraint mechanism, acquiring high-precision three-dimensional (3D) data of an object in real time without any additional auxiliary fringe pattern; and then, after a two-dimensional (2D) matching points optimized by the means of corresponding 3D information is rapidly acquired, by means of a two-thread parallel mechanism, carrying out coarse registration based on Simultaneous Localization and Mapping (SLAM) technology and fine registration based on Iterative Closest Point (ICP) technology.

Abstract: Collaborative video capture and sharing is described. A login to a primary device is received from a first user. A session is formed between the primary device and a secondary device. A start command and a stop command are sent during the session from the primary device to the secondary device to cause the secondary device to begin and stop a take. The session ID and an identification of the devices of the session are loaded to a remote data store from the primary device through the primary device communications interface. The take at the primary device is uploaded into the remote data store through the primary device communications interface with the session ID, and the primary device ID; and the secondary device uploads the take of the secondary device camera into the remote data store through the secondary device communications interface with the secondary device ID.

Abstract: Various embodiments disclosed herein describe a divided-aperture infrared spectral imaging (DAISI) system that is adapted to acquire multiple IR images of a scene with a single-shot (also referred to as a snapshot). The plurality of acquired images having different wavelength compositions that are obtained generally simultaneously. The system includes at least two optical channels that are spatially and spectrally different from one another. Each of the at least two optical channels are configured to transfer IR radiation incident on the optical system towards an optical FPA unit comprising at least two detector arrays disposed in the focal plane of two corresponding focusing lenses. The system further comprises at least one temperature reference source or surface that is used to dynamically calibrate the two detector arrays and compensate for a temperature difference between the two detector arrays.

Abstract: A system and/or method for imaging system calibration, including: determining a dense correspondence map matching features in a first image to features in a second image, and determining updated calibration parameters associated with the image acquisition system based on the matching features.

Abstract: A method for constructing a real-geographic-space scene in real time based on a panoramic-video technique is provided. By using a measuring robot and the attitude sensors, accurately determining the geographic coordinates and the attitudes of the cameras, where the cameras may be installed in a fixed or stringing manner, where in the fixing type a plurality of neighboring videos at the same moment undergo orthographic correction and splicing, and in the stringing type the cameras are installed to a guiding device and may locally, independently and quickly move and shoot, and the videos of the neighboring cameras are spliced in real time; and fusing the videos, the geographic coordinates and the environment sounds that satisfy the delay time, to form a scene video streaming.

Abstract: Provided are a method and apparatus for determining image depth information, an electronic device, and a medium. The method includes: acquiring first depth information of pixels in a target image output by a first prediction layer; generating the point cloud model of the target image according to the first depth information, and determining initial depth information of the pixels in the target image in a second prediction layer according to the point cloud model; and performing propagation optimization according to the initial depth information, and determining second depth information of the pixels in the target image output by the second prediction layer, where the first prediction layer is configured before the second prediction layer.

Abstract: Processing a 360-degree video content for video coding may include receiving the video content in a first geometry. The video content may include unaligned chroma and luma components associated with a first chroma sampling scheme. The unaligned chroma and luma components may be aligned to a sampling grid associated with a second chroma sampling scheme that has aligned chroma and luma components. A geometric conversion to the video content may be performed. The video content, that may comprise the aligned chroma and luma components, in the first geometry may be converted to a second geometry. The first geometry may be a stitched geometry, and the second geometry may be a coding geometry. The converted video content in the second geometry may include the chroma and luma components aligned to the sampling grid associated with the second chroma sampling scheme.

Abstract: Provided is an electronic device for a temporal synchronization, which determines a set of parameters associated with each imaging device of a plurality of imaging devices. The set of parameters include frame rate of each imaging device. The electronic device generates a synchronization signal that includes a preamble pulse of a first time duration set based on the frame rate and a sequence of alternating ON and OFF pulses. Each pulse of the sequence of alternating ON and OFF pulses is of a second time duration set based on the set of parameters. Based on the synchronization signal, lighting devices may be controlled to generate a pattern of alternating light pulses that is captured by each imaging device. The electronic device further acquires a plurality of images that includes information about the pattern of alternating light pulses. The electronic device further synchronizes the plurality of images, based on the information.

Abstract: A dual-camera image capture system may include a first light source, disposed above a target area, a first mobile unit, configured to rotate around the target area, and a second mobile unit, operatively coupled to the first mobile unit, configured to move vertically along the first mobile unit. The dual-camera image capture system may further include a second light source, operatively coupled to the second mobile unit and a dual-camera unit, operatively coupled to the second mobile unit. The dual-camera image capture system may include a first camera configured to capture structural data and a second camera configured to capture color data. The first mobile unit and the second mobile unit may be configured to move the first camera and the second camera to face the target area in a variety of positions around the target area.

Abstract: An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.

Abstract: Enhanced methods and systems for generating both a geometry model and an optical-reflectance model (an object reconstruction model) for a physical object, based on a sparse set of images of the object under a sparse set of viewpoints. The geometry model is a mesh model that includes a set of vertices representing the object's surface. The reflectance model is SVBRDF that is parameterized via multiple channels (e.g., diffuse albedo, surface-roughness, specular albedo, and surface-normals). For each vertex of the geometry model, the reflectance model includes a value for each of the multiple channels. The object reconstruction model is employed to render graphical representations of a virtualized object (a VO based on the physical object) within a computation-based (e.g., a virtual or immersive) environment. Via the reconstruction model, the VO may be rendered from arbitrary viewpoints and under arbitrary lighting conditions.

Abstract: A computer, including a processor and a memory, the memory including instructions to be executed by the processor to receive an emitted polarized light beam at a lidar receiver that determines a polarization pattern and a distance to an object, wherein the polarization pattern is determined by comparing a linear polarization pattern and a circular polarization pattern and identify the object by processing the polarization pattern and the distance with a deep neural network, wherein the identity of the object can be metallic or non-metallic. The instructions can include further instructions to operate a vehicle based on the identified object.

Abstract: Systems and methods for depth estimation in accordance with embodiments of the invention are illustrated. One embodiment includes a method for estimating depth from images. The method includes steps for receiving a plurality of source images captured from a plurality of different viewpoints using a processing system configured by an image processing application, generating a target image from a target viewpoint that is different to the viewpoints of the plurality of source images based upon a set of generative model parameters using the processing system configured by the image processing application, and identifying depth information of at least one output image based on the predicted target image using the processing system configured by the image processing application.

Abstract: Disclosed are an artificial intelligence learning method and an operating method of a robot using the same. An on-screen label is generated based on image data acquired through a camera, an off-screen label is generated based on data acquired through other sensors, and the on-screen label and the off-screen label are used in learning for action recognition, thereby raising action recognition performance and recognizing a user's action even in a situation in which the user deviates from a camera's view.

Abstract: A lightweight, inexpensive LADAR sensor incorporating 3-D focal plane arrays is adapted specifically for modular manufacture and rapid field configurability and provisioning. The sensor generates, at high speed, 3-D image maps and object data at short to medium ranges. The techniques and structures described may be used to extend the range of long range systems as well, though the focus is on compact, short to medium range ladar sensors suitable for use in multi-sensor television production systems and 3-D graphics capture and moviemaking. 3-D focal plane arrays are used in a variety of physical configurations to provide useful new capabilities.

Abstract: Systems and methods for hybrid depth regularization in accordance with various embodiments of the invention are disclosed. In one embodiment of the invention, a depth sensing system comprises a plurality of cameras; a processor; and a memory containing an image processing application. The image processing application may direct the processor to obtain image data for a plurality of images from multiple viewpoints, the image data comprising a reference image and at least one alternate view image; generate a raw depth map using a first depth estimation process, and a confidence map; and generate a regularized depth map. The regularized depth map may be generated by computing a secondary depth map using a second different depth estimation process; and computing a composite depth map by selecting depth estimates from the raw depth map and the secondary depth map based on the confidence map.

Abstract: A system for documenting a state of a building, comprising a first measuring system to determine actual data of the building, and at least one server having a memory for storing a digital model of the building, the server providing the digital model to the first measuring system and providing a blockchain of blocks, each block comprising a timestamp, hash data of a previous block and change data related to changes of the model, wherein a current block comprises current change data related to a latest change and task data related to tasks to be performed at the building hat have to be met. The first measuring system is adapted to interpret the task data, perform a measuring task, generate measurement data obtained by performing the measuring task, and to generate a new block of the blockchain, wherein the server is adapted to verify an admissibility of the new block.

Abstract: Systems, devices, media, and methods are presented for capturing and sharing visual content, especially three-dimensional video, with a plurality of users with compatible devices. The methods in some implementations include transmitting the visual content to a portable projector, generating a unique invite and broadcasting it to a plurality of eyewear devices, and projecting the visual content onto a screen for viewers who accepted the invite and are wearing a compatible eyewear device. For projection in 3D format, the eyewear devices include an active shutter mode. The portable projector may be housed in the interior of a case. In some configurations, the case interior is sized and shaped to support the projector and an eyewear device. The system may include multiple projectors at remote locations directed to project the visual content simultaneously.

Abstract: The embodiment of the present specification discloses an image synthesis method, apparatus and device for free-viewpoint.

Abstract: The present disclosure relates to systems and methods that provide information about a scene based on a time-of-flight (ToF) sensor and a structured light pattern. In an example embodiment, a sensor system could include at least one ToF sensor configured to receive light from a scene. The sensor system could also include at least one light source configured to emit a structured light pattern and a controller that carries out operations. The operations include causing the at least one light source to illuminate at least a portion of the scene with the structured light pattern and causing the at least one ToF sensor to provide information indicative of a depth map of the scene based on the structured light pattern.

Abstract: A three-dimensional (3D) imaging system includes a mobile device that has a display screen configured to display a series of patterns onto an object that is to be imaged. The mobile device also includes a front-facing camera configured to capture reflections of the series of patterns off of the object. The system also includes a controller that is configured to control a timing of the series of patterns that appear on the display screen and activation of the front-facing camera in relation to the appearance of the series of patterns.

Abstract: A dual-camera image capture system may include a first light source, disposed above a target area, a first mobile unit, configured to rotate around the target area, and a second mobile unit, operatively coupled to the first mobile unit, configured to move vertically along the first mobile unit. The dual-camera image capture system may further include a second light source, operatively coupled to the second mobile unit and a dual-camera unit, operatively coupled to the second mobile unit. The dual-camera image capture system may include a first camera configured to capture structural data and a second camera configured to capture color data. The first mobile unit and the second mobile unit may be configured to move the first camera and the second camera to face the target area in a variety of positions around the target area.

Abstract: Disclosed are devices, systems, methods, techniques, and computer program products for estimating a Region Of Interest (ROI) corresponding to a plurality of content streams. A method may include receiving a plurality of sensor data associated with a plurality of mobile devices. The plurality of sensor data corresponds to a plurality of content streams captured by the plurality of mobile devices. Further, each of the plurality of mobile devices may include at least one recorder configured to capture a corresponding content stream. Further, a sensor data associated with a mobile device may include a location data and an orientation data of the mobile device during capturing of a content stream. The method may further include, analyzing, by the system, the plurality of sensor data and determining, by the system, a ROI based on at least the plurality of sensor data, thereby generating an estimation of the ROI.

Abstract: Systems and methods for stitching videos are disclosed. Image-based registration between frames from a first video source and frames from a second video source is performed at a first rate. Calibration-based registration between frames from the first video source and frames from the second video source are performed at a second rate higher than the first rate. Then, for a first frame from the first video source for which calibration-based registration data and image-based registration data have been generated, a stitching transform that maps the first frame to a counterpart frame from the second video source based on image-based registration data is generated. A delta transform from the image-based registration data and the calibration-based registration data at the first frame is also derived.

Abstract: A system and/or method for imaging system calibration, including: determining a dense correspondence map matching features in a first image to features in a second image, and determining updated calibration parameters associated with the image acquisition system based on the matching features.

Abstract: This disclosure describes a configuration of an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of cameras that may be selectively combined to form a stereo pair for use in obtaining stereo images that provide depth information corresponding to objects represented in those images. Depending on the distance between an object and the aerial vehicle, different cameras may be selected for the stereo pair based on the baseline between those cameras and a distance between the object and the aerial vehicle. For example, cameras with a small baseline (close together) may be selected to generate stereo images and depth information for an object that is close to the aerial vehicle. In comparison, cameras with a large baseline may be selected to generate stereo images and depth information for an object that is farther away from the aerial vehicle.

Abstract: Computing devices and methods utilizing a joint speaker location/speaker identification neural network are provided. In one example a computing device receives an audio signal of utterances spoken by multiple persons. Magnitude and phase information features are extracted from the signal and inputted into a joint speaker location and speaker identification neural network. The neural network utilizes both the magnitude and phase information features to determine a change in the person speaking. Output comprising the determination of the change is received from the neural network. The output is then used to perform a speaker recognition function, speaker location function, or both.

Abstract: A signaling device able to operate in association with a capturing device able to capture a scene. The signaling device includes: an obtaining module able to obtain a first observation direction from the scene captured by the capturing device, a determining module able to determine a first field of observation associated with the first observation direction, and a signalling module able to signal the first observation field using first signage based on at least one sensorial indicator.

Abstract: An automobile-mounted imaging apparatus and a computer readable storage medium for detecting a distance to at least one object. The apparatus comprises circuitry configured to select at least two images from images captured by at least three cameras to use for detecting the distance to the at least one object based on at least one condition. Alternatively or additionally, the apparatus comprises circuitry configured to select two cameras of at least three cameras for detecting the distance to the at least one object based on at least one condition. Alternatively or additionally, the apparatus comprises circuitry configured to determine which of at least two cameras to use for detecting the distance to the at least one object based on at least one condition from at least three cameras capturing images.

Abstract: Systems, devices, and methods disclosed herein may generate captured views and a plurality of intermediate views within a pixel disparity range, Td, the plurality of intermediate views being extrapolated from the captured views.

Abstract: Anamorphic system for the acquisition, post-production and reproduction of 360° panorama images on three-dimensional objects, suitable for the representation of panorama images deformed according to the principle of anamorphosis on a two-dimensional medium, the image being adapted to be reflected on the outer surface of a three-dimensional medium positioned centrally with respect to the two-dimensional medium; the system including: (A) acquisition: wherein 360° photography shots are taken around the object; the photography shots equidistant from the object and provided with focals; the photography shots also having a mutual superimposition included between 30% and 40% of the image; the acquisition step occurring over time, for acquiring shots of the entire object; (B) post-production: wherein the photography shots are edited to generate the deformed image; (C) reproduction of the image on a two-dimensional medium, the image provided with a central hole; and (D) positioning a three-dimensional medium at the ce

Abstract: The disclosure includes a system and method for generating virtual reality content. For example, the disclosure includes a method for generating virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data with a processor-based computing device programmed to perform the generating, providing the virtual reality content to a user, detecting a location of the user's gaze at the virtual reality content, and suggesting an advertisement based on the location of the user's gaze. Another example includes receiving virtual reality content that includes a stream of three-dimensional video data and a stream of three-dimensional audio data to a first user with a processor-based computing device programmed to perform the receiving, generating a social network for the first user, and generating a social graph that includes user interactions with the virtual reality content.

Abstract: A method for improving the interpretation of the surroundings of a UAV, and to a UAV system is presented herein. The method comprises the steps of acquiring an image comprising depth data, and determining a boundary between a first image portion and a second image portion. The second image portion surrounds the first image portion, and the boundary is defined by an interface between first periphery sub-portions and second periphery sub-portions. A difference in depth data between adjacent first periphery sub-portions and second periphery sub-portions is above a first predetermined threshold and/or second periphery sub-portions comprises undefined depth data. The method further comprises determining the area of the first image portion, and if the area of the first image portion is below a second predetermined threshold, determining that the first image portion contains incorrect depth data and deleting and/or adjusting the incorrect depth data contained by the first image portion.

Abstract: A three camera alignment system, having a first camera module having a first fixed zoom, a second camera module having a second fixed zoom coupled to the first camera module, wherein the second camera module is calibrated to the first camera module and a third camera module having a third fixed zoom coupled to at least one of the first camera module and the second camera module and wherein the third camera module is aligned to the calibrated first camera module and second camera module based on block matching along epipolar lines.

Abstract: Systems and methods for depth estimation in accordance with embodiments of the invention are illustrated. One embodiment includes a method for estimating depth from images. The method includes steps for receiving a plurality of source images captured from a plurality of different viewpoints using a processing system configured by an image processing application, generating a target image from a target viewpoint that is different to the viewpoints of the plurality of source images based upon a set of generative model parameters using the processing system configured by the image processing application, and identifying depth information of at least one output image based on the predicted target image using the processing system configured by the image processing application.

Abstract: The present disclosure relates to a positioning system suitable for use in an imaging system. The positioning system may include one or more cameras configured to capture images or videos of an imaging object and surrounding environment thereof for ROI targeting or patient position recognition. The positioning system may also include one or more position probes and sources configured to determine an instant location of an imaging object or an ROI thereof in a non-contact manner.

Abstract: The disclosure includes generating a stream of panoramic images. A method includes determining a first matching camera module. The method includes constructing a first camera map that associates a first pixel location in a first panoramic image to the first matching camera module, wherein the first pixel location corresponds to the point in a panorama from a first viewing direction. The method includes generating, based on the first camera map, a stream of first panoramic images.

Abstract: A dual camera module system includes a housing and a pair of camera modules (e.g., digital cameras) that are aligned with fields of view that overlap below the housing. The camera modules are mounted to a bench within the housing. The dual camera module system is configured for mounting above areas such as retail establishments or other materials handling facilities. The housing is formed from one or more sections of plastic or like materials, and includes inlets and outlets that enable air to flow past the camera modules and other components within the housing, and to maintain such components at a desired temperature. Images captured by the imaging devices of the camera module may be utilized for any purpose.

Abstract: The disclosure is directed to a method to compensate for visual distortion when viewing video image streams from a multiple camera capture of a scene where the method determines the disparity difference utilizing the user view orientation and then compresses and/or stretches the left and/or right eye video image streams to compensate for the visual distortion. In another aspect, the method describes additional adjustments and corrections to the video image streams including rotating, tilting, shifting, and scaling the video image streams, and correcting for gapping and clipping visual image artifacts. In another aspect, a visual compensation system is described to implement the method. Additionally, a visual compensation apparatus is disclosed to perform the method operations.

Abstract: There are provided methods and apparatus for video usability information (VUI) for scalable video coding (SVC). An apparatus includes an encoder (100) for encoding video signal data into a bitstream. The encoder specifies video user information, excluding hypothetical reference decoder parameters, in the bitstream using a high level syntax element. The video user information corresponds to a set of interoperability points in the bitstream relating to scalable video coding (340, 355).

Abstract: There is provided an all-celestial imaging apparatus enabling imaging of images that enable estimation of depth information relating to an object to be imaged by suppressing any generation of occlusion. An all-celestial imaging apparatus that is an aspect of the present technique includes plural imaging parts each arranged being directed in a direction different from that of each other, and the plural imaging parts are arranged such that all imaging ranges on at least one circumference of the imaging ranges by the plural imaging parts are each overlapped by angles of view of two or more pairs of the imaging parts. The present technique is applicable to, for example, an all-celestial camera imaging images that are used in the case where the depth information on a distance to an object to be imaged that may be present in an optional direction of all azimuth directions of 360° is estimated.