Abstract: A first light beam can be collected by using an optical module. A second light beam can be obtained based on the first light beam. An image sensor can perform photoelectric conversion on the infrared light beam that is in the second light beam and that is irradiated to the first channel to obtain a first electrical signal. Photoelectric conversion can be performed on the visible light beam that is in the second light beam and that is irradiated to the second channel to obtain a second electrical signal. An initial image can be generated based on the first electrical signal and the second electrical signal. A color image and a grayscale image can be sent to an image processor. The image processor can receive the color image and the grayscale image. Fusion processing can be performed on the color image and the grayscale image to obtain a fused image.

Abstract: Systems and methods for correcting point of view (POV) aberrations in scanning folded cameras and multi-cameras including such scanning folded cameras. In a Tele folded camera that includes an optical path folding element (OPFE) and an image sensor, the OPFE is tilted in one or two directions to direct the Tele folded camera towards a POV of a scene, a Tele image or a stream of Tele images is captured from the POV, the Tele image having POV aberrations and the POV aberrations are digitally corrected to obtain an aberration-corrected image or stream of images.

Abstract: A method, an electronic device, and a computer program product for generating a three-dimensional scene are provided in embodiments of the present disclosure. The method may include obtaining source image features from a plurality of two-dimensional source images associated with the three-dimensional scene to be generated. The method may further include obtaining editing features from an editing instruction input by a user for the three-dimensional scene, each of the editing features respectively forming a feature pair with each of the source image features. Furthermore, the method may include updating the source image features by maximizing a correlation coefficient of each of the feature pairs, and generating the three-dimensional scene based at least on the updated source image features. Embodiments of the present disclosure can realize arbitrary editing of a three-dimensional scene, thus enhancing the experience of human-computer interaction.

Abstract: First images that are screenshots from a first version of a software component are obtained. Second images that are screenshots from a second version are obtained. A collection of image deviations that includes pair-wise image deviations between pairs of images are identified. A pair of images includes a first image from the first images and a corresponding second image from the second images. An image deviation indicates a portion of the second image identified as differing from a spatially corresponding portion of the first image. The image deviations are grouped into deviation groups. At least some of the second images are associated with at least some of the deviation groups. A subset of the second images corresponding to a deviation group is output responsive to a selection of an indication of the deviation group.

Abstract: A method includes applying both a first dedicated functional-anatomical registration scheme to a first volume of interest to deform the first volume of interest and a second dedicated functional-anatomical registration scheme to a second volume of interest to deform the second volume of interest, wherein the first volume of interest at least partially encompasses the second volume of interest. The method includes identifying or segmenting relevant organs or anatomical structures related to a first group and a second group in the first volume of interest and the second volume of interest, respectively; generating a spatially smooth-transition weight mask that gives higher weight to image data corresponding to the identified or segmented relevant organs or anatomical structures related to the first group and the second group; and generating a final cohesive registered image volume from the first image volume and the second image volume utilizing the spatially smooth-transition weight mask.

Abstract: An image enhancement method is provided. The method includes obtaining an image, extracting high-frequency components of the image, calculating an average pixel value of pixels corresponding to the extracted high-frequency components, and performing enhancement on pixels in the image that have pixel values greater than or equal to the calculated average pixel value to obtain an enhanced image. Apparatus and non-transitory computer-readable storage medium counterpart embodiments are also provided.

Abstract: In an object recognition apparatus, a storage unit stores a table in that a plurality of feature amounts are associated with each object having feature points of respective feature amounts. An object region detection unit detects object regions of a plurality of objects from an input image. A feature amount extraction unit extracts feature amounts of feature points from the input image. A refining unit refers to the table, and refines from all objects of recognition subjects to object candidates corresponding to the object regions based on feature amounts of feature points belonging to the object regions. A matching unit recognizes the plurality of objects by matching the feature points belonging to each of the object regions with feature points for each of the object candidates, and outputs a recognition result.

Abstract: An information processing method, and a terminal and a computer-readable storage medium for processing information are provided. The information processing method includes: acquiring measurement data obtained by measuring a product area contained in a captured image; and notifying, a user of the terminal, of second information of at least one first product that is selected, based on the measurement data, from first information of a plurality of products stored in a storage device.

Abstract: Described herein are systems, methods, and non-transitory computer readable media for generating fused sensor data through metadata association. First sensor data captured by a first vehicle sensor and second sensor data captured by a second vehicle sensor are associated with first metadata and second metadata, respectively, to obtain labeled first sensor data and labeled second sensor data. A frame synchronization is performed between the first sensor data and the second sensor data to obtain a set of synchronized frames, where each synchronized frame includes a portion of the first sensor data and a corresponding portion of the second sensor data. For each frame in the set of synchronized frames, a metadata association algorithm is executed on the labeled first sensor data and the labeled second sensor data to generate fused sensor data that identifies associations between the first metadata and the second metadata.

Abstract: A system and method of mode selection face recognition with parallel CNNs are disclosed. The system includes a mode selection module, a parallel convolutional neural network module, a database module and an ID judgment module. The parallel convolutional neural network module includes several convolutional neural network units. The mode selection module can determine the facial characteristics of each facial image, and send each facial image to the convolutional nerve corresponding to its facial characteristics The results serve as a benchmark for the ID judgment module to compare and test other facial images. By using several convolutional neural network units for facial image training for different facial characteristics of the same person, the noise from other convolutional neural network units can be reduced and the similarity in the feature vector extraction stage can be improved. The resulting accuracy of face recognition will increase.

Abstract: There is provided an image processing apparatus, an image processing method, and a program that enable display of an advertisement in an appropriate region within a captured image. The image processing apparatus sets, on the basis of density of people in a predetermined region within a captured image, an advertisement display region for superimposition of an advertisement image on the captured image. The present technology is applicable to a television (TV) broadcast system.

Abstract: Techniques are presented for generating semantic layers that are used to facilitate data analyses of subject datasets. The semantic layers are generated from data analysis configurations that characterize analysis environments pertaining to the subject datasets rather than from subject dataset metadata that is associated with the subject datasets. Data analysis attributes are extracted from configuration content objects that codify the data analysis configurations. A set of rules are accessed to facilitate mapping of the data analysis attributes to semantic model metadata that constitute the semantic layers. Some of the generated semantic layers comprise virtual data models. The virtual data models and/or recommendations associated with implementation of the semantic layers are presented to users. Certain portions of the semantic layers and/or the configuration content objects may be modified (e.g.

Abstract: Aspects of present disclosure relate to slide imaging. An exemplary system for imaging a slide includes at least an optical system, including an optical sensor; a slide port configured to hold a slide; and a first computing device configured to: capture, using the at least an optical system, a plurality of images of the slide, including a first image; automatically select an algorithm to apply to the first image; identify a control command as a function of the first image; and capture, using the at least an optical system, a second image of the plurality of images as a function of the control command.

Abstract: Disclosed are camera pose determination methods and apparatuses. The method includes determining first pixels in a current image and second pixels in a previous image, determining second pixel points with the preconfigured semantics in a previous image frame before the current image frame, the first pixel points corresponding to at least a portion of the second pixel points, determining an error between the first pixel points and the second pixel points, and a camera pose change value of the current image frame relative to the previous image frame based on the error, and determining a camera pose of the current image based on a camera pose of the previous image and the camera pose change. Related devices and storage media are also disclosed.

Abstract: Systems and techniques for updating floor plans for use by autonomous mobile devices. The techniques include accessing a first floor plan with associated spatial metadata. An updated occupancy map is received with additional geographic updates over the first floor plan. A transformation of the first floor plan is determined to match the new occupancy map. The spatial data and the first floor plan are transformed and the transformed spatial metadata is associated with the new occupancy map to form a second floor plan.

Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: The current disclosure provides methods and systems for visualizing, comparing, and navigating through, labeled image sequences. In one example, a degree of variation between a plurality of labels for an image in a sequence of images may be encoded as a comparison metric, and the comparison metric for each image may be graphed as a function of image position in the sequence of images, thereby providing a contextually rich view of label variation as a function of progression through the sequence of images. Further, the encoded variation of image labels may be used to automatically flag inconsistently labeled images, wherein the flagged images may be highlighted in a graphical user interface presented to a user, pruned from a training dataset, or a loss associated with the flagged image may be scaled based on the encoded variation during training of a machine learning model.

Abstract: Techniques for tagging virtualized content are disclosed. In some embodiments, a modeled three-dimensional scene of objects representing abstracted source content is generated and analyzed to determine a contextual characteristic of the scene that is based on a plurality of objects comprising the scene. The modeled scene is tagged with a tag specifying the determined contextual characteristic.

Abstract: A method for monitoring a surveillance area includes receiving a plurality of video streams that are captured by a plurality of video cameras in the surveillance area, each of the plurality of video streams capturing one or more objects in the surveillance area that are within a camera field of view (FOV) of the corresponding video camera and from a camera vantage point of the corresponding video camera. A vantage point transformation is applied to each of two or more objects captured in two or more of the plurality of video streams, the vantage point transformation transforming a view of each of the two or more objects from the camera vantage point of the corresponding video camera to a common vantage point. The transformed view of each of the two or more objects from the common vantage point is rendered on a display.

Abstract: Embodiments of the present invention are a high dynamic range (HDR) synthesis method and apparatus, an image processing chip and an aerial camera. The method includes: acquiring a plurality of to-be-synthesized images having different exposure time; calculating a mean brightness of the to-be-synthesized images; determining an image brightness type of the to-be-synthesized images according to the mean brightness; calculating a brightness difference between adjacent pixel points in one to-be-synthesized image; calculating an inter-frame difference of different to-be-synthesized images at a same pixel point position according to the brightness difference; determining a motion state of the to-be-synthesized images at the pixel point position according to the inter-frame difference; and weighting and synthesizing the to-be-synthesized images into a corresponding HDR image according to the image brightness type and the motion state.

Abstract: An image processing system for generating a display for a vehicle. The image processing system receives images, respectively, from a plurality of cameras mounted on the vehicle. The field of view of the plurality of cameras at least partially overlaps. The field of view of one or more of the plurality of cameras includes a region underneath the vehicle. The images are transformed to a common reference plane using a perspective transformation algorithm and based on intrinsic and extrinsic parameters of the plurality of cameras, to thereby obtain a projected image. The projected image is projected to the common reference plane. A display is generated based on the projected image. The display includes a synthetic depiction of the vehicle including an outer profile. The display includes an image area within the outer profile that is based on the projected image for the region underneath the vehicle.

Abstract: The invention discloses a Trace Microanalysis Microscope System for high throughput screening. A multimodal imaging sensor arrangement acquires color, multispectral, hyperspectral and multi-directional polarized imaging, independently and in combinations thereof. In one aspect of this disclosure, the multimodal acquisition is combined with a plurality of sample illumination modes, further expanding the dimensionality of the generated data. In another aspect of this invention, machine learning-based methods combining and comparing a-priori data with the acquired multimodal data space, provide unique identifiers for the composition of the analyzed target objects. In yet another aspect of this invention, projection mapping of the identified compositional features navigates secondary sampling for subsequent analyses.

Abstract: The present disclosure relates to methods and apparatuses for processing an image, training an image recognition network and recognizing an image. The method of processing an image includes: obtaining a plurality of original images from an original image set, where at least one of the plurality of original images includes an annotation area; obtaining at least one first image by splicing the plurality of original images; for each of the at least one first image, adjusting a shape and/or size of the first image based on the plurality of original images to form a second image; obtaining respective positions of the at least one annotation area in the second image by converting respective positions of the at least one annotation area in the plurality of original images.

Abstract: A method of controlling a mobile work machine includes receiving an image of spectral response at an area of terrain corresponding to a path of the mobile work machine, generating an image distance metric based on a distance between the spectral response and a base spectral response model corresponding to the terrain, comparing the image distance metric to a distance threshold, and controlling a controllable subsystem of the mobile work machine based on the comparison.

Abstract: A computer-implemented method includes obtaining an image of an area of a property from an augmented reality device, identifying the area of the property based on the image obtained from the augmented reality device, determining that the area of the property corresponds to an event at the property or a configuration of a monitoring system of the property, and providing, in response to determining that the area of the property corresponds to the event or the configuration, information that represents the event or the configuration and that is configured to be displayed on the augmented reality device.

Abstract: Certain aspects of the present disclosure provide a method for performing parallel data processing, including: receiving data for parallel processing from a data processing requestor; generating a plurality of data sub-blocks; determining a plurality of data portions in each data sub-block of the plurality of data sub-blocks; changing an order of the plurality of data portions in at least one data sub-block of the plurality of data sub-blocks; providing the plurality of data sub-blocks, including the at least one data sub-block comprising the changed order of the plurality of data portions, to a plurality of processing units for parallel processing; and receiving processed data associated with the plurality of data sub-blocks from the plurality of processing units.

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.

Abstract: A wrinkle detection method includes: obtaining an original image, where the original image includes a face; adjusting a size of an ROI region on the original image to obtain at least two ROI images of different sizes, where the ROI region is a region in which a wrinkle on the face is located. A terminal device processes all the at least two ROI images of different sizes to obtain at least two binary images, where a white region in each binary image is a region in which a wrinkle is suspected to appear. The terminal device fuses the at least two binary images to obtain a final image, where a white region on the final image is recognized as a wrinkle.

Abstract: A system for merging a plurality of image sources into a single image stream defines a predistortion image mask for each source. Each mask defines a distorted image space to account for distortion in the display optics, and indicates a region or regions in the desired output image where one merge method should be used versus another (e.g., overlay vs. replace). Each source mask may have a separate level of granularity according to the requirements of the included image and corresponding distortion.

Abstract: Methods and systems for generating new product images are disclosed. In one aspect, a method includes identifying, via hardware processing circuitry, a template for a category of products, the template defining locations of attributes of products belonging to the category, identifying, via the hardware processing circuitry, common attributes of products of the category based on the template, averaging, via the hardware processing circuitry, corresponding pixel values across images representing the products having the common attributes, generating, via the hardware processing circuitry, a new product image representing a new product based on the averaged pixel values; and generating, via the hardware processing circuitry, a modified new product image by varying attributes of the new product based on the locations of the attributes defined by the template.

Abstract: Provided are an image fusion method and apparatus, and a portable terminal. The method comprises: obtaining several aligned images; respectively calculating gradient information of each image; setting a mask image of each image, and generating a target gradient image; performing a gradient operation on the target gradient image, and obtaining a target Laplacian image; performing a deconvolution transform on the Laplacian image, and generating a fused panoramic image. The technical solution generates a Laplacian image by performing gradient information calculations on several images, and then performs a deconvolution transform to generate a fused panoramic image, thereby eliminating image stitching color differences, and implementing a better image fusion effect.

Abstract: A system and method is provided for rendering key and fill video streams for video processing. The system includes a database that stores video data including a video stream of a sequence of images and alpha data defining transparency levels for each portion of each image. An encoder encodes each frame of the sequence of images to generate encoded composite frames that each contain a fill portion and a key portion, such that each encoded composite frame includes both the fill and key portions that are disposed horizontally and side-by side with respect to each other. A renderer having a single decoder decodes each encoded composite frame to extract pixel values from the fill portion and respective transparency levels from the key portion and in order to generate a proxy of the respective frame to be displayed by a video processing device.

Abstract: The present disclosure relates to systems and methods for image processing. The methods may include obtaining, by a first processor, a first image and a second image of a target region. The methods may further include generating, by the first processor, a fused image based on the first image and the second image. The methods may further include identifying, by a second processor, a region of interest (ROI) associated with a target object in the first image. And the method may also include generating, by the second processor, a target image based at least in part on information associated with the ROI in the first image and the fused image.

Abstract: An adapter configured to be optically coupled to a plurality of microscopes. The adapter includes a) a first microscope interface configured to optically couple a first microscope to an optical element in optical communication with an optical probe; b) a second microscope interface configured to optically couple a second microscope to the optical element in optical communication with the optical probe; and c) an optical arrangement configured to direct light collected from a sample with aid of the optical probe to (1) the first microscope and second microscope simultaneously, or (2) the first microscope or second microscope selectively.

Abstract: Systems and method directed to generating a stylized image are disclosed. In particular, the method includes, in a first data path, (a) applying first stylization to an input image and (b) applying enlargement to the stylized image from (a). The method also includes, in a second data path, (c) applying segmentation to the input image to identify a face region of the input image and generate a mask image, and (d) applying second stylization to an entirety of the input image and inpainting to the identified face region of the stylized image. Machine-assisted blending is performed based on (1) the stylized image after the enlargement from the first data path, (2) the inpainted image from the second data path, and (3) the mask image, in order to obtain a final stylized image.

Abstract: This application discloses an image content removal method, and relates to the field of computer vision. The method includes: enabling a camera application; displaying a photographing preview interface of the camera application; obtaining a first preview picture and a first reference frame picture that are captured by a camera; determining a first object in the first preview picture as a to-be-removed object; and determining to-be-filled content in the first preview picture based on the first reference frame picture, where the to-be-filled content is image content that is of a second object and that is shielded by the first object in the first preview picture. The terminal generates a first restored picture based on the to-be-filled content and the first preview picture. In this way, image content that a user does not want in a picture or a video shot by the user can be removed.

Abstract: A surface inspection apparatus includes an imaging device configured to image a surface of an object to be inspected, and a processor configured to: calculate a numerical value representing a quality of the surface by processing an image captured by the imaging device, and receive a change in a range used to calculate the numerical value indicated by an index in the image.

Abstract: A method of generating a map for visual localization includes specifying a virtual camera pose by using 3-dimensional (3D) model data which is based on an image of an outdoor space captured from the air; rendering the image of the outdoor space from a perspective of the virtual camera, by using the virtual camera pose and the 3D model data; and generating a feature point map by using the rendered image and the virtual camera pose.

Abstract: Methods and systems for identifying areas of interest in an image and management of images are disclosed. To manage identification of areas of interest in an image, subject matter expert driven processes may be used to identify the areas of interest. The identified areas of interest may be used to maintain a database usable to guide subsequent use of the images. The database may associate image segments of the images with various landmarks and/or area of interest. The associations may be used to limit the quantity of image segments read from storage during subsequent use of the images.

Abstract: Methods and systems are disclosed including a method comprising, with one or more computer processors, associating geographic position data and orientation data of the one or more video capture devices with each video frame of a geographic area; analyzing the geographic position data and orientation data and the video frames to generate geo-referencing data for pixels of the video frames; determining a geographical boundary of the video frame from the geo-referencing data; receiving, one or more layers of geographic information system (GIS) data using the determined geographical boundary of the video frame; and determining overlay position of the geographic information system (GIS) data on the video frames in real time based at least in part on the geo-referencing data; and overlaying at least a portion of the geographic information system (GIS) data on the video frames based on the overlay position.

Abstract: Disclosed is a video editing method including: acquiring an editing instruction to be executed from a user; calling a template video stored in advance according to the editing instruction, and acquiring a time axis representing duration of the template video; and overlaying the time axis on a progress bar of an editing video to indicate, by a combination of the time axis and the progress bar, a position of the template video in the editing video. A video editing apparatus and a smart mobile terminal are further provided.

Abstract: Certain aspects of the present disclosure provide techniques for generating a unified knowledge graph. In one example, a method includes receiving entity data from a data source comprising a plurality of entities; forming a plurality of type-specific groups of entity data based on the received entity data; for each respective type-specific group of entity data of the plurality of type-specific groups of entity data; disambiguating the entity data within the respective type-specific group of entity data; creating a plurality of entity relationships based on the disambiguated entity data; and exporting the plurality of entity relationships to a type-specific subgraph; and forming a unified knowledge graph based on a plurality of type-specific subgraphs, wherein each type-specific subgraph of the plurality of type-specific subgraphs is associated with a single type-specific group of entity data of the plurality of type-specific groups of entity data.

Abstract: The disclosure discloses a historical map utilization method based on a vision robot, including: S1, the vision robot is controlled to continuously collect image of a preset road sign of a preset working area, and road sign information of the preset road sign is obtained; S2, the obtained road sign information is transmitted to a first map positioning system and a second map positioning system; S3, the first map positioning system and the second map positioning system are controlled to respectively process corresponding road sign information, thereby obtaining first pose information and second pose information; S4, the first pose information and the second pose information under the same preset road sign are selected, and a transformation relationship formula of the first pose information and the second pose information is calculated; and S5, the historical map is controlled to perform a corresponding transformation operation, and subsequent motion control is performed.

Abstract: A computer program according allows a processor to function such that a first stream of a first data type including a motion, a sound, a comment, or information according to gifting is retrieved, a second stream of a second data type including a video is retrieved, data according to the first stream and data according to the second stream are synthesized, and the synthesized data is provided. In addition, the first data type includes intermediate information according to the video. In addition, the intermediate information includes depth information according to the video.

Abstract: An inspection apparatus (100) detects an inspection object (90) from first image data (10) in which the inspection object (90) is included. The inspection apparatus (100) generates second image data (20) by performing a geometric transform on the first image data (10) in such a way that a view of the detected inspection object (90) becomes a view satisfying a predetermined reference. In an inference phase, the inspection apparatus (100) detects, by using an identification model for detecting an abnormality of the inspection object (90), an abnormality of the inspection object (90) included in the second image data (20). Further, in a learning phase, the inspection apparatus (100) learns, by using the second image data (20), an identification model for detecting an abnormality of the inspection object (90).

Abstract: A stereoscopic image acquisition method includes acquiring a first three-dimensional model corresponding to a two-dimensional image according to the two-dimensional image and a depth image; acquiring a target area and an area to be repaired corresponding to the first three-dimensional model; obtaining a second three-dimensional model by repairing a pixel in the area to be repaired according to a color value and a depth value of a pixel in the target area; and acquiring a stereoscopic image to be displayed according to a preset viewing angle change path and the second three-dimensional model.

Abstract: Systems and methods for correcting point of view (POV) aberrations in scanning folded cameras and multi-cameras including such scanning folded cameras. In a Tele folded camera that includes an optical path folding element (OPFE) and an image sensor, the OPFE is tilted in one or two directions to direct the Tele folded camera towards a POV of a scene, a Tele image or a stream of Tele images is captured from the POV, the Tele image having POV aberrations and the POV aberrations are digitally corrected to obtain an aberration-corrected image or stream of images.

Abstract: A system and method obtain first image data of a route at a location of interest from a first optical sensor disposed onboard a vehicle system moving along the route. The first image data depicts the route at the location of interest prior to passage of the vehicle system over the route at the location of interest. Second image data of the route at the location of interest is obtained from a second optical sensor disposed onboard the vehicle system. The second image data depicts the route at the location of interest after passage of the vehicle system over the route at the location of interest. A determination is made as to whether a change in the route has occurred at the location of interest by comparing the first image data with the second image data.

Abstract: A post capture imagery processing system is provided. The system is for use with aerial imagery and includes a server having a processor and a memory and a software application providing instruction to the server to process the captured aerial imagery, such as spherical imagery. The server further includes instructions to geo-rectify the spherical imagery. The geo rectifying of the spherical imagery may include one of use of a third party GIS map to associate corresponding data with the spherical imagery in order to produce a geo-referenced spherical image, or calculate the geo-references by a software application performing particular operations on the server.

Abstract: The present disclosure describes devices and methods for generating RGB images from Bayer filter images using adaptive sub-pixel spatiotemporal interpolation. An electronic device includes a processor configured to estimate green values at red and blue pixel locations of an input Bayer frame based on green values at green pixel locations of the input Bayer frame and a kernel for green pixels, generate a green channel of a joint demosaiced-warped output RGB pixel from the input Bayer frame based on the green values at the green pixel locations, the kernel for green pixels, and an alignment vector map, and generate red and blue channels of the joint demosaiced-warped output RGB pixel from the input Bayer frame based on the estimated green values at the red and blue pixel locations, kernels for red and blue pixels, and the alignment vector map.