Abstract: Various embodiments are directed to systems and methods for processing a discretion order in a dark pool matching environment. A first order to buy or sell a trading product is received from a computer of a first trader. The first order has a first price and a first size. A second order to buy or sell the trading product that is contra to the first order is received from a second trader. The second order defines a second quantity and a price range of possible prices at which the second order can be executed. The price range comprises at least a second price. The second quantity of the trading product is reserved in an OMS of the second trader such that the second quantity of the second order is permitted by the OMS to be executed at any price within the price range. The second order is received before or after the first order is received. A processor determines that the first price of the first order is within the price range of the second order.

Abstract: A system for providing real-time bi-directional charge capture-centralized conversation between Billing and Provider entities, comprising a first computer apparatus with a computer apparatus charge capture module installed and a second computer apparatus with a computer apparatus billing module installed that are used to transmit and/or receive real-time charge capture centralized conversation data. Real-time charge capture-centralized conversation data is comprised of real-time charge capture data. The real-time charge capture data and the real-time charge capture-centralized conversation data can be combined to create real-time claim data. The system further comprises first computer apparatus and second computer apparatus receipt and transmission via secured communication links. The real-time charge capture data, real-time charge capture-centralized conversation data and real-time claim data is presented in a social media conversation style format.

Abstract: Methods and systems for monitoring use and determining risks associated with operation of a vehicle having one or more autonomous operation features are provided. According to certain aspects, operating data may be recorded during operation of the vehicle. This may include information regarding the vehicle, the vehicle environment, use of the autonomous operation features, and/or control decisions made by the features. The control decisions may include actions the feature would have taken to control the vehicle, but which were not taken because a vehicle operator was controlling the relevant aspect of vehicle operation at the time. The operating data may be recorded in a log, which may then be used to determine risk levels associated with vehicle operation based upon risk levels associated with the autonomous operation features. The risk levels may further be used to adjust an insurance policy associated with the vehicle.

Abstract: Systems and methods provide for an automated system for analyzing damage and processing claims associated with an insured item, such as a vehicle. An enhanced claims processing server may analyze damage associated with the insured item using photos/video transmitted to the server from a user device (e.g., a mobile device). The mobile device may receive feedback from the server regarding the acceptability of submitted photos/video, and if the server determines that any of the submitted photos/video is unacceptable, the mobile device may capture additional photos/video until all of the data are deemed acceptable. To aid in damage analysis, the server may also interface with various internal and external databases storing reference images of undamaged items and cost estimate information for repairing previously analyzed damages to similar items. Further still, the server may generate a payment for compensating a claimant for repair of the insured item.

Abstract: Systems and methods are disclosed with respect to using a blockchain for managing the subrogation claim process related to a vehicle accident, in particular, determining fault as part of the subrogation process. An exemplary embodiment may include receiving an electronic notification of a vehicle collision; receiving sensor data (such as telematics, image, audio, vehicle operational, or other sensor data) related to the vehicle collision; determining a percentage of fault of the vehicle collision for one or more vehicles, vehicle systems, and/or drivers based upon, at least in part, analysis of the sensor data collected; and creating a blockchain for the vehicle collision with one or more links to the sensor image data and an indication of the percentage of fault(s) determined to facilitate blockchain-based claim handling.

Abstract: Systems, methods and articles of manufacture for performing a comparison of tax results based on different sets of tax data, and generating an explanation as to why the tax results differ or do not differ due to the differences in the tax data. The system includes a computing device, a data store in communication with the computing device and a tax preparation software application executable by the computing device. The tax preparation software application has a tax calculation engine, a tax calculation graph, and a change analysis engine. The tax calculation engine is configured to perform a plurality of tax calculation operations based on the tax calculation graph. The change analysis engine is configured to determine whether tax results based on different tax data differ or do not differ. The system may also generate explanation(s) of the reasons that the tax results differ or do not differ due to the different tax data.

Abstract: The present disclosure generally relates to contact management and communication with contacts. On a portable electronic device having a display a plurality of affordances associated with a plurality of contacts are displayed. A first user input is received selecting a first affordance of the plurality of affordances for a first contact of the plurality of contacts. In response to receiving the first user input and in accordance with a determination that a first communication application is in a set of communication applications installed on the portable electronic device, a contact information interface is displayed for the first contact. The contact information interface includes a first contact identification field for the first contact. The first contact identification field is associated with the first contact and the first communication application.

Abstract: A method of predicting crop yield includes generating, via a processor, a plurality of vectors representative of growing conditions for a current time period and a plurality of vectors representative of growing conditions for a previous time period. The processor compares the plurality of vectors for the current time to the vectors of the previous time periods for corresponding growing conditions and determines which previous vectors are closest to the current vectors. The plurality of previous time periods are each associated with crop yields. Thus, the processor can determine a crop yield for the current time period for a selected crop producing field and crop type based on crop yields for the closest previous time periods.

Abstract: A power management system obtains first data regarding several groups of electrical devices, including a budget and a respective priority metric associated with each of the groups. The system allots a respective amount of electrical power for use by each of the groups based on the first data. Further, the system obtains second data regarding the groups, including a respective amount of electrical power consumed by each of the groups. The system determines that a first group has consumed a first amount of electrical power that is greater than or equal to a second amount of electrical power that had been allotted for use by the first group. In response, the system re-allots at least a portion of a third amount of electrical power that had been allotted for use by a second group for use by the first group instead.

Abstract: The systems and methods herein provide a user-friendly, automated and transparent, contract drafting and negotiation tool. Through the contract drafting and negotiation tool two parties can negotiate agreement using template agreements including one or more sections in which each user is able to select one of a plurality of input options that affect the terms of the contract. In each instance, each party can see the option selected by the other party, as well as the options not selected by the other party. The systems and methods facilitate efficient and transparent contract negotiation and drafting.

Abstract: Exemplary embodiments provide a transportation staffing management system. An amount of transportations miles are forecasted for delivering inventory from a distribution enter to a store based on a sales forecast for a store. Non-driving time for drivers engaged in delivering inventory to a store is tracked based on data collected in real-time from mobile computing devices associated with delivery vehicles. An amount of time needed to deliver the inventory based on the forecasted amount of transportation miles and non-driving is calculated. An optimal transportation workload is generated for the distribution center based on the amount of time, data from a first database storing data from a central office, and data from a second database storing data from a distribution center.

Abstract: A parcel delivery system is provided for use in complex having a plurality of tenant units each having a tenant address, wherein the complex further comprising an intake facility, a delivery facility, and parcel storage boxes, and wherein the intake facility comprises a scanning station and a first automated ground delivery vehicle in communication with the scanning station and wherein the delivery facility comprises a second automated ground delivery vehicle configured to travel between the delivery station and tenant units. In accordance with embodiments, a computer system interfaces with the parcel delivery system to notify tenants when they have a parcel and to further notify tenants when delivery of the parcel has been completed.

Abstract: In some embodiments, methods and systems are provided that provide for facilitating delivery, via autonomous ground vehicles, of products ordered by customers of a retailer to customer-specified restricted areas accessible by an entryway openable via an access code.

Abstract: An information processing apparatus according to the present application includes an acquiring unit and a deciding unit. The acquiring unit acquires attribute information on a user. The deciding unit decides, based on the attribute information acquired by the acquiring unit, a placement position in which a virtual riding point that corresponds to a riding point that is used for the user to ride in a moving vehicle and that is virtually set is placed.

Abstract: A method of content production includes generating a survey of a performance area that includes a point cloud representing a first physical object, in a survey graph hierarchy, constraining the point cloud and a taking camera coordinate system as child nodes of an origin of a survey coordinate system, obtaining virtual content including a first virtual object that corresponds to the first physical object, applying a transformation to the origin of the survey coordinate system so that at least a portion of the point cloud that represents the first physical object is substantially aligned with a portion of the virtual content that represents the first virtual object, displaying the first virtual object on one or more displays from a perspective of the taking camera, capturing, using the taking camera, one or more images of the performance area, and generating content based on the one or more images.

Abstract: Each input image from a plurality of input images is divided into a plurality of image tiles. A feature point map including a plurality of feature point tiles respectively corresponding to the plurality of image tiles is generated by extracting feature points included in each image tile of the plurality of image tiles. A descriptor map including a plurality of descriptor tiles respectively corresponding to the plurality of feature point tiles is generated by generating descriptors of feature points included in the feature point map. Mapping information containing matching relationships between feature points included in different input images of the plurality of input images is generated based on a plurality of descriptor maps respectively corresponding to the plurality of input images. Image merging performance may be enhanced by dividing the input image into the plurality of image tiles to increase distribution uniformity of the feature points.

Abstract: A compositor receives, from each of a plurality of originating devices, compressed and/or encrypted image data portions of a frame of image data, together with portion metadata for each of the compressed and/or encrypted image data portions. Frame metadata for the frame of image data. The compositor then composites the image data portions without decompressing and/or decrypting them, based on the portion and frame metadata, by generating composited frame metadata for the composited image frame and amending the portion metadata for each of the compressed and/or encrypted image data portions to indicate a location of the compressed and/or encrypted image data portions in the composited image frame. The compressed and/or encrypted image data portions, the composited frame metadata and the amended portion metadata are then transmitted by the compositor to a display control device.

Abstract: There is provided with an image processing apparatus. A noise reduction unit generates a noise-reduced image in which noise is reduced from an input image in which a plurality of types of pixels that represent mutually different types of color information are arranged in one plane. An extraction unit generates a high-frequency emphasized image in which a high-frequency component of the input image is emphasized. A demosaicing unit generates a demosaiced image having a plurality of planes that each represent one type of color information by demosaicing processing to the noise-reduced image. A generation unit generates an output image by correcting the demosaiced image by using the high-frequency emphasized image.

Abstract: Aspects of the disclosure provide a device for processing frames with aliasing artifacts. For example, the device can include a motion estimation circuit, a warping circuit coupled to the motion estimation circuit, and a temporal decision circuit coupled to the warping circuit. The motion estimation circuit can estimate a motion value between a current frame and a previous frame. The warping circuit can warp the previous frame based on the motion value such that the warped previous frame is aligned with the current frame and determine whether the current frame and the warped previous frame are consistent. The temporal decision circuit can generate an output frame, the output frame including either the current frame and the warped previous frame when the current frame and the warped previous frame are consistent, or the current frame when the current frame and the warped previous frame are not consistent.

Abstract: A system for image inpainting is provided, including an encoder, a decoder, and a sketch tensor space of a third-order tensor; wherein the encoder includes an improved wireframe parser and a canny detector, and a pyramid structure sub-encoder; the improved wireframe parser is used to extract line maps from an original image input to the encoder, the canny detector is used to extract edge maps from the original image, and the pyramid structure sub-encoder is used to generate the sketch tensor space based on the original image, the line maps and the edge maps; and the decoder outputs an inpainted image from the sketch tensor space. A method thereof is also provided.

Abstract: A high efficiency method of processing images to provide perceptual high-contrast output. Pixel intensities are calculated by a weighted combination of a fixed number of static bounding rectangle sizes. This is more performant than incrementally growing the bounding rectangle size and performing expensive analysis on resultant histograms. To mitigate image artifacts and noise, blurring and down-sampling are applied to the image prior to processing.

Abstract: An image processing apparatus includes a processor configured to extract a component related to luminance of each of a sample image and a processing target image that is to undergo image processing to match an impression of the processing target image to the sample image, extract feature values of the processing target image and the sample image by attaching to a pixel value of each pixel forming the processing target image and the sample image a weight responsive to the component related to the luminance, and make adjustment to match the feature value of the processing target image to the feature value of the sample image.

Abstract: A computer apparatus and methods generate multi-parametric color composite images from multi-echo chemical shift encoded (CSE) MRI. Some embodiments use inherently co-registered images (i.e., image maps) that are combined into a single intuitive composite color image. The color (e.g., brightness, hue, and/or saturation) reflects in part the water and fat content, and other properties, particularly T2* relaxation (related to magnetic susceptibility) of the tissue.

Abstract: Systems and methods for automatically grading a user device are provided. Such systems and methods can include (1) a lighting element positioned at an angle relative to a platform, (2) an imaging device positioned at the angle relative to the platform such that light emitted from the lighting element and a field of view of the imaging device form a right angle where the light emitted from the lighting element and the field of view meet at a user device when the user device is positioned at a predetermined location on the platform, and (3) control circuitry that can activate the lighting element, instruct the imaging device to capture an image of a screen of the user device while the user device is at the predetermined location and is being illuminated by the first lighting element, and parse the image to determine whether the screen is damaged.

Abstract: Methods, apparatus, systems and articles of manufacture are disclosed for augmented reality vehicle condition inspection. An example apparatus disclosed herein includes a location analyzer to determine whether a camera is at an inspection location and directed towards a first vehicle in an inspection profile, the inspection location corresponding to a location of the camera relative to the first vehicle, an interface generator to generate an indication on a display that the camera is at the inspection location, the indication associated with an inspection image being captured, and an image analyzer to compare the inspection image captured at the inspection location with a reference image taken of a reference vehicle of a same type as the first vehicle, and determine a vehicle part condition or a vehicle condition based on the comparison of the inspection image and the reference image.

Abstract: Embodiments relate to a method and system for determining a situation of a facility by imaging a sensing data of the facility including receiving sensing data through a plurality of sensors at a query time, generating a situation image at the query time, showing the situation of the facility at the query time based on the sensing data, and determining if an abnormal situation occurred at the query time by applying the situation image to a pre-learned situation determination model.

Abstract: A method of inspecting images on printed products by a computer in a printing machine. Printed products are recorded and digitized by an image sensor of an image inspection system in the course of the image inspection process, and the computer compares them to a digital reference image. If deviations are found, the defective printed products are removed. The computer analyzes the deviations found in the course of the image inspection process together with further data from other system parts and from the machine, determines specific defect classes and the causes thereof based on the defects by machine learning processes, assigns the defects found in the image inspection process to the defect classes in a corresponding way, and displays the classified detected defects with their defect classes and causes to an operator of the machine so that the operator can initiate specific measures to eliminate the defect causes.

Abstract: Dynamic thin film interferometry is a technique used to non-invasively characterize the thickness of thin liquid films that are evolving in both space and time. Recovering the underlying thickness from the captured interferograms, unconditionally and automatically is still an open problem. A compact setup is provided employing a snapshot hyperspectral camera and the related algorithms for the automated determination of thickness profiles of dynamic thin liquid films. The technique is shown to recover film thickness profiles to within 100 nm of accuracy as compared to those profiles reconstructed through the manual color matching process. Characteristics and advantages of hyperspectral interferometry are discussed including the increased robustness against imaging noise as well as the ability to perform thickness reconstruction without considering the absolute light intensity information.

Abstract: In an inspection system including a printing apparatus, an inspection apparatus configured to inspect quality of a printed product printed by the printing apparatus, and an information processing apparatus configured to transmit a print job to the printing apparatus, the information processing apparatus transmits a print job to the printing apparatus in a case where a reference image to be used for inspecting the quality of the printed product corresponding to the print job is registered, and does not transmit the print job in a case where the reference image corresponding to the print job is not registered.

Abstract: A control device controls sectors for the assembly of turbine stators of a turbine. Each turbine stator is formed of an assembly of sectors juxtaposed to one another, and each sector has a reference. The control device includes an automated system for identifying the sector with means for reading the sector reference, a database of the references of the sectors that form the turbine stators of the turbine, and means for associating the read reference of the sector with a determined turbine stator of the turbine.

Abstract: Embodiments described herein provide a system for assessing the surface of an object for detecting contamination or other defects. During operation, the system obtains an input image indicating the contamination on the object and generates a synthetic image using an artificial intelligence (AI) model based on the input image. The synthetic image can indicate the object without the contamination. The system then determines a difference between the input image and the synthetic image to identify an image area corresponding to the contamination. Subsequently, the system generates a contamination map of the contamination by highlighting the image area based on one or more image enhancement operations.

Abstract: The invention provides a fluid analysis apparatus, a method for operating a fluid analysis apparatus, and a fluid analysis program that perform display such that the tendency of a fluid flow in a blood vessel is easily checked. Route position information that is capable of identifying an order along a route of the anatomical structure is assigned to each position in the anatomical structure, using three-dimensional volume data in which each voxel has the information of a three-dimensional flow velocity vector indicating a flow velocity of a fluid in an anatomical structure. The three-dimensional flow velocity vector is selected such that the route position information of a position where the three-dimensional flow velocity vector is present is sequentially arranged from one point in the anatomical structure and a trajectory indicating the flow of the fluid is drawn so as to be visibly recognized.

Abstract: Systems and methods of the present invention provide for: receiving a digital image data; modifying the digital image data to reduce a width of a feature within the digital image data; executing a dimension reduction process on the feature; storing a feature vector comprising: at least one feature for each of the received digital image data, and a correct or incorrect label associated with each feature vector; selecting the feature vector from a data store; training a classification software engine to classify each feature vector according to the label; classifying the image data as correct or incorrect according to a classification software engine; and generating an output labeling a second digital image data as correct or incorrect.

Abstract: The present application related to a method for detecting an object image using a convolutional neural network. Firstly, obtaining feature images by Convolution kernel, and then positioning an image of an object under detected by a default box and a boundary box from the feature image. By Comparing with the sample image, the detected object image is classifying to an esophageal cancer image or a non-esophageal cancer image. Thus, detecting an input image from the image capturing device by the convolutional neural network to judge if the input image is the esophageal cancer image for helping the doctor to interpret the detected object image.

Abstract: This invention provides a signal-processing method that makes it possible to acquire, relatively easily and surely, a highly reliable normalized impulse-response signal without relying on the signal-correction processing after normalization. The signal-processing method of this invention includes a low-frequency extraction step, a high-frequency extraction step and a synthesizing step. In the low-frequency extraction step, only the low-frequency component is extracted from the spectrum of the first normalized signal NS1 obtained by normalizing the target signal Stgt in the time domain. In the high-frequency extraction step, only the high-frequency component is extracted from the spectrum of the second normalized signal NS2 obtained by normalizing the target signal Stgt in the frequency domain using the reference signal Sref.

Abstract: A first electronic device according to various embodiments may include: a display; a communication module comprising communication circuitry; a camera module including at least one camera; and a processor.

Abstract: A system for performing adaptive focusing of a microscopy device comprises a microscopy device configured to acquire microscopy images depicting cells and one or more processors executing instructions for performing a method that includes extracting pixels from the microscopy images. Each set of pixels corresponds to an independent cell. The method further includes using a trained classifier to assign one of a plurality of image quality labels to each set of pixels indicating the degree to which the independent cell is in focus. If the image quality labels corresponding to the sets of pixels indicate that the cells are out of focus, a focal length adjustment for adjusting focus of the microscopy device is determined using a trained machine learning model. Then, executable instructions are sent to the microscopy device to perform the focal length adjustment.

Abstract: Methods and systems for determining a plurality of sequences of nucleic acid (e.g., DNA) molecules in a sequencing-by-synthesis process are provided. In one embodiment, the method comprises obtaining images of fluorescent signals obtained in a plurality of synthesis cycles. The images of fluorescent signals are associated with a plurality of different fluorescence channels. The method further comprises preprocessing the images of fluorescent signals to obtain processed images. Based on a set of the processed images, the method further comprises detecting center positions of clusters of the fluorescent signals using a trained convolutional neural network (CNN) and extracting, based on the center positions of the clusters of fluorescent signals, features from the set of the processed images to generate feature embedding vectors. The method further comprises determining, in parallel, the plurality of sequences of DNA molecules using the extracted features based on a trained attention-based neural network.

Abstract: Provided are a disease region extraction apparatus, a disease region extraction method, and a disease region extraction program that can extract an infarction region even in an image in which it is difficult to prepare a large amount of data indicating a correct infarction region. A disease region extraction apparatus includes: an image acquisition unit that acquires a first image obtained by capturing an image of a subject that has developed a disease; an estimated image derivation unit that estimates a second image, whose type is different from the type of the first image, from the first image to derive an estimated image; and a disease region extraction unit that extracts a disease region from the estimated image.

Abstract: A system for facilitating medical image interpretation includes a processing unit and a display control unit. The processing unit includes a location information module generating a reference location indicator, and a feature marking module generating indication markers. The display control unit is in signal connection with the processing unit and a display device. The display control unit includes an image displaying module controlling the display device to display tissue images, and an auxiliary information displaying module controlling the display device to display, for each of the tissue images displayed by the display device, the reference location indicator and the indication markers together on the tissue image.

Abstract: The album creation application of the present disclosure displays image data, to which trimming is performed, and a template, which includes a slot in which the image data is arranged, so that a slot and image data to be arranged in the slot are selected by use of an input device. Position information of a point of interest in the image to be arranged in the slot is obtained. Composition patterns applicable to the image with designation of the point of interest are presented to the user, and the composition pattern to be applied, which is selected by the user from among the presented composition patterns, is obtained. Trimming is performed based on the point of interest and the selected composition pattern selected. The trimmed images are listed, so that multiple trimmed images are presented to the user as trimming proposals.

Abstract: An image processing apparatus, includes a memory; and a processor coupled to the memory and configured to: generate a trained machine learning model by learning a machine learning model using a first set of image data, output an inference result by inputting a second set of image data to the trained machine learning model, and process a region of interest at a time of inference with respect to image data for which an inference result is correct in the second set of image data.

Abstract: A medical image segmentation method based on a U-Net, including: sending real segmentation image and original image to a generative adversarial network for data enhancement to generate a composite image with a label; then putting the composite image into original data set to obtain an expanded data set, and sending the expanded data set to improved multi-feature fusion segmentation network for training. A Dilated Convolution Module is added between the shallow and deep feature skip connections of the segmentation network to obtain receptive fields with different sizes, which enhances the fusion of detail information and deep semantics, improves the adaptability to the size of the segmentation target, and improves the medical image segmentation accuracy. The over-fitting problem that occurs when training the segmentation network is alleviated by using the expanded data set of the generative adversarial network.

Abstract: A global and local binary pattern image crack segmentation method based on robot vision comprises the following steps: enhancing a contrast of an acquired original image to obtain an enhanced map; using an improved local binary pattern detection algorithm to process the enhanced map and construct a saliency map; using the enhanced map and the saliency map to segment cracks and obtaining a global and local binary pattern automatic crack segmentation method; and evaluating performance of the obtained global and local binary pattern automatic crack segmentation method. The present application uses logarithmic transformation to enhance the contrast of a crack image, so that information of dark parts of the cracks is richer. Texture features of a rotation invariant local binary pattern are improved. Global information of four directions is integrated, and the law of universal gravitation and gray and roundness features are introduced to correct crack segmentation results, thereby improving segmentation accuracy.

Abstract: A visual tracking system for tracking and identifying persons within a monitored location, comprising a plurality of cameras and a visual processing unit, each camera produces a sequence of video frames depicting one or more of the persons, the visual processing unit is adapted to maintain a coherent track identity for each person across the plurality of cameras using a combination of motion data and visual featurization data, and further determine demographic data and sentiment data using the visual featurization data, the visual tracking system further having a recommendation module adapted to identify a customer need for each person using the sentiment data of the person in addition to context data, and generate an action recommendation for addressing the customer need, the visual tracking system is operably connected to a customer-oriented device configured to perform a customer-oriented action in accordance with the action recommendation.

Abstract: A client device receives a first map tile, a second map tile, and map terrain data from a mapping system, the first and second map tiles together including map feature having a geometric base with a height value, the geometric base represented by a set of vertices split across the first and second map tiles. The client device identifies edges of the geometric base that intersect a tile border between the first and second map tiles. The client device determines a set of sample points based on the identified edges and determines a particular sample elevation value corresponding to a sample point in the set. The client device renders the map feature based on the particular sample elevation value and displays the rendering of the map feature.

Abstract: Methods and systems for aligning images of a specimen generated with different modes of an imaging subsystem are provided. One method includes separately aligning first and second images generated with first and second modes, respectively, to a design for the specimen. For a location of interest in the first image, the method includes generating a first difference image for the location of interest and the first mode and generating a second difference image for the location of interest and the second mode. The method also includes aligning the first and second difference images to each other and determining information for the location of interest from results of the aligning.

Abstract: An image fusion system provides a predicted alignment between images of different modalities and synchronization of the alignment, once acquired. A spatial tracker detects and tracks a position and orientation of an imaging device within an environment. A predicted pose of an anatomical feature can be determined, based on previously acquired image data, with respect to a desired position and orientation of the imaging device. When the imaging device is moved into the desired position and orientation, a relationship is established between the pose of the anatomical feature in the image data and the pose of the anatomical feature imaged by the imaging device. Based on tracking information provided by the spatial tracker, the relationship is maintained even when the imaging device moves to various positions during a procedure.

Abstract: One exemplary implementation facilitates object detection using multiple scans of an object in different lighting conditions. For example, a first scan of the object can be created by capturing images of the object by moving an image sensor on a first path in a first lighting condition, e.g., bright lighting. A second scan of the object can then be created by capturing additional images of the object by moving the image sensor on a second path in a second lighting condition, e.g., dim lighting. Implementations determine a transform that associates the scan data from these multiple scans to one another and use the transforms to generate a 3D model of the object in a single coordinate system. Augmented content can be positioned relative to that object in the single coordinate system and thus will be displayed in the appropriate location regardless of the lighting condition in which the physical object is later detected.

Abstract: A method for ascertaining a depth information image for an input image. The input image is processed using a convolutional neural network, which includes multiple layers that sequentially process the input image, and each converts an input feature map into an output feature map. At least one of the layers is a depth map layer, the depth information image being ascertained as a function of a depth map layer. In the depth map layer, an input feature map of the depth map layer is convoluted with multiple scaling filters to obtain respective scaling maps, the multiple scaling maps are compared pixel by pixel to generate a respective output feature map in which each pixel corresponds to a corresponding pixel from a selected one of the scaling maps.