Abstract: Provided are mechanisms and processes for performing visual search using multi-view digital media representations, such as surround views. In one example, a process includes receiving a visual search query that includes a surround view of an object to be searched, where the surround view includes spatial information, scale information, and different viewpoint images of the object. The surround view is compared to stored surround views by comparing spatial information and scale information of the surround view to spatial information and scale information of the stored surround views. A correspondence measure is then generated indicating the degree of similarity between the surround view and a possible match. At least one search result is then transmitted with a corresponding image in response to the visual search query.

Abstract: Images of an object may be captured via a camera at a mobile computing device at different viewpoints. The images may be used to identify components of the object and to identify damage estimates estimating damage to some or all of the components. Capture coverage levels corresponding with the components may be determined, and then recording guidance may be provided for capturing additional images to increase the capture coverage levels.

Abstract: A plurality of images of an object may be processed. The plurality of images may comprise a first image having an annotation. The plurality of images may further comprise second images. The annotation may be absent from the second images. A placement of the annotation for the second images such that the annotation is configured to be included in the second images may be automatically determined. The second images may be caused to include the annotation in accordance with the determined placement. The annotated second images may be stored on a storage device.

Abstract: According to various embodiments, techniques and mechanisms are provided to enhance damage detection and assessment for objects such as vehicles. In some implementations, a striped lighting tunnel is configured with cameras for capture of object or vehicle surface images when illuminated by striped lighting. The vehicle surface images may be captured from a variety of perspectives. Damage assessed is mapped to multiple views of a vehicle. In some embodiments, a damage likelihood score is generated and if the damage likelihood score reaches a threshold, a heatmap visual representation may be generated and included in one or more views to present the type, likelihood, and extent of damage.

Abstract: According to various embodiments, techniques and mechanisms are provided to enhance damage detection for objects such as vehicles. In some implementations, a striped lighting tunnel is configured with cameras for capture of object or vehicle surface images when illuminated by striped lighting. The vehicle surface images may be captured from a variety of perspectives. Striped lighting capture may be implemented using gaps between uniform lighting panels and the uniform lighting panels themselves, along with high speed cameras capable of taking more than 120 frames per second. The gap width between uniform lighting panels may be determined using an inverse relationship with frame rate. Damage may be determined using striped lighting illuminated vehicle surface images to identify the type, likelihood, and extent of damage.

Abstract: According to various embodiments, a variably switched striped lighting pattern panel is provided. A panel may include numerous rows of light emitting diodes (LEDs). Alternating rows are controlled separately by a microcontroller so that a first set can be switched on while a second set switched off to provide striped lighting. On the other hand, both sets can be switched on to provide for uniform lighting. Barriers may be provided between the rows of LEDs while a diffuser is placed in front of the LEDs. The variably switched striped lighting pattern panels can be used in a vehicle tunnel in a variety of configurations to allow for vehicle image capture in varying conditions for damage assessment.

Abstract: A multi-view interactive digital media representation (MVIDMR) of an object can be generated from live images of an object captured from a camera. Selectable tags can be placed at locations on the object in the MVIDMR. When the selectable tags are selected, media content can be output which shows details of the object at location where the selectable tag is placed. A machine learning algorithm can be used to automatically recognize landmarks on the object in the frames of the MVIDMR and a structure from motion calculation can be used to determine 3-D positions associated with the landmarks. A 3-D skeleton associated with the object can be assembled from the 3-D positions and projected into the frames associated with the MVIDMR. The 3-D skeleton can be used to determine the selectable tag locations in the frames of the MVIDMR of the object.

Abstract: A set of images may be captured by a camera as the camera moves along a path through space around an object. Then, a smoothed function (e.g., a polynomial) may be fitted to the translational and/or rotational position in space. For example, positions in a Cartesian coordinates pace may be determined for the images. The positions may then be transformed to a polar coordinate space, in which a trajectory along the points may be determined, and the trajectory transformed back into the Cartesian space. Similarly, the rotational position of the images may be smoothed, for instance by fitting a loss function. Finally, one or more images may be transformed to more closely align a viewpoint of the image with the fitted translational and/or rotational positions.

Abstract: A computing system configured to process a plurality of intermediate outputs from machine learning models to generate final outputs may be maintained. A combined confidence metric that reflects a probability that the final outputs are accurate may be determined based on the intermediate outputs. Suitability of the combined outputs as inputs for a further model may be determined using the combined confidence metrics. The suitable combined outputs may be caused to be used as inputs for the further model.

Abstract: According to various embodiments, techniques and mechanisms are provided to enhance camera positioning in vehicle tunnels. Tunnel configuration along with lighting pattern panel damage information is analyzed with a proposed camera configuration. The camera configuration information may include camera location, camera angle, focal length, resolution, etc. The effectiveness of image capture for a variety of vehicle components is analyzed to generate a camera configuration score to allow for feedback and revision of camera setup and positioning.

Abstract: According to various embodiments, techniques and mechanisms are provided to enhance damage detection in vehicle tunnels. In some implementations, a semicylindrical striped lighting tunnel is configured with cameras for capture of object or vehicle surface images when illuminated by striped lighting. The vehicle surface images may be captured from a variety of perspectives. The semicylindrical structure reduces edges and corners which can interfere with the generation of improved vehicle surface images illuminated with striped lighting. The vehicle surface images illuminated by striped lighting can be analyzed potentially with a vehicle object model. Damage may be determined using striped lighting illuminated vehicle surface images to identify the type, likelihood, and extent of damage.

Abstract: According to various embodiments, techniques and mechanisms are provided to improve striped lighting damage detection. In some implementations, a striped lighting tunnel is configured with cameras for capture of object or vehicle surface images when illuminated by striped lighting and when illuminated by uniform panel lighting. The vehicle surface images may be captured from a variety of perspectives. The vehicle surface images can be analyzed to generate vehicle object models or can be analyzed by using these vehicle object models. Damage may be determined using the vehicle surface images to identify the type, likelihood, and extent of damage.

Abstract: According to various embodiments, techniques and mechanisms are provided to enhance damage detection for objects such as vehicles in vehicle tunnels. In some implementations, a striped lighting tunnel is configured with cameras for capture of object or vehicle surface images when illuminated by striped lighting in a vehicle tunnel. Multiple vehicle surface images may be captured from a variety of perspectives. The vehicle surface images illuminated by striped lighting can be analyzed potentially with a vehicle object model. Each vehicle object model may include numerous object model components. Damage may be determined using striped lighting illuminated vehicle surface images to identify the type, likelihood, and extent of damage.

Abstract: Images may be captured from a plurality of cameras of an object moving along a path. Each of the cameras may be positioned at a respective identified location in three-dimensional space. Correspondence information for the plurality of images linking locations on different ones of the images may be determined. Linked locations may correspond to similar portions of the object captured by the cameras. A portion of the plurality of images may be presented on a display screen via a graphical user interface. The plurality of images may be grouped based on the correspondence information.

Abstract: A plurality of images may be analyzed to determine an object model. The object model may have a plurality of components, and each of the images may correspond with one or more of the components. Component condition information may be determined for one or more of the components based on the images. The component condition information may indicate damage incurred by the object portion corresponding with the component.

Abstract: A computing system configured to process a plurality of intermediate outputs from machine learning models to generate final outputs may be maintained. A combined confidence metric that reflects a probability that the final outputs are accurate may be determined based on the intermediate outputs. Outputs associated with combined confidence metrics that are below the threshold may be caused to be discarded.

Abstract: A computing system configured to process a plurality of intermediate outputs from machine learning models to generate final outputs may be maintained. A combined confidence metric that reflects a probability that the final outputs are accurate may be determined based on the intermediate outputs. A comprehensive damage assessment may be presented. The comprehensive damage assessment may include identified damage having combined confidence metrics determined to be above a threshold.

Abstract: A plurality of images of an object and a background may be captured. Three-dimensional representations of the background and the object may be generated based on the captured images. A synthetic image of the object and the background may be rendered. The synthetic image may depict a two-dimensional view of the object having a novel viewpoint different from the viewpoints of the captured images. A corrected synthetic image may be generated. The corrected synthetic image may be stored on a storage medium.

Abstract: Various embodiments of the present disclosure relate generally to systems and methods for drone-based systems and methods for capturing a multi-media representation of an entity. In some embodiments, the multi-media representation is digital, or multi-view, or interactive, and/or the combinations thereof. According to particular embodiments, a drone having a camera to is controlled or operated to obtain a plurality of images having location information. The plurality of images, including at least a portion of overlapping subject matter, are fused to form multi-view interactive digital media representations.

Abstract: Provided are mechanisms and processes for inserting a visual element into a multi-view digital media representation (MVIDMR). In one example, a process includes analyzing an MVIDMR to determine if there is an appropriate location to insert a visual element. Once a location is found, the type of visual element appropriate for the location is determined, where the type of visual element includes either a three-dimensional object to be inserted in the MVIDMR or a two-dimensional image to be inserted as or projected onto a background or object in the MVIDMR. A visual element that is appropriate for the location is then retrieved and inserted into the MVIDMR, such that the visual element is integrated into the MVIDMR and navigable by a user.