Abstract: This disclosure describes a device and system for verifying the content of items in a bin within a materials handling facility. In some implementations, a bin content verification apparatus may pass by one or more bins and capture images of those bins. The images may be processed to determine whether the content included in the bins has changed since the last time images of the bins were captured. A determination may also be made as to whether a change to the bin content was expected and, if so, if the determined change corresponds with the expected change.

Abstract: This disclosure describes a device and system for verifying the content of items in a bin within a materials handling facility. In some implementations, a bin content verification apparatus may pass by one or more bins and capture images of those bins. The images may be processed to determine whether the content included in the bins has changed since the last time images of the bins were captured. A determination may also be made as to whether a change to the bin content was expected and, if so, if the determined change corresponds with the expected change.

Abstract: Described is an imaging component for use by an unmanned aerial vehicle (“UAV”) for object detection. As described, the imaging component includes one or more cameras that are configured to obtain images of a scene using visible light that are converted into a depth map (e.g., stereo image) and one or more other cameras that are configured to form images, or thermograms, of the scene using infrared radiation (“IR”). The depth information and thermal information are combined to form a representation of the scene based on both depth and thermal information.

Abstract: A configurable unmanned aerial vehicle (UAV) may include swappable components that may be selectable to configure a customized UAV just prior to deployment of the UAV that is configured to deliver a package to a destination. The UAV may include a plurality of ports that may accept swappable components. The ports may be coupled to a logic board to enable control of the swappable components. The ports and swappable components may enable quick replacement of a malfunctioning components, such as an image sensor, which may avoid subjecting a UAV to significant downtime for service. The malfunctioning component may then be serviced after the UAV is readied for a subsequent flight or deployed on a subsequent flight.

Abstract: Methods and systems for collecting camera calibration data using wearable devices are described. An augmented reality interface may be provided at a wearable device. Three-dimensional virtual information may be presented at the augmented reality interface. The three-dimensional information may identify a field of view of a remote camera and may be associated with collection of calibration data for the remote camera. Calibration data collected by the remote camera viewing a calibration target in the field of view may be received. The camera may be calibrated based at least in part on the calibration data.

Abstract: A mobile calibration room may be used for calibrating one or more sensors used on unmanned aerial vehicles (UAVs). A system can include folding or collapsible walls to enable the system to be moved between a stowed position and a deployed position. In the deployed position, the system can comprise a calibration room including one or more 2D or 3D targets used to calibrate one or more sensors (e.g., cameras) on a UAV. The system can include a turntable to rotate the UAV about a first axis during calibration. The system can also include a cradle to rotate the UAV around, or translate the UAV along, a second axis. The turntable can include a frame to rotate the UAV around a third axis during calibration. The mobile calibration room can be coupled to a vehicle to enable the mobile calibration room to be moved between locations.

Abstract: Described is an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of sensors, such as stereo cameras, mounted along a perimeter frame of the aerial vehicle and arranged to generate a scene that surrounds the aerial vehicle. The sensors may be mounted in or on winglets of the perimeter frame. Each of the plurality of sensors has a field of view and the plurality of optical sensors are arranged and/or oriented such that their fields of view overlap with one another throughout a continuous space that surrounds the perimeter frame. The fields of view may also include a portion of the perimeter frame or space that is adjacent to the perimeter frame.

Abstract: This disclosure describes a configuration of an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of cameras that may be selectively combined to form a stereo pair for use in obtaining stereo images that provide depth information corresponding to objects represented in those images. Depending on the distance between an object and the aerial vehicle, different cameras may be selected for the stereo pair based on the baseline between those cameras and a distance between the object and the aerial vehicle. For example, cameras with a small baseline (close together) may be selected to generate stereo images and depth information for an object that is close to the aerial vehicle. In comparison, cameras with a large baseline may be selected to generate stereo images and depth information for an object that is farther away from the aerial vehicle.

Abstract: Techniques for verifying a location and identification of a landing marker to aid an unmanned aerial vehicle (UAV) to deliver a payload to a location may be provided. For example, upon receiving an indication that a UAV has arrived to a delivery location, a server computer may process one or more images of an area that are provided by the UAV and/or a user interacting with a user device. A landing marker may be identified in the image and a representation of the landing marker along with instructions to guide the UAV to deliver the payload to the landing marker may be transmitted to the UAV and implemented by the UAV.

Abstract: This disclosure describes a configuration of an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of cameras that may be selectively combined to form a stereo pair for use in obtaining stereo images that provide depth information corresponding to objects represented in those images. Depending on the distance between an object and the aerial vehicle, different cameras may be selected for the stereo pair based on the baseline between those cameras and a distance between the object and the aerial vehicle. For example, cameras with a small baseline (close together) may be selected to generate stereo images and depth information for an object that is close to the aerial vehicle. In comparison, cameras with a large baseline may be selected to generate stereo images and depth information for an object that is farther away from the aerial vehicle.

Abstract: Described is an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of sensors, such as stereo cameras, mounted along a perimeter frame of the aerial vehicle and arranged to generate a scene that surrounds the aerial vehicle. The sensors may be mounted in or on winglets of the perimeter frame. Each of the plurality of sensors has a field of view and the plurality of optical sensors are arranged and/or oriented such that their fields of view overlap with one another throughout a continuous space that surrounds the perimeter frame. The fields of view may also include a portion of the perimeter frame or space that is adjacent to the perimeter frame.

Abstract: Camera calibration may be performed in a mobile environment. One or more cameras can be mounted on a mobile vehicle, such as an unmanned aerial vehicle (UAV) or an automobile. Because of the mobility of the vehicle the one or more cameras may be subjected to inaccuracy in imagery caused by various factors, such as environmental factors (e.g., airflow, wind, etc.), impact by other objects (e.g., debris, vehicles, etc.), vehicle vibrations, and the like. To reduce the inaccuracy in imagery, the mobile vehicle can include a mobile camera calibration system configured to calibrate the one or more cameras while the mobile vehicle is traveling along a path. The mobile camera calibration system can cause the one or more cameras to capture an image of an imaging target while moving, and calibrate the one or more cameras based on a comparison between the image and imaging target data.

Abstract: Described is an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of sensors, such as stereo cameras, mounted along a perimeter frame of the aerial vehicle and arranged to generate a scene that surrounds the aerial vehicle. The sensors may be mounted in or on winglets of the perimeter frame. Each of the plurality of sensors has a field of view and the plurality of optical sensors are arranged and/or oriented such that their fields of view overlap with one another throughout a continuous space that surrounds the perimeter frame. The fields of view may also include a portion of the perimeter frame or space that is adjacent to the perimeter frame.

Abstract: A propeller provided on an aerial vehicle may include a digital camera or other imaging device embedded into a surface of one of the blades of the propeller. The digital camera may capture images while the propeller is rotating at an operational speed. Images captured by the digital camera may be processed to recognize one or more objects therein, and to determine ranges to such objects by stereo triangulation techniques. Using such ranges, a depth map or other model of the surface features in an environment in which the aerial vehicle is operating may be defined and stored or used for any purpose. A propeller may include digital cameras or other imaging devices embedded into two or more blades, and may also use such images to determine ranges to objects by stereo triangulation techniques.

Abstract: Systems, apparatuses, and methods provide simulations to vehicles, such as unmanned aerial vehicles (UAVs) equipped with stereoscopic cameras. The system can include a plurality of screens set at predetermined angles to provide proper parallax to the stereoscopic cameras. The system can also include a test computer to update the screens based on the actions and travel time of the UAV. The test computer can also monitor the load on the computing systems of the UAV due to the camera and other inputs. The system can enable the testing and configuration of cameras and sensors without requiring actual flight. The test computer can provide navigational information to the UAV, receive actions taken by the UAV, update the screens based on these actions and the travel speed and direction of the UAV, and monitor the effects of the cameras and other sensors on the internal components of the UAV during use.

Abstract: This disclosure describes a configuration of an aerial vehicle, such as an unmanned aerial vehicle (“UAV”), that includes a plurality of cameras that may be selectively combined to form a stereo pair for use in obtaining stereo images that provide depth information corresponding to objects represented in those images. Depending on the distance between an object and the aerial vehicle, different cameras may be selected for the stereo pair based on the baseline between those cameras and a distance between the object and the aerial vehicle. For example, cameras with a small baseline (close together) may be selected to generate stereo images and depth information for an object that is close to the aerial vehicle. In comparison, cameras with a large baseline may be selected to generate stereo images and depth information for an object that is farther away from the aerial vehicle.

Abstract: Described is an imaging component for use by an unmanned aerial vehicle (“UAV”) for object detection. As described, the imaging component includes one or more cameras that are configured to obtain images of a scene using visible light that are converted into a depth map (e.g., stereo image) and one or more other cameras that are configured to form images, or thermograms, of the scene using infrared radiation (“IR”). The depth information and thermal information are combined to form a representation of the scene based on both depth and thermal information.

Abstract: This disclosure describes a device and system for verifying the content of items in a bin within a materials handling facility. In some implementations, a bin content verification apparatus may pass by one or more bins and capture images of those bins. The images may be processed to determine whether the content included in the bins has changed since the last time images of the bins were captured. A determination may also be made as to whether a change to the bin content was expected and, if so, if the determined change corresponds with the expected change.

Abstract: Methods and systems for collecting camera calibration data using wearable devices are described. An augmented reality interface may be provided at a wearable device. Three-dimensional virtual information may be presented at the augmented reality interface. The three-dimensional information may identify a field of view of a remote camera and may be associated with collection of calibration data for the remote camera. Calibration data collected by the remote camera viewing a calibration target in the field of view may be received. The camera may be calibrated based at least in part on the calibration data.

Abstract: This disclosure is directed to monitoring exposure levels for individual cameras of a stereo camera system to reduce unwanted lens flaring which may disrupt stereo vision capabilities of an unmanned aerial vehicle (UAV). The UAV may identify lens flaring by monitoring histogram data received from the cameras and then mitigate the lens flaring by performing aerial maneuvers with respect to the light source and/or moving camera componentry such as deploying a lens hood. The UAV may also identify lens flaring patterns that on a camera's sensor and determine a location of a peripheral light source based on these patterns. The UAV may then deploy a visor between the location of the peripheral light source and the cameras.