Abstract: A vision-based navigation system (e.g., for aircraft on approach to a runway) captures via camera 2D images of the runway environment in an image plane. The vision-based navigation system stores a constellation database of runway features and their nominal 3D position information in a constellation plane. Image processors detect within the captured images 2D features potentially corresponding to the constellation features. The vision-based navigation system estimates optical pose of the camera in the constellation plane by aligning the image plane and constellation plane into a common domain, e.g., via orthocorrection of detected image features into the constellation plane or reprojection of constellation features into the image plane. Based on the common-domain plane, the vision-based navigational system generates candidate correspondence maps (CMAP) of constellation features mapped to the image features with high-confidence error bounding, from which optical pose of the camera or aircraft can be estimated.

Abstract: A system and method utilizing an existing boresighted HUD and a camera to determine the transformational and rotational relationships between the camera image and the boresighted HUD image of an aircraft to properly orient the camera for landing operations. Known boresight features are identified in a HUD image and are related to the same boresight features in a camera image, and transformations are applied to align pixels in the camera image to the pixel locations of the boresight features in the HUD image. Object recognition algorithms may be employed to identify the boresight features in the camera image.

Abstract: An onboard aircraft landing system includes one or more event-based cameras disposed at known locations to capture the runway and visible surrounding features such as lights and runway markings. The event-based cameras produce a continuous stream of event data that may be quickly processed to identify both light and dark features contemporaneously, and calculate an aircraft pose relative to the runway based on the identified features and the known locations of the event-based cameras. Composite features are identified via the relative location of individual features corresponding to pixel events.

Abstract: A system includes at least one camera implemented in an aircraft, the at least one camera configured to capture images external to the aircraft. The system further includes at least one processor implemented in the aircraft, one or more of the at least one processor communicatively coupled to the at least one camera, the at least one processor configured to: receive the images from the at least one camera; identify visual references in at least one of the images; and output an annunciation instruction configured to cause an annunciation to a pilot that the visual references have been identified by the at least one processor.

Abstract: A system and method for high-confidence error overbounding of multiple optical pose solutions receives a set of candidate correspondences between 2D image features captured by an aircraft camera and 3D constellation features including at least one ambiguous correspondence. A candidate estimate of the optical pose of the camera is determined for each of a set of candidate correspondence maps (CMAP), each CMAP resolving the ambiguities differently. Each candidate pose estimate is evaluated for viability and any non-viable estimates eliminated. An individual error bound is determined for each viable candidate pose estimate and CMAP, and based on the set of individual error bounds a multiple-pose containment error bound is determined, bounding with high confidence the set of candidate CMAPs and multiple pose estimates where at least one is correct. The containment error bound may be evaluated for accuracy as required for flight operations performed by aircraft-based instruments and systems.

Abstract: A vision-based navigation system (e.g., for aircraft on approach to a runway) captures via camera 2D images of the runway environment in an image plane. The vision-based navigation system stores a constellation database of runway features and their nominal 3D position information in a constellation plane. Image processors detect within the captured images 2D features potentially corresponding to the constellation features. The vision-based navigation system estimates optical pose of the camera in the constellation plane by aligning the image plane and constellation plane into a common domain, e.g., via orthocorrection of detected image features into the constellation plane or reprojection of constellation features into the image plane. Based on the common-domain plane, the vision-based navigational system generates candidate correspondence maps (CMAP) of constellation features mapped to the image features with high-confidence error bounding, from which optical pose of the camera or aircraft can be estimated.

Abstract: A system and method utilizing an existing boresighted HUD and a camera to determine the transformational and rotational relationships between the camera image and the boresighted HUD image of an aircraft to properly orient the camera for landing operations. Known boresight features are identified in a HUD image and are related to the same boresight features in a camera image, and transformations are applied to align pixels in the camera image to the pixel locations of the boresight features in the HUD image. Object recognition algorithms may be employed to identify the boresight features in the camera image.

Abstract: An onboard aircraft landing system includes one or more event-based cameras disposed at known locations to capture the runway and visible surrounding features such as lights and runway markings. The event-based cameras produce a continuous stream of event data that may be quickly processed to identify both light and dark features contemporaneously, and calculate an aircraft pose relative to the runway based on the identified features and the known locations of the event-based cameras. Composite features are identified via the relative location of individual features corresponding to pixel events.

Abstract: A system and method are provided for automatically adjusting exposure to maintain color fidelity where a point source puts a small cluster of pixels in saturation. An exposure level is iteratively reduced until pixels corresponding only one color in a Bayer filter remain above a threshold while all other colors are at or below the threshold. The cluster of pixels is isolated for analysis such that only neighboring pixels are considered while reducing the exposure.

Abstract: A mixed reality (MR) system is disclosed. The MR system may determine a first predicted head pose corresponding to a time that virtual reality imagery is rendered, determine a second predicted head pose corresponding to a selected point in time during a camera shutter period, and combine the virtual reality imagery with the stereoscopic imagery based on the first predicted head pose and the second predicted head pose. A simulator that employs remote (e.g., cloud) rendering is also disclosed. The simulator/client device may determine a first pose (e.g., vehicle pose and/or head pose), receive video imagery rendered by a remote server based on the first pose, and apply a timewarp correction to the video imagery based on a comparison of the first pose and a second pose.

Abstract: A system and method are provided for automatically adjusting exposure to maintain color fidelity where a point source puts a small cluster of pixels in saturation. An exposure level is iteratively reduced until pixels corresponding only one color in a Bayer filter remain above a threshold while all other colors are at or below the threshold. The cluster of pixels is isolated for analysis such that only neighboring pixels are considered while reducing the exposure.

Abstract: A mixed reality (MR) system is disclosed. The MR system may determine a first predicted head pose corresponding to a time that virtual reality imagery is rendered, determine a second predicted head pose corresponding to a selected point in time during a camera shutter period, and combine the virtual reality imagery with the stereoscopic imagery based on the first predicted head pose and the second predicted head pose. A simulator that employs remote (e.g., cloud) rendering is also disclosed. The simulator/client device may determine a first pose (e.g., vehicle pose and/or head pose), receive video imagery rendered by a remote server based on the first pose, and apply a timewarp correction to the video imagery based on a comparison of the first pose and a second pose.

Abstract: A weather radar system can be used as an enhanced vision sensor for providing an image on an electronic display during aircraft surface operations. The weather radar sensed image is representative of the external surroundings of the airport surface environment associated with radar returns received by the weather radar system. The radar returns are processed as a collection of radar measurements to determine a high resolution angle and range to a target, using beam sharpening techniques. When the radar image is combined with an image generated from an airport surface database, the combination or comparison of the two independently created images can be used to confirm the integrity of the positioning and attitude source along with the accuracy of the airport surface database.

Abstract: An enhanced vision method or a weather radar system can be used with an aircraft and includes an antenna and a control circuit. The control circuit is configured to provide radar beams via the antenna toward external surroundings and is configured to receive radar returns. The control circuit is configured to process a collection of radar measurements from the radar returns, wherein each of the radar measurements is associated with a location determined using an antenna position, an antenna attitude, a beam sharpening angle, and a range. The radar measurements are processed to determine power density per grid cell associated with the power and location of the radar measurements, and the power density per grid cell is used to provide an image associated with the power and location of the radar measurements.

Abstract: A radar system, such as a weather radar system, includes a radar antenna and a processor. The processor is configured to cause a first radar beam to be provided using a first portion of the radar antenna. The processor is configured to cause a second radar beam to be provided using a phase adjusted portion of the antenna and a remaining portion of the radar antenna. A radar method and system can allow multiple low-loss overlapping radar beams to be rapidly generated to support a sequential lobbing process which may be used to generate intra-beam target angle estimates. The production of these overlapping beams does not require mechanical antenna movement but beam selection is controlled by a simple electronic switch in some embodiments.

Abstract: A weather radar system can be used as an airborne sensor for providing an image on an electronic display during low visibility offshore IFR operations (e.g. for a helicopter approach to an offshore platform, such as, a petroleum rig or other structure). The weather radar sensed image is representative of the external surroundings of the maritime environment associated with radar returns received by the weather radar system. Beam sharpening technology produces higher angular resolution of the sensed objects in the radar image which reduces the interpreted azimuth errors from the sensed radar image. Accordingly, beam sharpening technology advantageously allows object isolation of closely clustered offshore platforms and nearby objects. With operational credit provided to these capabilities, the minimal distance for obtaining visual reference with the target platform could be reduced, increasing the success rate of completing offshore operations in low visibility IFR conditions.

Abstract: A weather radar system can be used as an enhanced vision sensor for providing an image on an electronic display during aircraft surface operations. The weather radar sensed image is representative of the external surroundings of the airport surface environment associated with radar returns received by the weather radar system. The radar returns are processed as a collection of radar measurements to determine a high resolution angle and range to a target, using beam sharpening techniques. When the radar image is combined with an image generated from an airport surface database, the combination or comparison of the two independently created images can be used to confirm the integrity of the positioning and attitude source along with the accuracy of the airport surface database.

Abstract: An enhanced vision method uses or an enhanced vision system includes an onboard weather radar system configured to improve angular resolution and/or resolution in range. The onboard weather radar system generates image data representative of the external scene topography of a runway environment associated with radar returns received by the onboard weather radar system. The radar returns are in an X-band or a C-band. The enhanced vision system also includes a display in communication with the onboard weather radar system and is configured to display an image associated with the image data that is generated by the onboard weather radar system. The enhanced vision system can also be used as an enhanced flight vision system.

Abstract: A radar system, such as a weather radar system, includes a radar antenna and a processor. The processor is configured to cause a first radar beam to be provided using a first portion of the radar antenna. The processor is configured to cause a second radar beam to be provided using a phase adjusted portion of the antenna and a remaining portion of the radar antenna. A radar method and system can allow multiple low-loss overlapping radar beams to be rapidly generated to support a sequential lobing process which may be used to generate intra-beam target angle estimates. The production of these overlapping beams does not require mechanical antenna movement but beam selection is controlled by a simple electronic switch in some embodiments.

Abstract: An apparatus is for use with an aircraft radar system having a radar antenna. The apparatus comprises processing electronics are configured to receive radar data associated with the radar antenna of the system. The processing electronics are also configured to detect periodic data associated with runway lights in the radar data.