Abstract: A system for object detection in an augmented reality scene includes a computing system adapted to receive a stream of images from a user device. For each image in a plurality of successive images from the stream of images, the computing system: generates predictions for objects identified in the image using object models from a datastore; compares the predictions with proposals from the datastore, the comparison including checking an overlap threshold of the predictions and the proposals; updates the proposals with the predictions if the overlap threshold is met, otherwise adds new proposals to the proposals using the predictions; filters the proposals to create stable object detections based on a stability threshold; annotates the image using the stable object detections; and sends the annotated image to the user device for presentation.

Abstract: A system for performing functions in AR experiences is provided having a computer receiving an image of a monitored device having at least one object; the computer processes said image to determine a plurality of feature points; a database is in data communication with said computer and stores a plurality of reference images with reference feature points and reference object zones, each having a property; the computer matches at least some of the plurality of feature points with at least some of the plurality of reference feature points to compute a homography matrix; the computer transforms the image into a transformed image using the homography matrix; the computer identifies an object zone in the transformed image based on the reference object zone; the computer determines an object state by processing a sub-image in the object zone of the transformed image based on the property associated with the reference object zone.

Abstract: A system to detect LEDs and their states in an AR context is provided having a monitored device having a plurality of LEDs; a computer receives a picture of the monitored device and LEDs; the computer processes said picture to determine a plurality of feature points; a database is in data communication with said computer that stores a plurality of reference images with reference feature points and reference zones; the computer matches at least some of the plurality of feature points with at least some of the plurality of reference feature points to compute a homography matrix; the computer transforms the picture into a transformed picture using the homography matrix; the computer processes zones of the transformed picture based on the reference zones to determine the state of each of the plurality of LEDs by comparing a value of the picture in the zone with a reference value.

Abstract: A system for zonal OCR in an AR context is provided having a monitored device having text in at least one zone for indicating device states; a computer receives a picture of said monitored device and said text and processes said picture to determine a plurality of feature points; a database is in data communication with said computer and stores a plurality of reference images with reference feature points and reference zones; the computer matches at least some of the plurality of feature points with at least some of the plurality of reference feature points to compute a homography matrix; the computer transforms the image into a transformed image using the homography matrix; the computer executes optical character recognition on a zone of the transformed image based on the reference zones to generate extracted text.