Abstract: Visual data is used to locate a device in the real world. The location and orientation of the device is detected by matching the camera view of the device to a computer-generated view of an area surrounding the location. The computer-generated view of the area is constructed by combining various remotely sensed geospatial data including satellite imagery, aerial LIDAR, map data, GIS inventory data, and/or the like. In various embodiments, the disclosed system can not only locate the device but can also provide measurements regarding where the user is looking and 3D measurement of the scene in the device camera view. In various embodiments, the presented invention enables devices to have a system that provides spatial intelligence to any camera.

Abstract: Methods to access place data such as local business reviews, restaurant menus, merchant details, and other point-of-interest information directly from images is provided. Methods of the invention can enable users to interact with places digitally through pictures and videos. While digital images are captured, the location and orientation of the camera is also recorded. The method compares the digital images captured by the camera with images synthetically generated by a virtual camera placed inside a 3D geospatial model consisting of, for example, LIDAR, satellite image, and GIS data. The camera location and orientation of the virtual camera is iteratively refined until the synthetically generated image matches the camera image. The place information from the synthetically generated image is transferred to the actual picture once the match is completed. User can access the transferred place information directly through the picture.