Abstract: The present disclosure is directed to determining geographic orientation based at least in part on imagery. In particular, the methods and systems of the present disclosure can: receive data generated by a camera and representing imagery that includes at least a portion of a physical real-world environment comprising the camera and a travelway; and determine, based at least in part on the data and a machine-learning model, a geographic orientation of the camera with respect to the travelway.

Abstract: Methods, systems, devices, and tangible non-transitory computer readable media for determining orientation are provided. The disclosed technology can include capturing images of an environment visible in a field of view of the mobile computing device. Location data associated with a location of the mobile computing device can be received. Image data including information associated with the images can be generated. Based on the image data and one or more machine-learned models, features of one or more objects in the environment can be determined. Based on the location data and the features of the objects, respective orientations of the objects relative to the location of the mobile computing device can be determined. Furthermore, orientation data that includes a geographic orientation of the mobile computing device can be generated based on the respective (geographic) orientations of the objects.

Abstract: A system and method is provided that displays cursors for street level images, where the cursor changes appearance based on the objects in the image, such as the geographic distance between the objects and the camera position and the surface of the objects. For example, the cursor may appear to lie flat against the objects in the image change size based on the distance between the camera and object's surface.

Abstract: Methods, systems, devices, and tangible non-transitory computer readable media for determining orientation are provided. The disclosed technology can include capturing images of an environment visible in a field of view of the mobile computing device. Location data associated with a location of the mobile computing device can be received. Image data including information associated with the images can be generated. Based on the image data and one or more machine-learned models, features of one or more objects in the environment can be determined. Based on the location data and the features of the objects, respective orientations of the objects relative to the location of the mobile computing device can be determined. Furthermore, orientation data that includes a geographic orientation of the mobile computing device can be generated based on the respective (geographic) orientations of the objects.

Abstract: A system and method is provided that displays cursors for street level images, where the cursor changes appearance based on the objects in the image, such as the geographic distance between the objects and the camera position and the surface of the objects. For example, the cursor may appear to lie flat against the objects in the image change size based on the distance between the camera and object's surface.

Abstract: In one aspect, a request to generate an automated tour based on a set of panoramic images is received. Each particular panoramic image is associated with geographic location information and linking information linking the particular panoramic image with one or more other panoramic images in the set. A starting panoramic image and a second panoramic image are determined based at least in part on the starting panoramic image and the linking information associated with the starting and second panoramic images. A first transition between the starting panoramic image and the second panoramic image is also determined based at least in part on the linking information for these panoramic images. Additional panoramic images as well as a second transition for between the additional panoramic images are also determined. The determined panoramic images and transitions are added to the tour according to an order of the tour.

Abstract: Methods, systems, devices, and tangible non-transitory computer readable media for determining orientation are provided. The disclosed technology can include capturing images of an environment visible in a field of view of the mobile computing device. Location data associated with a location of the mobile computing device can be received. Image data including information associated with the images can be generated. Based on the image data and one or more machine-learned models, features of one or more objects in the environment can be determined. Based on the location data and the features of the objects, respective orientations of the objects relative to the location of the mobile computing device can be determined. Furthermore, orientation data that includes a geographic orientation of the mobile computing device can be generated based on the respective (geographic) orientations of the objects.

Abstract: A system and method is provided that displays cursors for street level images, where the cursor changes appearance based on the objects in the image, such as the geographic distance between the objects and the camera position and the surface of the objects. For example, the cursor may appear to lie flat against the objects in the image change size based on the distance between the camera and object's surface.

Abstract: A system and method is provided that displays cursors for street level images, where the cursor changes appearance based on the objects in the image, such as the geographic distance between the objects and the camera position and the surface of the objects. For example, the cursor may appear to lie flat against the objects in the image change size based on the distance between the camera and object's surface.

Abstract: Aspects of the present disclosure relate to generating turn-by-turn direction previews. In one aspect, one or more computing devices, may receive a request for a turn-by-turn direction preview. The one or more computing devices may generate a set of directions from a first geographic location to a second geographic location. Each turn of the directions may be associated with a corresponding waypoint. The one or more computing devices may then identify street level images corresponding with the waypoints, and display a preview of their associated turns by displaying their street level images and a map in between.

Abstract: The present disclosure is directed to determining geographic orientation based at least in part on imagery. In particular, the methods and systems of the present disclosure can: receive data generated by a camera (118) and representing imagery that includes at least a portion of a physical real-world environment comprising the camera (118) and a travelway (312); and determine, based at least in part on the data and a machine-learning model, a geographic orientation of the camera (118) with respect to the travelway (312).

Abstract: A position fix identifying a geographic location of a receiver is received. The position fix was generated using signals received at the receiver from respective high-altitude signal sources (such as satellites). Imagery of a geographic area that includes the geographic location is also received. The imagery is automatically processed to determine whether one or more of the high-altitude signal sources were occluded from the geographic location when the position fix was generated. In response to determining that one or more of the high-altitude signal sources were occluded from the geographic location when the position fix was generated, the position fix is identified as being potentially erroneous.

Abstract: Aspects of the present disclosure relate to generating turn-by-turn direction previews. In one aspect, one or more computing devices, may receive a request for a turn-by-turn direction preview. The one or more computing devices may generate a set of turn-by-turn directions based on a series of road segments connecting a first geographic location and a second geographic location. Each direction in the set of turn-by-turn directions may be associated with a corresponding waypoint. The one or more computing devices then identify a set of images corresponding the series of road segments between two adjacent waypoints of the set of turn-by-turn directions, and determine a subset of the set of images to include in the turn-by-turn direction preview. Subsequently, the one or more computing devices may generate the turn-by-turn direction preview based on at least in part on the determined subset of the set of images.

Abstract: In one aspect, a request to generate an automated tour based on a set of panoramic images is received. Each particular panoramic image is associated with geographic location information and linking information linking the particular panoramic image with one or more other panoramic images in the set. A starting panoramic image and a second panoramic image are determined based at least in part on the starting panoramic image and the linking information associated with the starting and second panoramic images. A first transition between the starting panoramic image and the second panoramic image is also determined based at least in part on the linking information for these panoramic images. Additional panoramic images as well as a second transition for between the additional panoramic images are also determined. The determined panoramic images and transitions are added to the tour according to an order of the tour.

Abstract: The present invention relates to annotating images. In an embodiment, the present invention enables users to create annotations corresponding to three-dimensional objects while viewing two-dimensional images. In one embodiment, this is achieved by projecting a selecting object onto a three-dimensional model created from a plurality of two-dimensional images. The selecting object is input by a user while viewing a first image corresponding to a portion of the three-dimensional model. A location corresponding to the projection on the three-dimensional model is determined, and content entered by the user while viewing the first image is associated with the location. The content is stored together with the location information to form an annotation. The annotation can be retrieved and displayed together with other images corresponding to the location.

Abstract: A system and method are provided for updating imagery associated with map data. A request for map data is received, and a first image of a geographical location corresponding to the map data is provided in response to the request. Information relating to a status of an object in the first image is received, and it is determined whether the first image is to be updated based at least on the received information. If it is determined that the first image is to be updated, an updated image is received and used to update the first image.

Abstract: Aspects of the present disclosure relate to generating turn-by-turn direction previews. In one aspect, one or more computing devices, may receive a request for a turn-by-turn direction preview. The one or more computing devices may generate a set of directions from a first geographic location to a second geographic location. Each turn of the directions may be associated with a corresponding waypoint. The one or more computing devices may then identify street level images corresponding with the waypoints, and display a preview of their associated turns by displaying their street level images and a map in between.

Abstract: This technology relates to optimizing location and orientation information of an image using known locations of places captured within the image. For example, an image and associated pose data including the image's orientation and location may be received. One or more places captured within the image may be determined, with each place having a respective known location. The image may be annotated with the one or more places. A difference between each annotation and its respective known location to obtain updated pose data of the image may be minimized and the associated pose data may be updated to the updated pose data.

Abstract: The technology uses image content to facilitate navigation in panoramic image data. Aspects include providing a first image including a plurality of avatars, in which each avatar corresponds to an object within the first image, and determining an orientation of at least one of the plurality of avatars to a point of interest within the first image. A viewport is determined for a first avatar in accordance with the orientation thereof relative to the point of interest, which is included within the first avatar's viewport. In response to received user input, a second image is selected that includes at least a second avatar and the point of interest from the first image. A viewport of the second avatar in the second image is determined and the second image is oriented to align the second avatar's viewpoint with the point of interest to provide navigation between the first and second images.

Abstract: This technology relates to optimizing location and orientation information of an image using known locations of places captured within the image. For example, an image and associated pose data including the image's orientation and location may be received. One or more places captured within the image may be determined, with each place having a respective known location. The image may be annotated with the one or more places. A difference between each annotation and its respective known location to obtain updated pose data of the image may be minimized and the associated pose data may be updated to the updated pose data.