Abstract: A vehicle with road surface image rendering functionality includes: a light projection member configured to perform light projection for road surface image rendering toward a road surface in front of the vehicle; a controller configured to control the light projection by the light projection member; and a detection device configured to perform detection of a state where the light projection member is performing the light projection. The controller is configured to: cause the light projection member to perform the light projection; determine, based on the detection by the detection device, whether the light projection member is suitable for the light projection; when the light projection member is suitable for the light projection, start the light projection from the light projection member; and, when the light projection member is unsuitable for the light projection for the road surface image rendering, prohibit the light projection by the light projection member.

Abstract: A display device includes a display section provided in a cabin of a vehicle that is capable of autonomous driving, memory, and a processor connected to the memory. The processor is configured to, before conducting a lane change by autonomous driving from a first lane in which the vehicle is running to a second lane that is distinct from the first lane, display a lane display and a confirmation display at the display section. The lane display corresponds to the first lane and the second lane. The confirmation display relates to confirmation of a condition of the second lane.

Abstract: An information processing system includes a first device that is mounted in a mobile object which an occupant boards and a second device that is used by a user at a place different from the mobile object. The first device includes a first communication device configured to communicate with a second communication device of the second device and a camera unit. The second device includes the second communication device configured to communicate with the first communication device, a detection device configured to detect an orientation direction and a gesture of the user, and a display device configured to display an image corresponding to the orientation direction when seen from the predetermined seat out of images captured by the camera unit. The second device determines an operation unit of the mobile object oriented by the user and operation details on the operation unit from the image on the basis of the detected orientation direction and the detected gesture.

Abstract: The present technology provides systems, methods, and devices that can dynamically augment aspects of a map as an autonomous vehicle navigates a route, and therefore avoids the need for dispatching a special purpose mapping vehicle to keep navigating a route. As the autonomous vehicle navigates a route, the autonomous vehicle can determine that current data captured by at least one sensor of the autonomous vehicle describing a location is inconsistent with the primary map of the location. The autonomous vehicle can determine that a portion of the current data describes a second feature that is distinct from a first feature described by a primary map. The second feature can be added to an augmented map that is based on the primary map, and the position of the autonomous vehicle can be located with respect to the first feature rather than the second feature on the augmented map.

Abstract: The disclosure concerns a method for GNSS-based location of a vehicle having a GNSS location device in view of integrity information provided in relation to GNSS correction data, comprising at least the following steps: (a) receiving GNSS correction data for correcting delay measurements for GNSS-based location from a GNSS correction data provision system, (b) receiving at least one piece of integrity information about the reliability of the GNSS correction data from the GNSS correction data provision system, (c) evaluating the at least one piece of integrity information about the reliability of the GNSS correction data that was received in step (b), and (d) influencing GNSS-based location of the vehicle on the basis of the evaluation from step (c).

Abstract: The subject disclosure relates to techniques for providing augmented reality (AR) navigation guidance to users of an autonomous vehicle (AV) ride hailing service. In some aspects, a method of the disclosed technology includes steps for transmitting an autonomous vehicle (AV) ride request to an AV dispatch service, receiving a ride confirmation indicating that an AV has been dispatched to a rider associated with the mobile device, detecting arrival of the AV at a pick-up location associated with the rider, and initializing augment reality (AR) guidance on the mobile device, wherein the AR guidance is configured to provide the rider with navigation information to facilitate pick-up by the AV. Systems and computer-readable media are also provided.

Abstract: A method for displaying lane information on an augmented reality display includes receiving roadway data. The roadway data includes information about a roadway along a route of a vehicle. The roadway includes a plurality of lanes. The roadway data includes lane information about at least one of the plurality of lanes along the route of the vehicle. The method further includes receiving vehicle-location data. The vehicle-location data indicates a location of the vehicle. The method further includes determining that that the vehicle is approaching a road junction using the vehicle-location data and the roadway data. The method further includes, in response to determining that the vehicle is approaching the road junction, transmitting a command signal to a dual-focal plane augmented reality display to display at least one virtual image that is indicative of the lane information.

Abstract: A device with a display and a touch-sensitive surface: displays a geographic map in a first mode of an application, the geographic map including a plurality of landmarks, the geographic map being displayed at a first magnification level; detects a first input, the first input including a first finger contact at a location on the touch-sensitive surface that corresponds to a first landmark on the display; in response to detecting the first input: when the first input does not satisfy one or more predefined mode-change conditions, changes the magnification level in accordance with the first input and remains in the first mode; and when the first input satisfies the mode-change conditions, selects the first landmark and enters a second mode of the application; while in the second mode, detects a second input; and, in response to detecting the second input, displays information about the first landmark.

Abstract: Provided is a method including: associating a virtual display of an object with first media content including a first type media content; associating the virtual display of the object with second media content that includes second type media content; generating a data model that includes the virtual display associated with the first media content and the second media content; and storing the data model in a storage device coupled to the computer system. As such, the method unifies all components (e.g., media content, tags, permissions, descriptions) of the data model—text description and attributes, image, video, and audio—to create a unique, multi-dimensional, transferable digital representation of an idea, memory, or history tied to the object.

Abstract: A system and method estimate a future path ahead of a current location of a vehicle. The system includes at least one processor programmed to: obtain an image of an environment ahead of a current arbitrary location of a vehicle navigating a road; obtain a trained system that was trained to estimate a future path on a first plurality of images of environments ahead of vehicles navigating roads; apply the trained system to the image of the environment ahead of the current arbitrary location of the vehicle; and provide, based on the application of the trained system to the image, an estimated future path of the vehicle ahead of the current arbitrary location.

Abstract: Provided are a computer program product, system, and method for generating a visualization of data points returned in response to a query based on attributes of a display device and display screen to render the visualization. A determination is made of inputs comprising area dimensions of the display screen and capabilities of the display device to render data points retrieved in response to a query. The inputs and the data points are provided to a visualization engine to output a type of visual presentation for the data points, a size of the visual presentation to render on the display screen, and a level of detail to aggregate the data points to render on the display screen. A visualization is generated to render on the display screen the data points in the type of visual presentation according to the size of the visual presentation and with the level of detail.

Abstract: In some embodiments, an electronic device present navigation routes from various perspectives. In some embodiments, an electronic device modifies display of representations of (e.g., physical) objects in the vicinity of a navigation route while presenting navigation directions. In some embodiments, an electronic device modifies display of portions of a navigation route that are occluded by representations of (e.g., physical) objects in a map. In some embodiments, an electronic device presents representations of (e.g., physical) objects in maps. In some embodiments, an electronic device presents representations of (e.g., physical) objects in maps in response to requests to search for (e.g., physical) objects.

Abstract: The present technology provides systems, methods, and devices that can dynamically augment aspects of a map as an autonomous vehicle navigates a route, and therefore avoids the need for dispatching a special purpose mapping vehicle to keep navigating a route. As the autonomous vehicle navigates a route, the autonomous vehicle can determine that current data captured by at least one sensor of the autonomous vehicle describing a location is inconsistent with the primary map of the location. The autonomous vehicle can determine that a portion of the current data describes a second feature that is distinct from a first feature described by a primary map. The second feature can be added to an augmented map that is based on the primary map, and the position of the autonomous vehicle can be located with respect to the first feature rather than the second feature on the augmented map.

Abstract: An apparatus for controlling a vehicle includes a processor and a storage storing information determined by the processor. The processor determines whether a vehicle enters a tollgate, in advance based on driving situation information, and determine whether a current driving lane of the vehicle is a high-pass lane or a general lane, when the vehicle is scheduled to enter the tollgate. In particular, to the processor may automatically switch a driving mode depending on whether the current driving lane of the vehicle is the high-pass lane or the general lane to control the vehicle.

Abstract: A computer system including one or more processors programmed or configured to receive image data associated with an image of one or more roads, where the one or more roads comprise one or more lanes, determine a lane classification of the one or more lanes based on the image data associated with the image of the one or more roads, and provide lane classification data associated with the lane classification of the one or more lanes.

Abstract: An apparatus and method for efficient image reprojection in a virtual reality system. For example, one embodiment of an apparatus comprises: a sensor interface to collect motion data from one or more sensors during a virtual reality session; graphics circuitry to execute graphics program code to render an image frame during the virtual reality session; a processor to generate motion transform data using the motion data, the motion transform data specifying how the image frame is to be adjusted prior to display; a reprojection engine to perform an in-line reprojection of the frame using the motion transform data to generate a reprojected image frame; and display circuitry to display the reprojected frame.

Abstract: A display system includes a recognizer configured to recognize a surrounding situation of a vehicle, a display configured to display images, and a display controller configured to cause the display to display an image representing a road shape around the vehicle recognized by the recognizer, wherein, when a lane in which the vehicle can travel in the same direction as a travel direction of the vehicle is added, the display controller causes the display to display an image about the added lane outside the image representing the road shape on the side on which the lane is added before the display is caused to display an image representing a shape of the added lane.

Abstract: Navigation assistance is provided to a user of a vehicle. A live view shows a scene of the roadway and navigation indicators may be superimposed on to the scene of the roadway using augmented reality. Interface elements on the live view provide additional information related to navigation. A map view may also be provided and be toggled from the live view by a toggle interaction. In addition, a hazard detection system may be provided to detect hazards and display indicators of the hazards to the user.

Abstract: A route guidance method includes: if, on a set route from a departure point to a destination of a vehicle, a travelling road at a present position of the vehicle has a first plurality of lanes, and a next road following a nearest branch point from the present position has a second plurality of lanes, finding a branch-merge point up to which lanes other than a lane for reaching the destination out of the second plurality of lanes have gone away; and if a start point of traffic congestion is downstream of the branch-merge point, and an end point of the traffic congestion is upstream of the nearest branch point, guiding the vehicle to the lane for reaching the destination as a target before reaching the end point.

Abstract: Systems and methods generate synthetic sensor data, such as synthetic radar, lidar, and/or sonar data from three dimensional (3D) scene data that may be custom designed. Reflectivity coefficients in the radar, lidar, and/or sonar spectrums may be determined for objects included in the 3D scene data. The reflectivity coefficients may be utilized by a game engine for computing the synthetic sensor data. The synthetic sensor data may be used in the creation, evaluation, and/or verification of a design for a controller or other system that utilizes such data.

Abstract: A navigation system and a computer program are capable of changing the role of an apparatus that implements navigation in accordance with its performance and circumstances, and achieving single navigation, in a coordinated fashion, with multiple apparatuses to which their roles are appropriately distributed.

Abstract: Various embodiments of the present invention relate generally to systems and methods for collecting, analyzing, and manipulating images and video. According to particular embodiments, live images captured by a camera on a mobile device may be analyzed as the mobile device moves along a path. The live images may be compared with a target view. A visual indicator may be provided to guide the alteration of the positioning of the mobile device to more closely align with the target view.

Abstract: Systems and methods of providing content for display on a computing device via a computer network using a location feature index are provided. A data processing system can receive a request for content from the computing device, and can determine a geographic location of the computing device associated with the request for content. The data processing system can identify a keyword indicating a non-geographic semantic feature of the determined geographic location. The identification can be based on the determined geographic location and from a location feature index that maps geographic areas to keywords that indicate non-geographic semantic features of the geographic areas. The data processing system can select, based on the keyword, a candidate content item for display on the computing device.

Abstract: A device is disclosed for generating navigation instructions for display on a display device of a portable navigation device, comprising: means for accessing a repository storing digital map data pertaining to a navigable network along which the navigation device can travel, the digital map data including data pertaining to available lanes of the navigable network; means for generating, for display on the display device, a three-dimensional perspective view of a model representative of the map data as though from a camera positioned at an elevation and pitch angle behind a current position of the portable navigation device, that is updated to follow the device as it travels along a planned route, wherein the three-dimensional perspective view shows the available lanes of the navigable network, and wherein the planned route to be followed is shown in the view as a line, the line showing the route to be followed as passing along a determined current lane in which the device is travelling; and means for adapting

Abstract: A display system, method, and computer readable storage to provide a visual representation of an environment. A marker is placed by a user tagging a physical location in the environment. When the user looks at the environment using different viewpoints, the visual representation can automatically be adjusted via a programmed processing unit so that the marker would appear in the same physical location in the window each time the viewpoint is changed. For example, if the marker is placed to tag a real world boat in a visual representation, changing the viewpoint would maintain the marker in the same position in the visual representation in the window. By changing viewpoints, an object marked by a marker would remain in the same position in the window while other aspects of the visual representation would automatically change including zoom, rotation, pan, to accommodate the static position of the marker.

Abstract: If a first sign information detector 62 is normal, a first display 94 displays sign information detected by the first sign information detector 62, in accordance with an instruction from a control circuit 70. At this time, a second display 64 hides sign information in accordance with an instruction from the control circuit 70. On the other hand, if the first sign information detector 62 is abnormal, the first display 94 hides the sign information in accordance with an instruction from the control circuit 70. At this time, the second display 64 displays sign information detected by the second sign information detector 64, in accordance with an instruction from the control circuit 70.

Abstract: Projected synthetic vision methods, systems and computer readable media are disclosed. For example, a system can include one or more sensors, a terrain database, and a projected synthetic vision controller coupled to the one or more sensors and the terrain database, the projected synthetic vision controller configured to generate and project synthetic vision images based on aircraft position, terrain information and aviator boresight information. The system can also include one or more projectors coupled to the projected synthetic vision controller.

Abstract: A navigation apparatus includes a positioning unit configured to measure a current position, a route guidance screen generation unit configured to generate a route guidance screen used for route guidance for a retrieved route from the current position to a destination and display the route guidance screen on a display unit, and a guidance image generation unit configured to, in a case where a remaining distance between the current position and the destination is a predetermined value or less while route guidance is performed using the route guidance screen, generate a guidance image in which a display subject representing the destination is highlighted such that the display subject is more prominently displayed than a vicinity of the display subject and display the guidance image on the display unit.

Abstract: A satellite navigation method and system are provided. The system includes a global position system module, an input unit, a picture database, a geographical information system module, an integrating unit, and a display unit. The method includes the following steps. Firstly, a navigation area is determined through the input unit, so as to search out several picture batches in the navigation area from the picture database. Next, a map relating to the navigation area is provided by the GIS module. Then, the picture batches and the map are integrated by the integrating unit to produce an integrated map shown on a first frame of the display unit. Afterwards, several pictures of the picture batch chosen from the first frame displayed on a second frame and satellite navigation information of the picture chosen from the second frame are displayed on a third frame by the display unit.

Abstract: Systems and methods for image registration using data collected by an electronic device, such as a mobile device, capable of simultaneous localization and mapping are provided. An electronic device, such as a mobile device, can be can be configured to collect data using a variety of sensors as the device is carried or transported through a space. The collected data can be processed and analyzed to generate a three-dimensional representation of the space and objects in the space in near real time as the device is carried through the space. The data can be used for a variety of purposes, including registering imagery for localization and image processing.

Abstract: A situation display device is provided. The device includes: an observation data acquiring module configured to acquire observation data, and information of observed locations of the observation data; a data selecting module configured to select the observation data within a predetermined range from a course of the device; and a display unit configured to display a location of the device on a bottom side of a display screen, and display the course linearly such that its traveling direction extends upward from the bottom side. The display unit displays, a predetermined area in an upward tapering shape, and displays the selected observation data at a position that indicates a relation between the course and the observed location, the displayed position of the device in the perpendicular direction being corresponding to an offset of the location of the device from the course.

Abstract: Intersection guide systems, methods, and programs acquire information on a path of a vehicle and acquire a travel direction of the vehicle at a guide intersection ahead of the vehicle on the basis of the information on the path. The systems, methods, and programs display a guide image that represents the travel direction superimposed on a portion of a forward scene ahead of the vehicle other than an image of the guide intersection, and a connection line image as superimposed on the forward scene, the connection line image connecting between the image of the guide intersection in the forward scene and the guide image. The connection line image is superimposed on the forward scene such that a length of the connection line image becomes shorter as a degree of approach of the vehicle to the guide intersection becomes larger.

Abstract: An avionics system and method is provided that de-clutters an image on a cockpit display system on a host aircraft, thus increasing a pilot's situational awareness. The avionics display system comprises a processor and a display system. The processor is coupled to the display system, a user input device, and a plurality of sources of information layers. When the de-clutter process is enabled, a filter parameter is applied to a selected information layer, and a graphic display of the filtered information layer is provided. The adjustable filter parameter can be applied to any of the information layers displayed on the cockpit display system.

Abstract: In a method of generating a database for use in outputting three- dimensional maps, a projection of a two-dimensional road vector onto a three-dimensional surface defined by digital terrain model data is determined. At least one three-dimensional road vector (94, 95, 98, 99) is determined based on the established projection and is stored in the database. The database is generated before it is deployed to a navigation device for use in outputting three-dimensional maps. A method of outputting three-dimensional maps and a navigation device may use the thus generated database.

Abstract: A navigation system may include: a GPS module; an image recognition module having a line recognition function; a roadmap storage module configured to store roadmap information and route change possible section information through which a route of a vehicle is changed; a roadmap receiving module configured to receive the roadmap information; and an arithmetic processing module configured to determine whether the route of the vehicle is changed, based on the route change possible section information and line recognition information recognized by the image recognition module.

Abstract: A position detector is configured to detect a current position of a moving body. A condition detector is configured to detect moving conditions including a forward direction of the moving body. A display unit is configured to display a predetermined image overlaid on the landscape in front of the moving body. A storage unit is configured to store the position of each intersection in a route along which the moving body moves and the position and shape of each object existing around the intersection. A selector is configured to select any one of the objects existing around an intersection for which guidance is needed when the moving body nears the intersection. A drawing controller is configured to draw on the display unit, a guide figure indicating the object selected by the selector.

Abstract: An information display device includes: an image display unit that displays an image according to an orientation of a display screen; a terminal posture detection unit that detects a posture of the device using an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor; and a display direction determination unit that determines whether or not the posture of the device changes, and determines the orientation of the display screen. In the case where the display screen is substantially horizontal and the posture of the device changes, the orientation of the display screen is determined so that, when the device moves by a predetermined angle or more with respect to the orientation (reference orientation) of the display screen before the determination of the posture change, a side of the device at the predetermined angle or more from the reference orientation corresponds to the top of the display screen.

Abstract: A method for classification of three-dimensional structures in a virtual environment includes identifying a plurality of polygons in a structure located in a virtual environment, identifying a plurality of surface normals, each surface normal corresponding to one polygon in the plurality of polygons that are in the structure, identifying a variance of a distribution of the plurality of surface normals, generating a first classification for the structure in response to the variance being less than a predetermined threshold, and generating a graphical display of the structure with at least one visual aspect of the structure being modified with reference to the first classification.

Abstract: A display control unit that causes a display unit to display a front image on which a guide line is superimposed, wherein the guide line has a front end point that indicates a position inside a recommended lane and has a rear end point that indicates a position rearward of the front end point, is provided. When the vehicle is in a lane change state, the display control unit sets a position of the rear end point in the front image such that the rear end point indicates a central position in a width direction of the vehicle, and, when the vehicle is not in the lane change state, the display control unit sets a position of the rear end point in the front image such that the rear end point indicates a central position in a width direction in the travelling lane.

Abstract: A mobile terminal and a method of controlling the same are provided. The mobile terminal selectively provides 2D map data and 3D map data according to a predetermined event in a navigation mode, and thus by calling a driver's attention, the driver's visibility is improved, and a more accurate navigation service can be provided.

Abstract: An apparatus and method for depicting one or more objects are provided. The method includes determining a geolocation of one or more objects, determining a vector from the objects to a light source, applying shading to the objects according to the vector, determining shadows cast by the objects according to the vector, and depicting the objects in the geolocation with one or more of the applied shading and the cast shadows.

Abstract: A method of operation of a navigation system includes: generating a system message along a route determining a priority value for the system message; sorting the system message based on the priority value and a message play time for the system message; calculating an available play time for the system message; and selecting the system message having the message play time not exceeding the available play time.

Abstract: The mobile terminal includes a wireless communication unit configured to receive terminal position information and object related information of at least one object corresponding to the terminal position information; a display module configured to display at least one object indicator indicating the at least one object and display a storage target object indicator region on a background image corresponding to the terminal position information; a user input unit configured to receive a selection of an object indicator; a memory configured to store object related information; and a controller configured to control the components of the mobile terminal. The display module is further configured to display an identifier corresponding to the selected object indicator within the storage target object indicator region, and display an object item list including an object item corresponding to the stored object related information.

Abstract: A system and method for locating, tracking, and/or monitoring the status of personnel and/or assets (collectively “trackees”), both indoors and outdoors, is provided. Tracking data obtained from any number of sources utilizing any number of tracking methods may be provided as input to a mapping application. The mapping application generates position estimates for trackees using a suite of mapping tools to make corrections to the tracking data. The mapping application further uses information from building data, when available, to enhance position estimates. Indoor tracking methods including sensor fusion methods, map matching methods, and map building methods may be implemented compute a more accurate tracking estimate for trackees. Outdoor tracking methods may be implemented to enhance outdoor tracking data by combining tracking estimates such as inertial tracks with magnetic and/or compass data if and when available, and with GPS, if and when available.

Abstract: Predefined route data for a driving route situated in front of the vehicle in the driving direction are provided. Further, at least one predefined predictive operating variable for the vehicle is provided. A three-dimensional model for a predefined environment of the vehicle is determined as a function of the route data. A graphic element is determined as a function of the three-dimensional model and of the at least one predictive operating variable. A head-up display of the vehicle has a predefined display field. The graphic element is displayed in the predefined display field. The graphic element is determined and displayed such that the graphic element is perceived by a viewer of the display field from a predefined viewing position with direct reference to the real environment of the vehicle.

Abstract: Pictorial information is provided relevant to a geographic location through selecting characteristics relevant to geographic locations, searching pictorial image databases for images having an embedded tags associated with the characteristics, retrieving image files from databases having embedded tags correlated to characteristics and visually depicting a physical appearance or an attribute of a location, analyzing characteristics image files and responsively selecting preferred image data, formatting preferred image data for presentation to a traveler, associating formatted preferred data with geographic locations, and presenting associated formatted data to the traveler in association with geographic locations. Characteristics include global positioning satellite coordinates. Image data may be selected having preferred image resolutions or perspectives. Formatting pictorial information may comprise synthesizing photographs into a constructs.

Abstract: Disclosed is a navigation system and displaying method thereof, which controls the level of protrusion for each piece of indication data displayed on a 3-D screen of the navigation system based on its criticality so as to maximize the legibility of the driver. More specifically, the navigation system includes a GPS receiving member which receives GPS location information, a map data storage member which stores map data including a plurality of indication data, a controlling member which requests a display scope of the map data, corresponding to the received GPS location information, and at least one set of indication data within the display scope, and 3-D data-processes said indication data so that it can be displayed so that the most important data is protruding the most to the driver, and a display member which displays the map data containing the 3-D data-processed indication data.

Abstract: Systems and methods are disclosed for transferring information metadata from a first digital image to a second digital image. In one embodiment, an assignment module is configured to assign a corresponding portion of the first image to the second image using geolocation data. An extraction module is configured to extract a collection of features associated with the second image and the corresponding portion of the first image. An alignment module is configured to align the second image with a portion of the first image by transforming the second image so that features associated with the second image are geometrically aligned with the corresponding features of the portion of the first image. A metadata module is configured to associate metadata from the portion of the first image with the transformed second image. An annotation module is configured to annotate the second image with the associated metadata to generate an annotated image.

Abstract: A method, apparatus, computer program and user interface wherein the method includes: obtaining coordinate information from a first application where the coordinate information uniquely identifies an address as a location in a coordinate space; storing, using a second application, the coordinate information so that the coordinate information is associated with contact information indicative of the address; detecting user selection of a control element associated with the stored contact information; and in response to the detection of the user selection of the control element providing the coordinate information to the first application.

Abstract: A navigation system may display route information that includes a display of the fixtures that are located on or near the route. The fixtures may be selected and inserted into the digital map as graphical objects. The graphical objects may be classified into a class and at least one sub-class. The classification data may be used to select and generate the graphical objects.