Abstract: The disclosure includes a system and method for using a robot to prevent risk to a user by identifying a point of interest, determining whether the point of interest is a risk for the user with visual impairments based on the user's position, responsive to a first predetermined threshold for distance being met, determining where to move the robot to mitigate the risk to the user, and instructing the robot to move to a new location. The robot may move between the user and the point of interest to prevent the user from colliding with the point of interest. The robot may use an auditory or tactile warning to warn the user. The tactile warning may be transmitted to a walking stick or a belt worn by the user.

Abstract: The disclosure includes a system and method for determining a robot path based on user motion by determining a current position of a robot with a processor-based computing device programmed to perform the determining, receiving sensor readings on positions, directions, and velocities of a visually-impaired user and other users, generating a model of the motions of the visually-impaired user and the other users, the model including a user path for the visually-impaired user and a robot path for the robot, generating a collision prediction map to predict collisions between at least one of the robot, the visually-impaired user, and the other users, determining whether there is a risk of collision for either the visually-impaired user or the robot, and responsive to the risk of collision, updating at least one of the user path and the robot path.

Abstract: The disclosure includes a system and method for using a robot to simulate user motions by detecting a user, estimating a first position and orientation of the user, determining a current position of the robot, generating an initial path from the current position of the robot to a goal position based on whether the robot affects the user while travelling on the initial path, determining whether the user will traverse in response to the robot when the robot travels on the initial path, responsive to the user traversing in response to the robot, estimating a second position where the user will move when the robot is near, and generating a new path from the current position of the robot to the goal position.

Abstract: The disclosure includes a system and method for spatial information for a heads-up display. The system includes a processor and a memory storing instructions that, when executed, cause the system to: receive object data about an object, determine a vehicle path for the vehicle, estimate a danger index for the object based on the vehicle data and the object data, detect a user's gaze, determine whether the user sees the object based on the user's gaze, identify a graphic that is a representation of the object, and position the graphic to correspond to the user's eye frame.

Abstract: The disclosure includes a system and method for spatial information for a heads-up display. The system includes a processor and a memory storing instructions that, when executed, cause the system to: receive sensor data about an entity, assign the entity to a category, estimate a danger index for the entity based on vehicle data, category data, and a position of the entity, generate entity data that includes the danger index, identify a graphic that is a representation of the entity based on the entity data, determine a display modality for the graphic based on the danger index, and position the graphic to correspond to a user's eye frame.

Abstract: The disclosure includes a system and method for generating cloud-based content for a heads-up display. The cloud server includes a processor and a memory storing instructions that, when executed, cause the system to: register the first user and the second user, generate a social graph between with a connection between the first user and the second user, receive vehicle data from the first user and the second user, and process the data according to attributes. The system includes a processor and a memory storing instructions that, when executed, cause the system to: transmit sensor data to a cloud server, receive processed content from the cloud server that is aggregated from multiple vehicles, filter the processed content for a first user, selecting a graphic for the filtered content, and position the graphic to correspond to the first user's eye frame.

Abstract: The disclosure includes a system and method for spatial information for a heads-up display. The system includes a processor and a memory storing instructions that, when executed, cause the system to: receive object-to-vehicle (X2V) data from a first processor-based mobile computing device that broadcasts an object's position, generate object data including an object path from a second processor-based computing device programmed to perform the generating, determine vehicle data including a vehicle path, estimate a danger index for the object based on the vehicle data and the object data, identify a graphic that is a representation of the object, and position the graphic to correspond to a user's eye frame.

Abstract: The disclosure includes a speech-enabled device and method to share speech dialog capabilities of the speech-enabled device with a dumb device. The speech-enabled device includes a processor and a memory storing instructions that, when executed by the processor, cause the speech-enabled device to: receive speech dialog data of the dumb device that indicates a function of the dumb device; receive speech input; determine the function of the dumb device to be invoked based on the speech input by using the speech dialog data; generate a command effective to invoke the function of the dumb device based on the speech dialog data; and send the command to the dumb device to invoke the function of the dumb device.

Abstract: The disclosure includes a method that includes determining a location that corresponds to a problematic travel condition based on data associated with when a first client device is at the location. The method may further include notifying, a second client device with a possible travel route that includes the location, that the location includes the problematic travel condition.

Abstract: The disclosure includes a system and method for switching vibration modalities based on conditions to provide navigation guidance. The system includes a tactile belt and a computing device. The computing device includes a modality module for receiving path data describing a path planned for a user associated with a tactile belt and location data describing a location of the user associated with the tactile belt, determining condition data based on the path data and the location data and determining a vibration modality based on the condition data. The condition data describes a direction change. The vibration modality describes a pattern for vibration and indicates a vibration signal. The system applies the vibration signal indicated by the vibration modality to the tactile belt to instruct the user associated with the tactile belt to follow the path.

Abstract: A system for detecting a person and estimating pose information comprises a processor and a memory storing instructions causing the system to: retrieve depth data from a sensor, the depth data describing distance information associated with one or more objects detected by the sensor; cluster the depth data to determine two or more candidate leg clusters, each candidate leg cluster including a portion of the depth data that may represent a human leg detected by the sensor; identify a candidate leg cluster pair including two candidate leg clusters within a certain distance between each other; determine whether there is a connectivity between the two candidate leg clusters included in the candidate leg cluster pair; and responsive to determining that there is a connectivity between the two candidate leg clusters, determine that the candidate leg cluster pair is qualified to be a leg cluster pair representing a person.