Abstract: A vision-assist device may include at least one image sensor for generating image data corresponding to an environment, a user input device for receiving user input regarding one or more physical characteristics of a user, and a processor. The processor may be programmed to receive the image data from the at least one image sensor, receive the user input from the user input device, and adjust an alignment of the at least one image sensor based on the received image data and the user input. Methods for aligning an image sensor are also provided.

Abstract: Systems and methods for communicating with a guide animal are provided. One embodiment of a method includes determining a first command to provide to a user to proceed to a destination, determining a second command to provide to the guide animal to correspond with the first command, and outputting the first command to direct the user toward the destination. Some embodiments include outputting the second command to direct the guide animal toward the destination, where the second command is outputted to be imperceptible by the user but is perceptible by the guide animal.

Abstract: A device for providing guidance or feedback to a user. The device includes a camera configured to detect image data indicating a user performance of an activity. The system includes a guidance unit connected to the camera. The guidance unit is configured to identify the activity based on image processing of the image data or an identification of the activity from the user. The guidance unit is also configured to determine a criteria associated with the activity. The guidance unit is also configured to determine a user performance of the activity based on the image data. The guidance unit is also configured to determine feedback based on a comparison of the criteria and the user performance of the activity, the feedback indicating an improvement or suggestion for the user. The system also includes an output unit connected to the guidance unit, the output unit configured to output the feedback.

Abstract: A system for determining output text based on spoken language and sign language includes a camera configured to detect image data corresponding to a word in sign language. The system also includes a microphone configured to detect audio data corresponding to the word in spoken language. The system also includes a processor configured to receive the image data from the camera and convert the image data into an image based text word. The processor is also configured to receive the audio data from the microphone and convert the audio data into an audio based text word. The processor is also configured to determine an optimal word by selecting one of the image based text word or the audio based text word based on a comparison of the image based text word and the audio based text word.

Abstract: A wearable computing device includes an input/output port for communicating with an external mobile device, a microphone for receiving speech data, a speaker for outputting audio feedback data, and a mobile processor. The mobile processor is designed to receive detected speech data corresponding to a request to open an application on the external mobile device, transmit the request to the external mobile device, and receive a description of content within the application from the external mobile device. The mobile processor is also designed to transmit the description to the speaker to be output, receive detected speech data corresponding to a request for the external mobile device to perform an action within the application, and transmit the request to the external mobile device. The mobile processor is also designed to receive results of the action from the external mobile device and transmit the results to the speaker to be output.

Abstract: A system for providing, to a user, navigation directions to a point of interest. The system includes a device having an output unit configured to output the navigation directions to the point of interest. The device is configured to communicate, to an unmanned vehicle, a point of interest identification. The system also includes the unmanned vehicle having a camera configured to detect image data. The unmanned vehicle is configured to determine whether the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine a point of interest location when the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine point of interest navigation data based on the point of interest location. The unmanned vehicle is also configured to communicate, to the device, the point of interest navigation data.

Abstract: Vision-assist devices and methods are disclosed. In one embodiment, a vision-assist device includes an image sensor for generating image data corresponding to a scene, a processor, and an auditory device. The processor is programmed to receive the image data from the image sensor, perform object recognition on the image data to determine a classification of a detected object that is present within the scene, and determine a confidence value with respect to the classification of the detected object. The confidence value is based on a confidence that the classification of the detected object matches an actual classification of the detected object. The processor further generates an auditory signal based on the confidence value. The audio device receives the auditory signal from the processor and produces an auditory message from the auditory signal. The auditory message is indicative of the classification of the detected object and the confidence value.

Abstract: A wearable computing device includes an input device, a global positioning system (GPS) sensor, an inertial measurement unit (IMU), a camera, and a memory that is designed to store a database of landmarks and corresponding locations. The device includes a mobile processor that is designed to receive first user input indicating that the user is traveling from a starting location to a destination location and second user input indicating that new landmarks are present. The processor is designed to determine locations of the new landmarks based on the current location, the inertial measurement data, and/or the detected image data. The processor is designed to update the database to include the new landmarks and corresponding locations. The processor is designed to update the database to include an ordered list of landmarks including the new landmarks in order of their appearance from the starting location to the destination location.

Abstract: A device for providing guidance or feedback to a user. The device includes a camera configured to detect image data indicating a user performance of an activity. The system includes a guidance unit connected to the camera. The guidance unit is configured to identify the activity based on image processing of the image data or an identification of the activity from the user. The guidance unit is also configured to determine a criteria associated with the activity. The guidance unit is also configured to determine a user performance of the activity based on the image data. The guidance unit is also configured to determine feedback based on a comparison of the criteria and the user performance of the activity, the feedback indicating an improvement or suggestion for the user. The system also includes an output unit connected to the guidance unit, the output unit configured to output the feedback.

Abstract: A wearable computing device includes an input device, a global positioning system (GPS) sensor, an inertial measurement unit (IMU), a camera, and a memory that is designed to store a database of landmarks and corresponding locations. The device includes a mobile processor that is designed to receive first user input indicating that the user is traveling from a starting location to a destination location and second user input indicating that new landmarks are present. The processor is designed to determine locations of the new landmarks based on the current location, the inertial measurement data, and/or the detected image data. The processor is designed to update the database to include the new landmarks and corresponding locations. The processor is designed to update the database to include an ordered list of landmarks including the new landmarks in order of their appearance from the starting location to the destination location.

Abstract: A wearable computing device includes a first sensor designed to detect first data of a first type. The device also includes a second sensor designed to detect second data of a second type. The device also includes an input device designed to receive user input. The device also includes a memory designed to store a plurality of triggers corresponding to the first type of data and to store the second data. The device also includes a mobile processor designed to compare the first data to the plurality of triggers as the first data is being detected. The processor is also designed to cause the memory to store the second data when the first data matches one of the plurality of triggers. The device also includes an output device configured to output the second data when the user input indicates a request to output the second data.

Abstract: A smart necklace includes a first pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a second pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a curved main unit having a first connector removably, pivotably and electrically coupled to the proximate connector of the first pod and a second connector configured to be removably, pivotably and electrically coupled to the proximate connector of the second pod. The main unit also includes a mobile processor for receiving the input data from at least one of the first pod or the second pod, determining output data based on the input data, and outputting the output data via the first pod or the second pod.

Abstract: A vision-assist device may include at least one image sensor for generating image data corresponding to an environment, a user input device for receiving user input regarding one or more physical characteristics of a user, and a processor. The processor may be programmed to receive the image data from the at least one image sensor, receive the user input from the user input device, and adjust an alignment of the at least one image sensor based on the received image data and the user input. Methods for aligning an image sensor are also provided.

Abstract: Vision-assist devices and methods for calibrating a position of a vision-assist device worn by a user are disclosed. In one embodiment, a method of calibrating a vision-assist device includes capturing a calibration image using at least one capturing device of the vision-assist device, obtaining at least one attribute of the calibration image, and comparing the at least one attribute of the calibration image with a reference attribute. The method further includes determining an adjustment of the at least one image sensor based at least in part on the comparison of the at least one attribute of the calibration image with the reference attribute, and providing an output corresponding to the determined adjustment of the vision-assist device.

Abstract: A system for providing, to a user, navigation directions to a point of interest. The system includes a device having an output unit configured to output the navigation directions to the point of interest. The device is configured to communicate, to an unmanned vehicle, a point of interest identification. The system also includes the unmanned vehicle having a camera configured to detect image data. The unmanned vehicle is configured to determine Whether the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine a point of interest location when the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine point of interest navigation data based on the point of interest location. The unmanned vehicle is also configured to communicate, to the device, the point of interest navigation data.

Abstract: Systems and methods for communicating with a guide animal are provided. One embodiment of a method includes determining a first command to provide to a user to proceed to a destination, determining a second command to provide to the guide animal to correspond with the first command, and outputting the first command to direct the user toward the destination. Some embodiments include outputting the second command to direct the guide animal toward the destination, where the second command is outputted to be imperceptible by the user but is perceptible by the guide animal.

Abstract: A smart necklace includes a body defining at least one cavity and having a neck portion and first and a second side portions. The necklace includes a pair of stereo cameras that is configured to detect image data including depth information corresponding to a surrounding environment of the smart necklace. The necklace further includes a positioning sensor configured to detect positioning data corresponding to a positioning of the smart necklace. The necklace includes a non-transitory memory positioned in the at least one cavity and configured to store map data and object data. The smart necklace also includes a processor positioned in the at least one cavity, coupled to the pair of stereo cameras, the positioning sensor and the non-transitory memory. The processor is configured to determine output data based on the image data, the positioning data, the map data and the object data.

Abstract: A wearable smart device for providing hazard warning information to a user. The wearable smart device includes a microphone configured to detect audio data associated with a potential hazard. The wearable smart device also includes a camera configured to detect image data associated with the potential hazard. The wearable smart device also includes a processor coupled to the microphone and the camera and configured to determine whether the potential hazard presents a real hazard based on the detected audio data and the detected image data.

Abstract: A smart necklace includes a first pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a second pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a curved main unit having a first connector removably, pivotably and electrically coupled to the proximate connector of the first pod and a second connector configured to be removably, pivotably and electrically coupled to the proximate connector of the second pod. The main unit also includes a mobile processor for receiving the input data from at least one of the first pod or the second pod, determining output data based on the input data, and outputting the output data via the first pod or the second pod.