Abstract: A robot system includes a holding compartment configured to transport one or more items and an electronic control unit having a processor and a non-transitory computer readable memory including a machine-readable instruction set. The robot system further includes a camera for capturing image data of an environment of the holding compartment and a robotic arm each communicatively coupled to the electronic control unit. The machine-readable instruction set causes the processor to receive image data of the environment of the holding compartment from the camera, determine a set of handling instructions for an item collected by the robotic arm, determine a location within the holding compartment for placing the item collected by the robotic arm based on the image data of the environment of the holding compartment and the set of handling instructions, and manipulate the robotic arm to place the item within the holding compartment at the determined location.

Abstract: A device for providing guidance or feedback to a user. The device includes a camera configured to detect image data indicating a user performance of an activity. The system includes a guidance unit connected to the camera. The guidance unit is configured to identify the activity based on image processing of the image data or an identification of the activity from the user. The guidance unit is also configured to determine a criteria associated with the activity. The guidance unit is also configured to determine a user performance of the activity based on the image data. The guidance unit is also configured to determine feedback based on a comparison of the criteria and the user performance of the activity, the feedback indicating an improvement or suggestion for the user. The system also includes an output unit connected to the guidance unit, the output unit configured to output the feedback.

Abstract: A robot system includes a holding compartment configured to transport one or more items and an electronic control unit having a processor and a non-transitory computer readable memory including a machine-readable instruction set. The robot system further includes a camera for capturing image data of an environment of the holding compartment and a robotic arm each communicatively coupled to the electronic control unit. The machine-readable instruction set causes the processor to receive image data of the environment of the holding compartment from the camera, determine a set of handling instructions for an item collected by the robotic arm, determine a location within the holding compartment for placing the item collected by the robotic arm based on the image data of the environment of the holding compartment and the set of handling instructions, and manipulate the robotic arm to place the item within the holding compartment at the determined location.

Abstract: A wearable computing device includes an input device, a global positioning system (GPS) sensor, an inertial measurement unit (IMU), a camera, and a memory that is designed to store a database of landmarks and corresponding locations. The device includes a mobile processor that is designed to receive first user input indicating that the user is traveling from a starting location to a destination location and second user input indicating that new landmarks are present. The processor is designed to determine locations of the new landmarks based on the current location, the inertial measurement data, and/or the detected image data. The processor is designed to update the database to include the new landmarks and corresponding locations. The processor is designed to update the database to include an ordered list of landmarks including the new landmarks in order of their appearance from the starting location to the destination location.

Abstract: A wearable computing device includes an input device, a global positioning system (GPS) sensor, an inertial measurement unit (IMU), a camera, and a memory that is designed to store a database of landmarks and corresponding locations. The device includes a mobile processor that is designed to receive first user input indicating that the user is traveling from a starting location to a destination location and second user input indicating that new landmarks are present. The processor is designed to determine locations of the new landmarks based on the current location, the inertial measurement data, and/or the detected image data. The processor is designed to update the database to include the new landmarks and corresponding locations. The processor is designed to update the database to include an ordered list of landmarks including the new landmarks in order of their appearance from the starting location to the destination location.

Abstract: A device for providing guidance or feedback to a user. The device includes a camera configured to detect image data indicating a user performance of an activity. The system includes a guidance unit connected to the camera. The guidance unit is configured to identify the activity based on image processing of the image data or an identification of the activity from the user. The guidance unit is also configured to determine a criteria associated with the activity. The guidance unit is also configured to determine a user performance of the activity based on the image data. The guidance unit is also configured to determine feedback based on a comparison of the criteria and the user performance of the activity, the feedback indicating an improvement or suggestion for the user. The system also includes an output unit connected to the guidance unit, the output unit configured to output the feedback.

Abstract: A system for providing information to a user includes a haptic display including a plurality of sensors positioned thereon, a map positioned on the haptic display and including points of interest where each point of interest is positioned adjacent to or directly on at least one of the plurality of sensors, and a memory for storing a plurality of breadcrumb files where each of the plurality of breadcrumb files corresponds to at least one of the points of interest and contains information related to at least one of an environment, an object, an obstacle, a path or a location. The system includes a processor for determining which point of interest has been selected based on contact with at least one of the points of interest and an output device configured to provide the information contained in the breadcrumb file corresponding to the selected point of interest to the user.

Abstract: A wearable computing device includes a first sensor designed to detect first data of a first type. The device also includes a second sensor designed to detect second data of a second type. The device also includes an input device designed to receive user input. The device also includes a memory designed to store a plurality of triggers corresponding to the first type of data and to store the second data. The device also includes a mobile processor designed to compare the first data to the plurality of triggers as the first data is being detected. The processor is also designed to cause the memory to store the second data when the first data matches one of the plurality of triggers. The device also includes an output device configured to output the second data when the user input indicates a request to output the second data.

Abstract: A method for providing directions to a blind user of a smart device is described. The method includes detecting, by at least two sensors and in response to a selection of a find mode of the smart device, image data corresponding to a surrounding environment of the smart device and positioning data corresponding to a positioning of the smart device. The method also includes receiving, by an input device, the desired object or the desired location. The method also includes determining, by a processor, the initial location of the smart device based on the image data, the positioning data and map data stored in a memory of the smart device. The method also includes providing, by the output device, the directions to the desired object based on the initial location of the smart device and the map data.

Abstract: A system for providing environmental feedback including one or more processors and a tactile input hardware. The tactile input hardware is communicatively coupled to the one or more processors. The system further includes one or more memory modules communicatively coupled to the one or more processors, one or more sensing devices communicatively coupled to the one or more processors, and machine readable instructions stored in the one or more memory modules that, when executed by the one or more processors, causes the one or more processors to receive environmental information from the one or more sensing devices, receive a gestural input on the tactile input hardware, and generate feedback regarding a subset of the environmental information acquired by the one or more sensing devices in response to the gestural input received on the tactile input hardware.

Abstract: A smart necklace includes a first pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a second pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a curved main unit having a first connector removably, pivotably and electrically coupled to the proximate connector of the first pod and a second connector configured to be removably, pivotably and electrically coupled to the proximate connector of the second pod. The main unit also includes a mobile processor for receiving the input data from at least one of the first pod or the second pod, determining output data based on the input data, and outputting the output data via the first pod or the second pod.

Abstract: A smart necklace includes a body defining at least one cavity and having a neck portion and first and a second side portions. The necklace includes a pair of stereo cameras that is configured to detect image data including depth information corresponding to a surrounding environment of the smart necklace. The necklace further includes a positioning sensor configured to detect positioning data corresponding to a positioning of the smart necklace. The necklace includes a non-transitory memory positioned in the at least one cavity and configured to store map data and object data. The smart necklace also includes a processor positioned in the at least one cavity, coupled to the pair of stereo cameras, the positioning sensor and the non-transitory memory. The processor is configured to determine output data based on the image data, the positioning data, the map data and the object data.

Abstract: Systems and methods for providing contextual environmental information. One embodiment of a method includes detecting a plurality of objects in an environment, identifying at least a portion of the plurality of objects in the environment, and determining a location of a user relative to the plurality of objects. Some embodiments may be configured to determine a desired number of alerts to provide the user based on a characteristic of the user and, in response to determining that the desired number of alerts is less than a number of objects detected in the environment, provide data related to a location of a subset of the plurality of objects, relative to the user.

Abstract: A smart necklace includes a first pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a second pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a curved main unit having a first connector removably, pivotably and electrically coupled to the proximate connector of the first pod and a second connector configured to be removably, pivotably and electrically coupled to the proximate connector of the second pod. The main unit also includes a mobile processor for receiving the input data from at least one of the first pod or the second pod, determining output data based on the input data, and outputting the output data via the first pod or the second pod.

Abstract: A system for providing information to a user includes a haptic display including a plurality of sensors positioned thereon, a map positioned on the haptic display and including points of interest where each point of interest is positioned adjacent to or directly on at least one of the plurality of sensors, and a memory for storing a plurality of breadcrumb files where each of the plurality of breadcrumb files corresponds to at least one of the points of interest and contains information related to at least one of an environment, an object, an obstacle, a path or a location. The system includes a processor for determining which point of interest has been selected based on contact with at least one of the points of interest and an output device configured to provide the information contained in the breadcrumb file corresponding to the selected point of interest to the user.

Abstract: Systems and methods for providing contextual environmental information. One embodiment of a method includes detecting a plurality of objects in an environment, identifying at least a portion of the plurality of objects in the environment, and determining a location of a user relative to the plurality of objects. Some embodiments may be configured to determine a desired number of alerts to provide the user based on a characteristic of the user and, in response to determining that the desired number of alerts is less than a number of objects detected in the environment, provide data related to a location of a subset of the plurality of objects, relative to the user.

Abstract: A system for providing environmental feedback including one or more processors and a tactile input hardware. The tactile input hardware is communicatively coupled to the one or more processors. The system further includes one or more memory modules communicatively coupled to the one or more processors, one or more sensing devices communicatively coupled to the one or more processors, and machine readable instructions stored in the one or more memory modules that, when executed by the one or more processors, causes the one or more processors to receive environmental information from the one or more sensing devices, receive a gestural input on the tactile input hardware, and generate feedback regarding a subset of the environmental information acquired by the one or more sensing devices in response to the gestural input received on the tactile input hardware.

Abstract: A smart necklace includes a body defining at least one cavity and having a neck portion and first and a second side portions. The necklace includes a pair of stereo cameras that is configured to detect image data including depth information corresponding to a surrounding environment of the smart necklace. The necklace further includes a positioning sensor configured to detect positioning data corresponding to a positioning of the smart necklace. The necklace includes a non-transitory memory positioned in the at least one cavity and configured to store map data and object data. The smart necklace also includes a processor positioned in the at least one cavity, coupled to the pair of stereo cameras, the positioning sensor and the non-transitory memory. The processor is configured to determine output data based on the image data, the positioning data, the map data and the object data.