Abstract: A headset designed for inclusion of users with impairments is provided. The headset includes a frame, two eyepieces mounted on the frame, and at least one microphone and a speaker, mounted on the frame. The headset also includes a camera, a memory configured to store multiple instructions, and a processor configured to execute the instructions, wherein the instructions comprise to provide to a user an environmental context from a signal provided by the microphone and the camera. A method for using the above headset and a system for performing the method are also provided.

Abstract: A smart glass for incorporating speech recognition in an immersive reality environment is provided. The smart glass includes an eyepiece mounted on a frame including a transparent optical component to provide a user a view of a scene in a real world. The smart glass also includes a first camera configured to capture an image of a hand gesture from an interlocutor in the real world, and a processor configured to recognize, in the image of the hand gesture, a textual meaning. A system including memories storing instructions and processors to execute the instructions to perform methods for use of the above smart glass, and the methods, are also provided.