Abstract: A wearable apparatus is provided for capturing and processing images from an environment of a user. In one implementation, a server-based system includes a data interface for receiving a data stream including image-based information. The image based information may include images captured by a camera present on a particular wearable apparatus from among the plurality of wearable apparatuses worn by different users. The server-based system also includes at least one processing device programmed to receive the data stream from each of the plurality of wearable apparatuses using the data interface, and analyze the data streams to determine at least one trait common to two or more of the different users of the plurality of wearable apparatuses. The at least one processing device may also be programmed to store in a database information relating to the determined at least one trait.

Abstract: A apparatus and method are provided for processing images. In one embodiment, the apparatus includes an image sensor configured to capture real time images from an environment of a user. The apparatus also includes a mobile power source, and at least one processor device configured to process, at an initial resolution, images to determine existence of a trigger, and access rules associating image context with image capture resolution to enable images of a first context to be processed at a lower capture resolution than images of a second context. The processor device analyzes at least one first image, selects a first image capture resolution rule, and applies the first image capture resolution rule to a subsequent captured image. The processor device analyzes at least one second image, selects a second image capture resolution rule, and applies the second image capture resolution rule to a second subsequent captured image.

Abstract: Devices and a method are provided for providing context-related feedback to a user. In one implementation, the method comprises capturing real time image data from an environment of the user. The method further comprises identifying in the image data a hand-related trigger. Multiple context-based alternative actions are associated with the hand-related trigger. Further, the method comprises identifying in the image data an object associated with the hand-related trigger. The object is further associated with a particular context. Also, the method comprises selecting one of the multiple alternative actions based on the particular context. The method further comprises outputting the context-related feedback based on a result of the executed alternative action.

Abstract: A server and method are provided for determining a matching score related to users of wearable camera systems. In one implementation, a server determines a matching score related to users of wearable camera systems. Each wearable camera system is configured to capture images from an environment of a corresponding user and produce image data from the captured images. At least one processing device associated with the server may be programmed to receive image data from the wearable camera systems. The processing device may further determine a value of a matching score related to at least two users of the wearable camera systems. The value of the matching score may be based on the image data received from the wearable camera systems. The value of the matching score may indicate a level of exposure of the two users to similar visual details in their environments.

Abstract: A wearable apparatus and method are provided for capturing image data. In one implementation, a wearable apparatus for selectively processing images is provided. The wearable apparatus includes an image sensor configured to capture a plurality of images from an environment of a user. The wearable apparatus also includes at least one processing device programmed to access at least one rule for classifying images. The at least one processing device is also programmed to classify, according to the at least one rule, at least a first subset of the plurality of images as key images and at least a second subset of the plurality images as auxiliary images. The at least one processing device is further programmed to delete at least some of the auxiliary images.

Abstract: A wearable apparatus and method are provided for selectively categorizing information derived from images. In one implementation, a wearable apparatus for collecting information related to activities of a user may collect information related to activities of a user. The wearable apparatus may include an image sensor configured to capture a plurality of images from an environment of a user; a communications interface; and at least one processing device. The at least one processing device may be programmed to process the plurality of images to identify an activity occurring in the environment of the user; associate the activity with an activity category; and cause transmission of at least the activity category to a remotely located computing device via the communications interface.

Abstract: A device and method are provided for recognizing text on a curved surface. In one implementation, the device comprises an image sensor configured to capture from an environment of a user multiple images of text on a curved surface. The device also comprises at least one processor device. The at least one processor device is configured to receive a first image of a first perspective of text on the curved surface, receive a second image of a second perspective of the text on the curved surface, perform optical character recognition on at least parts of each of the first image and the second image, combine results of the optical character recognition on the first image and on the second image, and provide the user with a recognized representation of the text, including a recognized representation of the first portion of text.

Abstract: A device and method are provided for providing feedback based on the state of an object. In one implementation, an apparatus for processing images is provided. The apparatus may include an image sensor configured to capture real time images from an environment of a user and at least one processor device configured to initially process at least one image to determine whether an object is likely to change its state. If a determination is made that the object is unlikely to change its state, the at least one processor device may additionally process the at least one image and provide a first feedback. If a determination is made that the object is likely to change its state, the at least one processor device may continue to capture images of the object and alert the user with a second feedback after a change in the state of the object occurs.

Abstract: A device and method are provided for adjusting image capture settings. In one implementation, a wearable apparatus may include at least one wearable image sensor configured to capture a plurality of images from an environment of a user. The wearable apparatus may also include at least one processing device configured to identify, in at least one representation of at least one of the plurality of images, an existence of at least one visual trigger in the environment of the user, determine, based on a type of the at least one visual trigger, a value for at least one capturing parameter, cause the image sensor to capture at least one subsequent image according to at least the value of the at least one capturing parameter, determine a data size for storing at least one representation of the at least one subsequent image, and store, in a memory, the at least one representation of the at least one subsequent image.

Abstract: Apparatuses and a method are provided for providing environmental information to a user, who may be visually impaired. In one implementation, a method is provided for receiving real time image data including an object within the user environment. The method includes identifying a hand-related trigger in the image data. Upon identifying the hand-related trigger, the method includes executing a first search in the image data in an attempt to identify at least one object from a first category of objects. After initiating the first search, the method includes executing a second search in the image data in an attempt to identify at least one object from a second category of objects that differs from the first. The method also includes outputting audible feedback to the user associated with information related to an object or objects identified in the image data.

Abstract: Apparatuses may be configured to provide feedback to a user, who may be visually-impaired. In one implementation, a method for using the apparatuses provides this feedback to a visually impaired user. The method comprises receiving from a mobile image sensor real time image data that includes a representation of an object in an environment of the visually impaired user. The mobile image sensor is configured to be connected to glasses worn by the visually impaired user. Further, the method comprises receiving a signal indicating a desire of the visually impaired user to obtain information about the object. The method also includes accessing a database holding information about a plurality of objects, and comparing information derived from the received real time image data with information in the database. The method comprises providing the visually impaired user with nonvisual feedback that the object is not locatable in the database.

Abstract: A device and method are provided for adjusting image capture settings. In one implementation, a wearable apparatus may include at least one wearable image sensor configured to capture a plurality of images from an environment of a user. The wearable apparatus may also include at least one processing device configured to identify, in at least one representation of at least one of the plurality of images, an existence of at least one visual trigger in the environment of the user, determine, based on a type of the at least one visual trigger, a value for at least one capturing parameter, cause the image sensor to capture at least one subsequent image according to at least the value of the at least one capturing parameter, determine a data size for storing at least one representation of the at least one subsequent image, and store, in a memory, the at least one representation of the at least one subsequent image.

Abstract: A device and method are provided for audible facial recognition. In one implementation, an apparatus for aiding a visually impaired user to identify individuals is provided. The apparatus may include a portable image sensor configured to be worn by the visually impaired user and to capture real-time image data from an environment of the user. The apparatus may also include at least one portable processor device configured to determine an existence of face-identifying information in the real-time image data, and access stored facial information and audible indicators. The at least one portable processor device may also be configured to compare the face-identifying information with the stored facial information, and identify a match. Based on the match, the at least one portable processor may be configured to cause an audible indicator to be announced to the visually impaired user.

Abstract: A device and method are provided for processing mages to prolong battery life. In one implementation, a wearable apparatus may include a wearable image sensor configured to capture a plurality of images from an environment of a user. The wearable apparatus may also include at least one processing device configured to, in a first processing-mode, process representations of the plurality of images to determine a value of at least one capturing parameter for use in capturing at least one subsequent image, and in a second processing-mode, process the representations of the plurality of images to extract information. In addition, the at least one processing device may operate in the first processing-mode when the wearable apparatus is powered by a mobile power source included in the wearable apparatus and may operate in the second processing-mode when the wearable apparatus is powered by an external power source.

Abstract: A device and method are provided for performing a triggered action. In one implementation, an apparatus for processing real time images of an environment of a user is provided. The apparatus may include an image sensor configured to capture image data for providing a plurality of sequential images of the environment of the user. The apparatus may also include at least one processor device configured to identify a trigger associated with a desire of the user to cause at least one pre-defined action associated with an object. The trigger may include an erratic movement of the object. In response to identification of the trigger, the at least one processor device may also be configured to identify a captured representation of the object. Based on at least the captured representation of the object, the at least one processor device may be configured to execute the at least one pre-defined action.

Abstract: A device and method are provided for automatic control of a continuous action. In one implementation, an apparatus for providing feedback to a user is provided. The apparatus may include an image sensor configured to be positioned for movement with a head of a user. The image sensor may also be configured to capture real time images from an environment of the user as the user's head moves. The apparatus may also include at least one processor device configured to process at least one image to identify an existence of an object within a field of view of the image sensor and to initiate a continuous action associated with the object. The processing device may also be configured to suspend the continuous action associated with the object when the object moves outside the field of view of the image sensor.

Abstract: A system and method are provided for accelerating machine reading of text. In one embodiment, the system comprises at least one processor device. The processor device is configured to receive at least one image of text to be audibly read. The text includes a first portion and a second portion. The processor device is further configured to initiate optical character recognition (OCR) to recognize the first portion. The processor device is further configured to initiate an audible presentation of the first portion prior to initiating OCR of the second portion, and simultaneously perform OCR to recognize the second portion of the text to be audibly read during presentation of at least part of the first portion. The processor device is further configured to automatically cause the second portion of the text to be audibly presented immediately upon completion of the presentation of the first portion.

Abstract: An apparatus connectable to a pair of glasses provides information to a user by processing images captured from the environment of the user. In one embodiment, the apparatus includes a support configured for mounting on the pair of glasses and a sensory unit. The sensory unit includes a housing configured for selective attachment to the support and an image sensor contained within the housing. The support and the housing are configured to enable selective aiming of the image sensor to establish a set aiming direction relative to the pair of glasses. The support and the housing are configured to cooperate with each other such that each time the sensory unit is attached to the support, the image sensor assumes the set aiming direction without need for directional calibration.

Abstract: An apparatus and method are provided for identifying and audibly presenting textual information within captured image data. In one implementation, a method is provided for audibly presenting text retrieved from a captured image. According to the method, at least one image of text is received from an image sensor, and the text may include a first portion and a second portion. The method includes identifying contextual information associated with the text, and accessing at least one rule associating the contextual information with at least one portion of text to be excluded from an audible presentation associated with the text. The method further includes performing an analysis on the at least one image to identify the first portion and the second portion, and causing the audible presentation of the first portion.

Abstract: Apparatuses and a method are provided for providing feedback to a user, who may be visually-impaired. In one implementation, a method is provided for providing feedback to a visually impaired user. The method comprises receiving from a mobile image sensor real time image data that includes a representation of an object in an environment of the visually impaired user. The mobile image sensor is configured to be connected to glasses worn by the visually impaired user. Further, the method comprises receiving a signal indicating a desire of the visually impaired user to obtain information about the object. The method also includes accessing a database holding information about a plurality of objects, and comparing information derived from the received real time image data with information in the database. The method comprises providing the visually impaired user with nonvisual feedback that the object is not locatable in the database.