Abstract: Embodiments of the present invention are directed toward controlling electronic devices based on hand gestures detected by detecting the topography of a portion of a user's body. For example, pressure data indicative of a user's bone and tissue position corresponding to a certain movement, position, and/or pose of a user's hand may be detected. An electromyographic (EMG) sensor coupled to the user's skin can also be used to determine gestures made by the user. These sensors can be coupled to a camera that can be used to capture images, based on recognized gestures, of a device. The device can then be identified and controlled.

Abstract: This disclosure relates to techniques for providing hands-free augmented reality on a wireless communication device (WCD). According to the techniques, an application processor within the WCD executes an augmented reality (AR) application to receive a plurality of image frames and convert the plurality of image frames into a single picture comprising the plurality of image frames stitched together to represent a scene. The WCD executing the AR application then requests AR content for the scene represented in the single picture from an AR database server, receives AR content for the scene from the AR database server, and processes the AR content to overlay the single picture for display to a user on the WCD. In this way, the user may comfortably look at the single picture with the overlaid AR content on a display of the WCD to learn more about the scene represented in the single picture.

Abstract: Systems and methods for determining a battery-level of an electronic device and conserving the battery charge of the electronic device are disclosed. The battery consumption of an electronic device may be reduced when the user or the device learns via user input or determines via prediction that the battery will be depleted before the next possible charge cycle. Reducing battery consumption could be accomplished by accessing an application requiring less power consumption and/or delaying post-processing of sensor data related to that application, for example a camera application. Prediction of battery life could include determining the time to the next expected battery charge and delaying the processing of sensor data until the electronic device is plugged in and charging or has reached a predetermined charge level.

Abstract: Apparatuses, methods, systems and computer-readable media for using proximity inputs on or near a touch screen lens to select objects within a field of view are presented. In some embodiments, a viewing apparatus (e.g. head mounted display, augmented reality goggles) may include at least one lens, wherein the lens can sense touches or near-touches and output data indicative of a location of the proximity input by the user. A processor may receive the data and may select an object within the field of view of the user corresponding to the data, wherein the object and the location of the proximity input on or near the lens by the user are on a common line of sight. In some embodiments, the viewing apparatus may include at least one camera that is configured to record at least one image representative of the user's field of view.

Abstract: A battery system for monitoring a battery-operated electronic device includes one or more battery cells for operating the electronic device, an electronic processor for monitoring electrical activity of the one or more battery cells; and a wireless communication module for communicating with a remote electronic device via a network based on the electrical activity. Registration information, including a unique identity of the battery system, may be received at the remote electronic device. A first signal, including the unique identity, may be received at the remote electronic device during use of the battery system. A second signal may be transmitted from the remote electronic device to a communication device in response to receiving the first signal.

Abstract: A system, a method, and a computer program product for managing information for an interface device are provided. The system detects for one of a present physical encounter between a user of the interface device and a person, and a non-physical encounter between the user and a person. The system determines if a detected present physical encounter is an initial encounter or a subsequent encounter, and adds content associated with the person to a database of previously encountered persons when the present physical encounter is an initial encounter. When the present physical encounter is a subsequent encounter or a present non-physical encounter is detected, the system determines if the person is known by the user, and presents information to the interface device corresponding to the person when the person is not known by the user.

Abstract: An apparatus, a method, and a computer program product for detecting a gesture of a body part relative to a surface are provided. The apparatus determines if the body part is in proximity of the surface. If the body part is in proximity of the surface, the apparatus determines if electrical activity sensed from the body part is indicative of contact between the body part and the surface. If the body part is in contact with the surface, the apparatus determines if motion activity sensed from the body part is indicative of the gesture.

Abstract: Various arrangements for customizing a configuration of a mobile device are presented. The mobile device may collect proximity data. The mobile device may determine that a user has gripped the mobile device based on the proximity data. A finger length of the user may be determined using the proximity data. Configuration of the mobile device may be customized at least partially based on the determined finger length of the user.

Abstract: In an example, a method includes determining, by an electronic device, a user experience metric associated with content captured by at least one camera of the electronic device. The method also includes adjusting at least one operating parameter of the device to produce an operating characteristic target, wherein the adjustment is based on an estimated change to the determined user experience metric due to the adjustment.

Abstract: A mobile platform includes a microphone array and is capable of implementing beamforming to amplify or suppress audio information from a sound source. The sound source is indicated through a user input, such as pointing the mobile platform in the direction of the sound source or through a touch screen display interface. The mobile platform further includes orientation sensors capable of detecting movement of the mobile platform. When the mobile platform moves with respect to the sound source, the beamforming is adjusted based on the data from the orientation sensors so that beamforming is continuously implemented in the direction of the sound source. The audio information from the sound source may be included or suppressed from a telephone or video-telephony conversation. Images or video from a camera may be likewise controlled based on the data from the orientation sensors.

Abstract: A method for persistently displaying selected virtual content includes: selecting desired content; selecting, using a head-mounted display, a physical location as a reference location for the desired content to be displayed virtually as a window of desired content, the physical location being in a line of sight of, but separate from the head-mounted display; and displaying at least a portion of the window of desired content using the head-mounted display such that the at least a portion of the window of desired content appears to a user of the head-mounted display to be disposed at the physical location regardless of changes of orientation, location, or orientation and location of the head-mounted display.

Abstract: An apparatus, a method, and a computer program product for gesture recognition. The apparatus classifies a gesture based on a movement of a body part as detected by a primary sensor. The apparatus determine a reliability level of a secondary sensor and obtains corroborating information associated with the movement of the body part using the secondary sensor when the reliability level satisfies a criterion. The apparatus then confirms or negates the classification of the gesture based on the corroborating information. The secondary sensor may be a sensor already known to the apparatus, i.e., the sensor is currently being worn by the user, or it may be a sensor that is worn by a user at a later time. In the latter case, the apparatus detects for the presence of a new sensor, determines the gesture recognition capabilities of the new sensor and integrates the new sensor into the gesture recognition process.

Abstract: Various arrangements for recognizing a gesture are presented. User input may be received that causes a gesture classification context to be applied from a plurality of gesture classification contexts. This gesture classification context may be applied, such as to a gesture analysis engine. After applying the gesture classification context, data indicative of a gesture performed by a user may be received. The gesture may be identified in accordance with the applied gesture classification context.

Abstract: Various arrangements for defining a marker are presented. A first defined marker presented by a public display device may be determined to be insufficient for use by a head mounted display. The first defined marker may be used as a reference point for positioning information for display by the head mounted display. In response to determining that the first defined marker is insufficient, a second marker displayed by the public display device may be defined. The second marker may have a display characteristic different from the first defined marker. The second defined marker may then be used as the reference point for positioning the information for display by the head mounted display. An indication of the second marker may be transmitted to the head mounted display.

Abstract: Various arrangements for presenting private information are presented. Private information to be displayed via a head mounted display to a user may be identified. A marker displayed by a public display device may also be identified. This public display device may be visible in a vicinity of the user. The private information and an indication of the marker may be output to the head-mounted display of the user, such that the private information is displayed by the head-mounted display in relation to the marker displayed by the public display device.

Abstract: Methods and systems may facilitate access to media. A mobile computing device may manage media associated with links by evaluating factors that may affect battery life. The mobile computing device may obtain information about the media associated with the links, such as metadata indicating file characteristics, identifying information, and analytics. The information may be included in the media or obtained from a server. The mobile computing device may evaluate factors that affect the device's ability to receive and render the media. Such factors may include the battery charge state, signal strength, connectivity, or media characteristics (e.g., size, complexity, etc.). The mobile computing device may prioritize the links associated with the media based on the evaluation of the factors, such as by sorting the links by rank. The mobile computing device may also hide links, display warnings/indicators, display links in particular manners or formats, and automatically download the media.

Abstract: Systems and methods of bad pixel cluster detection are disclosed. In a particular embodiment, a system is disclosed that includes a bad pixel correction module coupled to receive image data and adapted to perform a bad pixel cluster detection process. The bad pixel correction module includes logic to determine whether two test pixels have values that exceed a representative value of a group of surrounding pixels by more than a threshold amount. The threshold amount is determined via a table lookup.

Abstract: A method is disclosed that includes receiving multiple sequential images captured by an image capture device. The method includes selecting a subset of the multiple sequential images that are aligned to each other. The method further includes averaging pixel values from each image in the subset of the multiple sequential images to produce a combined image.

Abstract: A method, an apparatus, and a computer program product render a graphical user interface (GUI) on an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with a GUI object displayed on the HMD. The GUI object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the GUI object satisfies a criterion, and adjusts a parameter of the GUI object when the criterion is not satisfied. The parameter may be one or more of a size of the GUI object, a size of a boundary associated with the GUI object or a location of the GUI object.

Abstract: A mobile platform includes a plurality of proximity sensors coupled to a housing including on the sides, front and back of the housing. Signals from the proximity sensors are analyzed to determine configuration of the proximity sensors that are activated. The configuration may be a sequence of proximity sensors that are activated, e.g., when a gesture is detected, or the locations of the proximity sensors that are activated when the mobile platform is held in different manners. Mobile platform applications associated with the configuration are determined and automatically launched. For example, the applications may include a camera application or short message service (SMS) application, as well as controlling telephony operations, controlling a music player, and providing status information. Information from an orientation sensor and/or ambient light detector may also be used to assist in determining the applications to be launched.