Abstract: The invention is directed towards a system where a head-mounted display (HMD), or other head mounted computing device, may annotate video data captured by the HMD. When a video is annotated on the computer processor, the data packet associated with that digital marker is encoded as an operation-encoded audio packet and sent over a secure audio link to the HMD. Sending the operation-encoded audio packet over the secure audio link requires the HMD to decode the packet into a data packet which may then be used to annotate a display on the HMD. The user of the HMD may be able to view his own recorded field of view on a display device which may then be annotated using the data in the data packet.

Abstract: Embodiments can cause a media capturing device and a carrier device to establish a communication session there between so that the media capturing device can receive hotspot credentials and connect to a hotspot of the carrier device for Internet connectivity. The media capturing device can then connect to a remote streaming server via the hotspot, causing the creation of a media stream associated with a unique identifier of the media capturing device at a streaming server. The streaming server can return a URL associated with the media stream of the media capturing device to the carrier device, so that the carrier device can access, view, control, or share the media stream with other computing devices.

Abstract: Aspects of the present invention facilitate the customization of binary application user interfaces without modification of the underlying source code. Embodiments described herein can provide for hands-free operation or accessibility services, such as touchless operation of compiled applications, with minimal intervention. Described embodiments can automatically interface with the touch-based operating system to generate hands-free commands that, when detected (e.g., voice detection), can cause corresponding touch-based commands to be executed. Embodiments can utilize audio inputs, by way of example, to facilitate hands-free interaction with the touch-based operating system and applications executing thereon.

Abstract: A head-mounted computing device having a waveguide optical engine assembly is disclosed. The waveguide is enclosed in a housing to limit or minimize exposure of the waveguide to ambient light. Further, the waveguide optical engine assembly comprises a compact footprint by allowing the other components of the waveguide optical engine assembly, such as a microprojector, a prism assembly, and the like, to be placed behind a rear surface of the waveguide. In addition to the compact footprint of the waveguide optical assembly, the configuration of the waveguide optical assembly disclosed, allows for maximization of advantages provided by the waveguide as related to eye box and eye relief. Additionally, the power requirements of the waveguide are greatly reduced, which also results in a prolonged battery life powering the head-mounted computing device.

Abstract: A head-mounted computing device having a convertible waveguide optical engine assembly is disclosed. The waveguide in accordance with aspects herein can be utilized in its transparent configuration, or may be provided with means for blocking light from passing through it either by using mechanical means, or by using different types of treatments that can switch the waveguide between opaque an transparent states based on an external stimulus, such as, for example, electricity, temperature, light, and the like. Further, the waveguide optical engine assembly comprises a compact footprint, which is advantageous for head-mounted computing devices. In addition to the compact footprint of the waveguide optical assembly, the configuration of the waveguide optical assembly, as disclosed, allows for maximization of advantages provided by the waveguide as related to eye box and eye relief.

Abstract: The invention is directed towards a an audio scrubbing system that allows for scrubbing recognized voice commands from audio data and replacing the recognized voice commands with environment audio data. Specifically, as a user captures video and audio data via a HMD, audio data captured by the HMD may be processed by an audio scrubbing module to identify voice commands in the audio data that are used for controlling the HMD. When a voice command is identified in the audio data, timestamps corresponding to the voice command may be determined. Filler audio data may then be generated to imitate the environment by processing at least a portion of the audio data by a neural network of a machine learning model. The filler audio data may then be used to replace the audio data corresponding to the identified voice commands, thereby scrubbing the voice command from the audio data.

Abstract: Systems and methods facilitate digital zoom of live video based on remote user instructions. A user of a remote device may desire to zoom in on a particular aspect of a copy of a full image captured by a sensor at a first resolution and communicated to the remote device at a second resolution less than the first resolution. A selection that corresponds to a user-selected area of the copy and corresponding to a portion of the sensor is received by the sensor. Based on the selection, an instruction is generated to capture a second electronic image utilizing the portion of the sensor with the first resolution. Thus, rather than zooming into the first electronic image at the second resolution, the second electronic image corresponding to the portion of the sensor is captured at the first resolution and then converted to the second resolution, resulting in a higher resolution zoom.

Abstract: A battery system for a head-mounted display is provided. A first arm member has one or more interior walls defining a first chamber, wherein one or more first batteries are positioned in the first chamber of the first arm member. A second arm member has one or more interior walls defining a second chamber, wherein one or more second batteries are positioned in the second chamber of the second arm member. A base member is coupled to the first arm member and the second arm member. The base member has a base member power connector positioned along an exterior surface. A first auxiliary battery removably couples to the exterior surface of the base member via a first fastener, the first auxiliary battery having a first side and a second side. A first auxiliary battery power connector is positioned on the first side and aligns with the base member power connector.

Abstract: The invention is directed towards a wearable platform system (e.g., head-mounted computing device) that allows for various modular peripheral devices to be interchangeably attached and detached, as well as methods and systems for transitioning an operational mode of the wearable platform between a hard connection mode and a wireless connection mode when a peripheral device is attached to or removed from the wearable platform. Specifically, the wearable platform may include a base member coupled to one or more arm members. A variety of modular peripheral devices may be attached at a hardware interface of the wearable platform to provide varied functionality to the wearable platform. As a user begins to remove a peripheral device, the wearable platform system may determine the peripheral device is being removed from the wearable platform and may transition from a hard connection mode to a wireless connection mode.

Abstract: Aspects of the present invention allow the customization binary application user interfaces without modification of the underlying source code. Embodiments described herein can provide, for instance, accessibility services such as touchless operation of compiled applications with minimal intervention. Described embodiments can automatically interface with the touch-based operating system to generate hands-free commands that, when detected (e.g., voice detection), can cause corresponding touch-based commands to be executed. Embodiments may utilize audio inputs, by way of example, to facilitate hands-free interaction with the touch-based operating system and applications executing thereon.

Abstract: Systems and methods for a flexible, modular head-mounted display is provided. The head-mounted display system may comprise a base member and one or more arm members that are coupled to the base member. The arm member(s) may be coupled to the base member via a hinge system that allows the arm member(s) to move with respect to the base member. Interior walls of the hinge system may define a passage therethrough such that wiring may extend throughout the head-mounted display system. The head-mounted display system may further include a cover that encloses at least a portion of the hinge. The cover may overlap with the base member or the one or more arm members.

Abstract: Systems and methods provide voice activated authentication over time. A user can be registered with a voice authentication system based on a voiceprint profile of common words. This user voiceprint profile can be used in an ongoing secondary authentication as a hands-free head-mounted wearable device is used over time. Upon a user logging into a hands-free head-mounted wearable device voiceprints can be collected during a session. These collected voiceprints can be compared with a user voiceprint profile for a user authorized to operate the hands-free head-mounted wearable device. Such a comparison can include an analysis of frequency, duration, and amplitude for the voiceprints. When the voiceprints match, the login of the user can be maintained based on this secondary authentication using the voiceprints matched to the user voiceprint profile.

Abstract: Systems and methods for a flexible, head-mounted display is provided. The head-mounted display system may comprise a base member and one or more arm members that are coupled to the base member. Each of the arm members are coupled to the base member via a hinge that allows the arm members to move with respect to one another. Interior walls of the arm members and base member may define one or more chambers. One or more first batteries are positioned within a chamber in the first arm member and one or more second batteries are positioned within a chamber in the second arm member. One or more wired connections coupled to the batteries extend through the arm member(s) and hinges, and into one or more chambers in the base member, where the one or more wired connections are coupled to a battery monitor.

Abstract: Aspects of the present invention allow hands-free navigation of touch-based operating systems. The system may automatically interface with a touch-based operating system and generate hands-free commands that are associated with touch-based commands. Embodiments may utilize motion and/or audio inputs to facilitate hands-free interaction with the touch-based operating system.

Abstract: A head-mounted display that is modular and configured for securement to an item of headwear is provided. The head-mounted display may comprise a selection of components that are desired for a particular application, such as a display boom, camera, microphone, position-tracking component, etc., and may include an attachment mechanism for securing the selection of components to the item of headwear. The head-mounted display may include a display module having a corresponding display characteristic that provides a visual display and/or display functionality that is appropriate for a particular application. The display module may include a micro display that is non-transparent and/or a waveguide optic that is at least partially transparent, and may be configured to provide an augmented reality display for a user.

Abstract: A head mounted display mounting assembly for casual headwear is provided. The assembly comprises a resilient support band that is employed to secure a head-mounted display unit to a piece of casual headwear worn by a user. The head mounted display mounting assembly can be supported by pre-existing structures (e.g., sweat band) of a piece of casual headwear, and further supported and/or secured to temple regions of the casual headwear. Once seated within and secured to the piece of casual headwear, the head-mounted display unit can be secured to the head mounted display mounting assembly, providing a comfortable and integrated wearable experience for the user.

Abstract: Systems and methods provide for content navigation based on an identified context. A wearable device is initiated and loaded with content from a content repository. The loaded content comprises one or more digital tags. The wearable device is configured to provide for display, content associated with a digital tag. A context is determined for the wearable device, and based on the determined context a digital tag can be presented to a user for selection, the digital tag associate with a piece of content or a portion of content. A command can be received to select the digital tag or perform an action associated with the digital tag. A piece or portion of content associated with the selected digital tag is provided for display. A second digital tag can be presented along with the display of a piece or portion of content to enable further navigation through the content.

Abstract: Aspects of the technology described herein allow a user to add tags to a video as the video is being recorded. The tags can be added by capturing the user's voice as the video is recorded. Aspects can be performed by a head-mounted display. The head-mounted display can include an augmented reality display. In one aspect, a list of tags are displayed. The tags can be selected from a curated list of tags associated with a project the user is filming. For example, a project could comprise a building inspection during construction. In another aspect, the most commonly used tags in a given context can be shown. The most commonly used tags associated with a particular context can be determined through machine learning process. At a high level, a machine learning process can sort through historical tag data and associated contexts to determine a pattern correlating a context to a tag.