Abstract: A computing system and method for producing and consuming metadata within multi-dimensional data is provided. The computing system comprising a see-through display, a sensor system, and a processor configured to: in a recording phase, generate an annotation at a location in a three dimensional environment, receive, via the sensor system, a stream of telemetry data recording movement of a first user in the three dimensional environment, receive a message to be recorded from the first user, and store, in memory as annotation data for the annotation, the stream of telemetry data and the message, and in a playback phase, display a visual indicator of the annotation at the location, receive a selection of the visual indicator by a second user, display a simulacrum superimposed onto the three dimensional environment and animated according to the telemetry data, and present the message via the animated simulacrum.

Abstract: A method is disclosed that includes accessing a building information modeling database comprising building information data of a structure. A position of a head-mounted display device with respect to the structure may be tracked, with the head-mounted display device comprising an at least partially see-through display. In response to a portal user input, a world-locked holographic portal may be displayed via the device on a surface of the structure, where the portal comprises a world-locked holographic representation of a portion of the structure otherwise hidden from view by the surface. In response to an operation user input, a virtual operation is performed on the structure, and the building information modeling database is updated based on the virtual operation.

Abstract: A computing system and method for producing and consuming metadata within multi-dimensional data is provided. The computing system comprising a see-through display, a sensor system, and a processor configured to: in a recording phase, generate an annotation at a location in a three dimensional environment, receive, via the sensor system, a stream of telemetry data recording movement of a first user in the three dimensional environment, receive a message to be recorded from the first user, and store, in memory as annotation data for the annotation, the stream of telemetry data and the message, and in a playback phase, display a visual indicator of the annotation at the location, receive a selection of the visual indicator by a second user, display a simulacrum superimposed onto the three dimensional environment and animated according to the telemetry data, and present the message via the animated simulacrum.

Abstract: A person is viewing a display. By evaluating tracked information about the person, the display and/or the content being viewed, a tracking system determines that an opportunity exists to present an advertisement that is relevant to the person in the context of the person currently viewing the display. The tracking system provides advertiser data for the advertisement and instructions for generating the advertisement to a synthesis system local to the viewer and the viewer's display system, which dynamically synthesizes the advertisement and provides it to the display.

Abstract: A radio-frequency identification (RFID) device, or other type of device that transmits data in response to a broadcast of energy, may have a switch. The switch may allow an operator to signal whether the device will transmit data when energized. The switch could also allow an operator to select a particular item of data, or a combination of items of data, to be transmitted. Receiving data reflected from the device may signify an action to be performed, or may signify the fact that some physical action (e.g., pressing, by a human finger) has occurred with respect to the device. Thus, device that transmit data when energized may be used to direct the operation of other devices (e.g., by turning such other devices on or off), to implement tactilely-sensitive displays, or as part of other applications.

Abstract: A person is viewing a display. By evaluating tracked information about the person, the display and/or the content being viewed, a tracking system determines that an opportunity exists to present an advertisement that is relevant to the person in the context of the person currently viewing the display. The tracking system provides advertiser data for the advertisement and instructions for generating the advertisement to a synthesis system local to the viewer and the viewer's display system, which dynamically synthesizes the advertisement and provides it to the display.

Abstract: A person is viewing a display. By evaluating tracked information about the person, the display and/or the content being viewed, a tracking system determines that an opportunity exists to present an advertisement that is relevant to the person in the context of the person currently viewing the display. The tracking system provides advertiser data for the advertisement and instructions for generating the advertisement to a synthesis system local to the viewer and the viewer's display system, which dynamically synthesizes the advertisement and provides it to the display.

Abstract: A system and related techniques integrate the accessing, retrieving and playback of enhanced music or other digital media or content, including to permit advanced authoring, mixing and environmental inputs and effects. According to embodiments of the invention in one regard, a user may access a playback engine to retrieve and dynamically mix, manage and integrate music content with environmental sensors and effects such as detection people or numbers or people, lighting effects and other sensory experience. Thus the tempo of a mixed music track may vary with the number or persons in a room or the time of day or night, or lighting effects may brighten or dim based on dynamic contrasts in the music or other content. According to further embodiments, the playback engine may permit a user to link or navigate to other community resources such as a Web site detailing an artist, album, movie or soundtrack, or a bulletin board for consumers with an interest in artists, actors or others.

Abstract: A radio-frequency identification (RFID) device, or other type of device that transmits data in response to a broadcast of energy, may have a switch. The switch may allow an operator to signal whether the device will transmit data when energized. The switch could also allow an operator to select a particular item of data, or a combination of items of data, to be transmitted. Receiving data reflected from the device may signify an action to be performed, or may signify the fact that some physical action (e.g., pressing, by a human finger) has occurred with respect to the device. Thus, device that transmit data when energized may be used to direct the operation of other devices (e.g., by turning such other devices on or off), to implement tactilely-sensitive displays, or as part of other applications.