Abstract: A free space input standard is instantiated on a processor. Free space input is sensed and communicated to the processor. If the free space input satisfies the free space input standard, a touch screen input response is invoked in an operating system. The free space input may be sensed using continuous implicit, discrete implicit, active explicit, or passive explicit approaches. The touch screen input response may be invoked through communicating virtual touch screen input, a virtual input event, or a virtual command to or within the operating system. In this manner free space gestures may control existing touch screen interfaces and devices, without modifying those interfaces and devices directly to accept free space gestures.

Abstract: A method, system, apparatus, and/or device for sensing an input in an augmented reality construct. The method, system, apparatus, and/or device may include a mixed-reality device, comprises memory and one or more processors communicatively coupled to a sensor, a touch device, and a display device that is at least partially transparent and configured to display a virtual object. The store instructions executable by the one or more processors to generate virtual object data for displaying a virtual object by the display device; output the virtual object data to the display device; receive, from the sensor, interaction data corresponding to a free-space interaction by a hand of a user with the virtual object; generate touch input data based on the interaction data; and output the touch input data to the touch device.

Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.

Abstract: To enhance a mono-output-only controller such as a mobile OS to support selective mono/stereo/mixed output, a stereo controller is instantiated in communication with the mono controller. The stereo controller coordinates stereo output, but calls and adapts functions already present in the mono controller for creating surface and image buffers, rendering, compositing, and/or merging. For content designated for 2D display, left and right surfaces are rendered from a mono perspective; for content designated for 3D display, left and right surfaces are rendered from left and right stereo perspectives, respectively. Some, all, or none of available content may be delivered to a stereo display in 3D, with a remainder delivered in 2D, and with comparable content still delivered in 2D to the mono display. The stereo controller is an add-on; the mono controller need not be replaced, removed, deactivated, or modified, facilitating transparency and backward compatibility.

Abstract: Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include projecting a ray from a user device to a ground plane and determining an angle at which the projected ray touches the ground plane. The method further helps determine a level for the ground plane for positioning the 3D model of the object in the 2D environment.

Abstract: A method, system, apparatus, and/or device for adjusting a task or a task flow in an augmented reality environment. The method, system, apparatus, and/or device may include: identifying a first task in a task flow to collect data associated with a user performing the first task; collecting a first set of data associated with the user performing the first task; comparing an amount of time the user expends to perform the first task to a first threshold amount of time; and in response to the amount of time the user expends to perform the first task exceeding the first threshold amount of time displaying a notification to the user or another device.

Abstract: Methods for providing simultaneous access to a hardware data stream to multiple applications are disclosed. The first application to access a hardware device is responsible for providing and publishing an application programming interface (API) that provides access to the hardware device's data stream, which other applications can then call to gain access to the data stream. In some examples, the first application may be a server process or daemon dedicated to managing the hardware device data stream and publishing the API. In some further examples, the first application may instead may carry out user functionality unrelated to managing the hardware device.

Abstract: Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include capturing the 2D environment and adding scale and perspective to the 2D environment. Further, a user may select intersection points on a ground plane of the 2D environment to form walls, thereby converting the 2D environment into a 3D space. The user may further add 3D models of objects on the wall plane such that the objects may remain flush with the wall plane.

Abstract: A system, apparatus, device, or method to output different iterations of data entities. The method may include establishing a first data entity; establishing a first state for the first data entity. The method may include establishing a second state for the first data entity. The method may include storing the first data entity, the first state, and the second state at a storage device. The method may include retrieving a first iteration of the first data entity exhibiting at least a portion of the first state. The method may include retrieving a second iteration of the first data entity exhibiting at least a portion of the second state. The method may include outputting the first iteration and the second iteration at an output time.

Abstract: A method includes sensing entities in first and second domains. If a first stimulus is present and an entity is in the first domain, the entity is transferred from first to second domain via a bridge. If a second stimulus is present and an entity is in the second domain, the entity is transferred from second first domain via the bridge. At least some of the first domain is outputted. An apparatus includes a processor that defines first and second domains and a bridge that enables transfer of entities between domains, an entity identifier that identifies entities in the domains, a stimulus identifier that identifies stimuli, and a display that outputs at least some of the first domain. The processor transfers entities from first to second domain responsive to a first stimulus, and transfers entities from second to first domain responsive to a second stimulus.

Abstract: A method, system, apparatus, and/or device that may include a first optic located a first distance from an optical receiver, the first optic being adapted to: receive environment content from a location in front of the first optic relative to the optical receiver; and alter a focal vergence of the environment content. The method, system, apparatus, and/or device may include a display located a second distance from the optical receiver, the display being is adapted to: receive the environment content from the first optic; and deliver the environment content and display content to a second optic. The method, system, apparatus, and/or device may include the second optic located a third distance from the optical receiver, the second optic being is adapted to: receive the environment content and the display content from the display; alter the focal vergence of the environment content; and alter a focal vergence of the display content.

Abstract: A method, system, apparatus, and/or device for executing a translation instruction for a constructive movement. The method, system, apparatus, and/or device may include an input device configured to sense a first constructive movement input representative of a non-translational movement of a body of a user that does not move from a first point to a second point in the physical world environment. The method, system, apparatus, and/or device may include a processing device coupled to the input device, where the processing device is configured to execute a translational instruction associated with the first constructive movement input, execute a first resizing instruction to reduce a size of a portion of the physical world environment as displayed by a head-mounted display by an amount indicated by the first resizing stimulus, receive a second constructive movement input, and execute a second translational instruction associated with the second constructive translational movement input.

Abstract: Disclosed are methods and apparatuses to recognize actors during normal system operation. The method includes defining actor input such as hand gestures, executing and detecting input, and identifying salient features of the actor therein. A model is defined from salient features, and a data set of salient features and/or model are retained, and may be used to identify actors for other inputs. A command such as “unlock” may be executed in response to actor input. Parameters may be applied to further define where, when, how, etc. actor input is executed, such as defining a region for a gesture. The apparatus includes a processor and sensor, the processor defining actor input, identifying salient features, defining a model therefrom, and retaining a data set. A display may also be used to show actor input, a defined region, relevant information, and/or an environment. A stylus or other non-human actor may be used.

Abstract: A method, system, apparatus, and/or device for sensing an input in an augmented reality construct. The method, system, apparatus, and/or device may include a processing device and a sensor. The processing device may be configured to determine a virtual boundary within an augmented reality construct, define a first portion of the virtual boundary within the augmented reality construct, and define a second portion of the virtual boundary within the augmented reality construct. The sensor may be sense a first input from an end-effector within the first portion of the virtual boundary and sense a second input from the end-effector within the second portion of the virtual boundary, where the processing device may further generate a device input that corresponds to the first input and the second input and send the device input to another device.

Abstract: In the method, a processor generates a three dimensional interface with at least one virtual object, defines a stimulus of the interface, and defines a response to the stimulus. The stimulus is an approach to the virtual object with a finger or other end-effector to within a threshold of the virtual object. When the stimulus is sensed, the response is executed. Stimuli may include touch, click, double click, peg, scale, and swipe gestures. The apparatus includes a processor that generates a three dimensional interface with at least one virtual object, and defines a stimulus for the virtual object and a response to the stimulus. A display outputs the interface and object. A camera or other sensor detects the stimulus, e.g. a gesture with a finger or other end-effector, whereupon the processor executes the response. The apparatus may be part of a head mounted display.

Abstract: A method, system, apparatus, and/or device for adjusting or removing frames in a set of frames. The method, system, apparatus, and/or device may include: associating a first frame of a set of frames with motion data that is captured approximately contemporaneously with the first frame; when a sampling rate of the motion data is greater than a frame rate of the set of frames, aggregating a first sample of the motion data captured at the first frame and a second sample of the motion data captured between the first frame and a second frame of the set of frames to obtain a movement value; when the movement value does not exceed a first threshold value, accepting the first frame from the set of frames; and when the movement value exceeds the first threshold value, rejecting the first frame from the set of frames.

Abstract: A data space such as a virtual/augmented reality environment is generated, through which a viewer/point of view may move. The physical world motion of a display outputting the data space is sensed, received, or computed. The motion of a physical world environment in which the display also is sensed, received, or computed. An output adjustment is determined from the display and environment motions, typically being equal to the environment motion(s). Motion of a point of view within the data space to be outputted by the display is determined. The viewpoint motion corresponds with the display motion within physical space adjusted by the output adjustment. At least part of the data space is outputted to the display from the point of view. The point of view is navigated through the data space according to the viewpoint motion.

Abstract: A method, system, apparatus, and/or device for displaying a portion of data so as to not obstruct a portion of a central visual field. The method, system, apparatus, and/or device may include a display configured to display data and a processing device coupled to the display. The processing device may be configured to determine a position of an eye of a viewer with respect to the display, define a first region of the display substantially corresponding with a peripheral vision field of the eye, define a second region of the display substantially corresponding with a central visual field of the eye, send a first portion of the data to be displayed at the first region, and send a second portion of the data to be displayed at the second output region such that a portion of the central visual field is unobstructed by the second portion of the data.

Abstract: Switching among sensor feeds for optimum performance includes disposing a processor in communication with sensors, each said sensor providing a primary data stream. A data stream standard is established in the processor. The primary data streams are communicated from the sensors to the processor, and are compared against the data stream in the processor. A secondary data stream is selected from among the primary data streams or synthesized from one or more of the primary data streams, based on which primary data stream(s) most closely match the data stream standard. The secondary data stream is communicated to a data stream recipient. The data stream recipient may identify input in the secondary data stream, and an input executor may execute control commands corresponding to the input so as to control a device or system.

Abstract: A free space input standard is instantiated on a processor. Free space input is sensed and communicated to the processor. If the free space input satisfies the free space input standard, a touch screen input response is invoked in an operating system. The free space input may be sensed using continuous implicit, discrete implicit, active explicit, or passive explicit approaches. The touch screen input response may be invoked through communicating virtual touch screen input, a virtual input event, or a virtual command to or within the operating system. In this manner free space gestures may control existing touch screen interfaces and devices, without modifying those interfaces and devices directly to accept free space gestures.