Abstract: Autonomous vehicles use various computing systems to transport passengers from one location to another. A control computer sends messages to the various systems of the vehicle in order to maneuver the vehicle safely to the destination. The control computer may display information on an electronic display in order to allow the passenger to understand what actions the vehicle may be taking in the immediate future. Various icons and images may be used to provide this information to the passenger.

Abstract: A passenger in an automated vehicle may relinquish control of the vehicle to a control computer when the control computer has determined that it may maneuver the vehicle safely to a destination. The passenger may relinquish or regain control of the vehicle by applying different degrees of pressure, for example, on a steering wheel of the vehicle. The control computer may convey status information to a passenger in a variety of ways including by illuminating elements of the vehicle. The color and location of the illumination may indicate the status of the control computer, for example, whether the control computer has been armed, is ready to take control of the vehicle, or is currently controlling the vehicle.

Abstract: In an embodiment of the present invention, a GraphSLAM-like algorithm for signal strength SLAM is presented. This algorithm as an embodiment of the present invention shares many of the benefits of Gaussian processes yet is viable for a broader range of environments since it makes no signature uniqueness assumptions. It is also more tractable to larger map sizes, requiring O(N2) operations per iteration. In the present disclosure, an algorithm according to an embodiment of the present invention is compared to a laser-SLAM ground truth, showing that it produces excellent results in practice.

Abstract: A system and process of morphing location-referenced panoramic images into views at nearby locations. When using panoramic images in an interactive tour, a user might desire to see the environment from viewpoints for which no panoramic images are available. This invention makes this possible. It enables a user to experience views from arbitrary locations in the environment, so as long as one or more panoramic images are available at nearby locations. In particular, this invention makes it possible to combine two non-overlapping geo-referenced panoramic video streams into a new video stream which seamlessly transitions between these streams. When used in a client-server architecture, this invention also makes it possible for the server to transmit a sparse sequence of panoramic images, and provide the user with a dense panoramic video stream, by synthesizing the missing panoramic images. Said system and process is also applicable to incomplete panoramic images, photographs, and video.

Abstract: A system and process for attaching tags to panoramic video. Tags provide information when viewing panoramic images, serve as references to specific actions and serve as reference for outside systems into a panoramic image database. Objects in a video can be tagged. It defines tags through 4-D time-space curves, which specify the 3-D location of a tagged object over time. It provides a user-friendly mechanism for defining said curves in panoramic video, which rely on curve fitting techniques to minimize the number of images to be labeled. It provides a mechanism for annotating tags with further information. When displaying tagged panoramic video, tags are graphically superimposed on the panoramic video feed using projective projection techniques. From this visualization, a user can then select a given tag and invoke an associated action. Additionally a mechanism whereby tags and associated user-provided information are used as index into panoramic image databases is provided.

Abstract: According to various embodiments, a user interface (UI) includes a precedence graph area and an icon list displaying multiple types of program icons. A user selection of one of the program icons is received, the user selection corresponding to moving the selected program icon to the precedence graph area, the selected program icon referencing a composer UI to generate content of a specific media type. The selected program icon is characterized as a first program-content-pairing icon that references the content created by the composer UI. Thereafter, a user interaction with a plurality of program-content-pairing icons in the precedence graph area is detected, the user interaction corresponding to specifying an ordering of the plurality of program-content-pairing icons. A program flow precedence graph referencing a program flow of an interactive program is the generated, based on the ordering of the program-content-pairing icons in the precedence graph area.

Abstract: Aspects of the present disclosure relate generally to indoor localization, for example, where GPS or other localization signals are unavailable. More particularly, the estimated location, and in some examples the estimated heading, of a client device may be displayed on a display of the client device. As the device is moved through the indoor space, its location and/or orientation may be estimated based on measurements from one or more orientation devices. Typically, as the client device moves through an indoor space, the location estimation may become less and less accurate. This may be addressed by allowing the user to correct the current location and/or heading. The correction may be logged by the client device and transmitted to a server for further processing.

Abstract: Methods and devices for providing a user-interface are disclosed. In one embodiment, the method comprises receiving data corresponding to a first position of a wearable computing device and responsively causing the wearable computing device to provide a user-interface. The user-interfaces comprises a view region and a menu, where the view region substantially fills a field of view of the wearable computing device and the menu is not fully visible in the view region. The method further comprises receiving data indicating a selection of an item present in the view region and causing an indicator to be displayed in the view region, wherein the indicator changes incrementally over a length of time. When the length of time has passed, the method comprises responsively causing the wearable computing device to select the item.

Abstract: Velocity controllers in accordance with embodiments of the invention enable velocity estimation for tracked objects. One embodiment includes a tracker controller, including: a processor, and a memory containing: a velocity tracker application; a state space describing relationships between measured locations, calculated locations, and changes in locations, where the calculated locations in the state space correspond to unoccluded points on the surface of the tracked object; wherein the processor is configured by the velocity tracker application to: pre-process the state space to identify a tracked object; estimate a velocity of the tracked object using a location history calculated from the measured locations of the tracked object within the state space and a motion model calculated from the state space; and return the velocity of the tracked object.

Abstract: In an embodiment of the present invention, a GraphSLAM-like algorithm for signal strength SLAM is presented. This algorithm as an embodiment of the present invention shares many of the benefits of Gaussian processes yet is viable for a broader range of environments since it makes no signature uniqueness assumptions. It is also more tractable to larger map sizes, requiring O(N2) operations per iteration. In the present disclosure, an algorithm according to an embodiment of the present invention is compared to a laser-SLAM ground truth, showing that it produces excellent results in practice.

Abstract: According to various embodiments, a user interface (UI) includes a precedence graph area and an icon list displaying multiple types of program icons. A user selection of one of the program icons is received, the user selection corresponding to moving the selected program icon to the precedence graph area, the selected program icon referencing a composer UI to generate content of a specific media type. The selected program icon is characterized as a first program-content-pairing icon that references the content created by the composer UI. Thereafter, a user interaction with a plurality of program-content-pairing icons in the precedence graph area is detected, the user interaction corresponding to specifying an ordering of the plurality of program-content-pairing icons. A program flow precedence graph referencing a program flow of an interactive program is the generated, based on the ordering of the program-content-pairing icons in the precedence graph area.

Abstract: A passenger in an automated vehicle may relinquish control of the vehicle to a control computer when the control computer has determined that it may maneuver the vehicle safely to a destination. The passenger may relinquish or regain control of the vehicle by applying different degrees of pressure, for example, on a steering wheel of the vehicle. The control computer may convey status information to a passenger in a variety of ways including by illuminating elements of the vehicle. The color and location of the illumination may indicate the status of the control computer, for example, whether the control computer has been armed, is ready to take control of the vehicle, or is currently controlling the vehicle.

Abstract: Autonomous vehicles use various computing systems to transport passengers from one location to another. A control computer sends messages to the various systems of the vehicle in order to maneuver the vehicle safely to the destination. The control computer may display information on an electronic display in order to allow the passenger to understand what actions the vehicle may be taking in the immediate future. Various icons and images may be used to provide this information to the passenger.

Abstract: A variety of methods, systems, devices and arrangements are implemented for use with motion capture. One such method is implemented for identifying salient points from three-dimensional image data. The method involves the execution of instructions on a computer system to generate a three-dimensional surface mesh from the three-dimensional image data. Lengths of possible paths from a plurality of points on the three-dimensional surface mesh to a common reference point are categorized. The categorized lengths of possible paths are used to identify a subset of the plurality of points as salient points.

Abstract: The present invention provides a system and computerized method for receiving image information and translating it to computer inputs. In an embodiment of the invention, image information is received for a predetermined action space to identify an active body part. From such image information, depth information is extracted to interpret the actions of the active body part. Predetermined gestures can then be identified to provide input to a computer. For example, gestures that can be interpreted to mimic computerized touchscreen operation. Also, touchpad or mouse operations can be mimicked.

Abstract: Methods and devices for providing a user-interface are disclosed. In one aspect, a head-mounted-device system includes a processor data storage comprising user-interface logic executable by the at least one processor to receive data corresponding to first position of a head-mounted display (HMD) and responsively cause the HMD to display a user-interface comprising a view region, at least one content region located above the view region, and a history region located below the view region. The user-interface logic is further executable to receive data corresponding to an left or right movement of the HMD and responsively cause the HMD to move the field of view such that the at least one content region becomes more visible, for example, scrolling an item in a user interface. The scrolling may have a non-linear relationship with the head movement speed.

Abstract: Systems, devices, methods and arrangements are implemented in a variety of embodiments to facilitate motion capture of objects. Consistent with one such system, three-dimensional representations are determined for at least one object. Depth-based image data is used in the system, which includes a processing circuit configured and arranged to render a plurality of orientations for at least one object. Orientations from the plurality of orientations are assessed against the depth-based image data. An orientation is selected from the plurality of orientations as a function of the assessment of orientations from the plurality of orientations.

Abstract: An electronic device includes a band configured to be worn on the head of a user. The band has a central portion and first and second temple portions extending therefrom. The central portion is configured to contact a portion of the face of a user, and the temple portions are configured to contact portions of the head of the user near ears thereof. An operational unit having a display element is affixed to the first temple portion and includes a housing having an arm defining a longitudinal axis. The housing also includes an elbow portion defining a display end that supports the display element such that it extends along a display axis angled with respect to the longitudinal axis and such that the display element is positionable over an eye of the user. Image generating means are disposed within the housing for generating an image presentable on the display element.

Abstract: Exemplary methods and systems involve chord-based authentication on a touch-based interface. An exemplary method may involve: (a) providing a user-interface on a touch-based interface of a computing device, wherein the user-interface comprises a plurality of input regions; (b) receiving input data corresponding to a plurality of touch interactions on the touch-based interface; (c) determining a sequence of chords from the input data, wherein each chord is defined by touch interaction with a certain combination of one or more of the input regions; (d) determining that the sequence of chords substantially matches a predetermined chord authentication sequence; and (e) responsive to the match, causing a computing device to make at least one function accessible.

Abstract: Methods and systems involving navigation of a graphical interface are disclosed herein. An example system may be configured to: (a) cause a head-mounted display (HMD) to provide a graphical interface, the graphical interface comprising (i) a view port having a view-port orientation and (ii) at least one navigable area having at least one border, the at least one border having a first border orientation; (b) receive input data that indicates movement of the view port towards the at least one border; (c) determine that the view-port orientation is within a predetermined threshold distance from the first border orientation; and (d) based on at least the determination that the view-port orientation is within a predetermined threshold distance from the first border orientation, adjust the first border orientation from the first border orientation to a second border orientation.