Abstract: Augmented reality with direct user interaction is described. In one example, an augmented reality system comprises a user-interaction region, a camera that captures images of an object in the user-interaction region, and a partially transparent display device which combines a virtual environment with a view of the user-interaction region, so that both are visible at the same time to a user. A processor receives the images, tracks the object's movement, calculates a corresponding movement within the virtual environment, and updates the virtual environment based on the corresponding movement. In another example, a method of direct interaction in an augmented reality system comprises generating a virtual representation of the object having the corresponding movement, and updating the virtual environment so that the virtual representation interacts with virtual objects in the virtual environment. From the user's perspective, the object directly interacts with the virtual objects.

Abstract: A display device which includes an electronic paper display additionally comprises power harvesting hardware and display update hardware which is configured to control the updating of the electronic paper display based on a sensed power harvesting level which may, in various embodiments, be a current incoming power level as generated by the power harvesting hardware or a stored power level in a power storage device within the display device.

Abstract: A wearable interactive device, such as a wearable identity badge is disclosed. When a user moves the device, such as to position a display (e.g., part) of the device a sensed distance at a sensed horizontal and vertical angle, the device outputs content that is based on the position. Context data also may be used in determining the content to output, as well as any other sensed data that may be available.

Abstract: A display device has both an emissive display and an electronic paper display. The electronic paper display is used for rendering visually static user input controls and a portion of the emissive display which is close to the electronic paper display is used for rendering visually dynamic user input controls. Also described are covers for an emissive display device, the covers comprising an electronic paper display device, and an emissive display device.

Abstract: An electronic paper display device comprises a layer of multi-stable material and one or more electrodes on one face of the layer of multi-stable material. Each electrode is electrically contactable on its underside through the layer of multi-stable material so that all electrodes in the electronic paper display device are electrically contactable on a single face of the electronic paper display device.

Abstract: Augmented reality with direct user interaction is described. In one example, an augmented reality system comprises a user-interaction region, a camera that captures images of an object in the user-interaction region, and a partially transparent display device which combines a virtual environment with a view of the user-interaction region, so that both are visible at the same time to a user. A processor receives the images, tracks the object's movement, calculates a corresponding movement within the virtual environment, and updates the virtual environment based on the corresponding movement. In another example, a method of direct interaction in an augmented reality system comprises generating a virtual representation of the object having the corresponding movement, and updating the virtual environment so that the virtual representation interacts with virtual objects in the virtual environment. From the user's perspective, the object directly interacts with the virtual objects.

Abstract: A system for determining a location of a mobile device is described. The system comprises receives a first time series dataset and a second time series dataset. The first data time series dataset records dynamic events in an infrastructure and the second time series dataset records dynamic events experienced by a mobile device, as captured by a sensor in the mobile device. The system further comprises a correlation engine which determines the location of the mobile device by correlating two or more data points from the first dataset with two or more data points from the second dataset.

Abstract: A method of fabricating a display comprising a plurality of autonomous pixels is described. Each autonomous pixel comprises a display element and a control element. The control element is configured to sense an external stimulus and to generate, entirely within the autonomous pixel, a control signal to drive the display element based, at least in part, on the magnitude of the sensed external stimulus.

Abstract: A display comprising a plurality of autonomous pixels is described. Each autonomous pixel comprises a display element and a control element. The control element is configured to sense an external stimulus and to generate, entirely within the autonomous pixel, a control signal to drive the display element based, at least in part, on the magnitude of the sensed external stimulus.

Abstract: A system provides a content service arranged to provide content for display on a display device which comprises an electronic paper display but which does not include a power source which is capable of providing sufficient power to update the electronic paper display. Instead, power is only provided to update the electronic paper display when in direct contact with a printer device. The power is provided via a contact based conductive digital data and power bus which also provides pixel data for content to be displayed on the electronic paper display. The display device further comprises a processing element which configured to drive the electronic paper display. The content service receives an identifier for a display device or printer device and identifies content based on the identifier received. The identified content is then transmitted to a printer device for display on a display device.

Abstract: A computer implemented method of processing content for display on an electronic paper display comprises generating both an image representing a piece of content stored in a content store and a token providing access to the piece of content in the content store. The image and the token are then transmitted to a display device comprising the electronic paper display directly or via one or more intermediary devices.

Abstract: A display device is described which comprises an electronic paper display, a transmitter, a digital data and power bus and a processor. The transmitter is configured to transmit data identifying content currently displayed on the electronic paper display. The digital data and power bus is arranged to receive pixel data for modified content associated with the transmitted data and the processor is configured to drive the electronic paper display; however, the electronic paper display can only be updated to display modified content when the display device is receiving power via the digital data and power bus.

Abstract: A display device comprises an electronic paper display, a security module, an input for receiving content for display on the electronic paper display and a processing element. The security module is arranged to store and/or generate a value that is periodically updated and to communicate the value to a proximate device. A proposed update to the displayed content is accompanied by a further value which is verified by the security module or by a remote content service before updating the content displayed on the electronic paper display.

Abstract: A display device is described that comprises an electronic paper display but that does not include a power source that is capable of providing sufficient power to update the electronic paper display. Instead, the electronic paper display can only be updated when receiving external power via a digital data and power bus. The bus also provides pixel data for content to be displayed on the electronic paper display and at least one externally generated bias voltage level for the electronic paper display. The display device further comprises a processor that configured to drive the electronic paper display.

Abstract: Systems and methods for reducing interference between multiple infra-red depth cameras are described. In an embodiment, the system comprises multiple infra-red sources, each of which projects a structured light pattern into the environment. A controller is used to control the sources in order to reduce the interference caused by overlapping light patterns. Various methods are described including: cycling between the different sources, where the cycle used may be fixed or may change dynamically based on the scene detected using the cameras; setting the wavelength of each source so that overlapping patterns are at different wavelengths; moving source-camera pairs in independent motion patterns; and adjusting the shape of the projected light patterns to minimize overlap. These methods may also be combined in any way. In another embodiment, the system comprises a single source and a mirror system is used to cast the projected structured light pattern around the environment.

Abstract: Systems and methods for reducing interference between multiple infra-red depth cameras are described. In an embodiment, the system comprises multiple infra-red sources, each of which projects a structured light pattern into the environment. A controller is used to control the sources in order to reduce the interference caused by overlapping light patterns. Various methods are described including: cycling between the different sources, where the cycle used may be fixed or may change dynamically based on the scene detected using the cameras; setting the wavelength of each source so that overlapping patterns are at different wavelengths; moving source-camera pairs in independent motion patterns; and adjusting the shape of the projected light patterns to minimize overlap. These methods may also be combined in any way. In another embodiment, the system comprises a single source and a mirror system is used to cast the projected structured light pattern around the environment.

Abstract: Real-time camera tracking using depth maps is described. In an embodiment depth map frames are captured by a mobile depth camera at over 20 frames per second and used to dynamically update in real-time a set of registration parameters which specify how the mobile depth camera has moved. In examples the real-time camera tracking output is used for computer game applications and robotics. In an example, an iterative closest point process is used with projective data association and a point-to-plane error metric in order to compute the updated registration parameters. In an example, a graphics processing unit (GPU) implementation is used to optimize the error metric in real-time. In some embodiments, a dense 3D model of the mobile camera environment is used.

Abstract: Inferring building metadata from distributed sensors is described. In an embodiment multiple sensors are situated at various locations in a building detecting physical quantities (e.g. light, heat, motion). The data from at least one sensor is analyzed in order to detect events occurring in proximity to the sensor. Data about an event detected at a first sensor is compared with events detected at other sensors in order to identify correlated events from which connections between the sensor locations can be inferred and a building layout generated. In some embodiments a threshold may be applied to the data in order to filter out false events. In some embodiments the building layout may be used as part of a building control system. In some embodiments the sensor data may be used to determine if the sensor has been moved.

Abstract: Speckle sensing for motion tracking is described, for example, to track a user's finger or head in an environment to control a graphical user interface, to track a hand-held device, to track digits of a hand for gesture-based control, and to track 3D motion of other objects or parts of objects in a real-world environment. In various examples a stream of images of a speckle pattern from at least one coherent light source illuminating the object, or which is generated by a light source at the object to be tracked, is used to compute an estimate of 3D position of the object. In various examples the estimate is transformed using information about position and/or orientation of the object from another source. In various examples the other source is a time of flight system, a structured light system, a stereo system, a sensor at the object, or other sources.

Abstract: Methods and systems for occupancy prediction using historical occupancy patterns are described. In an embodiment, an occupancy probability is computed by comparing a recent occupancy pattern to historic occupancy patterns. Sensor data for a room, or other space, is used to generate a table of past occupancy which comprises these historic occupancy patterns. The comparison which is performed identifies a number of similar historic occupancy patterns and data from these similar historic occupancy patterns is combined to generate an occupancy probability for a time in the future. In an example, time may be divided into discrete slots and binary values may be used to indicate occupancy or non-occupancy in each slot. An occupancy probability for a defined future time slot then comprises a combination of the binary values for corresponding time slots from each of the identified similar occupancy patterns.