Abstract: A sensing system includes a stretchable base material, a plurality of electrodes, a capacitive sensing channel and a controller. The stretchable base material has a resistance distribution that changes in response to being mechanically deformed as a result of a human body contact. The base material has a rebound elasticity. The electrodes are attached to a perimeter of the base material, the capacitive sensing channel is attached to the base material. The controller is operatively connected to the plurality of electrodes and the capacitive sensing channel. The controller is configured to measure instantaneous voltage measurements from the plurality of electrodes, and determine whether the base material is mechanically deformed based on the instantaneous voltage measurements using a support vector machine classifier.

Abstract: A method of manipulating a three-dimensional image file including a virtual object includes obtaining image information in a processing device of a non-instrumented physical object manipulated by a user, such image information including movement information; and causing virtual movement of the virtual object based on the movement information. A method of shaping a virtual object includes obtaining image information including movement information; and determining a shape of the virtual object based on the movement information. A method of modifying a virtual object includes obtaining image information including movement information; and altering a virtual surface appearance of at least a part of the virtual object based on the movement information. Systems and computer-readable media are also described.

Abstract: A method of operating an augmented reality (AR) system includes capturing images of a first real-world workspace using a camera of a first head mounted AR device of the AR system being worn by a first user, processing the images using a first processor of the AR system to identify physical objects in the first real-world workspace and detect 3D positions of the identified physical objects in a 3D space corresponding to the first real-world workspace, rendering virtual objects representing the identified physical objects on the display of the first head mounted AR device at the respective 3D positions for the identified physical objects, manipulating a first one of the virtual objects using at least one hand-held controller of the AR system in a manner that mimics a performance of a first procedural task using the physical object associated with the first one of the virtual objects, recording the manipulation of the first one of the virtual objects that mimics the performance of the first procedural task as fi

Abstract: A method using a two-dimensional (2D) image representation of three-dimensional (3D) geometric objects in a machine learning framework has been developed. The method includes generating a single 2D geometry image corresponding to a 3D object model, and providing the single geometry image as input to a shape analysis task to enable shape analysis of the 3D object model based only on information encoded in the single 2D geometry image in the machine learning framework.

Abstract: Techniques are disclosed relating to data compression. In some embodiments, compression circuitry determines, at least partially in parallel for multiple different lossless compression techniques, amounts of data needed to represent, using a given lossless compression technique of the multiple lossless compression techniques, individual pixels in a set of pixels being compressed. The compression techniques may include neighbor, origin, and gradient techniques, for example. The compression circuitry may select one of the compression techniques based on comparison, among the compression techniques, of sums of: the determined amount of data for an individual pixel for a given lossless compression technique and compression metadata size for a given lossless compression technique. The compression circuitry may generate and store information that encodes values for the set of pixels using the selected compression technique.

Abstract: An augmented reality system for developing and providing augmented reality learning experiences is disclosed. The augmented reality system advantageously combines augmented reality with the capabilities of cloud technology to provide a pull-based collaborative model, in which students and instructors collaborate by uploading, sharing, and downloading augmented reality learning content. The augmented reality system enables students to improve the augmented reality learning content by adding contributions to the original augmented reality learning content that was created by an instructor.

Abstract: A virtual reality system, comprising an electronic 2d interface having a depth sensor, the depth sensor allowing a user to provide input to the system to instruct the system to create a virtual 3D object in a real-world environment. The virtual 3D object is created with reference to at least one external physical object in the real-world environment, with the external physical object concurrently displayed with the virtual 3D object by the interface. The virtual 3D object is based on physical artifacts of the external physical object.

Abstract: A unique storytelling system is disclosed herein in which a plug-and-play hardware platform with an integrated augmented reality (AR) environment brings stories to life. The storytelling system includes an electronics toolkit and a structure toolkit which enable the user to prototype interactive physical devices for storytelling. The interactive physical devices crafted by the user are easily programmed using a simple visual programing environment of the storytelling system. Additionally, a story event planning tool of the storytelling system enables the user to create customized interactions between the interactive physical devices and virtual AR objects, such as virtual AR avatars or the like. Finally, an AR storytelling application of the storytelling system utilizes an AR device, such as a smartphone, to bring the interactive physical devices to life and enable the user to tell stories using the custom interactions that he or she created.

Abstract: A method and system for localizing a plurality of stationary devices, such as Internet of Things (IoT devices), arranged in an environment is disclosed. A mobile device is configured to survey an environment to generate a three-dimensional map of the environment using simultaneous localization and mapping (SLAM) techniques. The mobile device and the stationary devices are equipped with wireless transceivers, such as Ultra-wideband radios, for measuring distances between the devices using wireless ranging techniques. Based on the measured distances, the mobile device is configured to determine locations of the stationary devices in a reference frame of the three-dimensional map. In some embodiments, the determined locations can be used to enable a variety of spatially aware augmented reality features and interactions between the mobile device and the stationary device.

Abstract: Techniques are disclosed relating to data compression. In some embodiments, compression circuitry determines, at least partially in parallel for multiple different lossless compression techniques, a number of bits needed to represent a least compressible pixel, using that technique, in a set of pixels being compressed. The compression techniques may include neighbor, origin, and gradient techniques, for example. The compression circuitry may select one of the compression techniques based on the determined numbers of bits for the multiple compression techniques and corresponding header sizes. In some embodiments, the compression circuitry determines, for multiple regions of pixels in the set of pixels, for ones of the compression techniques, a region number of bits needed to represent a least compressible pixel, using that technique. The selection of a compression technique may be further based on region numbers of bits.

Abstract: A method of operating an augmented reality (AR) system includes capturing images of a first real-world workspace using a camera of a first head mounted AR device of the AR system being worn by a first user, processing the images using a first processor of the AR system to identify physical objects in the first real-world workspace and detect 3D positions of the identified physical objects in a 3D space corresponding to the first real-world workspace, rendering virtual objects representing the identified physical objects on the display of the first head mounted AR device at the respective 3D positions for the identified physical objects, manipulating a first one of the virtual objects using at least one hand-held controller of the AR system in a manner that mimics a performance of a first procedural task using the physical object associated with the first one of the virtual objects, recording the manipulation of the first one of the virtual objects that mimics the performance of the first procedural task as fi

Abstract: A method for hand pose identification in an automated system includes providing depth map data of a hand of a user to a first neural network trained to classify features corresponding to a joint angle of a wrist in the hand to generate a first plurality of activation features and performing a first search in a predetermined plurality of activation features stored in a database in the memory to identify a first plurality of hand pose parameters for the wrist associated with predetermined activation features in the database that are nearest neighbors to the first plurality of activation features. The method further includes generating a hand pose model corresponding to the hand of the user based on the first plurality of hand pose parameters and performing an operation in the automated system in response to input from the user based on the hand pose model.

Abstract: A single volume soft sensor capable of sensing real-time continuous contact and stretching. A low-cost and an easy method to fabricate such piezoresistive elastomer-based soft sensors for instant interactions is also provided. An electrical impedance tomography (EIT) technique is employed to estimate changes of resistance distribution on the sensor caused by fingertip contact. To compensate for the rebound elasticity of the elastomer and achieve real-time contact sensing, an adaptive baseline update for EIT is utilized. The baseline updates are triggered by fingertip contact and movement detections.

Abstract: Some examples provides a set of frameworks, process and methods aimed at enabling the expression and exploration of free-form and parametric 3D shape designs enabled through natural interactions with a hand-held mobile device acting as a controller for 3D virtual objects. A reference plane in a virtual space generated by the location of the mobile device may be used to select a 3D virtual object intersected by the reference plane. Positioning of the mobile device may also be used to control a pointer in the virtual space. In an example, the orientation of the mobile device may be detected by an accelerometer or gyroscope. In example, the position of the mobile device may be detected by a position sensor.

Abstract: A machine task tutorial system is disclosed that utilizes augmented reality to enable an expert user to record a tutorial for a machine task that can be learned by different trainee users in an adaptive manner. The machine task tutorial system advantageously utilizes an adaptation model that focuses on spatial and bodily visual presence for machine task tutoring. The machine task tutorial system advantageously enables adaptive tutoring in the recorded-tutorial environment based on machine state and user activity recognition. The machine task tutorial system advantageously utilizes AR to provide tutorial recording, adaptive visualization, and state recognition. In this way, the machine task tutorial system supports more effective apprenticeship and training for machine tasks in workshops or factories.

Abstract: A method and system for enabling a self-localizing mobile device to localize other self-localizing mobile devices having different reference frames is disclosed. Multiple self-localizing mobile devices are configured to survey an environment to generate a three-dimensional map of the environment using simultaneous localization and mapping (SLAM) techniques. The mobile devices are equipped with wireless transceivers, such as Ultra-wideband radios, for measuring distances between the mobile devices using wireless ranging techniques. Based on the measured distances and self-localized positions in the environment corresponding to each measured distance, at least one of the mobile devices is configured to determine relative rotational and translational transformations between the different reference frames of the mobile devices.

Abstract: A sensing system includes a stretchable base material, a plurality of electrodes, a capacitive sensing channel and a controller. The stretchable base material has a resistance distribution that changes in response to being mechanically deformed as a result of a human body contact. The base material has a rebound elasticity. The electrodes are attached to a perimeter of the base material, the capacitive sensing channel is attached to the base material. The controller is operatively connected to the plurality of electrodes and the capacitive sensing channel. The controller is configured to measure instantaneous voltage measurements from the plurality of electrodes, and determine whether the base material is mechanically deformed based on the instantaneous voltage measurements using a support vector machine classifier.

Abstract: Techniques are disclosed relating to filtering cache accesses. In some embodiments, a control unit is configured to, in response to a request to process a set of data, determine a size of a portion of the set of data to be handled using a cache. In some embodiments, the control unit is configured to determine filtering parameters indicative of a set of addresses corresponding to the determined size. In some embodiments, the control unit is configured to process one or more access requests for the set of data based on the determined filter parameters, including: using the cache to process one or more access requests having addresses in the set of addresses and bypassing the cache to access a backing memory directly, for access requests having addresses that are not in the set of addresses. The disclosed techniques may reduce average memory bandwidth or peak memory bandwidth.

Abstract: Some examples provides a set of frameworks, process and methods aimed at enabling the expression and exploration of free-form and parametric 3D shape designs enabled through natural interactions with a hand-held mobile device acting as a controller for 3D virtual objects. A reference plane in a virtual space generated by the location of the mobile device may be used to select a 3D virtual object intersected by the reference plane. Positioning of the mobile device may also be used to control a pointer in the virtual space. In an example, the orientation of the mobile device may be detected by an accelerometer or gyroscope. In example, the position of the mobile device may be detected by a position sensor.

Abstract: A system and method for authoring and implementing context-aware applications (CAPs) are disclosed. The system and method enables users to record their daily activities and then build and deploy customized CAPs onto augmented reality platforms in which automated actions are performed in response to user-defined human actions. The system and method utilizes an integrated augmented reality platform composed of multiple camera systems, which allows for non-intrusive recording of end-users' activities and context detection while authoring and implementing CAPs. The system and method provides an augmented reality authoring interface for browsing, selecting, and editing recorded activities, and creating flexible CAPs through spatial interaction and visual programming.