Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a reinforcement learning system. The method includes: training an action selection policy neural network, and during the training of the action selection neural network, training one or more auxiliary control neural networks and a reward prediction neural network. Each of the auxiliary control neural networks is configured to receive a respective intermediate output generated by the action selection policy neural network and generate a policy output for a corresponding auxiliary control task. The reward prediction neural network is configured to receive one or more intermediate outputs generated by the action selection policy neural network and generate a corresponding predicted reward.

Abstract: A slidable accessory system includes a case body configured to accommodate a portable electronic device, the case body having a case length and two tracks spanning from a track top and extending along at least a portion of the case length towards a bottom of the case body. The slidable accessory system also includes a platform having two engaging arms each of which is adapted to slidably engage within a corresponding one of the two tracks. An accessory is attachable to a top side of the platform.

Abstract: An accessory assembly for a mobile electronic device includes a platform, having a first side and an opposing second side. The platform includes one or more magnetic elements configured to magnetically attach the platform to a mobile electronic device or case along the first side. The accessory assembly also includes a wallet integrated with or attached to the second side of the platform, where the wallet is configured to hold one or more objects associated with a user of the accessory. The assembly also includes a grip accessory configured to attach to the wallet, where the grip accessory is configured to be handheld in order to support the accessory assembly and mobile electronic device when magnetically attached to the platform.

Abstract: A piano training device is described herein. The piano training device comprising a plurality of keys which may be illuminated by a light source associated with each key. The light source associated with each key is oriented such that the light source transmits light toward the front surface of the key. The key is further manufactured so that the light transmitted toward the front surface of the key is redirected to the top surface of the key.

Abstract: A piano training device is described herein. The piano training device comprising a plurality of keys which may be illuminated by a light source associated with each key. The light source associated with each key is oriented such that the light source transmits light toward the front surface of the key. The key is further manufactured so that the light transmitted toward the front surface of the key is redirected to the top surface of the key.

Abstract: The invention disclosed herein is a system and method to locate lost objects. The system (1000) is comprised of at least one accessory, at least one computing device (e.g. smartphone, tablet, lap top), and at least one remote device. In one embodiment, the accessory computing device, and remote device may further comprise a compass, gyro, and/or accelerometer. In one embodiment the accessory and/or remote device may be embedded in sporting, outdoor, and working gear/tools.

Abstract: One embodiment of the practical framework for production of apparel articles incorporating electronic devices such as wired speakers. This framework securely locates the desired electronic (1) and applique elements (9, 10). The materials of which the substrate (3, 4, 6, 7) is comprised possess distinct qualities enabling it to be molded, formed, cut, sewn, mechanically fastened, and adhered to. In this way the substrate (3, 4, 6, 7) can be imparted with distinct features (3a, 3b, 3c, 4a, etc. . . . ). The features can provide for specific dimensional requirements and structural conditions. Some of these substrate features can be an acoustic chamber for a speaker (4a) or a detailed shape on which to fasten decorative materials (3a). This combination of features and qualities make the framework uniquely provide for any number of varied designs.

Abstract: Disclosed is a refillable aperture pouch for food or beverage comprising a refill-base and a lid; the refill-base and lid releasably connect; the refill-base allows the pouch to be refilled and allows access to the contents of the pouch through use of a utensil; an aperture is in the lid; the aperture pouch is adapted for use by children; the aperture pouch may be cleaned in a dishwasher; the aperture pouch may be hung on a rack by a cap, which cap connects to and seals the aperture; the aperture pouch may be refilled through use of a funnel; the funnel comprises an air-release channel.