Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an action selection neural network used to select actions to be performed by an agent interacting with an environment. In one aspect, a system comprises a plurality of actor computing units and a plurality of learner computing units. The actor computing units generate experience tuple trajectories that are used by the learner computing units to update learner action selection neural network parameters using a reinforcement learning technique. The reinforcement learning technique may be an off-policy actor critic reinforcement learning technique.

Abstract: The present disclosure relates to aerosol delivery devices, methods of forming such devices, and elements of such devices. In some embodiments, the present disclosure provides a heating member that can be formed of a heating element conformed to a heater substrate configured as a truncated cone (or similar shape) having a first end of a first size and a second end of greater size. In some embodiments, the disclosure provides methods of forming an aerosol delivery device, which can include providing a shell, providing a heating member formed of a heating element conformed to a substrate, configuring the heating member as a truncated cone (or similar shape) having a first end of a first size and a second end of greater size, and inserting the heating member within the shell.

Abstract: The present invention provides combination therapy that includes an KRASG12C inhibitor, such as or a pharmaceutically acceptable salt thereof, and one or more additional pharmaceutically active agents, particularly for the treatment of cancers. The invention also relates to pharmaceutical compositions that contain an KRASG12C inhibitor and one or more additional pharmaceutically active agents for the treatment of cancers.

Abstract: The present disclosure relates to aerosol delivery devices, methods of forming such devices, and elements of such devices. In some embodiments, the present disclosure provides a heating member that can be formed of a heating element conformed to a heater substrate configured as a truncated cone (or similar shape) having a first end of a first size and a second end of greater size. In some embodiments, the disclosure provides methods of forming an aerosol delivery device, which can include providing a shell, providing a heating member formed of a heating element conformed to a substrate, configuring the heating member as a truncated cone (or similar shape) having a first end of a first size and a second end of greater size, and inserting the heating member within the shell.

Abstract: A method and system create a geometric object model for use in machine vision inspection. A pixel image representation of an object is acquired. Based on this pixel image representation, part models for the parts of the object are generated. Each part model corresponds to a different part of the object. From the part models of the object, a model for the entire object can be created. Using this created object model, a test inspection is performed on a set of test images, and each of the test images is associated with a set of known inspection measurements. The test inspection produces a set of testing inspection measurements. If the test inspection yields satisfactory performance, the object models created are stored.

Abstract: A machine vision method for locating a leaded electronic device, such as integrated circuit chips, includes searching the image with a template depicting only a portion—e.g., one or two “side” edges—of each of one or more of the leads expected on the device. The template can include portions representing expected leads, as well as unexpected leads or unexpected lead positions. Positive and negative weightings are applied to such portions, as appropriate. A location of the device, or of one or more of its leads, is based on the results of the search.