Abstract: In one aspect there is provided a method for training a neural network system by reinforcement learning. The neural network system may be configured to receive an input observation characterizing a state of an environment interacted with by an agent and to select and output an action in accordance with a policy aiming to satisfy an objective. The method may comprise obtaining a policy set comprising one or more policies for satisfying the objective and determining a new policy based on the one or more policies. The determining may include one or more optimization steps that aim to maximize a diversity of the new policy relative to the policy set under the condition that the new policy satisfies a minimum performance criterion based on an expected return that would be obtained by following the new policy.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for solving mixed integer programs (MIPs) using neural networks. One of the methods includes obtaining data specifying parameters of a MIP; generating, from the parameters of the MIP, an input representation; processing the input representation using an encoder neural network to generate a respective embedding for each of the integer variables; generating a plurality of partial assignments by selecting a respective second, proper subset of the integer variables; and for each of the variables in the respective second subset, generating, using at least the respective embedding for the variable, a respective additional constraint on the value of the variable; generating, for each of the partial assignments, a corresponding candidate final assignment that assigns a respective value to each of the plurality of variables; and selecting, as a final assignment for the MIP, one of the candidate final assignments.

Abstract: Systems (and corresponding methodologies) that provide an image appliance which alleviates enterprises from custom designing each appliance for specific business processing purposes are disclosed. Enterprises and organizations can easily capture, consolidate, organize and process image files and electronic documents/content from a variety of input sources such as facsimile, electronic mail, multi-function printer devices (MFDs), desktop files, etc. without a need to custom code specific appliances.

Abstract: Foaming apparatus for foaming a water detergent mixture using compressed air comprises a housing having an elongated main bore extending therethrough. An upstream portion of the main bore is tapered in a generally downstream direction. A jet of water detergent mixture is delivered axially into the tapered portion of the main bore through a first orifice. Four second orifices extending transversely into the tapered portion deliver compressed air for mixing with and foaming the jet of water detergent mixture. Foamed water and detergent mixture is delivered through an outlet at the downstream end of the bore.