Abstract: A neuron is provided that has the property of having a compact support, which means its output is zero outside a bounded domain. A method for training a neural network containing such neurons is provided, starting from a standard neural network. The approach described herein has good prediction on samples belonging to the same distribution, and it has low confidence and may return all-zero responses on data away from the training examples.