Abstract: A coffee bean sorting system has a feeding mechanism, a rotary disk, at least one image capture device, an information processing device, and a removal mechanism. The rotary disk can receive coffee beans transported from the feeding mechanism, and can rotate along an axis thereof, such that the coffee beans are spaced apart from each other and form a succession. The image capture device can capture an initial image of each of the coffee beans. The information processing device can perform machine learning training or deep learning training function, identify each of the initial images, and after determining a coffee bean is non-conforming, make the removal mechanism to remove the non-conforming coffee bean.