Abstract: A system and method for installing solar panels are provided. The method includes obtaining images of solar panels an installation structure during installation. The method also includes pre-processing the images by compensating for camera intrinsics or distortions, rectifying the images, and/or determining depth information. The method also includes detecting the solar panels by inputting the images into neural networks. The method also includes a first post-processing to compute a first panel pose based on an output of the neural networks. The method also includes generating control signals, based on the first panel pose, for operating a robotic controller for installing the solar panels. In some embodiments, the method also includes homography transforms to obtain a second panel pose, based on the first panel pose and visual patterns or fiducials on a solar panel, and generating the control signals further based on the second panel pose.