Abstract: A method (1300) and system (201) for generating an astro-lapse video on a user device is disclosed. Initially, at least one current frame comprising one or more stars, is captured via the user device. Further, region(s) with a degree of exposure and focus greater or less than a predefined threshold are determined and a set of subsequent frames including the stars are captured. The exposure and focus of region(s) in the subsequent frames is corrected during the capturing based on degree of exposure and focus of the region(s) within the current frame. Further, fusion weights of the current and subsequent frames are determined based on one or more cloud categories and associated cloud density scores. Finally, an astro-lapse video is generated by fusing the at least one current frame and the set of subsequent frames based on the determined fusion weights.