Abstract: Advanced electron microscopy techniques, including scanning electron microscopes (SEM), scanning transmission electron microscopes (STEM), and transmission electron microscopes (TEM), have revolutionized imaging capabilities. However, achieving high-quality experimental images remains a challenge due to various distortions stemming from the instrumentation and external factors. These distortions, introduced at different stages of imaging, hinder the extraction of reliable quantitative insights. In this paper, we will discuss the main sources of distortion in TEM and S(T)EM images, develop models to describe them, and propose a method to correct these distortions using a convolutional neural network. We validate the effectiveness of our method on a range of simulated and experimental images, demonstrating its ability to significantly enhance the signal-to-noise ratio. This improvement leads to a more reliable extraction of quantitative structural information from the images. In summary, our findings offer a robust framework to enhance the quality of electron microscopy images, which in turn supports progress in structural analysis and quantification in materials science and biology.