Abstract: This paper investigates the possible benefits for counting atoms of different chemical nature when analysing multiple 2D scanning transmission electron microscopy (STEM) images resulting from independent annular dark field (ADF) detector regimes. To reach this goal, the principles of statistical detection theory are used to quantify the probability of error when determining the number of atoms in atomic columns consisting of multiple types of elements. In order to apply this theory, atom-counting is formulated as a statistical hypothesis test, where each hypothesis corresponds to a specific number of atoms of each atom type in an atomic column. The probability of error, which is limited by the unavoidable presence of electron counting noise, can then be computed from scattering-cross sections extracted from multiple ADF STEM images. Minimisation of the probability of error as a function of the inner and outer angles of a specified number of independent ADF collection regimes results in optimal experimental designs. Based on simulations of spherical Au@Ag and Au@Pt core–shell nanoparticles, we investigate how the combination of two non-overlapping detector regimes helps to improve the probability of error when unscrambling two types of atoms. In particular, the combination of a narrow low angle ADF detector with a detector formed by the remaining annular collection regime is found to be optimal. The benefit is more significant if the atomic number Z difference becomes larger. In
addition, we show the benefit of subdividing the detector regime into three collection areas for heterogeneous nanostructures based on a structure consisting of three types of elements, e.g., a mixture of Au, Ag and Al atoms. Finally, these results are compared with the probability of error resulting when one would ultimately use a pixelated 4D STEM detector and how this could help to further reduce the incident electron dose.

Abstract: In the present paper, the principles of detection theory are used to quantify the probability of error for atom-counting from high resolution scanning transmission electron microscopy (HR STEM) images. Binary and multiple hypothesis testing have been investigated in order to determine the limits to the precision with which the number of atoms in a projected atomic column can be estimated. The probability of error has been calculated when using STEM images, scattering cross-sections or peak intensities as a criterion to count atoms. Based on this analysis, we conclude that scattering cross-sections perform almost equally well as images and perform better than peak intensities. Furthermore, the optimal STEM detector design can be derived for atom-counting using the expression for the probability of error. We show that for very thin objects LAADF is optimal and that for thicker objects the optimal inner detector angle increases.

Abstract: In this study, we explore the possibility to use deep learning for the reconstruction of phase images from 4D scanning transmission electron microscopy (4D-STEM) data. The process can be divided into two main steps. First, the complex electron wave function is recovered for a convergent beam electron diffraction pattern (CBED) using a convolutional neural network (CNN). Subsequently, a corresponding patch of the phase object is recovered using the phase object approximation. Repeating this for each scan position in a 4D-STEM dataset and combining the patches by complex summation yields the full-phase object. Each patch is recovered from a kernel of 3x3 adjacent CBEDs only, which eliminates common, large memory requirements and enables live processing during an experiment. The machine learning pipeline, data generation, and the reconstruction algorithm are presented. We demonstrate that the CNN can retrieve phase information beyond the aperture angle, enabling super-resolution imaging. The image contrast formation is evaluated showing a dependence on the thickness and atomic column type. Columns containing light and heavy elements can be imaged simultaneously and are distinguishable. The combination of super-resolution, good noise robustness, and intuitive image contrast characteristics makes the approach unique among live imaging methods in 4D-STEM.

Abstract: Semiconductor heterostructures are used for the fabrication of optoelectronic devices. Performance of such devices is governed by their chemical morphology. The composition distribution of quantum wells and dots is influenced by kinetic growth processes which are not understood completely at present. To obtain more information about these effects, methods for composition determination with a spatial resolution at a near atomic scale are necessary. In this paper we focus on the present state of the composition evaluation by the lattice fringe analysis (CELFA) technique and explain the basic ideas, optimum imaging conditions, precision and accuracy.

Abstract: We report a method to reliably count the number of atoms from high-angle annular dark field scanning transmission electron microscopy images. A model-based analysis of the experimental images is used to measure scattering cross sections at the atomic level. The high sensitivity of these measurements in combination with a thorough statistical analysis enables us to count atoms with single-atom sensitivity. The validity of the results is confirmed by means of detailed image simulations. We will show that the method can be applied to nanocrystals of arbitrary shape, size, and atom type without the need for a priori knowledge about the atomic structure.

Abstract: The present contribution gives a review of recent quantification work of atom displacements, atom site occupations and level of crystallinity in various systems and based on aberration corrected HR(S)TEM images. Depending on the case studied, picometer range precisions for individual distances can be obtained, boundary widths at the unit cell level determined or statistical evolutions of fractions of the ordered areas calculated. In all of these cases, these quantitative measures imply new routes for the applications of the respective materials.

Abstract: Anisotropic bimetallic nanoparticles are promising candidates for plasmonic and catalytic applications. Their catalytic performance and plasmonic properties are closely linked to the distribution of the two metals, which can change during applications in which the particles are exposed to heat. Due to this fact, correlating the thermal stability of complex heterogeneous nanoparticles to their microstructural properties is of high interest for the practical applications of such materials. Here, we employ quantitative electron tomography in high-angle annular dark-field scanning transmission electron microscopy (HAADFSTEM) mode to measure the 3D elemental diffusion dynamics in individual anisotropic Au−Ag nanoparticles upon heating in situ. This approach allows us to study the elemental redistribution in complex, asymmetric nanoparticles on a single particle level, which has been inaccessible to other techniques so far. In this work, we apply the proposed method to compare the alloying dynamics of Au−Ag nanoparticles with different shapes and compositions and find that the shape of the nanoparticle does not exhibit a significant effect on the alloying speed whereas the composition does. Finally, comparing the experimental results to diffusion simulations allows us to estimate the diffusion coefficients of the metals for individual nanoparticles.

Abstract: Quantitative atomic resolution annular dark field scanning transmission electron microscopy (ADF STEM) has become a powerful technique for nanoparticle atom-counting. However, a lot of nanoparticles provide a severe characterisation challenge because of their limited size and beam sensitivity. Therefore, quantitative ADF STEM may greatly benefit from statistical detection theory in order to optimise the instrumental microscope settings such that the incoming electron dose can be kept as low as possible whilst still retaining single-atom precision. The principles of detection theory are used to quantify the probability of error for atom-counting. This enables us to decide between different image performance measures and to optimise the experimental detector settings for atom-counting in ADF STEM in an objective manner. To demonstrate this, ADF STEM imaging of an industrial catalyst has been conducted using the near-optimal detector settings. For this experiment, we discussed the limits for atom-counting diagnosed by combining a thorough statistical method and detailed image simulations.

Abstract: High angle annular dark field scanning transmission electron microscopy (HAADF STEM) images provide sample information which is sensitive to the chemical composition. The image intensities indeed scale with the mean atomic number Z. To some extent, chemically different atomic column types can therefore be visually distinguished. However, in order to quantify the atomic column composition with high accuracy and precision, model-based methods are necessary. Therefore, an empirical incoherent parametric imaging model can be used of which the unknown parameters are determined using statistical parameter estimation theory (Van Aert et al., 2009, [1]). In this paper, it will be shown how this method can be combined with frozen lattice multislice simulations in order to evolve from a relative toward an absolute quantification of the composition of single atomic columns with mixed atom types. Furthermore, the validity of the model assumptions are explored and discussed.

Abstract: A real-time image reconstruction method for scanning transmission electron microscopy (STEM) is proposed. With an algorithm requiring only the center of mass of the diffraction pattern at one probe position at a time, it is able to update the resulting image each time a new probe position is visited without storing any intermediate diffraction patterns. The results show clear features at high spatial frequency, such as atomic column positions. It is also demonstrated that some common post-processing methods, such as band-pass filtering, can be directly integrated in the real-time processing flow. Compared with other reconstruction methods, the proposed method produces high-quality reconstructions with good noise robustness at extremely low memory and computational requirements. An efficient, interactive open source implementation of the concept is further presented, which is compatible with frame-based, as well as event-based camera/file types. This method provides the attractive feature of immediate feedback that microscope operators have become used to, for example, conventional high-angle annular dark field STEM imaging, allowing for rapid decision-making and fine-tuning to obtain the best possible images for beam-sensitive samples at the lowest possible dose.

Abstract: The rapid progress in materials science that enables the design of materials down to the nanoscale also demands characterization techniques able to analyze the materials down to the same scale, such as transmission electron microscopy. As Belgium’s foremost electron microscopy group, among the largest in the world, EMAT is continuously contributing to the development of TEM techniques, such as high-resolution imaging, diffraction, electron tomography, and spectroscopies, with an emphasis on quantification and reproducibility, as well as employing TEM methodology at the highest level to solve real-world materials science problems. The lab’s recent contributions are presented here together with specific case studies in order to highlight the usefulness of TEM to the advancement of materials science.

Abstract: Even at low temperatures, metal nanoparticles (NPs) possess atomic dynamics that are key for their properties but challenging to elucidate. Recent experimental advances allow obtaining atomic-resolution snapshots of the NPs in realistic regimes, but data acquisition limitations hinder the experimental reconstruction of the atomic dynamics present within them. Molecular simulations have the advantage that these allow directly tracking the motion of atoms over time. However, these typically start from ideal/perfect NP structures and, suffering from sampling limits, provide results that are often dependent on the initial/putative structure and remain purely indicative. Here, by combining state-of-the-art experimental and computational approaches, how it is possible to tackle the limitations of both approaches and resolve the atomistic dynamics present in metal NPs in realistic conditions is demonstrated. Annular dark-field scanning transmission electron microscopy enables the acquisition of ten high-resolution images of an Au NP at intervals of 0.6 s. These are used to reconstruct atomistic 3D models of the real NP used to run ten independent molecular dynamics simulations. Machine learning analyses of the simulation trajectories allow resolving the real-time atomic dynamics present within the NP. This provides a robust combined experimental/computational approach to characterize the structural dynamics of metal NPs in realistic conditions. Experimental and computational techniques are bridged to unveil atomic dynamics in gold nanoparticles (NPs), using annular dark-field scanning transmission electron microscopy and molecular dynamics simulations informed by machine learning. The approach provides unprecedented insights into the real-time structural behaviors of NPs, merging state-of-the-art techniques to accurately characterize their dynamics under realistic conditions. image