Abstract: Electron energy loss spectroscopy (EELS) is a well established technique in electron microscopy that yields information on the elemental content of a sample in a very direct manner. One of the persisting limitations of EELS is the requirement for manual identification of core-loss edges and their corresponding elements. This can be especially bothersome in spectrum imaging, where a large amount of spectra are recorded when spatially scanning over a sample area. This paper introduces a synthetic dataset with 736,000 labeled EELS spectra, computed from available generalized oscillator strength tables, that represents 107 K, L, M or N core-loss edges and 80 chemical elements. Generic lifetime broadened peaks are used to mimic the fine structure due to band structure effects present in experimental core-loss edges. The proposed dataset is used to train and evaluate a series of neural network architectures, being a multilayer perceptron, a convolutional neural network, a U-Net, a residual neural network, a vision transformer and a compact convolutional transformer. An ensemble of neural networks is used to further increase performance. The ensemble network is used to demonstrate fully automated elemental mapping in a spectrum image, both by directly mapping the predicted elemental content and by using the predicted content as input for a physical model-based mapping.