Finding the right XAI Method --- Dataset

<p>This dataset provides the complementary preprocessed data for the training of the neural networks used in Bommer et. al. and according source code (<a href="https://github.com/philine-bommer/Climate_X_Quantus">https://github.com/philine-bommer/Climate_X_Quantus</a>). In the&nbsp;publication , we introduce XAI evaluation in the context of climate research and assess different desired explanation properties, namely, robustness, faithfulness, randomization, complexity, and localization. To this end we build upon previous work (Labe and Barnes et. al. 2021) and<br> train a multi-layer perceptron (MLP) and a convolutional neural network (CNN) to predict the decade based on annual-mean temperature maps.</p> <p>Following Labe and Barnes et. al. 2021, we use data simulated by the general climate model, CESM1 (Hurrell et. al.&nbsp;2013).&nbsp;We use the global 2-m air temperature (T2m) temperature maps from 1920&nbsp;to 2080. The data consist of 40 ensemble members and each member is generated by varying the atmospheric initial conditions with fixed external forcing, i.e.&nbsp;historical forcings are imposed from&nbsp;1920 to&nbsp;2005&nbsp;and Representative Concentration Pathways 8.5 for the following years (Kay&nbsp;et. al. 2015).<br> Following Labe and Barnes et. al. 2021, we compute annual averages and apply a bilinear interpolation. This results in T=161&nbsp;temperature maps for each member, with v=144 longitude grid cells&nbsp;and h=95&nbsp;latitude grid cells, given the&nbsp;1.9&deg;&nbsp;sampling in latitude and 2.5&deg; sampling in longitude. The temperature maps are finally standardized by removing the multi-year (1920 to&nbsp;2080)&nbsp;mean and subsequently dividing by the corresponding standard deviation.</p> <p>Unlike the flattened input used for the MLP (temperature maps are flattened into a vector), the CNN maintains the longitude-latitude grid of the temperature maps.&nbsp;Similar to Labe and Barnes et. al. 2021, for training, validation and testing we use the model data discussed above. For both MLP and CNN we consider 20%&nbsp;of the data as test set and the remaining 80%&nbsp;is split into a training (64%) and validation (16%) set. We train&nbsp;both networks to solve a fuzzy classification problem which&nbsp;combines&nbsp;classification and regression.&nbsp;In the classification setting, the network assigns each map to one of the 20 different classes, where each class corresponds to one decade between 1900 and 2100 (necessary class devision for later regression, as done by&nbsp;Labe and Barnes et. al. 2021). The network output thus, is a probability vector containing a probability for each class.</p> <p>To assess the network performance we use the&nbsp;monthly 2m air temperature of the 20th century Reanalysis data (V3) (Slivinski et. al. 2019) from&nbsp;1920 to&nbsp;2015.</p> <p>The dataset includes two compressed .npz-files and a Readme.md.&nbsp;A full description of the data contained in this dataset&nbsp;and instructions on the data usage&nbsp;are provided in the Readme-file.&nbsp;</p>