Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
274
datasets available to search
ShareScore release 0.9.0
Dataset results
274 results for “data consistency”
Data from: Early diversification dynamics in a highly successful insular plant taxon are consistent with the general dynamic model of oceanic island biogeography
<p>The general dynamic model (GDM) of oceanic island biogeography views oceanic islands predominantly as sinks rather than sources of dispersing lineages. To test this, we conducted a biogeographic analysis of a highly successful insular plant taxon, <em>Cyrtandra </em>and inferred directionality of dispersal and founder events throughout the four biogeographical units of the Indo-Australian Archipelago (IAA), namely Sunda, Wallacea, Philippines, and Sahul. Sunda was recovered as the major source area, followed by Wallacea, a system of oceanic islands. The relatively high number of events originating from Wallacea is attributed to its central location in the IAA and its complex geological history selecting for increased dispersibility. We also tested if diversification dynamics in <em>Cyrtandra </em>follow predictions of adaptive radiation, which is the dominant process as per the GDM. Diversification dynamics of dispersing lineages of <em>Cyrtandra</em> in the Southeast Asian grade showed early bursts followed by a plateau, which is consistent with adaptive radiation. We did not detect signals of diversity-dependent diversification, and this is attributed to Southeast Asian cyrtandras<em> </em>occupying various niche spaces, evident by their wide morphological range in habit and floral characters. The Pacific clade, which arrived at the immaturity phase of the Pacific Islands, showed diversification dynamics predicted by the Island Immaturity Speciation Pulse (IISP) model, wherein rates increase exponentially, and their morphological range is controlled by the least action effect favoring woodiness and fleshy fruits. Our study provides a first step toward a framework for investigating diversification dynamics as predicted by the GDM in highly successful insular taxa.</p>
Data of "Self-consistency Reinforced minimal Gated Recurrent Unit for surrogate modeling of history-dependent non-linear problems: application to history-dependent homogenized response of heterogeneous materials"
<h1>Development of the Self-Consistency reinforced Minimum Recurrent Unit (SC-MRU)</h1> <p>This directory contains the data and algorithms generated in publication<sup><a href="#fn-1-5292">1</a></sup></p> <h2>Table of Contents</h2> <ol> <li><a href="#dependencies-and-prerequisites">Dependencies and Prerequisites</a></li> <li><a href="#structure-of-repository">Structure of Repository</a></li> <li><a href="#part-1-data-preparation">Part 1: Data preparation</a></li> <li><a href="#part-2-rnn-training">Part 2: RNN training</a></li> <li><a href="#part-3-multiscale-analysis">Part 3: Multiscale analysis</a></li> <li><a href="#part-4-reproduce-paper1-figures">Part 4: Reproduce paper[^1] figures</a></li> </ol> <h2>Dependencies and Prerequisites</h2> <p> </p> <ul> <li> <p>Python, pandas, matplotlib, texttabble and latextable are pre requisites for visualizing and navigating the data.</p> </li> <li> <p>For generating mesh and for vizualization, gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) is required.</p> </li> <li> <p>For running simulations, cm3Libraries (<a href="http://www.ltas-cm3.ulg.ac.be/openSource.htm" target="_blank" rel="nofollow noreferrer noopener">http://www.ltas-cm3.ulg.ac.be/openSource.htm</a>) is required.</p> </li> </ul> <h3>Instructions using apt & pip3 package manager</h3> <p>Instructions for Debian/Ubuntu based workstations are as follows.</p> <h3>python, pandas and dependencies</h3> <div> <pre><code> sudo apt install python3 python3-scipy libpython3-dev python3-numpy python3-pandas</code></pre> </div> <h3>matplotlib, texttabble and latextable</h3> <div> <pre><code> pip3 install matplotlib texttable latextable</code></pre> </div> <h3>Pytorch (only for run with cm3Libraries)</h3> <ul> <li>Without GPU</li> </ul> <div> <pre><code> pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu</code></pre> </div> <ul> <li>With GPU</li> </ul> <div> <pre><code> pip3 install torch torchvision torchaudio</code></pre> </div> <h3>Libtorch (for compiling the cells)</h3> <ul> <li>Without GPU: In a local directory (e.g. <code>~/local</code> with <code>export TORCHDIR=$HOME/local/libtorch</code>)</li> </ul> <div> <pre><code> wget https://download.pytorch.org/libtorch/cpu/libtorch-shared-with-deps-2.1.1%2Bcpu.zip unzip libtorch-shared-with-deps-2.1.1%2Bcpu.zip</code></pre> </div> <ul> <li>With GPU: In a local directory (e.g. <code>~/local</code> with <code>export TORCHDIR=$HOME/local/libtorch</code>)</li> </ul> <div> <pre><code> wget https://download.pytorch.org/libtorch/cu121/libtorch-shared-with-deps-2.1.1%2Bcu121.zip unzip libtorch-shared-with-deps-2.1.1+cu121.zip</code></pre> </div> <h2>Structure of Repository</h2> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/All_Path_Res">All_Path_Res</a>: results of the direct numerical simulations used as training and testing data, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/ConstRVE">ConstRVE</a>: script to run direct numerical finite element simulations, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale</a>: scripts to run and visualise the multiscale analyses, see details in <a href="#part-3-multiscale-analysis">Part 3: Multiscale analysis</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU</a>: implementation of the RNN and scripts to train them, see details in <a href="#part-2-rnn-training">Part 2: RNN training</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a>: scripts to collect, normalise and truncate the RVEs direct simulation results as training and testing data, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>. The director also contained the storred processed data used in <sup><a href="#fn-1">1</a></sup>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a>: scripts to generate the different loading paths for the direct numerical simulations used as training and testing data, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>.</li> </ul> <h2>Part 1: Data preparation</h2> <h3>Generate the loading paths</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/testGenerationData.py">TrainingPaths/testGenerationData.py</a> is used to generate random walk paths, with the options <ul> <li><code>Rmax = 0.11</code> # bound on the final Green Lagrange strain</li> <li><code>TimeStep = 1.</code> # in second</li> <li><code>EvalStep = [1e-4,5e-3]</code> #Bounds on the Green Lagrange increments</li> <li><code>Nmax = 2500</code> #maximum length of the sequence</li> <li><code>k = 4000</code> # number of path to generate</li> <li>The path are storred by default in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a>. The path has to be existing before launching the script. You can change the name in line 123 <code>saveDir = '../ConstRVE'+'/Paths/'</code>.</li> <li>Examples of generated paths can be found in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/ConstRVE/PathsExamples">ConstRVE/PathsExamples/</a></li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a> is</li> </ul> </li> </ul> <div> <pre><code>(mkdir ../ConstRVE/Paths) #if needed python3 testGenerationData.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/generationData_Cyclic.py">TrainingPaths/generationData_Cyclic.py</a> is used to generate random cylic paths, with the options <ul> <li><code>Rmax = [np.random.uniform(0.,0.04),np.random.uniform(0.,0.06),np.random.uniform(0.0,0.09),0.12]</code> # bound on the final Green Lagrange strain is random</li> <li><code>TimeStep = 1.</code> # in second</li> <li><code>EvalStep = [1e-4,5e-3]</code> #Bounds on the Green Lagrange increments</li> <li><code>Nmax = 2500</code> #maximum length of the sequence</li> <li><code>k = 2000</code> # number of path to generate</li> <li>The path are stored by default in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a>. You can change the name in line 123 <code>saveDir = '../ConstRVE'+'/Paths/'</code>.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a> is</li> </ul> </li> </ul> <div> <pre><code>(mkdir ../ConstRVE/Paths) #if needed python3 generationData_Cyclic.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/countPathLength.py">TrainingPaths/countPathLength.py</a> gives average, minimum and maximum lengths of the generated paths and the distribution of the <code>\Delta R</code>. By default the paths are read in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a> but the directory can be given as an argument. The file can be used to read <ul> <li>either the generated loading paths</li> </ul> </li> </ul> <div> <pre><code> python3 countPathLength.py '../ConstRVE/PathsExamples'</code></pre> </div> <ul> <li> <ul> <li>or the results of the <a href="#generate-the-rves-direct-simulation-results">simulations</a></li> </ul> </li> </ul> <div> <pre><code> python3 countPathLength.py '../All_Path_Res/Path_Res9'</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/graphData.py">TrainingPaths/graphData.py</a> generates illustrations from randomly picked paths in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a> and generate png figures.</li> </ul> <h3>Generate the RVEs direct simulation results</h3> <ul> <li>Uses the loading paths existing in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/rve.geo">ConstRVE/rve.geo</a> is the RVE geometry file that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/rve.msh">ConstRVE/rve.msh</a> is the RVE mesh file that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/utilsFunc.py">ConstRVE/utilsFunc.py</a> contains python tools to be used.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Rve_withoutInternalVars.py">ConstRVE/Rve_withoutInternalVars.py</a> is used to run all the RVE simulations: <ul> <li>This requires cm3Libraries (<a href="http://www.ltas-cm3.ulg.ac.be/openSource.htm" target="_blank" rel="nofollow noreferrer noopener">http://www.ltas-cm3.ulg.ac.be/openSource.htm</a>).</li> <li>All the ouptus are stored in <code>All_Path_Res/Path_Res12</code>, you can change the name in line 71 <code>Path_Res = '../All_Path_Res/Path_Res12/'</code>. The results of RVE simulations are saved as the sequence (one configuration per line) of the Green-Lagrange strains and Second Piola-Kirchhoff stress (in column). One example can be found in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_Res1/data_path1000.csv">All_Path_Res/Path_Res1/data_path1000.csv</a>.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/ConstRVE">ConstRVE</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 Rve_withoutInternalVars.py</code></pre> </div> <h3>Collect, normalised and truncate the RVEs direct simulation results as training and testing data</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/CheckNanData.py">TrainingData/CheckNanData.py</a> is used to check the integrity of the direct numerical simulations results <ul> <li>DNS results are read from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res1">All_Path_Res/Path_res1</a> to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res11">All_Path_Res/Path_res11</a> subdirectories.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 CheckNanData.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/CollectData.py">TrainingData/CollectData.py</a> is used to gather all the direct numerical simulations results <ul> <li>DNS results are read from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res1">All_Path_Res/Path_res1</a> to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res11">All_Path_Res/Path_res11</a> subdirectories. It can be changed in line 31 <code>for ll in range(11):</code>.</li> <li>It saves the bounds and raw data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Bounds_GS">TrainingData/Processed_Data/Bounds_GS</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Origin_GS">TrainingData/Processed_Data/Origin_GS</a>, respectively.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 CollectData.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Normalization.py">TrainingData/Normalization.py</a> is used to normalise the gathered direct numerical simulations results <ul> <li>Bounds and raw data are read from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Bounds_GS">TrainingData/Processed_Data/Bounds_GS</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Origin_GS">TrainingData/Processed_Data/Origin_GS</a>, respectively.</li> <li>It saves the normalized training (75%) and testing (25%) data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Train">TrainingData/Processed_Data/Normalized_GS_Train</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Test">TrainingData/Processed_Data/Normalized_GS_Test</a>, respectively.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 Normalization.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/GaussCollectData.py">TrainingData/GaussCollectData.py</a> is an alternative using Gaussian normaliation and is used to gather all the direct numerical simulations results.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/GaussNormalization.py">TrainingData/GaussNormalization.py</a> is an alternative to normalise following a Gaussian the gathered direct numerical simulations results.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Data_Padding.py">TrainingData/Data_Padding.py</a> is used to pad and trim the normalised data <ul> <li>Normalized training (75%) and testing (25%) data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Train">TrainingData/Processed_Data/Normalized_GS_Train</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Test">TrainingData/Processed_Data/Normalized_GS_Test</a>, respectively.</li> <li>The final length of the sequence (including zero padding and trimming) is given by <code>N = 200</code>.</li> <li>It saves the trimmed and padded normalised training and testing data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data">TrainingData/Processed_Data/</a> as <code>'GS_Train'N</code> and <code>'GS_Test'N</code>, respectively.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 Data_Padding.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Tool.py">TrainingData/Tool.py</a> is a list of function used to normalise dat.</li> </ul> <h2>Part 2: RNN training</h2> <h3>Available rnn</h3> <ul> <li>The different cells are in the following directories <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SMRU">SC_MRU/MGRU/NNW_SMRU</a>: Neural network with SMRU recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SCMRU_T">SC_MRU/MGRU/NNW_SCMRU_T</a>: Neural network with SC-MRU-T recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_MGRU">SC_MRU/MGRU/NNW_MGRU</a>: Neural network with orginal MGRU recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_MGRU_M">SC_MRU/MGRU/NNW_MGRU_M</a>: Neural network with modified MGRU recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/FNN_LeakyReLU">SC_MRU/FNN_LeakyReLU/NNW_<code>X</code>Fw</a>: Neural network with SC-MRU-I recurrent cell using <code>X</code> Feed Forward non-linear transition layers.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/Quadratic_NLT">SC_MRU/Quandratic_NLT/NNW_<code>X</code>Q, NNW_Q_Fw, NNW_Fw_Q</a>: Neural network with SC-MRU-I recurrent cell using <code>X</code> quadratic or mixed feed-forward-quadratic non-linear transition layers.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/ReferenceRNN">SC_MRU/ReferenceRNN/NNW_<code>X</code>Layers</a>: Neural network with SC-LMSC recurrent cell using <code>X</code> non-linear transition layers.</li> </ul> </li> </ul> <h3>Compile the neural network models</h3> <ul> <li>In the adequate directory, e.g. <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SMRU">SC_MRU/MGRU/NNW_SMRU</a> for the Neural network with SMRU recurrent cell.</li> </ul> <div> <pre><code> cd build rm -rf * cmake -DCMAKE_PREFIX_PATH=$TORCHDIR .. make</code></pre> </div> <ul> <li>This create the RNN_<code>CELL</code> model in the build directory</li> </ul> <h3>Train the neural network models</h3> <ul> <li>In the adequate directory, e.g. <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SMRU">SC_MRU/MGRU/NNW_SMRU</a> for the Neural network with SMRU recurrent cell.</li> <li>Requires to have <a href="#compile-the-neural-network-models">compiled</a> the RNN model.</li> <li>The file <code>Train.py</code> <ul> <li>Uses the RNN_<code>CELL</code> model compiled in the <code>build</code> directory.</li> <li>Uses the trimmed and padded normalised training and testing data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data">TrainingData/Processed_Data/</a> as <code>'GS_Train'N</code> and <code>'GS_Test'N</code>, respectively.</li> <li>Can be modified to use the requested ratios of training and testing sequences of different lengths to prepate the mini-baches, e.g.: <ul> <li><code>ratio = [0.2,0.02,0.6,0.06,0.01,0.9]</code></li> <li><code>PathIn1 = ['../../../TrainingData/Processed_data/GS_Train200','../../../TrainingData/Processed_data/GS_Train2500','../../../TrainingData/Processed_data/GS_Test200','../../../TrainingData/Processed_data/GS_Test2500']</code></li> <li><code>PathIn2 = ['../../../TrainingData/Processed_data/GS_Test200','../../../TrainingData/Processed_data/GS_Test400','../../../TrainingData/Processed_data/GS_Test2500','../../../TrainingData/Processed_data/GS_Test400']</code></li> </ul> </li> <li>Saves the mini-batches in <ul> <li><code>PathOut = "TrainingData.pt"</code></li> </ul> </li> <li>Saves the model <code>module-checkpoint.pt</code> and <code>module-checkpoint-optimizer.pt</code>, and loss evolution <code>Loss.txt</code> in <ul> <li>Module/H<code>n</code> with <code>n</code> the number of hiden variables.</li> <li>Output directory can be changes in NNW_<code>CELL</code>.cpp of the cell name <code>CELL</code> (and recompiling).</li> <li>Warm start can be disabled in by commenting <code>torch::load(net, "./Module/H120/module-checkpoint_CM0.pt");</code> and <code>torch::load(optimizer, "./Module/H120/module-optimizer-checkpoint_CM0.pt");</code> in NNW_<code>CELL</code>.cpp of the cell name <code>CELL</code> (and recompiling).</li> <li>Is executed with</li> </ul> </li> </ul> </li> </ul> <div> <pre><code> python3 Train.py</code></pre> </div> <h3>Convert trained c++ models for pyTorch (in view of multiscale simulations)</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Save_RU.py">SC_MRU/CheckLoss/RU.py</a>: functions used to read and use the rnn models.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Save_RNN_script.py">SC_MRU/CheckLoss/Save_RNN_script.py</a>: <ul> <li>Converts c++ trained models to pyTorch models</li> <li>Reads the trained models in SC_MRU/CELL_<code>Kind</code>/NNW_<code>CELL</code>/Module/H<code>N</code>/module.pt</li> <li>Save the converted models to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> and to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/Model">MultiScale/Model/</a></li> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells <code>cell=["SC_MRU_T","SC_MRU_I","SMRU"]</code>.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is</li> </ul> </li> </ul> <div> <pre><code>python3 Save_RNN_script.py</code></pre> </div> <h3>Vizualize loss evolution and testing results</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Data_prepare.py">SC_MRU/CheckLoss/Data_prepare.py</a> contains fucntion used for testing.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/LossVS_insertN.py">SC_MRU/CheckLoss/LossVS_insertN.py</a> tests the effect of testing data augmentation: <ul> <li>Requires to have <a href="#compile-the-neural-network-models">compiled</a> the RNN models.</li> <li>Cell type and augmentation kind can be modified: <ul> <li><code>repeat = 10</code> #number of tests</li> <li><code>dataType ='random'</code> #'even' or 'random'</li> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells ```cell=["SC_MRU_T","SC_MRU_I","SMRU"]``</li> <li><code>reevaluate= False</code> # <code>False</code> to use the saved loss values and <code>True</code> to evaluate the loss values</li> <li><code>fastshifting=False</code> # <code>False</code> to vizualize before fast shifting (Fig. 11) and <code>True</code> after (Fig. 12). When <code>reevaluate== True</code>, this has no effect: the training with fast-shifting or not has to be done manually, see <a href="#train-the-neural-network-models">details</a>.</li> </ul> </li> <li>Generates new Loss_<code>CELL</code>.txt and TrainingData.pt files in case <code>reevaluate== True</code>, read the existing one if <code>reevaluate== False</code>.</li> <li>Generates Figs. 11 and 12 from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a></li> </ul> </li> </ul> <div> <pre><code> python3 LossVS_insertN.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Plot_GS.py">SC_MRU/CheckLoss/Plot_GS.py</a> test the different NNW on RVE testing paths: <ul> <li>Requires to have <a href="#compile-the-neural-network-models">compiled</a> the RNN models.</li> <li>Cell type and augmentation kind can be modified: <ul> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells ```cell=["SC_MRU_T","SC_MRU_I","SMRU"]``</li> </ul> </li> <li>Generate Figs. 13, 14 and 15 from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a></li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 Plot_GS.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Plot_GS_step.py">SC_MRU/CheckLoss/Plot_GS_step.py</a> tests the different pyTorch NNWs on the RVE testing paths: <ul> <li>Requires to have <a href="#convert-trained-c-models-for-pytorch-in-view-of-multiscale-simulations">converted</a> the RNN models.</li> <li>Cell type and augmentation kind can be modified: <ul> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells ```cell=["SC_MRU_T","SC_MRU_I","SMRU"]``</li> </ul> </li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 Plot_GS_step.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_HiddenV.py">SC_MRU/PlotLoss_HiddenV.py</a> shows the loss evolution for the different number of hidden variables --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- for the SMRU cell: <ul> <li>Generates Fig. 8.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_HiddenV.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_3MRU.py">SC_MRU/PlotLoss_3MRU.py</a> shows the loss evolution for the different recurrent units --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- for the 120 hidden variables: <ul> <li>Generates Fig. 9.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_3MRU.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_RefNL_H120.py">SC_MRU/PlotLoss_RefNL_H120.py</a> shows the loss evolution for the different SC-LMSC and SC-MRU-I cells --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- for 120 hidden variables: <ul> <li>Generates Fig. 10.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_RefNL_H120.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_MGRU.py">SC_MRU/PlotLoss_MGRU.py</a> shows the loss evolution for the original and modified MGRU --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- and for the 120 hidden variables: <ul> <li>Generates Fig. A.18.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_MGRU.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_NL.py">SC_MRU/PlotLoss_NL.py</a> shows the loss evolution for the different non-liner transition layers (quadratic and Leaky ReLU) of the SC-MRU-I cell --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- and for the 120 hidden variables: <ul> <li>Generates Fig. B.19.</li> <li><code>Case=1</code> # 0 for quadratic transition blocks and 1 for Leaky ReLU transition blocks</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_NL.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_DiffNL_H120.py">SC_MRU/PlotLoss_DiffNL_H120.py</a> shows the loss evolution for the different non-liner transition layers (hybrid) of the SC-MRU-I cell --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- and for the 120 hidden variables: <ul> <li>Generates Fig. B.20.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_DiffNL_H120.py</code></pre> </div> <h2>Part 3: Multiscale analysis</h2> <h3>Trained surrogate models</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/Model">MultiScale/Model</a>: contains the different rnn <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/Bounds_GS">MultiScale/Model/Bounds_GS</a>: Bounds.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/DInpFullModel.pt">MultiScale/Model/DInpFullModel.pt</a>: trained rnn with <code>SC-MRU-T</code> recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/IncrementModel.pt">MultiScale/Model/IncrementModel.pt</a>: trained rnn with <code>SC-MRU-I</code> recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/FullModel.pt">MultiScale/Model/FullModel.pt</a>: trained rnn with <code>SMRU</code> recurrent cell.</li> </ul> </li> </ul> <h3>Run mutiscale simulations using the surrogates</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/model.geo">MultiScale/2D_MultiScale/model.geo</a>: geometry of the macro-scale model that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/model.msh">MultiScale/2D_MultiScale/model.msh</a>: mesh of the macro-scale model that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/model.py">MultiScale/2D_MultiScale/model.py</a>: is used to run all the multiscale simulation: <ul> <li>This requires cm3Libraries (<a href="http://www.ltas-cm3.ulg.ac.be/openSource.htm" target="_blank" rel="nofollow noreferrer noopener">http://www.ltas-cm3.ulg.ac.be/openSource.htm</a>).</li> <li>Uses the bounds and trained models in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/Model">MultiScale/Model</a>.</li> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells <code>cell=["SC_MRU_T","SC_MRU_I","SMRU"]</code>.</li> <li><code>factorStep= 100</code> # is the number of steps x 20 during the reloading stage between points B and C.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/2D_MultiScale">MultiScale/2D_MultiScale/</a> is</li> </ul> </li> </ul> <div> <pre><code>python3 model.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2">MultiScale/FE2</a>: <ul> <li>Contains the reference displacement-force results of the FE2 simulation.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2/Distributions">MultiScale/FE2/Distributions</a>: contains the macro-scale displacement and stress fields. They can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> </ul> </li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_<code>STEPS</code></a>: <ul> <li>Contain the reference displacement-force results of the rnn-based multiscale simulations for the different recurrent cells <code>CELL</code> and steps number <code>STEPS</code> during the reloading stage between points B and C.</li> <li>For the cases <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_20</a>, the macro-scale displacement and stress fields are also available and can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> </ul> </li> </ul> <h3>Vizualize mutiscale simulations results</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/plot_force.py">MultiScale/2D_MultiScale/plot_force.py</a>: is used to plot the multiscale simulations results: <ul> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells <code>cell=["SC_MRU_T","SC_MRU_I","SMRU"]</code>.</li> <li>The multiscale simulations results to be plotted are saved in the directories <code>CELL_120_Step</code>, where <code>Step</code> # is the number of steps during the reloading stage between points B and C.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/2D_MultiScale">MultiScale/2D_MultiScale/</a> is</li> </ul> </li> </ul> <div> <pre><code>python3 plot_force.py</code></pre> </div> <ul> <li>To vizualize the macro-scale displacement and stress fields distributions: <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2/Distributions">MultiScale/FE2/Distributions</a>: contains the macro-scale displacement and stress fields. They can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_20</a>, the macro-scale displacement and stress fields are also available and can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> </ul> </li> </ul> <h2>Part 4: Reproduce paper<sup><a href="#fn-1">1</a></sup> figures</h2> <ul> <li>Fig. 7: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a> is</li> </ul> <div> <pre><code> python3 countPathLength.py '../ConstRVE/PathsExamples'</code></pre> </div> <ul> <li>Fig. 9: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> <div> <pre><code> python3 PlotLoss_HiddenV.py</code></pre> </div> <ul> <li>Fig. 10: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> <div> <pre><code> python3 PlotLoss_3MRU.py</code></pre> </div> <ul> <li>Fig. 11: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> <div> <pre><code> python3 PlotLoss_DiffNL_H120.py</code></pre> </div> <ul> <li>Figs. 12 and 13: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 LossVS_insertN.py</code></pre> </div> <ul> <li>Figs. 14, 15 and 16: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a></li> </ul> <div> <pre><code> python3 Plot_GS.py</code></pre> </div> <ul> <li>Figs. 17(b)(c)(d): The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/2D_MultiScale">MultiScale/2D_MultiScale/</a> is, see <a href="#vizualize-mutiscale-simulations-results">details</a>:</li> </ul> <div> <pre><code>python3 plot_force.py</code></pre> </div> <ul> <li>Figs. 18-23: Need gmsh to vizualize the results stored in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2/Distributions">MultiScale/FE2/Distributions</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_20</a>, see <a href="#vizualize-mutiscale-simulations-results">details</a></li> <li>Fig. A.24: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 PlotLoss_MGRU.py.py</code></pre> </div> <ul> <li>Fig. B.25: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 PlotLoss_NL.py</code></pre> </div> <ul> <li>Fig. B.26: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 PlotLoss_DiffNL_H120.py</code></pre> </div> <h2>Disclaimer</h2> <p>This project has received funding from the European Union’s Horizon Europe Framework Programme under grant agreement No. 101056682 for the project “DIgital DEsign strategies to certify and mAnufacture Robust cOmposite sTructures (DIDEAROT)”. The contents of this publication are the sole responsibility of ULiege and do not necessarily reflect the opinion of the European Union. Neither the European Union nor the granting authority can be held responsible for them.</p> <ol> <li> <p>The work is described in:<br>"<em>Wu, L. and Noels, L. (2024).</em> <strong>Self-consistency Reinforced minimal Gated Recurrent Unit for surrogate modeling of history-dependent non-linear problems: application to history-dependent homogenized response of heterogeneous materials</strong> 424: 116881, <a href="https://doi.org/10.1016/j.cma.2024.116881" target="_blank" rel="nofollow noreferrer noopener">doi: 10.1016/j.cma.2024.116881</a>" which can be downloaded. We would be grateful if you could cite this publication in case you use the files. <a href="#fnref-1-5292">↩</a> <a href="#fnref-1-2">↩<sup>2</sup></a> <a href="#fnref-1-3">↩<sup>3</sup></a></p> </li> </ol>
Data from: Consistent seasonal flexibility of the gut and its regions across wild populations of a winter-quiescent fish
<p>Here, we investigated phenotypic flexibility in the size of the gastrointestinal (GI) tract across three northern populations of a winter-dormant warm-water fish, pumpkinseed sunfish (<em>Lepomis gibbosus</em>). The dried masses of all gut regions (stomach, pyloric caeca, intestine) were measured approximately biweekly between January and August 2021. In all populations, pumpkinseed exhibited pronounced structural flexibility in the GI tract, aligned with winter and the timing of reproduction. The dry mass of the GI increased by 1.3- to nearly 2.5-fold in the early spring. The pyloric caeca demonstrated the greatest capacity for flexibility, increasing by up to 3.7-fold prior to reproduction. In all populations, minimum dry GI mass was consistently achieved during winter and mid-summer. This capacity for gut flexibility may represent a novel mechanism for facilitating rapid adaptive responses (e.g., metabolic plasticity) to future environmental change.</p>
Figure 1 in Guidelines and quantitative standards to improve consistency in cetacean subspecies and species delimitation relying on molecular genetic data
Figure 1. Guidelines for studies of cetacean taxonomy based on genetic data.
Application Case 3: Data sets consisting of 3D scans, 3D model and the derived metadata, from two different software programs
<p>In this repository we provide 3D scan projects and the 3D models processed from them with their metadata using the example of a wood sample. The metadata was generated using our metadata generation script, which is described in the referenced publication.</p> <p>The 3D scan projects were created in different software (atos v6.2, atos 2016 and zeiss 2023). For each there is a scan project, a 3D model and the generated metadata with and without uri in this repository.</p> <p>The publication in which this application case is included: Homburg, T., Cramer, A., Raddatz, L. <em>et al.</em> Metadata schema and ontology for capturing and processing of 3D cultural heritage objects. <em>Herit Sci</em> <strong>9</strong>, 91 (2021). <a href="https://doi.org/10.1186/s40494-021-00561-w">https://doi.org/10.1186/s40494-021-00561-w</a></p> <p>Python scripts for exporting metadata can be found here: <a href="https://github.com/i3mainz/3dcap-md-gen/tree/0.1.3">GitHub - i3mainz/3dcap-md-gen</a></p>
Datasets for Yue et al. (2022), Atmospheric Measurement Techniques: "Evaluating the Consistency and Continuity of Pixel-Scale Cloud Property Data Records From Aqua and SNPP"
<p>Pixel scaled collocated AIRS, Aqua MODIS, SNPP CrIS, and SNPP VIIRS cloud retrieval products. These datasets are used to generate analyses and results presented in Yue et al. (2022, AMT): "Evaluating the Consistency and Continuity of Pixel-Scale Cloud Property Data Records From Aqua and SNPP"</p>
Data and scripts from: Long term analysis of social structure: evidence of age-based consistent associations in male Alpine ibex
<p>The folder contains the data and scripts used to produce the manuscript: "Long term analysis of social structure: evidence of age-based consistent associations in Alpine ibex" by Alice Brambilla, Achaz von Hardenberg, Claudia Canedoli, Francesca Brivio, Cédric Sueur and Christina R Stanley.</p>
Data from: Interannual consistency of migration phenology is season- and breeding region-specific in North American Golden Eagles
<p class="MsoNormal">Avian migrants can adjust the time they depart for migration and arrive at their destination (i.e. phenology) based on environmental conditions, the period of the annual cycle, and the distance of migration. Our study shows that interannual consistency (an indicator of the strength of adjustments) in migration schedule of Golden Eagles (Aquila chrysaetos) in North America was greatest in boreal spring migration and the breeding regions of eastern Canada, suggesting that migration schedule is partly environmentally driven. Using multi-year GPS tracks of 83 adults breeding in three spatially distant regions (Alaska, northeast Canada, and southeast Canada), we quantified the interannual consistency of migration timing with variations within individuals tracked across multiple years and among-individuals and repeatability (r) of migration schedule, duration, and wintering latitude by breeding regions and seasons. By comparing regions and seasons, we found that consistency was highest (r > 0.85) for the schedule of the boreal spring migration in eastern Canada while Alaska had the lowest value (r < 0.15). Since seasonal consistency of migration schedule was only detected in eastern Canada, we conclude that seasonal features are not the main constraint on consistency of migration schedule. While regional differences in consistency were not related to differences in migratory distances, they could be the result of genetic or habitat differences. We also found that warmer temperatures than the decadal average at the region of departure delayed the start of boreal spring migration by ~10 days and advanced boreal autumn migration by ~20 days. It suggests that warmer temperatures would reduce residence time on breeding grounds, which is contrary to expectations and trends found in other studies. Wide variations in migratory strategies across a species distribution can add to the lists of challenges for conservation yet such variations can give migrants the capacity to acclimate to environmental changes.</p>
Exploring Hierarchy and Dependency of Rules for Consistency Checking Between Code and Model (Evaluation Data)
<p>This repository contains the data related to the protocol and results of the evaluation conducted on the HiDeoCR approach. </p>
Data for the paper "Optimization of quasisymmetric stellarators with self-consistent bootstrap current and energetic particle confinement"
<p>Data for the paper "Optimization of quasisymmetric stellarators with self-consistent bootstrap current and energetic particle confinement"</p>
Analysis of Data Consistency of Howells' Craniometric Data Sets
<p>Derived data and R scripts for analyzing the data consistency of Howells' craniometric data sets.</p>
Replication data and code for: Environmental discourse exhibits consistency and variation across spatial scales on Twitter
<p>Social media platforms, such as Twitter, are an increasingly important source of information and are forums for discourse within and between interest groups. Research highlights how social media communities have amplified movements such as the Arab Spring, #MeToo, and Black Lives Matter. But environmental digital discourse remains underexplored. In the present article, we apply automated text analysis to 200,000 Twitter users in several countries following leading environmental nongovernmental organizations. Some issues such as public action to decarbonize society or species conservation were discussed more intensely than agriculture or marine conservation. Our results illustrate where environmental discourse diverges and converges on Twitter across countries, states, and characteristics, such as political ideology. Using the coterminous United States as a case study, we observed that the prominence of issues varies across states and, in some cases, covaries with political ideology across counties. Our findings show paths forward to characterizing environmental priorities across many issues at unprecedented scale and extent. In this repository, we provide data and code to reproduce the results in the main text of this manuscript. This replication code and dataset accompany this manuscript: https://doi.org/10.1093/biosci/biac051</p>
Data from: Understanding Test Convention Consistency as a Dimension of Test Quality
<div> <div>This archive provides additional data for the article "Understanding Test Convention Consistency</div> <div>as a Dimension of Test Quality" by Martin P. Robillard, Mathieu Nassif, and Muhammad Sohail,</div> <div>published in ACM Transactions on Software Engineering and Methodology.</div> </div>
The data for "Periodic Coronal Rain Driven by Self-consistent Heating Process in a Radiative Magnetohydrodynamic Simulation"
<p>The volumetric heating rate along the coronal loop at all time steps in the work is provided as 'appendix_heating.h5'. The Python script for reading and plotting the data is provided as 'read_appendix_heating.py'. Note that the python module 'h5py' is necessary to read .h5 file.</p>
Data and code for "Loss of pollinator diversity consistently reduces reproductive success for wild and cultivated plants"
<p>Data and code for "Loss of pollinator diversity consistently reduces reproductive success for wild and cultivated plants"</p>
Consistency Bias Data Sets
<p>This is the data set correspond to the calculation of Consistency Bias. This has been submitted for publication to a journal and will be linked directly to the manuscript when published.</p>
Genotype data not consistent with clonal transmission of sea turtle fibropapillomatosis or goldfish schwannoma
<p>Recent<b> </b>discoveries of transmissible cancers in multiple bivalve species suggest that direct transmission of cancer cells within species may be more common than previously thought, particularly in aquatic environments. Fibropapillomatosis occurs with high prevalence in green sea turtles (Chelonia mydas) and the geographic range of disease has increased since fibropapillomatosis was first reported in this species. Widespread incidence of schwannomas, benign tumours of Schwann cell origin, reported in aquarium-bred goldfish (Carassius auratus), suggest an infectious aetiology. We investigated the hypothesis that cancers in these species arise by clonal transmission of cancer cells. Through analysis of polymorphic microsatellite alleles, we demonstrate concordance of host and tumour genotypes in diseased animals. These results imply that the tumours examined arose from independent oncogenic transformation of host tissue and were not clonally transmitted. Further, failure to experimentally transmit goldfish schwannoma via water exposure or inoculation suggest that this disease is unlikely to have an infectious aetiology.</p>
Data for MILP algorithm for control strategy optimisation of a hybrid solar thermal plant consisting of two different solar fields working for two processes at different temperatures, a three tanks storage and a boiler for SHIP applications
<p>This repository contains the results of simulations exposed in the article <strong>MILP algorithm for control strategy optimisation of a hybrid solar thermal plant consisting of two different solar fields working for two processes at different temperatures, a three tanks storage and a boiler for SHIP applications.</strong></p> <p>Notebooks for easy plotting of the results are contained in this repository. The README.txt contains light explainations regarding how to use those notebooks.</p> <p>This article is yet to be published at the time of writing.</p> <p> </p>
Data from: Diversification dynamics in Caribbean rain frogs (Eleutherodactylus) are uncoupled from the anuran community and consistent with adaptive radiation
<p><span>Adaptive radiation</span><span> is proposed to play a key role in generating differences in species richness among lineages and geographic regions. Due to the importance of ecological divergence in adaptive radiation, species richness is predicted to be influenced by equilibrium diversity dynamics, although the concept continues to generate much debate. An additional important question is whether radiating clades have intrinsic biological characteristics that make them particularly prone to diversify. We tackle these questions by analyzing <em>i</em>) the temporal patterns of diversification of Caribbean <em>Eleutherodactylus</em> frogs, and <em>ii</em>) assembly of the complete native anuran community of the Caribbean archipelago (197 species), testing for the presence of equilibrium dynamics and whether diversification patterns of <em>Eleutherodactylus</em> differ from those of the rest of the Caribbean anurans. Diversification rates follow the predicted pattern of rapid diversification early in the radiation, which gradually decreases towards the present. <em>Eleutherodactylus</em> diversification is significantly faster than that of the Caribbean anuran community, and although equilibrium dynamics influence richness of all Caribbean anurans, <em>Eleutherodactylus</em> shows higher carrying capacity. Our results indicate that ecological opportunity <em>per se</em> is not sufficient for adaptive radiation and that diverse lineages present intrinsic characteristics that enable them to make the most of available opportunity.</span></p>
Data for: Liverworts show a globally consistent mid-elevation richness peak
<p>The study of elevational gradients allows to draw conclusions on factors and mechanisms determining patterns in species richness distribution. Several earlier studies investigated liverwort diversity on single or few elevational transects. However, a comprehensive survey on elevational distribution patterns of liverwort richness and their underlying factors is lacking so far. This study's purpose was to fill this gap by compiling an extensive dataset of liverwort elevational patterns encompassing a broad diversity of mountains and mountain ranges around the world. Using polynomial regression analyses, we found a prevalence of hump-shaped richness patterns (19 of 25 gradients), where liverwort species richness peaked at mid-elevation and decreased towards both ends of the gradient. Against our expectation and unlike in other plant groups, in liverworts, this pattern also applies to elevational gradients at mid-latitudes in temperate climates. Indeed, relative elevation, calculated as the percentage of the elevational range potentially inhabited by liverworts, was the most powerful predictor for the distribution of liverwort species richness. We conclude from these results that admixture of low- and high-elevation liverwort floras, in combination with steep ecological gradients, leads to a floristic turnover shaping elevational distribution patterns of liverwort diversity. Our analyses further detected significant effects of climatic variables (temperature of the warmest month, potential evapotranspiration, and precipitation of the warmest month) in explaining elevational liverwort richness patterns. This indicates that montane liverwort diversity is restricted by high temperatures and subsequent low water availability, especially towards lower elevations, which presumably will lead to serious effects by temperature shifts associated with global warming.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.