Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
5,805
datasets available to search
ShareScore release 0.9.0
Dataset results
5,805 results for “Data model”
Data from: Spatiotemporal modeling reveals high-resolution invasion states in glioblastoma
<p>Diffuse invasion of glioblastoma cells through normal brain tissue is a key contributor to tumor aggressiveness, resistance to conventional therapies, and dismal prognosis in patients. A deeper understanding of how components of the tumor microenvironment (TME) contribute to overall tumor organization and to programs of invasion may reveal opportunities for improved therapeutic strategies. Towards this goal, we applied a novel computational workflow to a spatiotemporally profiled GBM xenograft cohort, leveraging the ability to distinguish human tumor from mouse TME to overcome previous limitations in analysis of diffuse invasion. Our analytic approach, based on unsupervised deconvolution, performs reference-free discovery of cell types and cell activities within the complete GBM ecosystem. We present a comprehensive catalogue of 15 tumor cell programs set within the spatiotemporal context of 90 mouse brain and TME cell types, cell activities, and anatomic structures. Distinct tumor programs related to invasion were aligned with routes of perivascular, white matter, and parenchymal invasion. Furthermore, sub-modules of genes serving as program hubs were highly prognostic in GBM patients. The compendium of programs presented here provides a basis for rational targeting of tumor and/or TME components. We anticipate that our approach will facilitate an ecosystem-level understanding of immediate and long-term consequences of such perturbations, including identification of compensatory programs that will inform improved combinatorial therapies.</p>
Data for simultaneous inference of sea ice state and surface emissivity model using machine learning and data assimilation
<h2>Overview</h2> <p>This dataset supports the draft manuscript "Simultaneous inference of sea ice state and surface emissivity model using machine learning and data assimilation" which describes a way to infer the daily maps of the sea ice concentration and empirical properties of the sea ice (relating to its snow cover and its physical properties, such as air inclusions) along with the creation of a new empirical model for the sea ice surface emissivity. This is done using knowledge of the atmosphere state, skin temperature and ocean water emissivity from the European Centre for Medium-range Weather Forecasts (ECMWF) weather forecasting model and the observed radiances at microwave frequencies from the Advanced Microwave Scanning Radiometer 2 (AMSR2). The inverse modelling and state estimation is achieved by combining empirical machine learning elements in a Bayesian-inspired network along with a number of physical components. The work also introduces the idea of an "empirical state", in this case describing the aspects of the sea ice physical state which affect the observations, and which is defined by the inputs to the new empirical model component (in machine learning terms, it is defined by the latent input state of a neural network). This dataset includes the data used in training the model and inferring the sea ice parameters, as well as the outputs from that training process. The software used to perform the training is in Python and uses the Keras and Tensorflow software. See the draft manuscript for full details of this data.</p> <p>The code used in the draft manuscript is archived at <a href="https://doi.org/10.5281/zenodo.10013542">https://doi.org/10.5281/zenodo.10013542</a></p> <p>The data used in the draft manuscript is archived at <a href="https://doi.org/10.5281/zenodo.10033377">https://doi.org/10.5281/zenodo.10033377</a></p> <h2>Training data </h2> <h3>Observation space training and ancillary data</h3> <p>Training is done at the location of AMSR2 superobservations (superobs) over ocean with less than 1% land contamination and polewards of 45 degrees latitude, between 1st July 2020 and 30th June 2021. There are 64,184,021 superobs used. A superob is the average of all raw JAXA level 1B observations from one orbit falling into a grid box on an approximately constant area (reduced Gaussian) grid at approximately 40 km by 40 km resolution (noting that polar regions can thus have up to around 7 superobs per day). The superobs have been computed using the field of view central locations for each channel as derived from the JAXA level 1B data. A subset of 10 of the AMSR2 channels is used, from 10 GHz, V polarised, to 89 GHz, H polarised.</p> <p>At each superob location, the relevant fields from the ECMWF 12 hour 'background' forecast are interpolated to the observation time and location. The atmosphere is represented indirectly by the relevant radiative transfer terms from a scattering radiative transfer model. The sea ice concentration from the ECMWF OCEAN5 analysis is included as a validation reference but is not used in the training itself, except to provide a monthly mean first guess to speed up the training. Each field is provided in a separate netCDF file:</p> <ul> <li>field_v2_JULIAN_DAY.nc - superob time in days since 12 UTC on Nov 24th 4714 BC on the proleptic Gregorian calendar</li> <li>field_v2_LAT.nc - superob central latitude in degrees</li> <li>field_v2_LON.nc - superob central longitude in degrees</li> <li>field_v2_IGRID.nc - corresponding grid number on the map grid used in this work (see below)</li> <li>field_v2_OBSVALUE.nc - observed superob brightness temperature at each of 10 AMSR2 channels.</li> <li>field_v2_TSFC.nc - skin temperature computed by the ECMWF forecast model</li> <li>field_v2_WINDSPEED10M.nc - 10m wind speed computed by the ECMWF forecast model</li> <li>field_v2_EMIS_WATER.nc - Ocean water surface emissivity at 10 AMSR2 channels, simulated from the ECMWF forecast fields using the FASTEM-6 model</li> <li>field_v2_CLOUD_FRACTION.nc - Effective cloud fraction used in the atmospheric radiative transfer model at each of 10 AMSR2 channels</li> <li>field_v2_TAUSFC_CLD.nc - Surface to space transmittance in the cloudy column at each of 10 AMSR2 channels</li> <li>field_v2_TUP_CLD.nc - Upwelling brightness temperature from the atmosphere in the cloudy column at each of 10 AMSR2 channels</li> <li>field_v2_TDOWN_CLD.nc - Downwelling brightness temperature from the atmosphere in the cloudy column at each of 10 AMSR2 channels</li> <li>field_v2_TAUSFC.nc - Equivalently for the clear column</li> <li>field_v2_TUP.nc - Equivalently for the clear column</li> <li>field_v2_TDOWN.nc - Equivalently for the clear column</li> <li>field_v2_SEAICE.nc - Sea ice concentration from the ECMWF OCEAN5 analysis, for validation only (not used in training)</li> </ul> <h3>Grid space data: initial data for training; validation sea ice data</h3> <p>A number of properties are provided to the hybrid physical-empirical model that is being trained, on a special map grid defined in this project, including all 62,499 of the reduced Gaussian 40km grid points that have at least one superob at some point during the year of training data. These are:</p> <ul> <li>ifs_seaice_initials_year.nc - sea ice concentration from OCEAN5, monthly averaged on the grid, and then provided on all days of the relevant month as initial conditions (technically, first guess) for the training. This includes an additional day before the beginning of the training, used for time-lagging (see draft paper).</li> <li>ifs_tsfc_year_dailyx.nc - skin temperature from ECMWF forecast fields at observation locations, averaged onto the daily grid, to help provide constraints on the likelihood of sea ice as part of a sea ice loss function.</li> </ul> <p>For diagnostic and validation purposes, the ECMWF OCEAN5 analysis is also provided on the grid:</p> <ul> <li>ifs_seaice_year.nc - sea ice concentration from OCEAN5 at observation locations, averaged onto the daily grid</li> </ul> <p>All these fields are provided on the following dimensions:</p> <ul> <li>LON - the longitude of the grid point in degrees</li> <li>DAY - the day through the training year (0-364, 1st July 2020 to 30th June 2021) or through the training year extended forward by one day (30th June 2020) for the sea ice (0-365). In practice the days are offset by 3 hours from the UTC day to match the ECMWF data assimilation windows, which start at 21 UTC the day before.</li> </ul> <p>The latitude is also provided</p> <ul> <li>LAT - the latitude of the grid point in degrees</li> </ul> <p>Note that the observation location IGRID is on the custom grid of the ML model that is defined implicitly in these gridded files. The LON and LAT vectors in these files are the longitude and latitude points of the grid and are of 62499 in length. The IGRID number for an observation is the index into these arrays from 0-62498.</p> <h2>Outputs from training</h2> <p>The following files are the output and diagnostics from the year-long training. The python code and the draft paper are the primary documentation for these:</p> <ul> <li>models_year.nc - settings of the model are recorded here, along with the trained values of the smaller empirical components/layers within the hybrid model. For example, the layer weights of the wind speed bias correction, the observation space bias correction, and the empirical surface emissivity model are recorded here. The values of the loss function at each epoch are also recorded here.</li> <li>properties_year.nc - trained values of each of 3 empirical properties of sea ice on the map grid (3 properties by 62499 locations by 365 days from 1st July 2020)</li> <li>seaice_year.nc - inferred values of sea ice fraction on the map grid (62499 locations by 365 days from 1st July 2020, discarding the additional day at the start)</li> <li>tbsim_year.nc - simulated AMSR2 brightness temperatures from the trained network</li> <li>tbsim_initial_year.nc - simulated AMSR2 brightness temperatures using the untrained network</li> </ul> <p>The longitude and latitude of the map grid is found in any of the initial data files described in the previous section. The days are 0-364 corresponding to 1st July 2020 to 30th June 2021.</p> <h3>Sea ice surface emissivity at grid locations</h3> <p>A packaged version of the sea ice surface emissivity is provided at grid locations, alongside the surface emissivity model, the sea ice concentration and the four inputs to the model, i.e. the normalised skin temperature and the three empirical variables:</p> <ul> <li>emissivity_grid_year.nc</li> </ul> <p>Note that in the training, the surface emissivity is computed at observation locations and has not been stored due to memory limitations. For easier comparison to other datasets, the surface emissivity has been recomputed on grid locations in this package, using the year-long trained emissivity model and its trained inputs. The sea ice surface emissivity is only physically meaningful for sea ice concentrations above around 0.25. Also be aware of the "hole at the pole" which is the small region of the Arctic ocean that is sometimes not covered by an AMSR2 overpass, and which is found from 88 degrees N. On days where the hole or part of the hole exists, the sea ice emissivity on the grid is not valid at these locations. These locations can be identified by having all values of the empirical properties zero (because the empirical properties were never constrained by any observations on that day, and remain at their initial values before training).</p> <h2>Sensitivity tests</h2> <p>Extensive sensitivity tests were carried out, as described in the appendices of the draft paper and as documented in the Python code, using the month of August 2020 as an example. These required equivalent month-long training and initial data similar to those described above, but all observation space fields are contained within the same file in this case. Output files follow similar principles to those described above. The full package is provided as a tar file:</p> <ul> <li>sensitivity.tar</li> </ul> <p>This contains the training and initial files:</p> <ul> <li>amsr2_v2_202008.nc</li> <li>ifs_tsfc_dailyx_202008.nc</li> <li>ifs_seaice_202008.nc</li> </ul> <p>as well as directories containing the trained model outputs and diagnostics at each of the sensitivity tests, using the same formats as described for the yearly training, with these names:</p> <ul> <li>nprop - number of empirical properties</li> <li>epoch - number of epochs</li> <li>deep - configuration of the empirical sea ice emissivity model, including multiple layers of nonlinear dense neural network</li> <li>bseaice - background error for the sea ice physical bounds background error (loss) term</li> <li>bemis - background error for the sea ice emissivity background error (loss) term</li> <li>bbias - background error for the bias correction background error (loss) term</li> <li>batchsize - batch size used in training</li> <li>bbatchsize - extended epochs testing of batch size used in training</li> </ul> <h2>Licensing</h2> <p>This data product is published under a Creative Commons Attribution 4.0 International (CC BY 4.0). To view a copy of this licence, visit <a href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</a></p> <p>You are free to:</p> <ul> <li>Share — copy and redistribute the material in any medium or format</li> <li>Adapt — remix, transform, and build upon the material for any purpose, even commercially.</li> </ul> <p>Under the following terms:</p> <ul> <li>You must give appropriate credit (attribution) to ECMWF as outlined below, provide a link to the licence, and indicate if changes were made.</li> <li>No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the licence permits.</li> </ul> <p>The following wording shall be attached to the use of this ECMWF data product: </p> <ol> <li>Copyright statement: Copyright "© 2023 European Centre for Medium-Range Weather Forecasts (ECMWF)".</li> <li>Source <a href="http://www.ecmwf.int/">www.ecmwf.int </a>and <a href="https://doi.org/10.5281/zenodo.10009497">https://doi.org/10.5281/zenodo.10009497</a></li> <li>Licence Statement: This data is published under a Creative Commons Attribution 4.0 International (CC BY 4.0). <a href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</a></li> <li>Disclaimer: ECMWF does not accept any liability whatsoever for any error or omission in the data, their availability, or for any loss or damage arising from their use.</li> <li>Where applicable, an indication if the material has been modified and an indication of previous modifications.</li> <li>DOI: 10.5281/zenodo.10009498</li> </ol> <p>Original data for this value-added product was provided by Japan Aerospace Exploitation Agency (JAXA). Specifically, this dataset builds on the Advanced Microwave Scanning Radiometer 2 (AMSR2) level 1B data available from the JAXA G-Portal, https://gportal.jaxa.jp/gpr/, which has the following attribution and licensing:</p> <ol> <li>Give credit for the original data to JAXA, i.e. "Original data for this value added data product was provided by Japan Aerospace Exploration Agency"</li> <li>DOI for original JAXA data is L1B-Brightness temperature (TB) GCOM-W/AMSR2 L1B Brightness Temperature: <a href="https://doi.org/10.57746/EO.01gs73ans548qghaknzdjyxd2h">https://doi.org/10.57746/EO.01gs73ans548qghaknzdjyxd2h</a></li> <li>Original terms of data service from JAXA, with highlighted extracts: <ul> <li><a href="https://gportal.jaxa.jp/gpr/index/eula?lang=en">https://gportal.jaxa.jp/gpr/index/eula</a> <ol> <li>The user is entitled to use G-Portal data free of charge without any restrictions (including commercial use) except for the condition about acknowledgement of data credit as stipulated in Article 7.(2). (see above)</li> <li>JAXA is collecting results (papers, theses, reports, etc.) using G-Portal data. If you have any results using G-Portal data, please mail/e-mail a copy of the result to G-Portal Support Desk (Contact Information written at the end of the Terms of Use). We appreciate your cooperation very much.</li> </ol> </li> </ul> </li> </ol>
Data for: Direct measurement of dynamic attractant gradients reveals breakdown of the Patlak-Keller-Segel chemotaxis model
<p>Chemotactic bacteria not only navigate chemical gradients but also shape their environments by consuming and secreting attractants. Investigating how these processes influence the dynamics of bacterial populations has been challenging because of a lack of experimental methods for measuring spatial profiles of chemoattractants in real-time. Here, we use a fluorescent sensor for aspartate to directly measure bacterially generated chemoattractant gradients during collective migration. Our measurements show that the standard Patlak-Keller-Segel model for collective chemotactic bacterial migration breaks down at high cell densities. To address this, we propose modifications to the model that consider the impact of cell density on bacterial chemotaxis and attractant consumption. With these changes, the model explains our experimental data across all cell densities, offering new insight into chemotactic dynamics. Our findings highlight the significance of considering cell density effects on bacterial behavior and the potential for fluorescent metabolite sensors to shed light on the complex emergent dynamics of bacterial communities.</p>
Data from Uncertainty Ensembles of the MIT EPPA Model
<p>This data repository is created by the MIT Joint Program on the Science and Policy of Global Change (https://globalchange.mit.edu/) and makes available data resulting from ensembles of simulations of the MIT Economic Projection and Policy Analysis (EPPA) Model that were designed to quantify socio-economic uncertainties. </p>
Data sets for phylogenomic analyses in: Ant backbone phylogeny resolved by modelling compositional heterogeneity among sites in genomic data
<p>Ants are the most ubiquitous and ecologically dominant arthropods on Earth, and understanding their phylogeny is crucial for deciphering their character evolution, species diversification, and biogeography. Although recent genomic data have shown promise in clarifying intrafamilial relationships across the tree of ants, inconsistencies between molecular datasets have also emerged. Here I re-examine the most comprehensive published Sanger-sequencing and genome-scale datasets of ants using model comparison methods that model among-site compositional heterogeneity to understand the sources of conflict in phylogenetic studies. My results under the best-fitting model, selected on the basis of Bayesian cross-validation and posterior predictive model checking, identify contentious nodes in ant phylogeny whose resolution is <a>modelling-dependent. </a>I show that the Bayesian infinite mixture CAT model outperforms empirical finite mixture models (C20, C40 and C60) and that, under the best-fitting CAT-GTR+G4 model, the enigmatic <a><em>Martialis</em> </a><em>heureka</em> is sister to all ants except Leptanillinae, rejecting the more popular hypothesis supported under worse-fitting models, that place it as sister to Leptanillinae. These analyses resolve a lasting controversy in ant phylogeny and highlight the significance of model comparison and adequate modelling of among-site compositional heterogeneity in reconstructing the deep phylogeny of insects.</p>
Data from: Metabolomic profiles of acute and chronic ambient hydrogen sulfide exposure in a mouse model
<p>Hydrogen sulfide (H<sub>2</sub>S) is an environmental toxicant of health concern following acute or chronic human exposures. Male 6-8 week-old C57BL/6J mice were exposed by whole-body inhalation to 1000 ppm H<sub>2</sub>S for 45 min and euthanized at 5 min and 72 h for acute exposure. For subchronic study, mice were exposed to 5 ppm H<sub>2</sub>S 2 h/day, 5 days/week for 5 weeks. The brainstem was removed for metabolomic analysis. The metabolomics analyses consisted of three assays, (1) primary metabolism by GC-TOF MS, (2) biogenic amines (hydrophilic compounds) by HILIC-MS/MS and (3) lipidomics by RPLC-MS/MS. Metabolomics were performed in West Coast Metabolomics Center, University of California at Davis, CA, USA. 348, 311, and 565 known metabolites were detected and analyzed by primary metabolism, biogenic amines, and lipidomic metabolomics assays. 33, 19, and 46 metabolites were increased at 5 min and 72 h post acute H<sub>2</sub>S exposures and subchronic ambient H<sub>2</sub>S exposures, respectively, compared to room air control group. 22, 17, and 32 metabolites were decreased at 5 min and 72 h post acute H<sub>2</sub>S exposures and subchronic ambient H<sub>2</sub>S exposures, respectively, compared to room air control group. Acute H<sub>2</sub>S exposure decreased excitatory neurotransmitters aspartate and glutamate concentrations while the inhibitory neurotransmitter serotonin was increased. Glutamate and serotonin were also decreased after ambient H<sub>2</sub>S exposure. Branched-chain amino acids, fructose, and glucose were increased by acute H<sub>2</sub>S exposure. In ambient H<sub>2</sub>S exposure, glucose was decreased while MUFAs, PUFAs, inosine, and hypoxanthine were increased. Collectively, these results provide important mechanistic clues of acute and subchronic ambient H<sub>2</sub>S poisonings and show that H<sub>2</sub>S alters neurotransmission homeostasis.</p>
Thermal modeling of subduction zones with prescribed and evolving 2D and 3D slab geometries data
<p>Deforming subduction zone finite element model temperature, velocity, surface and flux field data as reported in the work:</p> <p>N. Sime, C. R. Wilson and P. E. van Keken<br> Thermal modeling of subduction zones with prescribed and evolving 2D and 3D slab geometries.</p>
Data from: Early diversification dynamics in a highly successful insular plant taxon are consistent with the general dynamic model of oceanic island biogeography
<p>The general dynamic model (GDM) of oceanic island biogeography views oceanic islands predominantly as sinks rather than sources of dispersing lineages. To test this, we conducted a biogeographic analysis of a highly successful insular plant taxon, <em>Cyrtandra </em>and inferred directionality of dispersal and founder events throughout the four biogeographical units of the Indo-Australian Archipelago (IAA), namely Sunda, Wallacea, Philippines, and Sahul. Sunda was recovered as the major source area, followed by Wallacea, a system of oceanic islands. The relatively high number of events originating from Wallacea is attributed to its central location in the IAA and its complex geological history selecting for increased dispersibility. We also tested if diversification dynamics in <em>Cyrtandra </em>follow predictions of adaptive radiation, which is the dominant process as per the GDM. Diversification dynamics of dispersing lineages of <em>Cyrtandra</em> in the Southeast Asian grade showed early bursts followed by a plateau, which is consistent with adaptive radiation. We did not detect signals of diversity-dependent diversification, and this is attributed to Southeast Asian cyrtandras<em> </em>occupying various niche spaces, evident by their wide morphological range in habit and floral characters. The Pacific clade, which arrived at the immaturity phase of the Pacific Islands, showed diversification dynamics predicted by the Island Immaturity Speciation Pulse (IISP) model, wherein rates increase exponentially, and their morphological range is controlled by the least action effect favoring woodiness and fleshy fruits. Our study provides a first step toward a framework for investigating diversification dynamics as predicted by the GDM in highly successful insular taxa.</p>
Behavioral data for: A preclinical model of THC edibles that produces high-dose cannabimimetic responses
<p>No preclinical experimental approach enables the study of voluntary oral consumption of high-concentration Δ<sup>9</sup>-tetrahydrocannabinol (THC) and its intoxicating effects, mainly owing to the aversive response of rodents to THC that limits intake. Here we developed a palatable THC formulation and an optimized access paradigm in mice to drive voluntary consumption.<strong> </strong>THC was formulated in chocolate gelatin (THC-E-gel). Adult male and female mice were allowed <em>ad libitum </em>access for 1 and 2 h. Cannabimimetic responses (hypolocomotion, analgesia, and hypothermia) were measured following access. Levels of THC and its metabolites were measured in blood and brain tissue. Acute acoustic startle responses were measured to investigate THC-induced psychotomimetic behavior. When allowed access for 2 h to THC-E-gel on the second day of a three-day exposure paradigm, adult mice consumed up to ≈30 mg/kg over 2 h which resulted in robust cannabimimetic behavioral responses (hypolocomotion, analgesia and hypothermia). Consumption of the same gelatin decreased on the following 3<sup>rd</sup> day of exposure. Pharmacokinetic analysis show that THC-E-gel consumption led to parallel accumulation of THC and its psychoactive metabolite, 11-OH-THC, in brain, a profile that contrasts with the known rapid decline in brain 11-OH-THC levels following THC intraperitoneal (<em>i.p</em>.) injections. THC-E-gel consumption increased the acoustic startle response in males but not in females, demonstrating a sex-dependent effect of consumption. Thus, while voluntary consumption of THC-E-gel triggered equivalent cannabimimetic responses in male and female mice, it potentiated acoustic startle responses preferentially in males. We build a dose-prediction model that included cannabimimetic behavioral responses elicited by <em>i.p.</em> versus THC-E-gel to test the accuracy and generalizability of this experimental approach and found that it closely predicted the measured acoustic startle results in males and females. In summary, THC-E-gel offers a robust preclinical experimental approach to study cannabimimetic responses triggered by voluntary consumption in mice, including sex-dependent psychotomimetic responses.</p>
Data supplement for "Drops on polymer brushes – advances in thin-film modelling of adaptive substrates"
<p>This dataset contains supplementary data for the following publication:</p> <p>Hartmann, S., Diekmann, J., Greve, D., and & Thiele, U.<br>Drops on polymer brushes – advances in thin-film modelling of adaptive substrates<br><span><em>Langmuir</em></span> <span>2024</span><span>, 40</span><span>, 8</span><span>, 4001–4021</span></p> <p>We provide the source files and data for figures 3-15.</p>
The global distribution of plants used by humans datasets: list of utilised species, occurrence data and model outputs at 10 arc-minutes spatial resolution
<p>Datasets and model outputs used to map the global distribution of utilised plants by humans. The folder is composed of two subfolders <em>raw_data</em> and <em>processed_data</em> containing respectively the list of utilised plant species modelled -<em>utilised_plants_species_list.csv</em>-, and their occurrence data -<em>occurrence_data.zip-</em> and predicted distribution -<em>species_proba_per_cell.rds-.</em></p> <p> </p> <ul> <li>The file <em>utilised_plants_species_list.csv</em> in the <em>raw_data</em> folder contains a<strong> </strong>list of 35687 plant species (and hybrids) used by humans and 10 plant use categories with the following 14 fields:</li> </ul> <p><strong>plant_ID:<em> </em></strong>plant identifier number ranging from between 1-35687</p> <p><strong>binomial_acc_name:</strong> binomial accepted name of the plant species</p> <p><strong>author_acc_name</strong>: name of the author(s)</p> <p><strong>is_hybrid:</strong> logical TRUE or FALSE indicating whether the species is an hybrid or not.</p> <p><strong>AnimalFood:</strong> forage and fodder for vertebrate animals only.</p> <p><strong>EnvironmentalUses:</strong> examples include intercrops and nurse crops, ornamentals, barrier hedges, shade plants, windbreaks, soil improvers, plants for revegetation and erosion control, wastewater purifiers, indicators of the presence of metals, pollution, or underground water.</p> <p><strong>Fuels:</strong> charcoal, petroleum substitutes, fuel alcohols, etc. Given the importance of energy plants for people, those were distinguished from Materials.</p> <p><strong>GeneSources:</strong> wild relatives of major crops which may possess traits associated with biotic or abiotic resistance and may be valuable for breeding programs.</p> <p><strong>HumanFood:</strong> food for humans only, including beverages and food additives.</p> <p><strong>InvertebrateFood:</strong> plants consumed by invertebrates used by humans, such as bees, silkworms, lac insects and edible grubs.</p> <p><strong>Materials:</strong> woods, fibers, cork, cane, tannins, latex, resins, gums, waxes, oils, lipids, etc. and their derived products.</p> <p><strong>Medicines:</strong> both human and veterinary.</p> <p><strong>Poisons:</strong> plants which are poisonous to both vertebrates and invertebrates, both accidentally and intentionally, e.g., for hunting and fishing, molluscicides, herbicides, insecticides.</p> <p><strong>SocialsUses:</strong> plants used for social purposes, which cannot be defined as food or medicine, for instance, masticatories, smoking materials, narcotics, hallucinogens and psychoactive drugs, and plants with ritual or religious significance.</p> <p><strong>Totals:</strong> total number of uses recorded for a species</p> <p> </p> <ul> <li>The zipfile <em>occurrence_data.zip</em> in the <em>processed_data</em> folder contains 35687 Comma Separated Values (CSV) files, one for each species, containing curated geographic occurrence records used to build species distribution models with the following 14 fields:</li> </ul> <p><strong>Species:</strong> the binomial accepted name of the species</p> <p><strong>Fullname:</strong> same as species</p> <p><strong>decimalLongitude:</strong> the geographic longitude of the occurrence records of the species in decimal degrees</p> <p><strong>decimalLatitude:</strong> the geographic latitude of the occurrence records of the species in decimal degrees</p> <p><strong>countryCode:</strong> a three-letter standard abbreviation for the country of the occurrence locality</p> <p><strong>coordinateUncertaintyinMeters</strong>: indicator for the accuracy of the coordinate location, described as the radius of a circle around the stated point location</p> <p><strong>year:</strong> year of the observation of the occurrence record of the species</p> <p><strong>individualCount:</strong> the number of individuals present at the time of the observation</p> <p><strong>gbifID:</strong> unique identifier number for the occurrence from the original database</p> <p><strong>basisOfRecords:</strong> the type of the individual record, e.g. observation, physical specimen, fossil, living ex-situ, culture collection specimen</p> <p><strong>institutionCode</strong>: the name of the institution or organization listed as the data publisher on GBIF</p> <p><strong>establishmentMeans:</strong> statement about whether an organism has been introduced to a given place and time through the direct or indirect activity of modern humans</p> <p><strong>is_cultivated_observation:</strong> whether or not an organism is cultivated</p> <p><strong>sourceID:</strong> name of the source database</p> <p> </p> <ul> <li>The file <em>species_proba_per_cell.rds</em> in the <em>processed_data</em> folder is<em> a R Data Serialization </em>(RDS) file containing a data.table object with the following 3 fields:</li> </ul> <p><strong>plant_ID:</strong><em> </em>plant identifier number ranging from between 1-35687</p> <p><strong>proba:</strong> species occurrence probability</p> <p><strong>cell:</strong><em> </em>raster grid cell number between 1-2251762</p> <p>This object can be used in combination with a raster layer to reconstruct the modelled distribution of each species or retrieve species richness and endemism.</p>
Data from: Statistical stream temperature modelling with SSN and INLA: an introduction for conservation practitioners
<p>Statistical stream temperature models can predict the fine-scale spatial distribution of water temperatures and guide species recovery and habitat restoration efforts. However, stream temperature modelling is complicated by spatial autocorrelation arising from non-independence data collected within dendritic networks. We used data from miniature sensors deployed in Canadian Rocky Mountain streams to develop and validate two statistical stream temperature modelling techniques that account for spatial autocorrelation. The first was based on spatial steam network models (SSNs) specifically developed to account for spatial autocorrelation in dendritic stream networks. The second used integrated nested Laplace approximation (INLA) that accounts for spatial autocorrelation but was not designed to address anisotropic stream network data. We evaluated the best-fitted SSN and INLA models using leave-one-out cross validation from the data collected along the stream network. Both modelling techniques had similar RMSE and MAE (near 1<sup>o</sup>C) and r<sup>2</sup> (> 0.6) values, and proved flexible with respect to implementation; however, the SSN models required more preprocessing steps before incorporating spatially correlated random errors. We provide practical advice and open-access data and r-script to help non-experts develop statistical stream temperature models of their own.</p>
Data from: A zebrafish model to elucidate the impact of host genes on the microbiota
<p>Every host species and organism provide a unique environmental niche contributing to the overall diversity of microbial ecosystems from the intestine of an animal to the oceans and forests of our planet. The study of host-microbiota interactions has long focused on the well-established effects the microbiota has on its host. In contrast, little focus has been allocated to the role of the host in these intricate interactions. However, understanding the role of the host may well be an essential key to understanding the complexity of the relationship between the host and its microbiota. In this study, we present a model in which the effects of host genes on the microbiota can be elucidated and how such genetic effects may shape host-associated microbiota. We demonstrate a hologenomic approach implementing the CRISPR/Cas system in the zebrafish model to combine the effects of a host gene with 16S metabarcoding and metabolomics data. We show that knocking out the gene coding for the rate-limiting enzyme in melanogenesis, tyrosinase <em>(tyr</em>), correlates with changes in the intestinal microbiota of zebrafish and differences in the abundance of specific metabolites illustrating the value of our model for studying the impact of host genes on the composition and function of the intestinal microbiota.</p>
Data of "Self-consistency Reinforced minimal Gated Recurrent Unit for surrogate modeling of history-dependent non-linear problems: application to history-dependent homogenized response of heterogeneous materials"
<h1>Development of the Self-Consistency reinforced Minimum Recurrent Unit (SC-MRU)</h1> <p>This directory contains the data and algorithms generated in publication<sup><a href="#fn-1-5292">1</a></sup></p> <h2>Table of Contents</h2> <ol> <li><a href="#dependencies-and-prerequisites">Dependencies and Prerequisites</a></li> <li><a href="#structure-of-repository">Structure of Repository</a></li> <li><a href="#part-1-data-preparation">Part 1: Data preparation</a></li> <li><a href="#part-2-rnn-training">Part 2: RNN training</a></li> <li><a href="#part-3-multiscale-analysis">Part 3: Multiscale analysis</a></li> <li><a href="#part-4-reproduce-paper1-figures">Part 4: Reproduce paper[^1] figures</a></li> </ol> <h2>Dependencies and Prerequisites</h2> <p> </p> <ul> <li> <p>Python, pandas, matplotlib, texttabble and latextable are pre requisites for visualizing and navigating the data.</p> </li> <li> <p>For generating mesh and for vizualization, gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) is required.</p> </li> <li> <p>For running simulations, cm3Libraries (<a href="http://www.ltas-cm3.ulg.ac.be/openSource.htm" target="_blank" rel="nofollow noreferrer noopener">http://www.ltas-cm3.ulg.ac.be/openSource.htm</a>) is required.</p> </li> </ul> <h3>Instructions using apt & pip3 package manager</h3> <p>Instructions for Debian/Ubuntu based workstations are as follows.</p> <h3>python, pandas and dependencies</h3> <div> <pre><code> sudo apt install python3 python3-scipy libpython3-dev python3-numpy python3-pandas</code></pre> </div> <h3>matplotlib, texttabble and latextable</h3> <div> <pre><code> pip3 install matplotlib texttable latextable</code></pre> </div> <h3>Pytorch (only for run with cm3Libraries)</h3> <ul> <li>Without GPU</li> </ul> <div> <pre><code> pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu</code></pre> </div> <ul> <li>With GPU</li> </ul> <div> <pre><code> pip3 install torch torchvision torchaudio</code></pre> </div> <h3>Libtorch (for compiling the cells)</h3> <ul> <li>Without GPU: In a local directory (e.g. <code>~/local</code> with <code>export TORCHDIR=$HOME/local/libtorch</code>)</li> </ul> <div> <pre><code> wget https://download.pytorch.org/libtorch/cpu/libtorch-shared-with-deps-2.1.1%2Bcpu.zip unzip libtorch-shared-with-deps-2.1.1%2Bcpu.zip</code></pre> </div> <ul> <li>With GPU: In a local directory (e.g. <code>~/local</code> with <code>export TORCHDIR=$HOME/local/libtorch</code>)</li> </ul> <div> <pre><code> wget https://download.pytorch.org/libtorch/cu121/libtorch-shared-with-deps-2.1.1%2Bcu121.zip unzip libtorch-shared-with-deps-2.1.1+cu121.zip</code></pre> </div> <h2>Structure of Repository</h2> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/All_Path_Res">All_Path_Res</a>: results of the direct numerical simulations used as training and testing data, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/ConstRVE">ConstRVE</a>: script to run direct numerical finite element simulations, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale</a>: scripts to run and visualise the multiscale analyses, see details in <a href="#part-3-multiscale-analysis">Part 3: Multiscale analysis</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU</a>: implementation of the RNN and scripts to train them, see details in <a href="#part-2-rnn-training">Part 2: RNN training</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a>: scripts to collect, normalise and truncate the RVEs direct simulation results as training and testing data, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>. The director also contained the storred processed data used in <sup><a href="#fn-1">1</a></sup>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a>: scripts to generate the different loading paths for the direct numerical simulations used as training and testing data, see details in <a href="#part-1-data-preparation">Part 1: Data preparation</a>.</li> </ul> <h2>Part 1: Data preparation</h2> <h3>Generate the loading paths</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/testGenerationData.py">TrainingPaths/testGenerationData.py</a> is used to generate random walk paths, with the options <ul> <li><code>Rmax = 0.11</code> # bound on the final Green Lagrange strain</li> <li><code>TimeStep = 1.</code> # in second</li> <li><code>EvalStep = [1e-4,5e-3]</code> #Bounds on the Green Lagrange increments</li> <li><code>Nmax = 2500</code> #maximum length of the sequence</li> <li><code>k = 4000</code> # number of path to generate</li> <li>The path are storred by default in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a>. The path has to be existing before launching the script. You can change the name in line 123 <code>saveDir = '../ConstRVE'+'/Paths/'</code>.</li> <li>Examples of generated paths can be found in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/ConstRVE/PathsExamples">ConstRVE/PathsExamples/</a></li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a> is</li> </ul> </li> </ul> <div> <pre><code>(mkdir ../ConstRVE/Paths) #if needed python3 testGenerationData.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/generationData_Cyclic.py">TrainingPaths/generationData_Cyclic.py</a> is used to generate random cylic paths, with the options <ul> <li><code>Rmax = [np.random.uniform(0.,0.04),np.random.uniform(0.,0.06),np.random.uniform(0.0,0.09),0.12]</code> # bound on the final Green Lagrange strain is random</li> <li><code>TimeStep = 1.</code> # in second</li> <li><code>EvalStep = [1e-4,5e-3]</code> #Bounds on the Green Lagrange increments</li> <li><code>Nmax = 2500</code> #maximum length of the sequence</li> <li><code>k = 2000</code> # number of path to generate</li> <li>The path are stored by default in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a>. You can change the name in line 123 <code>saveDir = '../ConstRVE'+'/Paths/'</code>.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a> is</li> </ul> </li> </ul> <div> <pre><code>(mkdir ../ConstRVE/Paths) #if needed python3 generationData_Cyclic.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/countPathLength.py">TrainingPaths/countPathLength.py</a> gives average, minimum and maximum lengths of the generated paths and the distribution of the <code>\Delta R</code>. By default the paths are read in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a> but the directory can be given as an argument. The file can be used to read <ul> <li>either the generated loading paths</li> </ul> </li> </ul> <div> <pre><code> python3 countPathLength.py '../ConstRVE/PathsExamples'</code></pre> </div> <ul> <li> <ul> <li>or the results of the <a href="#generate-the-rves-direct-simulation-results">simulations</a></li> </ul> </li> </ul> <div> <pre><code> python3 countPathLength.py '../All_Path_Res/Path_Res9'</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingPaths/graphData.py">TrainingPaths/graphData.py</a> generates illustrations from randomly picked paths in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a> and generate png figures.</li> </ul> <h3>Generate the RVEs direct simulation results</h3> <ul> <li>Uses the loading paths existing in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Paths">ConstRVE/Paths/</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/rve.geo">ConstRVE/rve.geo</a> is the RVE geometry file that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/rve.msh">ConstRVE/rve.msh</a> is the RVE mesh file that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/utilsFunc.py">ConstRVE/utilsFunc.py</a> contains python tools to be used.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/ConstRVE/Rve_withoutInternalVars.py">ConstRVE/Rve_withoutInternalVars.py</a> is used to run all the RVE simulations: <ul> <li>This requires cm3Libraries (<a href="http://www.ltas-cm3.ulg.ac.be/openSource.htm" target="_blank" rel="nofollow noreferrer noopener">http://www.ltas-cm3.ulg.ac.be/openSource.htm</a>).</li> <li>All the ouptus are stored in <code>All_Path_Res/Path_Res12</code>, you can change the name in line 71 <code>Path_Res = '../All_Path_Res/Path_Res12/'</code>. The results of RVE simulations are saved as the sequence (one configuration per line) of the Green-Lagrange strains and Second Piola-Kirchhoff stress (in column). One example can be found in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_Res1/data_path1000.csv">All_Path_Res/Path_Res1/data_path1000.csv</a>.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/ConstRVE">ConstRVE</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 Rve_withoutInternalVars.py</code></pre> </div> <h3>Collect, normalised and truncate the RVEs direct simulation results as training and testing data</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/CheckNanData.py">TrainingData/CheckNanData.py</a> is used to check the integrity of the direct numerical simulations results <ul> <li>DNS results are read from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res1">All_Path_Res/Path_res1</a> to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res11">All_Path_Res/Path_res11</a> subdirectories.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 CheckNanData.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/CollectData.py">TrainingData/CollectData.py</a> is used to gather all the direct numerical simulations results <ul> <li>DNS results are read from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res1">All_Path_Res/Path_res1</a> to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/All_Path_Res/Path_res11">All_Path_Res/Path_res11</a> subdirectories. It can be changed in line 31 <code>for ll in range(11):</code>.</li> <li>It saves the bounds and raw data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Bounds_GS">TrainingData/Processed_Data/Bounds_GS</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Origin_GS">TrainingData/Processed_Data/Origin_GS</a>, respectively.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 CollectData.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Normalization.py">TrainingData/Normalization.py</a> is used to normalise the gathered direct numerical simulations results <ul> <li>Bounds and raw data are read from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Bounds_GS">TrainingData/Processed_Data/Bounds_GS</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Origin_GS">TrainingData/Processed_Data/Origin_GS</a>, respectively.</li> <li>It saves the normalized training (75%) and testing (25%) data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Train">TrainingData/Processed_Data/Normalized_GS_Train</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Test">TrainingData/Processed_Data/Normalized_GS_Test</a>, respectively.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 Normalization.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/GaussCollectData.py">TrainingData/GaussCollectData.py</a> is an alternative using Gaussian normaliation and is used to gather all the direct numerical simulations results.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/GaussNormalization.py">TrainingData/GaussNormalization.py</a> is an alternative to normalise following a Gaussian the gathered direct numerical simulations results.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Data_Padding.py">TrainingData/Data_Padding.py</a> is used to pad and trim the normalised data <ul> <li>Normalized training (75%) and testing (25%) data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Train">TrainingData/Processed_Data/Normalized_GS_Train</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data/Normalized_GS_Test">TrainingData/Processed_Data/Normalized_GS_Test</a>, respectively.</li> <li>The final length of the sequence (including zero padding and trimming) is given by <code>N = 200</code>.</li> <li>It saves the trimmed and padded normalised training and testing data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data">TrainingData/Processed_Data/</a> as <code>'GS_Train'N</code> and <code>'GS_Test'N</code>, respectively.</li> <li>The command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingData">TrainingData</a> directory is</li> </ul> </li> </ul> <div> <pre><code> python3 Data_Padding.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Tool.py">TrainingData/Tool.py</a> is a list of function used to normalise dat.</li> </ul> <h2>Part 2: RNN training</h2> <h3>Available rnn</h3> <ul> <li>The different cells are in the following directories <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SMRU">SC_MRU/MGRU/NNW_SMRU</a>: Neural network with SMRU recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SCMRU_T">SC_MRU/MGRU/NNW_SCMRU_T</a>: Neural network with SC-MRU-T recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_MGRU">SC_MRU/MGRU/NNW_MGRU</a>: Neural network with orginal MGRU recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_MGRU_M">SC_MRU/MGRU/NNW_MGRU_M</a>: Neural network with modified MGRU recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/FNN_LeakyReLU">SC_MRU/FNN_LeakyReLU/NNW_<code>X</code>Fw</a>: Neural network with SC-MRU-I recurrent cell using <code>X</code> Feed Forward non-linear transition layers.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/Quadratic_NLT">SC_MRU/Quandratic_NLT/NNW_<code>X</code>Q, NNW_Q_Fw, NNW_Fw_Q</a>: Neural network with SC-MRU-I recurrent cell using <code>X</code> quadratic or mixed feed-forward-quadratic non-linear transition layers.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/ReferenceRNN">SC_MRU/ReferenceRNN/NNW_<code>X</code>Layers</a>: Neural network with SC-LMSC recurrent cell using <code>X</code> non-linear transition layers.</li> </ul> </li> </ul> <h3>Compile the neural network models</h3> <ul> <li>In the adequate directory, e.g. <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SMRU">SC_MRU/MGRU/NNW_SMRU</a> for the Neural network with SMRU recurrent cell.</li> </ul> <div> <pre><code> cd build rm -rf * cmake -DCMAKE_PREFIX_PATH=$TORCHDIR .. make</code></pre> </div> <ul> <li>This create the RNN_<code>CELL</code> model in the build directory</li> </ul> <h3>Train the neural network models</h3> <ul> <li>In the adequate directory, e.g. <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/MGRU/NNW_SMRU">SC_MRU/MGRU/NNW_SMRU</a> for the Neural network with SMRU recurrent cell.</li> <li>Requires to have <a href="#compile-the-neural-network-models">compiled</a> the RNN model.</li> <li>The file <code>Train.py</code> <ul> <li>Uses the RNN_<code>CELL</code> model compiled in the <code>build</code> directory.</li> <li>Uses the trimmed and padded normalised training and testing data in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/TrainingData/Processed_Data">TrainingData/Processed_Data/</a> as <code>'GS_Train'N</code> and <code>'GS_Test'N</code>, respectively.</li> <li>Can be modified to use the requested ratios of training and testing sequences of different lengths to prepate the mini-baches, e.g.: <ul> <li><code>ratio = [0.2,0.02,0.6,0.06,0.01,0.9]</code></li> <li><code>PathIn1 = ['../../../TrainingData/Processed_data/GS_Train200','../../../TrainingData/Processed_data/GS_Train2500','../../../TrainingData/Processed_data/GS_Test200','../../../TrainingData/Processed_data/GS_Test2500']</code></li> <li><code>PathIn2 = ['../../../TrainingData/Processed_data/GS_Test200','../../../TrainingData/Processed_data/GS_Test400','../../../TrainingData/Processed_data/GS_Test2500','../../../TrainingData/Processed_data/GS_Test400']</code></li> </ul> </li> <li>Saves the mini-batches in <ul> <li><code>PathOut = "TrainingData.pt"</code></li> </ul> </li> <li>Saves the model <code>module-checkpoint.pt</code> and <code>module-checkpoint-optimizer.pt</code>, and loss evolution <code>Loss.txt</code> in <ul> <li>Module/H<code>n</code> with <code>n</code> the number of hiden variables.</li> <li>Output directory can be changes in NNW_<code>CELL</code>.cpp of the cell name <code>CELL</code> (and recompiling).</li> <li>Warm start can be disabled in by commenting <code>torch::load(net, "./Module/H120/module-checkpoint_CM0.pt");</code> and <code>torch::load(optimizer, "./Module/H120/module-optimizer-checkpoint_CM0.pt");</code> in NNW_<code>CELL</code>.cpp of the cell name <code>CELL</code> (and recompiling).</li> <li>Is executed with</li> </ul> </li> </ul> </li> </ul> <div> <pre><code> python3 Train.py</code></pre> </div> <h3>Convert trained c++ models for pyTorch (in view of multiscale simulations)</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Save_RU.py">SC_MRU/CheckLoss/RU.py</a>: functions used to read and use the rnn models.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Save_RNN_script.py">SC_MRU/CheckLoss/Save_RNN_script.py</a>: <ul> <li>Converts c++ trained models to pyTorch models</li> <li>Reads the trained models in SC_MRU/CELL_<code>Kind</code>/NNW_<code>CELL</code>/Module/H<code>N</code>/module.pt</li> <li>Save the converted models to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> and to <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/Model">MultiScale/Model/</a></li> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells <code>cell=["SC_MRU_T","SC_MRU_I","SMRU"]</code>.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is</li> </ul> </li> </ul> <div> <pre><code>python3 Save_RNN_script.py</code></pre> </div> <h3>Vizualize loss evolution and testing results</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Data_prepare.py">SC_MRU/CheckLoss/Data_prepare.py</a> contains fucntion used for testing.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/LossVS_insertN.py">SC_MRU/CheckLoss/LossVS_insertN.py</a> tests the effect of testing data augmentation: <ul> <li>Requires to have <a href="#compile-the-neural-network-models">compiled</a> the RNN models.</li> <li>Cell type and augmentation kind can be modified: <ul> <li><code>repeat = 10</code> #number of tests</li> <li><code>dataType ='random'</code> #'even' or 'random'</li> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells ```cell=["SC_MRU_T","SC_MRU_I","SMRU"]``</li> <li><code>reevaluate= False</code> # <code>False</code> to use the saved loss values and <code>True</code> to evaluate the loss values</li> <li><code>fastshifting=False</code> # <code>False</code> to vizualize before fast shifting (Fig. 11) and <code>True</code> after (Fig. 12). When <code>reevaluate== True</code>, this has no effect: the training with fast-shifting or not has to be done manually, see <a href="#train-the-neural-network-models">details</a>.</li> </ul> </li> <li>Generates new Loss_<code>CELL</code>.txt and TrainingData.pt files in case <code>reevaluate== True</code>, read the existing one if <code>reevaluate== False</code>.</li> <li>Generates Figs. 11 and 12 from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a></li> </ul> </li> </ul> <div> <pre><code> python3 LossVS_insertN.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Plot_GS.py">SC_MRU/CheckLoss/Plot_GS.py</a> test the different NNW on RVE testing paths: <ul> <li>Requires to have <a href="#compile-the-neural-network-models">compiled</a> the RNN models.</li> <li>Cell type and augmentation kind can be modified: <ul> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells ```cell=["SC_MRU_T","SC_MRU_I","SMRU"]``</li> </ul> </li> <li>Generate Figs. 13, 14 and 15 from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a></li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 Plot_GS.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/CheckLoss/Plot_GS_step.py">SC_MRU/CheckLoss/Plot_GS_step.py</a> tests the different pyTorch NNWs on the RVE testing paths: <ul> <li>Requires to have <a href="#convert-trained-c-models-for-pytorch-in-view-of-multiscale-simulations">converted</a> the RNN models.</li> <li>Cell type and augmentation kind can be modified: <ul> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells ```cell=["SC_MRU_T","SC_MRU_I","SMRU"]``</li> </ul> </li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 Plot_GS_step.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_HiddenV.py">SC_MRU/PlotLoss_HiddenV.py</a> shows the loss evolution for the different number of hidden variables --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- for the SMRU cell: <ul> <li>Generates Fig. 8.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_HiddenV.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_3MRU.py">SC_MRU/PlotLoss_3MRU.py</a> shows the loss evolution for the different recurrent units --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- for the 120 hidden variables: <ul> <li>Generates Fig. 9.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_3MRU.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_RefNL_H120.py">SC_MRU/PlotLoss_RefNL_H120.py</a> shows the loss evolution for the different SC-LMSC and SC-MRU-I cells --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- for 120 hidden variables: <ul> <li>Generates Fig. 10.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_RefNL_H120.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_MGRU.py">SC_MRU/PlotLoss_MGRU.py</a> shows the loss evolution for the original and modified MGRU --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- and for the 120 hidden variables: <ul> <li>Generates Fig. A.18.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_MGRU.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_NL.py">SC_MRU/PlotLoss_NL.py</a> shows the loss evolution for the different non-liner transition layers (quadratic and Leaky ReLU) of the SC-MRU-I cell --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- and for the 120 hidden variables: <ul> <li>Generates Fig. B.19.</li> <li><code>Case=1</code> # 0 for quadratic transition blocks and 1 for Leaky ReLU transition blocks</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_NL.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/SC_MRU/PlotLoss_DiffNL_H120.py">SC_MRU/PlotLoss_DiffNL_H120.py</a> shows the loss evolution for the different non-liner transition layers (hybrid) of the SC-MRU-I cell --<a href="#train-the-neural-network-models">after having trained</a> or using saved loss files-- and for the 120 hidden variables: <ul> <li>Generates Fig. B.20.</li> <li>Command to be run from <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> </li> </ul> <div> <pre><code> python3 PlotLoss_DiffNL_H120.py</code></pre> </div> <h2>Part 3: Multiscale analysis</h2> <h3>Trained surrogate models</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/Model">MultiScale/Model</a>: contains the different rnn <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/Bounds_GS">MultiScale/Model/Bounds_GS</a>: Bounds.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/DInpFullModel.pt">MultiScale/Model/DInpFullModel.pt</a>: trained rnn with <code>SC-MRU-T</code> recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/IncrementModel.pt">MultiScale/Model/IncrementModel.pt</a>: trained rnn with <code>SC-MRU-I</code> recurrent cell.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/Model/FullModel.pt">MultiScale/Model/FullModel.pt</a>: trained rnn with <code>SMRU</code> recurrent cell.</li> </ul> </li> </ul> <h3>Run mutiscale simulations using the surrogates</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/model.geo">MultiScale/2D_MultiScale/model.geo</a>: geometry of the macro-scale model that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/model.msh">MultiScale/2D_MultiScale/model.msh</a>: mesh of the macro-scale model that can be read by gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>).</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/model.py">MultiScale/2D_MultiScale/model.py</a>: is used to run all the multiscale simulation: <ul> <li>This requires cm3Libraries (<a href="http://www.ltas-cm3.ulg.ac.be/openSource.htm" target="_blank" rel="nofollow noreferrer noopener">http://www.ltas-cm3.ulg.ac.be/openSource.htm</a>).</li> <li>Uses the bounds and trained models in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/Model">MultiScale/Model</a>.</li> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells <code>cell=["SC_MRU_T","SC_MRU_I","SMRU"]</code>.</li> <li><code>factorStep= 100</code> # is the number of steps x 20 during the reloading stage between points B and C.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/2D_MultiScale">MultiScale/2D_MultiScale/</a> is</li> </ul> </li> </ul> <div> <pre><code>python3 model.py</code></pre> </div> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2">MultiScale/FE2</a>: <ul> <li>Contains the reference displacement-force results of the FE2 simulation.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2/Distributions">MultiScale/FE2/Distributions</a>: contains the macro-scale displacement and stress fields. They can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> </ul> </li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_<code>STEPS</code></a>: <ul> <li>Contain the reference displacement-force results of the rnn-based multiscale simulations for the different recurrent cells <code>CELL</code> and steps number <code>STEPS</code> during the reloading stage between points B and C.</li> <li>For the cases <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_20</a>, the macro-scale displacement and stress fields are also available and can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> </ul> </li> </ul> <h3>Vizualize mutiscale simulations results</h3> <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/2D_MultiScale/plot_force.py">MultiScale/2D_MultiScale/plot_force.py</a>: is used to plot the multiscale simulations results: <ul> <li><code>InpType = cell[0]</code> #choose the recurrent cell typeAmong the different available cells <code>cell=["SC_MRU_T","SC_MRU_I","SMRU"]</code>.</li> <li>The multiscale simulations results to be plotted are saved in the directories <code>CELL_120_Step</code>, where <code>Step</code> # is the number of steps during the reloading stage between points B and C.</li> <li>The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/2D_MultiScale">MultiScale/2D_MultiScale/</a> is</li> </ul> </li> </ul> <div> <pre><code>python3 plot_force.py</code></pre> </div> <ul> <li>To vizualize the macro-scale displacement and stress fields distributions: <ul> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2/Distributions">MultiScale/FE2/Distributions</a>: contains the macro-scale displacement and stress fields. They can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> <li><a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_20</a>, the macro-scale displacement and stress fields are also available and can be vizualized with gmsh (<a href="http://www.gmsh.info" target="_blank" rel="nofollow noreferrer noopener">www.gmsh.info</a>) using the mesh file <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/blob/main/MultiScale/FE2/Distributions/model.msh">model.msh</a>.</li> </ul> </li> </ul> <h2>Part 4: Reproduce paper<sup><a href="#fn-1">1</a></sup> figures</h2> <ul> <li>Fig. 7: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/TrainingPaths">TrainingPaths</a> is</li> </ul> <div> <pre><code> python3 countPathLength.py '../ConstRVE/PathsExamples'</code></pre> </div> <ul> <li>Fig. 9: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> <div> <pre><code> python3 PlotLoss_HiddenV.py</code></pre> </div> <ul> <li>Fig. 10: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> <div> <pre><code> python3 PlotLoss_3MRU.py</code></pre> </div> <ul> <li>Fig. 11: The command to be run from the diretory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU">SC_MRU/</a> is</li> </ul> <div> <pre><code> python3 PlotLoss_DiffNL_H120.py</code></pre> </div> <ul> <li>Figs. 12 and 13: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 LossVS_insertN.py</code></pre> </div> <ul> <li>Figs. 14, 15 and 16: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a></li> </ul> <div> <pre><code> python3 Plot_GS.py</code></pre> </div> <ul> <li>Figs. 17(b)(c)(d): The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/2D_MultiScale">MultiScale/2D_MultiScale/</a> is, see <a href="#vizualize-mutiscale-simulations-results">details</a>:</li> </ul> <div> <pre><code>python3 plot_force.py</code></pre> </div> <ul> <li>Figs. 18-23: Need gmsh to vizualize the results stored in <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale/FE2/Distributions">MultiScale/FE2/Distributions</a> and <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/MultiScale">MultiScale/S<code>CELL</code>_120_20</a>, see <a href="#vizualize-mutiscale-simulations-results">details</a></li> <li>Fig. A.24: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 PlotLoss_MGRU.py.py</code></pre> </div> <ul> <li>Fig. B.25: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 PlotLoss_NL.py</code></pre> </div> <ul> <li>Fig. B.26: The command to be run from the directory <a href="../didearot/didearotPublic/publicationsData/2024_scmru/-/tree/main/SC_MRU/CheckLoss">SC_MRU/CheckLoss/</a> is, see <a href="#vizualize-loss-evolution-and-testing-results">details</a></li> </ul> <div> <pre><code> python3 PlotLoss_DiffNL_H120.py</code></pre> </div> <h2>Disclaimer</h2> <p>This project has received funding from the European Union’s Horizon Europe Framework Programme under grant agreement No. 101056682 for the project “DIgital DEsign strategies to certify and mAnufacture Robust cOmposite sTructures (DIDEAROT)”. The contents of this publication are the sole responsibility of ULiege and do not necessarily reflect the opinion of the European Union. Neither the European Union nor the granting authority can be held responsible for them.</p> <ol> <li> <p>The work is described in:<br>"<em>Wu, L. and Noels, L. (2024).</em> <strong>Self-consistency Reinforced minimal Gated Recurrent Unit for surrogate modeling of history-dependent non-linear problems: application to history-dependent homogenized response of heterogeneous materials</strong> 424: 116881, <a href="https://doi.org/10.1016/j.cma.2024.116881" target="_blank" rel="nofollow noreferrer noopener">doi: 10.1016/j.cma.2024.116881</a>" which can be downloaded. We would be grateful if you could cite this publication in case you use the files. <a href="#fnref-1-5292">↩</a> <a href="#fnref-1-2">↩<sup>2</sup></a> <a href="#fnref-1-3">↩<sup>3</sup></a></p> </li> </ol>
Data for: Information accessibility, accounting manipulation, and sustainable development of digital enterprises: Based on double moderating effect model and panel PSM-DID method
<p>A theoretical mechanism was analyzed from the micro perspective of the enterprise to explore how information accessibility moderates the effect of accounting manipulation on the sustainable development of digital enterprises. Using data from 1200 listing digital enterprises in China and the DEA-Malmquist index method, the efficiency value of digital enterprises in 2007–2021 was estimated to represent the index of sustainable development of digital enterprises. The accounting manipulation was detected using the panel PSM-DID method based on the Administrative Measures for the Recognition of High-tech Enterprise's policy. The information accessibility value was estimated based on the MDA method. Empirical studies were conducted using text analysis, the panel PSM-DID method, and the double moderating effect model. The results showed that: (1) Accounting manipulation had a negative impact on the sustainable development of "true" digital enterprises and the "fake" digital enterprises; (2) Information accessibility directly and positively enhanced the technological progress and scale efficiency of digital enterprises, and its moderating effect was heterogeneous, with a significant moderating effect on the "true" digital enterprises and a negative effect on the "fake" ones.</p>
Evaluation data for: Adaptive sampling by citizen scientists improves species distribution model performance: a simulation study
<p>All of the evaluation data for the simulations in the paper: Adaptive sampling by citizen scientists improves species distribution model performance: a simulation study. We considered the impact of five adaptive sampling methods on the performance of species distribution models (SDMs), please see the paper for more information. Contained in this repository are the evaluation metrics (AUC, mean square error (MSE) and correlation) for SDMs before and after adaptive sampling has taken place. The MSE and correlation evaluation metrics were calculated against the true distributions of the species. These files are those with "combined_outputs" in the titles. The repository also contains the observations of all the species in the simulations both before and after adaptive sampling (the files with "all_observations" in the title.</p> <p>These datasets are to be used with the plotting and evaluation scripts in the GitHub repository associated with the paper.</p>
Raw data for the creation of a maturity model for Catalogues of Semantic Artefacts
<p>This dataset includes two data collections (in two different formats, i.e. CSV and XLSX) with the raw data used for creating the <a href="https://doi.org/10.5281/zenodo.10618105">Maturity Dimensions and Sub-Criteria for Catalogues of Semantic Artefacts</a>. In particular:</p> <p>1. <em>Dimension identification in literature</em> includes the list of relevant materials gathered involving all the members of the EOSC Task Force on Semantic Interoperability that include (1) definitions of semantic artefact catalogues and (2) dimensions that can be used to measure the maturity of such catalogues;</p> <p>2. <em>Catalogue assessment</em> is the result of the analysis of 26 different catalogues of semantic artefacts against the dimensions and sub-criteria described in the maturity model.</p>
Data from: Abundance models of endemic birds of the Sierra Nevada de Santa Marta, northern South America, suggest small population sizes and dependence on montane elevations
<p>Abundance measures are almost non-existent for several bird species threatened with extinction, particularly range-restricted Neotropical taxa, for which estimating population sizes can be challenging. Here we use data collected over nine years to explore the abundance of 11 endemic birds from the Sierra Nevada de Santa Marta (SNSM), one of Earth's most irreplaceable ecosystems. We established 99 transects in the "Cuchilla de San Lorenzo" Important Bird Area within native forest, early successional vegetation, and areas of transformed vegetation by human activities. A total of 763 bird counts were carried out covering the entire elevation range in the study area (~175–2650 m). We applied hierarchical distance-sampling models to assess elevation- and habitat-related variation in local abundance and obtain values of population density and total and effective population size. Most species were more abundant in the montane elevational range (1800–2650 m). Habitat-related differences in abundance were only detected for five species, which were more numerous in either early succession, secondary forest, or transformed areas. Inferences of effective population size indicated that at least four endemics likely maintain populations no larger than 15,000–20,000 mature individuals. Estimates of species' area of occupancy and effective population size were lower than most values previously described, a possible consequence of increasing anthropogenic threats. At least four of the endemics exceeded criteria for threatened species listing and a thorough evaluation of their extinction risk should be conducted. Population strongholds for most of the study species were located on the northern and western slopes of the SNSM between 1500–2700 m. We highlight the urgent need for facilitating effective protection of native vegetation in premontane and montane ecosystems to safeguard critical habitats for the SNSM's endemic avifauna. Follow-up studies collecting abundance data across the SNSM are needed to obtain precise range-wide density estimations for all species.</p>
Raw data and R code for statistical analyses from: Sensory trap leads to reliable communication without a shift in nonsexual responses to the model cue
<p>The sensory trap model of signal evolution suggests that males manipulate females into mating using traits that mimic cues used in a nonsexual context. Despite much empirical support for sensory traps, little is known about how females evolve in response to these deceptive signals. Female sea lamprey (<em>Petromyzon marinus</em>) evolved to discriminate a male sex pheromone from the larval odor it mimics and orient only towards males during mate search. Larvae and males release the attractant 3-keto petromyzonol sulfate (3kPZS), but spawning females avoid larval odor using the pheromone antagonist, petromyzonol sulfate (PZS), which larvae but not males, release at higher rates than 3kPZS. We tested the hypothesis that migratory females also discriminate between larval odor and the male pheromone and orient only to larval odor during anadromous migration, when they navigate within spawning streams using larval odor before they begin mate search. In-stream behavioral assays revealed that, unlike spawning females, migratory females do not discriminate between mixtures of 3kPZS and PZS applied at ratios typical of larval versus male odorants. Our results indicate females discriminate between the sexual and nonsexual sources of 3kPZS during but not outside of mating and show sensory traps can lead to reliable sexual communication without females shifting their responses in the original context.</p>
Raw data and outputs from: Sensory trap leads to reliable communication without a shift in nonsexual responses to the model cue
<p>The sensory trap model of signal evolution suggests that males manipulate females into mating using traits that mimic cues used in a nonsexual context. Despite much empirical support for sensory traps, little is known about how females evolve in response to these deceptive signals. Female sea lamprey (<em>Petromyzon marinus</em>) evolved to discriminate a male sex pheromone from the larval odor it mimics and orient only towards males during mate search. Larvae and males release the attractant 3-keto petromyzonol sulfate (3kPZS), but spawning females avoid larval odor using the pheromone antagonist, petromyzonol sulfate (PZS), which larvae but not males, release at higher rates than 3kPZS. We tested the hypothesis that migratory females also discriminate between larval odor and the male pheromone and orient only to larval odor during anadromous migration, when they navigate within spawning streams using larval odor before they begin mate search. In-stream behavioral assays revealed that, unlike spawning females, migratory females do not discriminate between mixtures of 3kPZS and PZS applied at ratios typical of larval versus male odorants. Our results indicate females discriminate between the sexual and nonsexual sources of 3kPZS during but not outside of mating and show sensory traps can lead to reliable sexual communication without females shifting their responses in the original context.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.