Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
180
datasets available to search
ShareScore release 0.9.0
Dataset results
180 results for “Cloud dataset”
Dataset for paper "Ejecta cloud distributions for the statistical analysis of impact cratering events onto asteroids' surfaces: a sensitivity analysis"
<p>Dataset for the paper "Ejecta cloud distributions for the statistical analysis of impact cratering events onto asteroids' surfaces: a sensitivity analysis" published in Icarus.</p>
Dataset for the paper "Anomaly Detection in Large-Scale Cloud Systems: An Industry Case and Dataset"
<p>We present a large-scale anomaly detection dataset collected from IBM Cloud's Console over approximately 4.5 months. This high-dimensional dataset captures telemetry data from multiple data centers, specifically designed to aid researchers in developing and benchmarking anomaly detection methods in large-scale cloud environments. It contains 39,365 entries, each representing a 5-minute interval, with 117,448 features/attributes, as interval_start is used as the index. The dataset includes detailed information on request counts, HTTP response codes, and various aggregated statistics. The dataset also includes labeled anomaly events identified through IBM's internal monitoring tools, providing a comprehensive resource for real-world anomaly detection research and evaluation.</p> <p><strong>File Descriptions</strong></p> <ul> <li><code>location_downtime.csv</code> - Details planned and unplanned downtimes for IBM Cloud data centers, including start and end times in ISO 8601 format.</li> <li><code>unpivoted_data.parquet</code> - Contains raw telemetry data with 413 million+ rows, covering details like location, HTTP status codes, request types, and aggregated statistics (min, max, median response times).</li> <li><code>anomaly_windows.csv</code> - Ground truth for anomalies, listing start and end times of recorded anomalies, categorized by source (Issue Tracker, Instant Messenger, Test Log).</li> <li><code>pivoted_data_all.parquet</code> - Pivoted version of the telemetry dataset with 39,365 rows and 117,449 columns, including aggregated statistics across multiple metrics and intervals.</li> <li><code>demo/demo.[ipynb|html]</code>: This demo file provides examples of how to access data in the Parquet files, available in Jupyter Notebook (<code>.ipynb</code>) and HTML (<code>.html</code>) formats, respectively.</li> </ul> <p>Further details of the dataset can be found in <strong>Appendix B: Dataset Characteristics</strong> of the <a href="https://arxiv.org/abs/2411.09047">paper</a> titled <strong><em>"Anomaly Detection in Large-Scale Cloud Systems: An Industry Case and Dataset."</em></strong> Sample code for training anomaly detectors using this data is provided in <a href="https://doi.org/10.5281/zenodo.14598119" target="_blank" rel="noopener">this package</a>.</p> <p> </p> <p>When using the dataset, please cite it as follows:</p> <pre><code>@misc{islam2024anomaly,</code><br><code> title={Anomaly Detection in Large-Scale Cloud Systems: An Industry Case and Dataset}, </code><br><code> author={Mohammad Saiful Islam and Mohamed Sami Rakha and William Pourmajidi and Janakan Sivaloganathan and John Steinbacher and Andriy Miranskyy},</code><br><code> year={2024},</code><br><code> eprint={2411.09047},</code><br><code> archivePrefix={arXiv},</code><br><code> url={https://arxiv.org/abs/2411.09047}</code><br><code>}</code></pre> <p> </p>
New Challenges in Point Cloud Visual Quality Assessment: A Systematic Review (Dataset)
<p>This dataset is a collection of annotated information on the scientific papers screened and analyzed for the systematic review of the literature in Point Cloud Visual Quality Assessment. </p> <p>The data is structured as follows:</p> <ul> <li>General information <ul> <li>Document title</li> <li>Authors</li> <li>Year of publication</li> <li>Venue (Conference or Journal title)</li> <li>Citations (number)</li> <li>URL/DOI</li> </ul> </li> </ul> <ul> <li>About the content <br> <ul> <li>Content Type: Point clouds (PC), Colored Point clouds (CPC), Meshes, Dynamic Point Clouds (DPC)</li> <li>Content source: Source of the content used in a subjective QA test or the evaluation of one or more QA metrics</li> </ul> </li> </ul> <ul> <li>About metric benchmarks <ul> <li>Subjective Ground-truth Data: Dataset(s) Source of the subjective scores used as ground-truth in a QA metric benchmark</li> <li>Assessed Metrics: Types of metrics assessed in a benchmark (JPEG standards, IQM, NR, State-of-the-art, others)</li> <li>Performance Measures: PLCC, SROCC, KRCC, RMSE, OR, others</li> </ul> </li> </ul> <ul> <li>About Objective QA metrics <ul> <li>Metric: Name given to the metric introduced in this paper</li> <li>Base: 3D-based or Projection-based</li> <li>Categories: Categories that characterize the approach of the proposed metric (Feature-based, Learning-Based, Perceptual-based, IQM, others) </li> <li>Reference: Full-Reference (FR), Reduced-Reference (RR) or No-Reference (NR)</li> </ul> </li> </ul> <ul> <li>About Subjective QA experiments <ul> <li>Display: Type of display (2D, 3D, AR, MR, VR) and interaction approach (passive, interactive, 3DoF, 6DoF) used in the described experiment.</li> <li>Rendering: Type of rendering used to display the stimuli (Points, Squares, Cubes, Surface)</li> <li>Lab/Remote: The experiment was run in one or more lab environments, or remotely (Lab, Cross-Lab, Remote)</li> <li>Rating: Subjective rating methodology used in the experiment (ACR, DSIS, PWC, others)</li> <li>Dataset: Name of the new subjective dataset if the experiment's results were published.</li> <li>Observers: Number of observers </li> <li>Distortion type: Types of distortions applied to the stimuli and assessed in the experiment</li> </ul> </li> </ul>
LigPCDS: Labeled Dataset of X-ray Protein Ligand Images in 3D Point Cloud and Validated Deep Learning Models
<p>The difference electron density from X-ray protein crystallography was used to create the first dataset of labeled ligand images in 3D point clouds, named <strong>LigPCDS</strong>. The dataset contain 244,226 entries of free organic ligands containing 3D representations labeled with two major labeling approaches: SP-based and AtomSymbol-based.</p> <p> </p> <p>The data from free organic molecules (non-covalent ligands) was retrieved from the Research Collaboratory for Structural Bioinformatics Protein Data Bank (RCSB PDB) in december 2019 with resolutions ranging from 1.5 to 2.2 Å. The ligand images (blobs) were interpolated from their calculated difference electron density map in a 3D grid-like bounding box, around their atomic positions, and stored in point clouds. These ligand grid representations were further processed to retrive the final ligands representation in 3D point clouds using a mask of the shape of the ligand. A grid spacing of 0.5 Å gave the best results. The density value of the grid points was used as feature. The labeling approach used the structure of the ligands to propose vocabularies of chemical classes based on the chemical atoms themselves and their cyclic substructures. These structure annotations were applied pointwise to the ligand 3D representations using an atomic sphere model. Four proposed vocabularies were validated by successfully training good performance deep learning models for the semantic segmentation of a stratified dataset from LigPCDS, using 78902 entries.</p> <p>The four validated deep learning models are: (i) the LigandRegion, composed by generic atoms of any type; (ii) the AtomCycle, composed by generic atoms outside cycles and generic cycles; (iii) the AtomC347CA56, composed by generic atoms outside cycles, not aromatic cycles of size 3 to 7 and aromatic cycles of size 5 and 6; and (iv) the AtomSymbolGroups, composed by the atoms symbols with groupings. The mean accuracy of these models in their cross-validation was between 49.7% <span lang="EN-GB">[-19.4,20.</span><span lang="EN-GB">2]</span> and 77.4% <span lang="EN-GB">[-11.7,12.1]</span> in terms of Intersection over Union (mIoU) metric and between 62.4% <span lang="EN-GB">[-18.8,19.</span><span lang="EN-GB">7]</span> and 87.0% <span lang="EN-GB">[-8.4,8.8]</span> in F1-score (mF1), confidence interval between squared brackets. The models i, ii and iii and the used labeled representations in 3D point cloud are contained in the SP-based record; and model iv and its used labeled representations are contained in the AtomSymbol-based record.</p> <p>The dataset and validated models may be used to tackle problems regarding known and unknown ligand building to drug discovery and fragment screening pipelines. </p> <p>The code used to create and validated the LigPCDS is available at the following repository: https://github.com/danielatrivella/np3_ligand</p> <p>This repository also contains the NP³ Blob Label application for ligand building using the validated deep learning models from LigPCDS.</p>
Extended datasets from MM-IMDB and Ads-Parallelity dataset with the features from Google Cloud Vision API
<p>This is extended datasets from MM-IMDB [<a href="https://openreview.net/forum?id=S12_nquOe">Arevalo+ ICLRW'17</a>], Ads-Parallelity [<a href="https://arxiv.org/abs/1807.08205">Zhang+ BMVC'18</a>] dataset with the features from Google Cloud Vision API. These datasets are stored in jsonl (JSON Lines) format.</p> <p><strong>Abstract (from our paper):</strong></p> <p>There is increasing interest in the use of multimodal data in various web applications, such as digital advertising and e-commerce. Typical methods for extracting important information from multimodal data rely on a mid-fusion architecture that combines the feature representations from multiple encoders. However, as the number of modalities increases, several potential problems with the mid-fusion model structure arise, such as an increase in the dimensionality of the concatenated multimodal features and missing modalities. To address these problems, we propose a new concept that considers multimodal inputs as a set of sequences, namely, deep multimodal sequence sets (DM<sup>2</sup>S<sup>2</sup>). Our set-aware concept consists of three components that capture the relationships among multiple modalities: (a) a BERT-based encoder to handle the inter- and intra-order of elements in the sequences, (b) intra-modality residual attention (IntraMRA) to capture the importance of the elements in a modality, and (c) inter-modality residual attention (InterMRA) to enhance the importance of elements with modality-level granularity further. Our concept exhibits performance that is comparable to or better than the previous set-aware models. Furthermore, we demonstrate that the visualization of the learned InterMRA and IntraMRA weights can provide an interpretation of the prediction results.</p> <p><strong>Dataset (MM-IMDB and Ads-Parallelity):</strong></p> <p>We extended two multimodal datasets, namely, MM-IMDB [<a href="https://openreview.net/forum?id=S12_nquOe">Arevalo+ ICLRW'17</a>], Ads-Parallelity [<a href="https://arxiv.org/abs/1807.08205">Zhang+ BMVC'18</a>] for the empirical experiments. The MM-IMDB dataset contains 25,925 movies with multiple labels (genres). We used the original split provided in the dataset and reported the F1 scores (micro, macro, and samples) of the test set. The Ads-Parallelity dataset contains 670 images and slogans from persuasive advertisements to understand the implicit relationship (parallel and non-parallel) between these two modalities. A binary classification task is used to predict whether the text and image in the same ad convey the same message.</p> <p>We transformed the following multimodal information (i.e., visual, textual, and categorical data) into textual tokens and fed these into our proposed model. We used the <a href="https://cloud.google.com/vision">Google Cloud Vision API</a> for the visual features to obtain the following four pieces of information as tokens: (1) text from the OCR, (2) category labels from the label detection, (3) object tags from the object detection, and (4) the number of faces from the facial detection. We input the labels and object detection results as a sequence in order of confidence, as obtained from the API. We describe the visual, textual, and categorical features of each dataset below.</p> <p><em><strong>MM-IMDB</strong></em>: We used the title and plot of movies as the textual features, and the aforementioned API results based on poster images as visual features.</p> <p><em><strong>Ads-Parallelity</strong></em>: We used the same API-based visual features as in MM-IMDB. Furthermore, we used textual and categorical features consisting of textual inputs of transcriptions and messages, and categorical inputs of natural and text concrete images.</p>
Harmonised branded foods dataset for FNS Cloud case studies (2017-2020)
<p>The dataset was compiled by merging and harmonisation of different datasets, which were compiled in four countries (Netherlands, Germany, Slovenia, Switzerland) in period 2017-2020 with the use of different methodologies. Dataset was prepared to support conduction of case studies within the HORIZON2020 FNS Cloud project. The dataset includes selected mandatory food labelling information about nutrition composition of foods/drinks within three categories, that are important for reformulation strategies: soft drinks, breakfast cereals and yoghurts. For one of the included datasets, data aslo include category of fruit and vegetable juices (including nectars).</p>
Dataset: Six years of surface remote sensing of stratiform warm clouds in marine and continental air over Mace Head, Ireland
<p>A total of 118 stratiform water clouds observed by ground-based remote sensing instruments at the Mace Head Atmospheric Research Station at the West coast of Ireland from 2009 to 2015 were analyzed in terms of microphysical and optical characteristics as well as the impact of aerosols on these properties. The microphysical and optical cloud properties in the files were obtained using the algorithm SYRSOC (SYnergistic Remote Sensing Of Clouds).</p>
ForensicVM Windows 11 Virtualization Dataset: Cloud and Local Application Data Retrieval with Virtualization and Password Bypass Challenge
<p>A Windows 11 Pro dataset designed in VirtualBox, complete with local and cloud apps, is to be virtually analyzed for crucial evidence. Bypassing the straightforward 'Bart' password is essential for access, yet original passwords should remain unchanged for others to attempt the same challenge. The task involves determining the password's nature, Bart's motives, identifying involved cloud applications, and extracting data both offline and online. The viability of dead box forensics for complete data retrieval is questioned, alongside what additional information network access could unveil. The challenge includes identifying two financial applications, extracting their data, and gathering cryptocurrency-related information, presented as an engaging forensicVM showcase by Nuno Mourinho, Mario Candeias, and Rogerio Bravo (Escola Superior de Tecnologia e Gestão de Beja, Instituto Politécnico de Beja).</p>
Precision viticulture dataset for detailed vineyard mapping composed of geotagged smartphone ground images, phytosanitary status, UAV orthomosaics, 3D point clouds, and RTK GNSS data - Northern Spain, July 2022
<p>This dataset offers a rich multimodal collection of data from vineyards, designed to enhance agricultural research with a focus on vineyard management and disease monitoring. It includes geotagged smartphone ground images in ".7z" format for detailed plant-level analysis, a ".csv" file detailing plants' phytosanitary status for health assessment, UAV-derived 3D Point Clouds and orthomosaics in ".las" and ".tiff" formats for aerial landscape views, and RTK GNSS data in ".shp" format for precise plant geolocations.</p> <p>This dataset can be combined with other datasets to enable a comprehensive view of the vineyards and improve its value:</p> <div> <ul> <li>Ariza-Sentís, Mar, Sergio Vélez, and João Valente. ‘Dataset on UAV RGB Videos Acquired over a Vineyard Including Bunch Labels for Object Detection and Tracking’. <em>Data in Brief</em> 46 (February 2023): 108848. <a href="https://doi.org/10.1016/j.dib.2022.108848">https://doi.org/10.1016/j.dib.2022.108848</a>.</li> <li>Vélez, Sergio, Mar Ariza-Sentís, and João Valente. ‘VineLiDAR: High-Resolution UAV-LiDAR Vineyard Dataset Acquired over Two Years in Northern Spain.’ <em>Data in Brief</em>, October 2023, 109686. <a href="https://doi.org/10.1016/j.dib.2023.109686">https://doi.org/10.1016/j.dib.2023.109686</a>.</li> <li> <div> <div>Vélez, Sergio, Mar Ariza-Sentís, and João Valente. ‘Dataset on Unmanned Aerial Vehicle Multispectral Images Acquired over a Vineyard Affected by Botrytis Cinerea in Northern Spain’. <em>Data in Brief</em> 46 (February 2023): 108876. <a href="https://doi.org/10.1016/j.dib.2022.108876">https://doi.org/10.1016/j.dib.2022.108876</a>.</div> <div> </div> </div> </li> </ul> </div>
Large-scale 3D building and tree datasets constructed from airborne LiDAR point clouds in Glasgow, UK
<p>This is the updated version of building 3D model data. The revision includes appending attributes to the lod1 and lod2 shapefile and creating cityjson file for each 3D building model. All 3D building models are available in mesh (.obj), multipath shapefile, and cityjson (.json) now.</p> <p><strong>IMPORTANT NOTE: We suggest using the building footprint, lod1, and lod2 data of this version (Version v4).</strong></p> <p>Urban Big Data Centre of the University of Glasgow generates 3D city models via the airborne LiDAR point clouds acquired between 2020-2021 on behalf of Glasgow City Council. It is a large-scale 3D city model containing 3D information on terrain, trees, and buildings in Glasgow City. This dataset comprises terrain, tree canopy, and building products derived from high-density airborne LiDAR point clouds. </p> <p>The terrain products include Digital Terrain Model (DTM), Digital Surface Model (DSM), and normalized Digital Surface Model (nDSM) in 0.5 m spatial resolution. The DTM and DSM rasters were provided by the vendor and nDSM rasters were obtained by subtracting DTM from DSM. Terrain products are provided in 5 km by 5 km GeoTIF format raster.</p> <p>The tree canopy products are composed of canopy height models (CHM) and tree top locations. Classified tree point clouds were applied with pit-free algorithm to generate CHM in 0.5 m grid raster in GeoTIF format [1]-[2]. Treetop locations were identified by using Local Maximum Filter based on CHM and are recorded as points in Shapefile format. The tree canopy products are provided in 5 km by 5 km tiles.</p> <p>Building 3D model products include footprint polygons with building height attributes and 3D mesh of building models in LoD1 and LoD2 levels. A series of processes such as converting building point clouds to building height models (BHM), converting BHM to polygons, and polygon regularization were conducted to obtain the building footprint polygons. Building height attributes were calculated from BHM for each footprint. The building footprint data are provided in Shapefile format. LoD1 models were generated based on the footprint and average height of the building. LoD2 models were constructed based on footprint and building point cloud with City3D tool[3]. LoD1 and LoD2 models are provided in OBJ and shapefile format. Building 3D model products are provided in 5 km by 5 km tiles. The RMSE of Euclidean distances between each point in the point cloud to the reconstructed model was calculated to evaluate the LoD2 model construction. A table of RMSE and a note for a few problematic models are provided.</p>
Reference dataset for comparison of cloud detection algorithms for Sentinel-2 imagery
<p>Sentinel-2 cloud mask reference dataset generated and analyzed as part of Tarrio, K., Tang, X., Masek, J.G., Claverie, M., Ju, J., Qiu, S., Zhu, Z. and Woodcock, C.E., 2020. Comparison of cloud detection algorithms for Sentinel-2 imagery. Science of Remote Sensing, 2, p.100010. [https://www.sciencedirect.com/science/article/pii/S2666017220300092](https://www.sciencedirect.com/science/article/pii/S2666017220300092)</p> <p><strong>1. Reference masks</strong></p> <p><strong>Algorithms:</strong></p> <ul> <li>Fmask 1.x</li> <li>Fmask 2.x</li> <li>Fmask 4.x</li> <li>Tmask</li> <li>Sen2Cor</li> <li>MAJA</li> <li>LaSRC</li> </ul> <p><strong>Locations:</strong></p> <ul> <li>South Africa (35JPM)</li> <li>Senegal (28PDC)</li> <li>Switzerland (32TLT)</li> <li>France (31TCJ, 31TFJ)</li> <li>Morocco (29RNQ)</li> </ul> <p><strong>Standardized legend:</strong></p> <p>Original algorithm outputs were standardized to the same categorical legend.</p> <ul> <li>0 = clear land</li> <li>1 = clear water</li> <li>2 = cloud shadow</li> <li>3 = snow/ice</li> <li>4 = cloud</li> </ul> <p>All reference masks processed to both 10m and 30m resolution, with the exception of Tmask, which is available only at a 30m resolution.</p> <p><strong>Mask naming convention:</strong></p> <p>All processed masks are named according to the following convention:<br> M<*resolution*><*S2 MGRS tile ID*><*YYYY*><*DOY*><*algorithm*><br> e.g. **M30T28PDC2016351TMASK**</p> <p><br> <strong>2. Interpreted sample points</strong></p> <p>Sample points were selected based on agreement among different map products. This record includes a shapefile with the final interpretations for each of the sampled sites. (See publication for additional information.)</p>
Multimodal Dataset of 3D point clouds and CT-volumes
<p>The multimodal dataset for evaluating algorithms for aligning CT volumes and point clouds which is presented in 'Multimodal registration across 3D point clouds and CT-volumes'. (Saiti, E., and T. Theoharis. "Multimodal registration across 3D point clouds and CT-volumes." <em>Computers & Graphics</em> 106 (2022): 259-266.) The multimodal dataset consistsof real micro-CT scans and their synthetically generated 3D models (point clouds) .</p>
Datasets of synthetic workflows for cyber-physical edge-hub-cloud systems
<p>These datasets of synthetic workflows were generated to evaluate the performance and scalability of a multi-constrained scheduling approach for workflow applications of various structures, sizes, and sensing/actuating requirements in a cyber-physical system (CPS) following the edge-hub-cloud paradigm. The examined CPS comprised four edge devices (i.e., single-board computers, each attached to an unmanned aerial vehicle (UAV) equipped with sensors/actuators) interacting with a hub device (e.g., a laptop), which in turn communicated with a more computationally capable cloud server. All system devices featured heterogeneous multicore processors and varied sensing/actuating or other specialized capabilities. The problem objective was the minimization of the overall latency of the application under deadline, memory, storage, energy, capability, and task precedence constraints.</p> <p>We generated 25 random workflows (task graphs) with 10, 20, 30, 40, and 50 nodes (5 task graphs for each size), utilizing the Task Graphs For Free (TGFF) random task graph generator [1],[2]. Additional task parameters (e.g., execution time, power consumption, memory, storage, output data size, capability) were included post-generation, using appropriate values. More details are provided in README.txt and in [3].<br><br>References:<br>[1] R. P. Dick, D. L. Rhodes, and W. Wolf, "TGFF: Task graphs for free," in Proc. Sixth International Workshop on Hardware/Software Codesign (CODES/CASHE), 1998, pp. 97-101, doi: 10.1109/HSC.1998.666245.</p> <p>[2] R. P. Dick, D. L. Rhodes, and K. Vallerio, "TGFF," https://robertdick.org/projects/tgff/.</p> <p>[3] A. Kouloumpris, G. L. Stavrinides, M. K. Michael, and T. Theocharides, “Optimal multi-constrained workflow scheduling for cyber-physical systems in the edge-cloud continuum,” in Proc. 2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC), Jul. 2024, pp. 483-492, doi: 10.1109/COMPSAC61105.2024.00072.</p>
Dataset for Paper Titled "First assessment of cloud-land coupling in LASSO Large-Eddy Simulations"
<div>The attached two files were used for analysis in the paper "First assessment of cloud-land coupling in LASSO Large-Eddy Simulations." The NetCDF file included planetary boundary layer heights derived from lidar and radiosondes. The CSV file detailed the model configurations for selected case days in simulation sets ID1-5.</div> <div> <div> <p> </p> </div> </div>
Dataset for "Low-cloud feedback in CAM5-CLUBB: physical mechanisms and parameter sensitivity analysis"
<p>This repository contains the data of 512 perturbed-parameter ensemble experiments and CAM5-CLUBB default experiments for the paper "Low-cloud feedback in CAM5-CLUBB: physical mechanisms and parameter sensitivity analysis".</p> <p>In this paper, the quasi-Monte Carlo (QMC) sampling approach is applied to explore the high-dimensional space. 512 samples are generated with the 18 perturbed parameters. For each parameter sample, a pair of experiments is performed: the control one is based on the climatological sea surface temperature (SST), and the 4K experiment applies a uniform +4K SST perturbation to the control experiment. The total of 1024 simulations are then performed. In addition, CAM5-CLUBB default experiments that adopt the default values of the 18 selected parameters as in Bogenschutz et al. (2013) are performed to provide detailed model diagnostics for analyzing physical mechanisms of the cloud feedback, and they include both control and +4K simulations. Each simulation is run for 5 years and 4 months, forced by climatological SSTs. Monthly mean results from the last 5 years are analysed in this study.</p> <p>Note: data uploaded here is annual-mean and the dimension name 'time' in the files (CAM5-CLUBB_PPE_512*.nc) is the number of 512 PPE member.</p>
Dataset for "Method to retrieve cloud condensation nuclei number concentrations using lidar measurements"
<p>This repository contains the source data for the manuscript "<strong>Method to retrieve cloud condensation nuclei number concentrations using lidar measurements</strong>" published in <em>Atmospheric Measurement Techniques</em>. In situ measured data from five filed campaigns and corresponding theoretical simulated CCN number concentrations, lidar extinction and backscatter are included.</p>
SwinUnet_HLS_CLOUD_test_dataset
<p>Test dataset for Swin-Unet model trained with Sentinel 2 surface reflectance from Harmonized Landsat Sentinel-2 (HLS)</p>
Dataset for the "a parameterization for cloud organization and propagation by evaporation-driven cold pools edges"
<p>When the negatively buoyant air in the cloud downdrafts reaches the surface, it spreads out horizontally, producing cold pools. A cold pool can trigger new convective cells. However, when combined with the ambient vertical wind shear, it can also connect and upscale them into large mesoscale convective systems (MCS). Given the broad spectrum of scales of the atmospheric phenomenon involving the interaction between cold pools and the MCS, a parameterization was designed here. Then, it is coupled with a classical convection parameterization to be applied in an atmospheric model with an insufficient spatial resolution to explicitly resolve convection and the sub-cloud layer. A new scalar quantity related to the deficit of moist static energy detrained by the downdrafts mass flux is proposed. This quantity is subject to grid-scale advection, mixing, and a sink term representing dissipation processes. The model is then applied to simulate moist convection development over a large portion of tropical land in the Amazon Basin in a wet and dry-to-wet 10-days period. Our results show that the cold pool edge parameterization improves the organization, longevity, propagation, and severity of simulated MCS over the Amazon and other different continental areas.</p><p> </p>
NASA GLOBE Cloud GAZE Test Dataset
<p>NASA GLOBE Community science project Leveraging Online and User Data through GLOBE And Zooniverse Engagement, or CLOUD GAZE is a NASA funded pilot project aimed to help NASA better understand the effect clouds are having on Earth’s climate. The CLOUD GAZE project is a collaboration between two giants of citizen science:<a href="https://www.globe.gov/"> The GLOBE Program</a> and the<a href="https://www.zooniverse.org/"> Zooniverse</a> online platform and is funded through NASA’s Citizen Science for Earth Systems Program. The CLOUD GAZE citizen science project characterizes cloud properties from sky photographs sent in through GLOBE Clouds ground observations. The GLOBE Clouds/CLOUD GAZE team at NASA Langley Research Center extracts cloud properties from sky photographs submitted to the GLOBE Program using the Zooniverse online platform.</p> <p>The team produces datasets from three sources: ground-cloud observations from The GLOBE Program collocated with NASA/NOAA satellite data and the CLOUD GAZE cloud cover and cloud type characterizations. The datasets are for cloud type worldwide investigations and serve as training sets for machine learning. This data is provided as CSV files. </p> <p><a href="https://www.globe.gov/documents/16792331/0/Summary+Data+Variables+CLOUD+GAZE_2.0.docx/388b8c8f-e869-148f-31c2-78f2d005f38d?t=1654531372682">NASA GLOBE CLOUD GAZE Data Description</a></p> <p>The data obtained from the Zooniverse, NASA Langley Research Center (NASA LaRC), and The GLOBE Program are free of charge for use in research, publications, and commercial applications. When data from The Zooniverse, The GLOBE Program, and NASA LaRC are used in a publication, we request this acknowledgment be included, "These data were obtained from the Zooniverse online platform, the GLOBE Program and NASA Langley Research Center." Please include such statements, either where the use of the data or other resource is described, or within the Acknowledgements section of the publication.</p>
Low-level mixed-phase clouds at the high Arctic site of Ny-Ålesund: A comprehensive long-term dataset of remote sensing observations
<p>This dataset contains a comprehensive set of quality-controlled remote sensing observations of low-level mixed-phase clouds collected at the high Arctic site of Ny-Ålesund, between 10 October 2021 and 31 December 2022. Cornerstones of the dataset are observations from a 35-GHz polarimetric scanning Doppler cloud radar and a 94-GHz zenith-pointing Doppler cloud radar. Radar data are complemented with thermodynamic retrievals from a microwave radiometer, liquid base height from a ceilometer and wind fields from large-eddy simulations. All data have undergone extensive quality control, especially the cloud radar data, which are accurately calibrated, matched, and corrected for gas and liquid-hydrometeor attenuation, ground clutter and range folding. This dataset is especially suited for cloud microphysical studies, and the high number of events included allows for the compiling of robust statistics. The dataset is accompanied by a data descriptor article, which is available at <a href="https://doi.org/10.5194/essd-15-5427-2023" target="_blank" rel="noopener">doi.org/10.5194/essd-15-5427-2023</a>.</p> <p> </p> <p><strong>Dataset overview</strong><br>The files include only low-level mixed-phase cloud (LLMPC) events, as well as the 2 hours preceding and following events. Each file contains an individual event, unless multiple events are less than 4 hours apart, in which case they are combined into the same file. LLMPC events are detected by requiring that ice and liquid phase coexist in a cloud layer with top below 2500 m for at least one hour. All radar variables observed in zenith (Doppler moments at 35 and 94 GHz, linear depolarization ratio (LDR) at 35 GHz), as well as microwave radiometer retrievals (temperature (T), liquid water path (LWP), integrated water vapor (IWV)), liquid base height from the ceilometer, and model data (horizontal wind speed and direction) are brought to the same time and range grids (respectively named ‘time_zen’ and ‘range_zen’ in the files). Off-zenith radar variables (reflectivity, differential reflectivity (ZDR), maximum spectral ZDR (sZDRmax), correlation coefficient (RhoHV), differential phase shift (PhiDP), and specific differential phase (KDP)) are stored on separate coordinates (named ‘time_slant’ and ‘range_slant’). All derived corrections are already applied to the data, and stored in the files, in case the user is interested in reconstructing the original data. A number of flags have been included in the files: in particular ‘MPC_detected’ indicates whether a LLMPC event was detected, and ‘liquid_attenuation_correction_flag_zen’ and ‘liquid_attenuation_correction_flag_slant’ indicate whether radar reflectivities were corrected for attenuation due to liquid hydrometeors. Liquid attenuation corrections should be especially taken into account when computing the dual-wavelength ratio (i.e., the difference between reflectivity at 35 GHz and at 94 GHz, both expressed in dBZ), and performing quantitative analyses of reflectivity fields.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.