Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
103
datasets available to search
ShareScore release 0.9.0
Dataset results
103 results for “Application Monitoring”
Data for: Application Performance Monitoring: Trade-Off between Overhead Reduction and Maintainability
<p>Monitoring of a software system provides insights into its runtime behavior, improving system analysis and comprehension. System-level monitoring approaches focus, e.g., on network monitoring, providing information on externally visible system behavior. Application-level performance monitoring frameworks, such as Kieker or Dapper, allow to observe the internal application behavior, but introduce runtime overhead depending on the number of instrumentation probes.<br /> We report on how we were able to significantly reduce the runtime overhead of the Kieker monitoring framework. For achieving this optimization, we employed micro-benchmarks with a structured performance engineering approach. During optimization, we kept track of the impact on maintainability of the framework. In this paper, we discuss the emerged trade-off between performance and maintainability in this context.<br /> To the best of our knowledge, publications on monitoring frameworks provide none or only weak performance evaluations, making comparisons cumbersome. However, our micro-benchmark, presented in this paper, provides a basis for such comparisons. Our experiment code and data are available as open source software such that interested researchers may repeat or extend our experiments for comparison on other hardware platforms or with other monitoring frameworks.</p> <p>This dataset supplements the paper and contains the raw experimental data as well as several generated diagrams for each experiment.</p>
Data for: A Comparison of the Influence of Different Multi-Core Processors on the Runtime Overhead for Application-Level Monitoring
<p>Application-level monitoring is required for continuously operating software systems to maintain their performance and availability at runtime. Performance monitoring of software systems requires storing time series data in a monitoring log or stream. Such monitoring may cause a significant runtime overhead to the monitored system.</p> <p>In this paper, we evaluate the influence of multi-core processors on the overhead of the Kieker application-level monitoring framework. We present a breakdown of the monitoring overhead into three portions and the results of extensive controlled laboratory experiments with microbenchmarks to quantify these portions of monitoring overhead under controlled and repeatable conditions. Our experiments show that the already low overhead of the Kieker framework may be further reduced on multi-core processors with asynchronous writing of the monitoring log.</p> <p>Our experiment code and data are available as open source software such that interested researchers may repeat or extend our experiments for comparison on other hardware platforms or with other monitoring frameworks.</p> <p>This dataset supplements the paper and contains the raw experimental data as well as several generated diagrams for each experiment.</p>
Data for: A Benchmark Engineering Methodology to Measure the Overhead of Application-Level Monitoring
<p>Application-level monitoring frameworks, such as Kieker, provide insight into the inner workings and the dynamic behavior of software systems. However, depending on the number of monitoring probes used, these frameworks may introduce significant runtime overhead. Consequently, planning the instrumentation of continuously operating software systems requires detailed knowledge of the performance impact of each monitoring probe.</p> <p>In this paper, we present our benchmark engineering approach to quantify the monitoring overhead caused by each probe under controlled and repeatable conditions. Our developed MooBench benchmark provides a basis for performance evaluations and comparisons of application-level monitoring frameworks. To evaluate its capabilities, we employ our benchmark to conduct a performance comparison of all available Kieker releases from version 0.91 to the current release 1.8.</p> <p>This dataset supplements the paper and contains the raw experimental data as well as several generated diagrams for each experiment.</p>
Data for: Performance Benchmarking of Application Monitoring Frameworks
<p>Application-level monitoring of continuously operating software systems provides insights into their dynamic behavior, helping to maintain their performance and availability during runtime. Such monitoring may cause a significant runtime overhead to the monitored system, depending on the number and location of used instrumentation probes. In order to improve a system’s instrumentation and to reduce the caused monitoring overhead, it is necessary to know the performance impact of each probe.<br /> While many monitoring frameworks are claiming to have minimal impact on the performance, these claims are often not backed up with a detailed performance evaluation determining the actual cost of monitoring. Benchmarks can be used as an effective and affordable way for these evaluations. However, no benchmark specifically targeting the overhead of monitoring itself exists. Furthermore, no established benchmark engineering methodology exists that provides guidelines for the design, execution, and analysis of benchmarks.<br /> This thesis introduces a benchmark approach to measure the performance overhead of application-level monitoring frameworks. The core contributions of this approach are 1) a definition of common causes of monitoring overhead, 2) a general benchmark engineering methodology, 3) the MooBench micro-benchmark to measure and quantify causes of monitoring overhead, and 4) detailed performance evaluations of three different application-level monitoring frameworks. Extensive experiments demonstrate the feasibility and practicality of the approach and validate the benchmark results. The developed benchmark is available as open source software and the results of all experiments are available for download to facilitate further validation and replication of the results.</p> <p>This dataset supplements the thesis and contains the results of all experiments, including the raw result data, the results of additional experiments, and the configuration of our benchmarks.</p>
Acoustic features as a tool to visualize and explore marine soundscapes: Applications illustrated using marine mammal Passive Acoustic Monitoring datasets
<p>Passive Acoustic Monitoring (PAM) is emerging as a solution for monitoring species and environmental change over large spatial and temporal scales. However, drawing rigorous conclusions based on acoustic recordings is challenging, as there is no consensus over which approaches, and indices are best suited for characterizing marine and terrestrial acoustic environments.</p> <p>Here, we describe the application of multiple machine-learning techniques to the analysis of a large PAM dataset. We combine pre-trained acoustic classification models (VGGish, NOAA & Google Humpback Whale Detector), dimensionality reduction (UMAP), and balanced random forest algorithms to demonstrate how machine-learned acoustic features capture different aspects of the marine environment.</p> <p>The UMAP dimensions derived from VGGish acoustic features exhibited good performance in separating marine mammal vocalizations according to species and locations. RF models trained on the acoustic features performed well for labelled sounds in the 8 kHz range, however, low and high-frequency sounds could not be classified using this approach.</p> <p>The workflow presented here shows how acoustic feature extraction, visualization, and analysis allow for establishing a link between ecologically relevant information and PAM recordings at multiple scales.</p> <p>The datasets and scripts provided in this repository allow replicating the results presented in the publication. </p>
MORPHEMIC Application Monitoring Dataset (Genom)
<p>The application component monitoring dataset for the Genom application under the MORPHEMIC project.</p>
Electronic appendix for "Are we there yet? A critical experimental assessment of the application of induced polarization for monitoring geochemical processes", Strobel, C., Störiko, A, Olaf, O.A. & Mellage, A.
Open the record for dataset details and reuse information.
Acoustic features as a tool to visualize and explore marine soundscapes: Applications illustrated using marine mammal Passive Acoustic Monitoring datasets
Open the record for dataset details and reuse information.
Application of spectral library prediction for parallel reaction monitoring of viral peptides_DDA_data
<p><strong>Project description: </strong></p> <p>A major part of the analysis of parallel reaction monitoring (PRM) data is the comparison of observed fragment ion intensities to a library spectrum. Classically, these libraries are generated by data-dependent acquisition (DDA). Here we test Prosit, a published deep neural network algorithm, for its applicability in predicting spectral libraries for PRM. For this purpose, we targeted 1,529 precursors derived from synthetic viral peptides and analyzed the data with Prosit and DDA-derived libraries. Additionally, we used a spectral library predicted by Prosit and a DDA library to identify SARS-CoV-2 peptides from a simulated oropharyngeal swab.</p> <p> </p> <p><strong>Sample processing protocol:</strong></p> <p>A total of 1,569 crude synthetic viral peptides were ordered in six pools from JPT (Berlin, Germany). Synthetic peptides were separated on a 200 cm μPAC™ column (PharmaFluidics) by using an EASY-nLC1200 system (Thermo Fisher Scientific) equipped with a μPAC™ trapping column (PharmaFluidics). The flow rate was set to 300 nL/min and a stepped linear 160 min gradient was applied: 3-10% B in 22 min, 10-33%B in 95 min, 33-49% B in 23 min, 49-80% B in 10 min and 80% B for 10 min. Solvent A was 0.1% (v/v) formic acid (FA) in water, solvent B consisted of 80% (v/v) acetonitrile in 0.1% (v/v) FA. The column temperature was set to 50 °C. The Q Exactive Plus (Thermo Fisher Scientific) operated in Full MS/dd-MS2 or unscheduled PRM mode. For MS/dd-MS2 the following parameters were used. MS1 resolution was 70.000 with an AGC target of 3x10<sup>6</sup>, max. injection time of 20 ms and a scan range of 300-1650 m/z. MS2 resolution was 17.500 with an AGC target of 10<sup>5</sup>, max. injection time of 50 ms and an isolation window of 2 m/z. The analysis parameters in PRM mode were set as follows. MS1 parameters were identical to DDA. MS2 resolution was 17.500 with an AGC target of 10<sup>6</sup>, max. injection time of 55 ms and an isolation window of 1.4 m/z.</p> <p>Potential SARS-CoV-2 target peptides belonging to the N protein were identified by DDA of SARS-CoV-2 infected Calu-3 cells. Peptides were diluted in 0.1% TFA (0.2 µg/µL) and 5 µL were separated on a 50 cm μPAC™ column (PharmaFluidics) using an EASY-nLC1200 system (Thermo Fisher Scientific). The flow rate was set to 800 nL/min and a stepped 30 min gradient was applied: 6-11% B in 2:58 min, 11-30% B in 17:10 min, 30-35% B in 2:41 min, 35-47% B in 3:11 min, 47-80% B for 0:10 min, 80% B for 1:50 min, 80-0% B in 0:10 min and 100% A for 1:50 min. Solvent A was 0.1% (v/v) formic acid (FA) in water, solvent B consisted of 80% (v/v) acetonitrile in 0.1% (v/v) FA. The column temperature was set to 50 °C. The Q Exactive HF (Thermo Fisher Scientific) operated in Full MS/dd-MS2 (Top20) using the following parameters. MS1 resolution was 60.000 with an AGC target of 3x10<sup>6</sup>, max. injection time of 20 ms and a scan range of 300-1650 m/z. MS2 resolution was 17.500 with an AGC target of 10<sup>5</sup>, max. injection time of 50 ms and an isolation window of 2 m/z.</p> <p> </p> <p>To simulate a SARS-CoV-2 positive patient sample, we spiked cell-culture derived virus in a negative oropharyngeal swab and targeted the N protein by PRM. LC parameters were identical to DDA analysis of SARS-CoV-2 infected Calu-3 cells. The PRM parameters of the The Q Exactive HF (Thermo Fisher Scientific) were set as follows. MS1 parameters were identical to DDA. MS2 resolution was 45.000 with an AGC target of 10<sup>6</sup>, max. injection time of 100 ms and an isolation window of 1.4 m/z.</p> <p> </p> <p> </p> <p><strong>Data processing protocol:</strong></p> <p>DDA Raw files were searched with MaxQuant against the respective virus database (UniProt) with a peptide FDR of 1%. Detailed MaxQuant parameters can be found in the parameters.txt files of the according results. MaxQuant .msms output files were used to generate spectral libraries with BiblioSpec implemented in the Skyline environment using a cut-off score of 0.95. Peptide identification of PRM runs was done in Skyline using the top 6 fragment ions of the DDA spectral library or according Prosit derived library (Prosit_2020_intensity_model).</p>
Application of spectral library prediction for parallel reaction monitoring of viral peptides_PRM_NCE_data
<p><strong>Project description: </strong></p> <p>A major part of the analysis of parallel reaction monitoring (PRM) data is the comparison of observed fragment ion intensities to a library spectrum. Classically, these libraries are generated by data-dependent acquisition (DDA). Here we test Prosit, a published deep neural network algorithm, for its applicability in predicting spectral libraries for PRM. For this purpose, we targeted 1,529 precursors derived from synthetic viral peptides and analyzed the data with Prosit and DDA-derived libraries. Additionally, we used a spectral library predicted by Prosit and a DDA library to identify SARS-CoV-2 peptides from a simulated oropharyngeal swab.</p> <p> </p> <p><strong>Sample processing protocol:</strong></p> <p>A total of 1,569 crude synthetic viral peptides were ordered in six pools from JPT (Berlin, Germany). Synthetic peptides were separated on a 200 cm μPAC™ column (PharmaFluidics) by using an EASY-nLC1200 system (Thermo Fisher Scientific) equipped with a μPAC™ trapping column (PharmaFluidics). The flow rate was set to 300 nL/min and a stepped linear 160 min gradient was applied: 3-10% B in 22 min, 10-33%B in 95 min, 33-49% B in 23 min, 49-80% B in 10 min and 80% B for 10 min. Solvent A was 0.1% (v/v) formic acid (FA) in water, solvent B consisted of 80% (v/v) acetonitrile in 0.1% (v/v) FA. The column temperature was set to 50 °C. The Q Exactive Plus (Thermo Fisher Scientific) operated in Full MS/dd-MS2 or unscheduled PRM mode. For MS/dd-MS2 the following parameters were used. MS1 resolution was 70.000 with an AGC target of 3x10<sup>6</sup>, max. injection time of 20 ms and a scan range of 300-1650 m/z. MS2 resolution was 17.500 with an AGC target of 10<sup>5</sup>, max. injection time of 50 ms and an isolation window of 2 m/z. The analysis parameters in PRM mode were set as follows. MS1 parameters were identical to DDA. MS2 resolution was 17.500 with an AGC target of 10<sup>6</sup>, max. injection time of 55 ms and an isolation window of 1.4 m/z.</p> <p>Potential SARS-CoV-2 target peptides belonging to the N protein were identified by DDA of SARS-CoV-2 infected Calu-3 cells. Peptides were diluted in 0.1% TFA (0.2 µg/µL) and 5 µL were separated on a 50 cm μPAC™ column (PharmaFluidics) using an EASY-nLC1200 system (Thermo Fisher Scientific). The flow rate was set to 800 nL/min and a stepped 30 min gradient was applied: 6-11% B in 2:58 min, 11-30% B in 17:10 min, 30-35% B in 2:41 min, 35-47% B in 3:11 min, 47-80% B for 0:10 min, 80% B for 1:50 min, 80-0% B in 0:10 min and 100% A for 1:50 min. Solvent A was 0.1% (v/v) formic acid (FA) in water, solvent B consisted of 80% (v/v) acetonitrile in 0.1% (v/v) FA. The column temperature was set to 50 °C. The Q Exactive HF (Thermo Fisher Scientific) operated in Full MS/dd-MS2 (Top20) using the following parameters. MS1 resolution was 60.000 with an AGC target of 3x10<sup>6</sup>, max. injection time of 20 ms and a scan range of 300-1650 m/z. MS2 resolution was 17.500 with an AGC target of 10<sup>5</sup>, max. injection time of 50 ms and an isolation window of 2 m/z.</p> <p> </p> <p>To simulate a SARS-CoV-2 positive patient sample, we spiked cell-culture derived virus in a negative oropharyngeal swab and targeted the N protein by PRM. LC parameters were identical to DDA analysis of SARS-CoV-2 infected Calu-3 cells. The PRM parameters of the The Q Exactive HF (Thermo Fisher Scientific) were set as follows. MS1 parameters were identical to DDA. MS2 resolution was 45.000 with an AGC target of 10<sup>6</sup>, max. injection time of 100 ms and an isolation window of 1.4 m/z.</p> <p> </p> <p> </p> <p><strong>Data processing protocol:</strong></p> <p>DDA Raw files were searched with MaxQuant against the respective virus database (UniProt) with a peptide FDR of 1%. Detailed MaxQuant parameters can be found in the parameters.txt files of the according results. MaxQuant .msms output files were used to generate spectral libraries with BiblioSpec implemented in the Skyline environment using a cut-off score of 0.95. Peptide identification of PRM runs was done in Skyline using the top 6 fragment ions of the DDA spectral library or according Prosit derived library (Prosit_2020_intensity_model).</p>
Data for: Elastic Application-Level Monitoring for Large Software Landscapes in the Cloud
<p>Application-level monitoring provides valuable, detailed insights into running applications. However, many approaches often only employ a single analysis application. This analysis application may become a performance bottleneck when monitoring several programs resulting in reduced monitoring quality or violated service level agreements of the monitored applications.</p> <p>We present an approach for elastic, distributed application-level monitoring for large software landscapes consisting of several hundreds of applications by utilizing cloud computing. Our approach dynamically inserts and removes worker levels to circumvent overloading the analysis master application without interrupting or pausing the actual live analysis of the monitored data. To evaluate our approach, we conduct an experiment in which we generate load - following a real workload pattern - on web applications in a 24 hour experiment.</p> <p>In our experiment, 160 monitored JPetStore instances generate roughly 20 million analyzed method calls per second in the peak. Furthermore, two worker levels are dynamically started and removed in line with the imposed workload on the monitored applications. The experiment shows that our monitoring approach is capable of live analyzing several millions of monitored method calls per second without overloading the analysis master application.</p> <p>This package provides our supplementary data.</p>
Shark-dust: Application of high-throughput DNA sequencing of processing residues for trade monitoring of threatened sharks and rays
<p>Data repository accompanying manuscript titled of "Shark-dust: Application of high-throughput DNA sequencing of processing residues for trade monitoring of threatened sharks and rays."</p> <p>Prasetyo, A. P., Murray, J. M., Kurniawan, M. F. A. K., Sales, N. G., McDevitt, A. D., & Mariani, S. (2023). Shark-dust: Application of high-throughput DNA sequencing of processing residues for trade monitoring of threatened sharks and rays. Conservation Letters, 16, e12971. https://doi.org/10.1111/conl.12971</p>
Simulation for the calibration of radiation housekeeping monitor onboard BepiColombo/MMO and application to the inner heliosphere exploration
<p>I appreciate your interest in this paper.</p> <p>These archived data are used for Kinoshita et al., (2024).</p> <p>If you have further questions about these data, please feel free to contact me.</p> <p>E-mail: g-kinoshita20686@g.ecc.u-tokyo.ac.jp</p> <p> </p> <p>Sincerely,</p> <p>Gaku Kinoshita</p>
Aerosol products presented in "ALICENET – an Italian network of automated lidar ceilometers for four-dimensional aerosol monitoring: infrastructure, data processing, and applications"
<p>ALICENET output products on aerosol optical and physical properties and vertical layering presented in “Bellini, A., Diémoz, H., Di Liberto, L., Gobbi, G. P., Bracci, A., Pasqualini, F., and Barnaba, F.: Alicenet – An Italian network of Automated Lidar-Ceilometers for 4D aerosol monitoring: infrastructure, data processing, and applications, AMT, https://doi.org/10.5194/egusphere-2024-730, 2024”.</p> <p>The aod*.txt files include the following information:</p> <p>- date: date in UTC<br>- AOD_ALICENET: AOD as retrieved by ALICENET at 1064 nm<br>- AOD_AERONET/SKYNET: AOD measured by a co-located photometer from AERONET/SKYNET (level 2) at 1020 nm<br>- AE: Angstrom Exponent from AERONET/SKYNET (level 2)</p> <p>The contiunous.aerosol.layer.rome.txt file includes the following information:</p> <p>- date: date in CET<br>- continuous_aerosol_layer: Continous Aerosol Layer heights as retrieved by ALICENET</p> <p>The mixed.aerosol.layer.rome.txt file includes the following information:</p> <p>- date: date in CET<br>- mixed_aerosol_layer: Mixed Aerosol Layer heights as retrieved by ALICENET</p> <p>This work received partial financial support from the EC H2020 Project RI-URBANS (GA No 101036245), and benefited from work done within the Action PROBE (CA18235), supported by COST (European Cooperation in Science and Technology).</p>
The application of unmanned aerial vehicle (UAV) surveys and GIS to the analysis and monitoring of recreational trail conditions - dataset
<p>This dataset contains data used to test the protocol for high-resolution mapping and monitoring of recreational impacts in protected natural areas (PNAs) using unmanned aerial vehicle (UAV) surveys, Structure-from-Motion (SfM) data processing and geographic information systems (GIS) analysis to derive spatially coherent information about trail conditions (Tomczyk et al., 2023). Dataset includes the following folders:</p> <ol> <li>Cocora_raster_data (~3GB) and Vinicunca_raster_data (~32GB) - a very high-resolution (cm-scale) dataset derived from UAV-generated images. Data covers selected recreational trails in Colombia (Valle de Cocora) and Peru (Vinicunca). UAV-captured images were processed using the structure-from-motion approach in Agisoft Metashape software. Data are available as GeoTIFF files in the UTM projected coordinate system (UTM 18N for Colombia, UTM 19S for Peru). Individual files are named as follows [location]_[year]_[product]_[raster cell size].tif, where: <ul> <li>[location] is the place of data collection (e.g., Cocora, Vinicucna)</li> <li>[year] is the year of data collection (e.g., 2023)</li> <li>[product] is the tape of files: DEM = digital elevation model; ortho = orthomosaic; hs = hillshade</li> <li>[raster cell size] is the dimension of individual raster cell in mm (e.g., 15mm)</li> </ul> </li> <li> <p>Cocora_vector_data. and Vinicunca_vector_data – mapping of trail tread and conditions in GIS environment (ArcPro). Data are available as shp files. Data are in the UTM projected coordinate system (UTM 18N for Colombia, UTM 19S for Peru).</p> </li> </ol> <p>Structure-from-motio<span> </span>n processing was performed in Agisoft Metashape (<a href="https://www.agisoft.com/">https://www.agisoft.com/</a>, Agisoft, 2023). Mapping was performed in ArcGIS Pro (<a href="https://www.esri.com/en-us/arcgis/about-arcgis/overview">https://www.esri.com/en-us/arcgis/about-arcgis/overview</a>, Esri, 2022). Data can be used in any GIS software, including commercial (e.g. ArcGIS) or open source (e.g. QGIS).</p> <p>Tomczyk, A. M., Ewertowski, M. W., Creany, N., Monz, C. A., & Ancin-Murguzur, F. J. (2023). The application of unmanned aerial vehicle (UAV) surveys and GIS to the analysis and monitoring of recreational trail conditions. <em>International Journal of Applied Earth Observations and Geoinformation</em>, 103474. doi:<a href="https://doi.org/10.1016/j.jag.2023.103474"> https://doi.org/10.1016/j.jag.2023.103474</a></p>
Self-monitoring Activity: a Randomized Trial of Game-oriented Applications
ClinicalTrials.gov study NCT02341235. IPD Sharing: Not stated. Countries: 1. Publications: 1.
Data from "Quantification of major particulate matter species from a single filter type using infrared spectroscopy – Application to a large-scale monitoring network"
Open the record for dataset details and reuse information.
Data from: Multiple estimates of effective population size for monitoring a long-lived vertebrate: an application to Yellowstone grizzly bears
Open the record for dataset details and reuse information.
Raw data for "Application of biological early warning systems in wastewater treatment plants: Introducing a promising approach to monitor changing wastewater composition"
Open the record for dataset details and reuse information.
SI-B for "Application of biological early warning systems in wastewater treatment plants: Introducing a promising approach to monitor changing wastewater composition"
Open the record for dataset details and reuse information.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.