Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
9,302
datasets available to search
ShareScore release 0.9.0
Dataset results
9,302 results for “DETECT”
CESNET-TimeSeries24: Time Series Dataset for Network Traffic Anomaly Detection and Forecasting
<h2><strong>CESNET-TimeSeries24: The dataset for network traffic forecasting and anomaly detection</strong></h2> <p>The dataset called CESNET-TimeSeries24 was collected by long-term monitoring of selected statistical metrics for 40 weeks for each IP address on the ISP network CESNET3 (Czech Education and Science Network). The dataset encompasses network traffic from more than 275,000 active IP addresses, assigned to a wide variety of devices, including office computers, NATs, servers, WiFi routers, honeypots, and video-game consoles found in dormitories. Moreover, the dataset is also rich in network anomaly types since it contains all types of anomalies, ensuring a comprehensive evaluation of anomaly detection methods.<br><br>Last but not least, the CESNET-TimeSeries24 dataset provides traffic time series on institutional and IP subnet levels to cover all possible anomaly detection or forecasting scopes. Overall, the time series dataset was created from the 66 billion IP flows that contain 4 trillion packets that carry approximately 3.7 petabytes of data. The CESNET-TimeSeries24 dataset is a complex real-world dataset that will finally bring insights into the evaluation of forecasting models in real-world environments.<br><br></p> <p>Please cite the usage of our dataset as:</p> <blockquote> <p>Koumar, J., Hynek, K., Čejka, T. <em>et al.</em> CESNET-TimeSeries24: Time Series Dataset for Network Traffic Anomaly Detection and Forecasting. <em>Sci Data</em> <strong>12</strong>, 338 (2025). https://doi.org/10.1038/s41597-025-04603-x<br><br>@Article{cesnettimeseries24,<br> author={Koumar, Josef and Hynek, Karel and {\v{C}}ejka, Tom{\'a}{\v{s}} and {\v{S}}i{\v{s}}ka, Pavel},<br> title={CESNET-TimeSeries24: Time Series Dataset for Network Traffic Anomaly Detection and Forecasting},<br> journal={Scientific Data},<br> year={2025},<br> month={Feb},<br> day={26},<br> volume={12},<br> number={1},<br> pages={338},<br> issn={2052-4463},<br> doi={10.1038/s41597-025-04603-x},<br> url={https://doi.org/10.1038/s41597-025-04603-x}<br>}<br><br></p> </blockquote> <p> </p> <h3>Time series</h3> <p>We create evenly spaced time series for each IP address by aggregating IP flow records into time series datapoints. The created datapoints represent the behavior of IP addresses within a defined time window of 10 minutes. The vector of time-series metrics v_{ip, i} describes the IP address ip in the i-th time window. Thus, IP flows for vector v_{ip, i} are captured in time windows starting at t_i and ending at t_{i+1}. The time series are built from these datapoints. </p> <p>Datapoints created by the aggregation of IP flows contain the following time-series metrics:</p> <ul> <li><strong><em>Simple volumetric metrics:</em></strong> the number of IP flows, the number of packets, and the transmitted data size (i.e. number of bytes)</li> <li><strong><em>Unique volumetric metrics:</em></strong> the number of unique destination IP addresses, the number of unique destination Autonomous System Numbers (ASNs), and the number of unique destination transport layer ports. The aggregation of \textit{Unique volumetric metrics} is memory intensive since all unique values must be stored in an array. We used a server with 41 GB of RAM, which was enough for 10-minute aggregation on the ISP network. </li> <li><strong><em>Ratios metrics:</em></strong> the ratio of UDP/TCP packets, the ratio of UDP/TCP transmitted data size, the direction ratio of packets, and the direction ratio of transmitted data size</li> <li><em><strong>Average metrics:</strong></em> the average flow duration, and the average Time To Live (TTL)</li> </ul> <p> </p> <p><strong>Multiple time aggregation: </strong> The original datapoints in the dataset are aggregated by 10 minutes of network traffic. The size of the aggregation interval influences anomaly detection procedures, mainly the training speed of the detection model. However, the 10-minute intervals can be too short for longitudinal anomaly detection methods. Therefore, we added two more aggregation intervals to the datasets--1 hour and 1 day.</p> <p><strong>Time series of institutions:</strong> We identify 283 institutions inside the CESNET3 network. These time series aggregated per each institution ID provide a view of the institution's data. </p> <p><strong>Time series of institutional subnets:</strong> We identify 548 institution subnets inside the CESNET3 network. These time series aggregated per each institution ID provide a view of the institution subnet's data. </p> <p> </p> <h3>Data Records</h3> <p>The file hierarchy is described below:</p> <blockquote> <p>cesnet-timeseries24/</p> <p> |- institution_subnets/</p> <p> | |- agg_10_minutes/<id_institution>.csv</p> <p> | |- agg_1_hour/<id_institution>.csv</p> <p> | |- agg_1_day/<id_institution>.csv</p> <p> | |- identifiers.csv</p> <p> |- institutions/</p> <p> | |- agg_10_minutes/<id_institution_subnet>.csv</p> <p> | |- agg_1_hour/<id_institution_subnet>.csv</p> <p> | |- agg_1_day/<id_institution_subnet>.csv</p> <p> | |- identifiers.csv</p> <p> |- ip_addresses_full/</p> <p> | |- agg_10_minutes/<id_ip_folder>/<id_ip>.csv</p> <p> | |- agg_1_hour/<id_ip_folder>/<id_ip>.csv</p> <p> | |- agg_1_day/<id_ip_folder>/<id_ip>.csv</p> <p> | |- identifiers.csv</p> <p> |- ip_addresses_sample/</p> <p> | |- agg_10_minutes/<id_ip>.csv</p> <p> | |- agg_1_hour/<id_ip>.csv</p> <p> | |- agg_1_day/<id_ip>.csv</p> <p> | |- identifiers.csv</p> <p> |- times/</p> <p> | |- times_10_minutes.csv</p> <p> | |- times_1_hour.csv</p> <p> | |- times_1_day.csv</p> <p> |- ids_relationship.csv<br> |- weekends_and_holidays.csv</p> </blockquote> <p>The following list describes time series data fields in CSV files:</p> <ul> <li><strong>id_time: </strong>Unique identifier for each aggregation interval within the time series, used to segment the dataset into specific time periods for analysis.</li> <li><strong>n_flows: </strong>Total number of flows observed in the aggregation interval, indicating the volume of distinct sessions or connections for the IP address.</li> <li><strong>n_packets: </strong>Total number of packets transmitted during the aggregation interval, reflecting the packet-level traffic volume for the IP address.</li> <li><strong>n_bytes: </strong>Total number of bytes transmitted during the aggregation interval, representing the data volume for the IP address.</li> <li><strong>n_dest_ip: </strong>Number of unique destination IP addresses contacted by the IP address during the aggregation interval, showing the diversity of endpoints reached.</li> <li><strong>n_dest_asn: </strong>Number of unique destination Autonomous System Numbers (ASNs) contacted by the IP address during the aggregation interval, indicating the diversity of networks reached.</li> <li><strong>n_dest_port: </strong>Number of unique destination transport layer ports contacted by the IP address during the aggregation interval, representing the variety of services accessed.</li> <li><strong>tcp_udp_ratio_packets: </strong>Ratio of packets sent using TCP versus UDP by the IP address during the aggregation interval, providing insight into the transport protocol usage pattern. This metric belongs to the interval <0, 1> where 1 is when all packets are sent over TCP, and 0 is when all packets are sent over UDP.</li> <li><strong>tcp_udp_ratio_bytes:</strong> Ratio of bytes sent using TCP versus UDP by the IP address during the aggregation interval, highlighting the data volume distribution between protocols. This metric belongs to the interval <0, 1> with same rule as <em>tcp_udp_ratio_packets</em>.</li> <li><strong>dir_ratio_packets: </strong>Ratio of packet directions (inbound versus outbound) for the IP address during the aggregation interval, indicating the balance of traffic flow directions. This metric belongs to the interval <0, 1>, where 1 is when all packets are sent in the outgoing direction from the monitored IP address, and 0 is when all packets are sent in the incoming direction to the monitored IP address.</li> <li><strong>dir_ratio_bytes: </strong>Ratio of byte directions (inbound versus outbound) for the IP address during the aggregation interval, showing the data volume distribution in traffic flows. This metric belongs to the interval <0, 1> with the same rule as <em>dir_ratio_packets</em>.</li> <li><strong>avg_duration: </strong>Average duration of IP flows for the IP address during the aggregation interval, measuring the typical session length.</li> <li><strong>avg_ttl: </strong>Average Time To Live (TTL) of IP flows for the IP address during the aggregation interval, providing insight into the lifespan of packets.</li> </ul> <p>Moreover, the time series created by re-aggregation contains following time series metrics instead of <strong>n_dest_ip</strong>, <strong>n_dest_asn</strong>, and <strong>n_dest_port</strong>:</p> <ul> <li><strong>sum_n_dest_ip: </strong>Sum of numbers of unique destination IP addresses.</li> <li><strong>avg_n_dest_ip: </strong>The average number of unique destination IP addresses.</li> <li><strong>std_n_dest_ip: </strong>Standard deviation of numbers of unique destination IP addresses.</li> <li><strong>sum_n_dest_asn: </strong>Sum of numbers of unique destination ASNs.</li> <li><strong>avg_n_dest_asn: </strong>The average number of unique destination ASNs.</li> <li><strong>std_n_dest_asn: </strong>Standard deviation of numbers of unique destination ASNs)</li> <li><strong>sum_n_dest_port: </strong>Sum of numbers of unique destination transport layer ports.</li> <li><strong>avg_n_dest_port: </strong> The average number of unique destination transport layer ports.</li> <li><strong>std_n_dest_port: </strong>Standard deviation of numbers of unique destination transport layer ports.</li> </ul> <p> </p> <p>Moreover, files <em>identifiers.csv</em> in each dataset type contain IDs of time series that are present in the dataset. Furthermore, the <em>ids_relationship.csv</em> file contains a relationship between IP addresses, Institutions, and institution subnets. The <em>weekends_and_holidays.csv</em> contains information about the non-working days in the Czech Republic.</p>
Ultrasensitive detection of cancer-associated nucleic acids and mutations by primer exchange reaction-based signal amplification and flow cytometry
<p>This dataset contains the raw data that were used for the publication entitled, "Ultrasensitive detection of cancer-associated nucleic acids and mutations by primer exchange reaction-based signal amplificaiton and flow cytometry" published in Biosensors and Bioelectronics on 5 October 2024.</p>
Photometric detection of internal gravity waves in upper main-sequence stars. IV. Comparable stochastic low-frequency variability in SMC, LMC, and Galactic massive stars
<p>Supporting data for peer-reviewed publication entitled: 'Photometric detection of internal gravity waves in upper main-sequence stars. IV. Comparable stochastic low-frequency variability in SMC, LMC, and Galactic massive stars', published in A&A. For the purpose of open access, the authors have applied a CC BY licence to the author accepted manuscript version and made it publicly available: <a href="https://arxiv.org/abs/2410.12726">https://arxiv.org/abs/2410.12726</a></p> <p>Evolutionary models and stability window calculations courtesy of Jermyn et al. 2022 (DOI: <a href="https://iopscience.iop.org/article/10.3847/1538-4357/ac4e89">10.3847/1538-4357/ac4e89</a>) are publicly available via: <a href="https://github.com/adamjermyn/conv_trends">https://github.com/adamjermyn/conv_trends</a></p> <p>TESS full-frame image data are publicly available from the Mikulski Archive for Space Telescopes (MAST) at the Space Telescope Science Institute (STScI): <a href="https://archive.stsci.edu/missions-and-data/tess">https://archive.stsci.edu/missions-and-data/tess</a></p> <p>TESS light curves (provided in this repository) were extracted using the publicly available tglc (Han & Brandt 2023; DOI: <a href="https://iopscience.iop.org/article/10.3847/1538-3881/acaaa7">10.3847/1538-3881/acaaa7</a>) software package: <a href="https://github.com/TeHanHunter/TESS_Gaia_Light_Curve">https://github.com/TeHanHunter/TESS_Gaia_Light_Curve </a></p> <p>SLF variability parameters (provided in this repository; cf. Tables 1 and 2 of the paper) were obtained using GP regression with the publicly available celerite2 (Foreman-Mackey et al. 2017; DOI: <a href="https://iopscience.iop.org/article/10.3847/1538-3881/aa9332">10.3847/1538-3881/aa9332</a>) software package: <a href="https://celerite2.readthedocs.io/en/latest/">https://celerite2.readthedocs.io/en/latest/</a> and confidence intervals were obtained using the publicly available pymc3 (Salvatier et al. 2016; <a href="https://doi.org/10.7717/peerj-cs.55">https://doi.org/10.7717/peerj-cs.55</a>) software package: <a href="https://github.com/pymc-devs/pymc">https://github.com/pymc-devs/pymc</a></p> <p>This research was supported in part by the National Science Foundation (NSF) under Grant Number NSF PHY-1748958; the Research Foundation Flanders (FWO) with grant agreement numbers 1286521N, 11F7120N, and V411621N; UK Research and Innovation (UKRI) in the form of a Frontier Research grant under the UK government's ERC Horizon Europe funding guarantee (SYMPHONY; grant number: EP/Y031059/1); a Royal Society University Research Fellowship (URF; grant number: URF\R1\231631); and the KU Leuven Research Council (grant number C16/18/005: PARADISE).</p>
OpenMapCD: A Multimodal Benchmark Dataset for Change Detection Between Optical Remote Sensing and Map Data
<p><strong>Overview: </strong></p> <ol> <li>OpenMapCD, the <strong>first large-scale multimodal dataset</strong> for change detection on optical remote sensing imagery and map (OpenStreetMap) data, <strong>supporing basic binary change detection and further semantic change detection</strong></li> <li>OpenMapCD is highly geographically diverse, with <strong>1288</strong> benchmark samples with 1024x1024 pixels from <strong>40 </strong>regions across six continents and out-of-distribution data in two areas in Japan</li> <li>Advancing land-cover mapping, binary change detection and semantic change detection tasks, and GIS system updating<br><br></li> </ol> <p><strong>Research Paper: <br></strong></p> <ul> <li>Arxiv paper: <a href="https://arxiv.org/abs/2310.02674v3">https://arxiv.org/html/2310.02674v3</a></li> <li>TGRS paper: <a href="https://ieeexplore.ieee.org/document/10551264">https://ieeexplore.ieee.org/document/10551264</a></li> </ul> <p><strong><br>Project Page:</strong><br>The benchmark code is available at: <a href="https://github.com/ChenHongruixuan/ObjFormer">https://github.com/ChenHongruixuan/ObjFormer</a><br><br><strong>Reference:</strong></p> <pre><code>@ARTICLE{Chen2024ObjFormer, author={Chen, Hongruixuan and Lan, Cuiling and Song, Jian and Broni-Bediako, Clifford and Xia, Junshi and Yokoya, Naoto}, journal={IEEE Transactions on Geoscience and Remote Sensing}, title={ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer}, year={2024}, volume={62}, number={}, pages={1-22}, doi={10.1109/TGRS.2024.3410389} }</code></pre>
Stellar Evolution Models from "Finding the Fuse: Prospects for the Detection and Characterization of Hydrogen-Rich Core-Collapse 5 Supernova Precursor Emission with the LSST"
<p>These data consist of all runs from the Modules for Experiments in Stellar Astrophysics (MESA; Paxton et al. 2011, 2013, 2015, 2018, 2019) code, used to construct radius priors for modeling supernova precursor emission in<em> <a href="https://arxiv.org/abs/2408.13314">Finding the Fuse: Prospects for the Detection and Characterization of Hydrogen-Rich Core-Collapse 5 Supernova Precursor Emission with the LSST</a></em> (Gagliano+2024, submitted). </p> <p>The contents of the data files are detailed in the file <strong>ReadmeMESA.txt</strong>. Additional detail concerning the simulations can be found in Section 2.2 of the linked publication. </p>
Open-Access Data for "Received SignalStrength Measurements with BLE Signals for Contact Tracing and Proximity Detection"
<p>This archive contains three folders which are supplementary material for the paper accepted for publishing in IEEE Sensors Journal.</p> <p><strong>Contents:</strong></p> <ul> <li> The folder `open-access-data/upb/` contains the measurements acquired at UPB. The subfolders are named as `upb_ble_*`, where an asterisk masks the directory number. Whenever UPB is specified, use the data sets from the corresponding directory.</li> <li>The folder `open-access-data/tau/` contains the measurements acquired at TAU. The subfolders are named as `tau_ble_*`, where an asterisk masks the directory number. Whenever TAU is specified, use the data sets from the corresponding directory.</li> <li>The folder `open-access-data/wifi-on-off/` contains a sample code to read the files and plot the data from Fig. 14 in `open-access-data/wifi-on-off/wifi_on_off_read_plot.py` and Fig. 15 in `open-access-data/wifi-on-off/wifi_on_off_read_plot.ipynb`.</li> </ul> <p><strong>Results based on the data have been presented in the paper:</strong><br> Flueratoru, L., Shubina, V., Niculescu, D., Lohan, E.S. (2021). On the High Fluctuations of Received Signal Strength Measurements with BLE Signals for Contact Tracing and Proximity Detection, IEEE Sensors, Special Issue on Advanced Sensors and Sensing Technologies for Indoor Positioning and Navigation</p> <p><strong>To cite these data sets please use the following:</strong><br> Laura Flueratoru, Viktoriia Shubina, Dragoș Niculescu, & Elena Simona Lohan. (2021). Open Access Data for "Received SignalStrength Measurements with BLE Signals for Contact Tracing and Proximity Detection" [Data set]. Zenodo. http://doi.org/10.5281/zenodo.4643668</p>
Dataset: Mask R-CNN Based C. Elegans Detection with a DIY Microscope
<p>The dataset consists of images of C. elegans in Petri Dish that were captured at a frequency of 1 Hz at 3280 × 2464 pixels via a Raspberry Pi based DIY Microscope. Further details of the recording setup and the dataset can be found in the corresponding article.</p> <p>Up on use, please cite the following article <a href="https://doi.org/10.3390/bios11080257">https://doi.org/10.3390/bios11080257</a> such as:</p> <p>Fudickar, S.; Nustede, E.J.; Dreyer, E.; Bornhorst, J. Mask R-CNN Based C. Elegans Detection with a DIY Microscope. <em>Biosensors</em> <strong>2021</strong>, <em>11</em>, 257. https://doi.org/10.3390/bios11080257</p> <p> </p> <p><br> </p>
ForTrunkDet - Image dataset of visible and thermal annotated images for forest tree trunk detection
<p>Forest dataset composed by visible and thermal images with trunk annotations. The images were acquired in three different portuguese forests and were captured by four different cameras:</p> <ul> <li>GoPro Hero6</li> <li>Allied Mako G-125</li> <li>FLIR M232</li> <li>ZED Stereo</li> </ul> <p>The images and annotations are stored in two zip files:</p> <ul> <li>forest_dataset_original.zip - original dataset</li> <li>forest_dataset_augmented - augmented dataset</li> </ul> <p>Also, the subsets that were used to train, validate and test some deep learning models are available in three .TXT files (train.txt, val.txt and test.txt), where each file line corresponds to an image name.</p> <p> </p>
CLDF dataset accompanying List and Forkel's "Borrowing Detection in Multilingual Wordlists" from 2021
<p>Cite the source of the dataset as:</p> <blockquote> <p>List, Johann-Mattis and Forkel, Robert (2021): Automated identification of borrowings in multilingual wordlists. Leipzig: Max Planck Institute for Evolutionary Anthropology.</p> </blockquote>
Dataset and Code for Manuscript "Multi-angle pulse shape detection of scattered light in flow cytometry for label-free cell cycle classification"
<p>Dataset of measurements for cell cycle analysis with description:</p> <ul> <li>ReadMe file with explanations on the data set and analysis</li> <li>exemplary Matlab script file for analysis</li> <li>binary data files conatining the pulse shapes in all channels</li> <li>FCS data files containing common flow cytometry parameters in each channel</li> </ul> <p>Data on unsorted HEK cells, HEK cells sorted for cell cycle phases, and unsorted Jurkat cell are included.</p>
DCASE 2021 Task 5: Few-shot Bioacoustic Event Detection Evaluation Set
<p><strong>General Description</strong></p> <p>The evaluation set for task 5 of DCASE 2021 "Few-shot Bioacoustic Event Detection" consists of 31 audio files acquired from different bioacoustic sources. </p> <p>In Evaluation_Set_Annotations: the first 5 annotations are provided for each file, with events marked as positive (POS) for the class of interest. This is the same setup used during the DCASE 2021 challenge.</p> <p>In Evaluation_Set_Full_Annotations: the full annotations are provided for each file, with events marked as positive (POS) or unknown (UNK) for the class of interest.</p> <p> </p> <p><strong>Folder Structure</strong></p> <p><em>Evaluation_Set.zip contains audio files and annotation files with 5 first POS events (as used during DCASE 2021 challenge)</em></p> <p>|__Evaluation_Set/</p> <p> |___DC/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> |___ME/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> |___ML/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p><em>Evaluation_Set_Audio.zip</em> has the same structure but contains only the *.wav files.</p> <p><em>Evaluation_Set_Annotations.zip</em> has the same structure but contains only the *.csv files with first 5 POS annotations.</p> <p><em>Evaluation_Set_Full_Annotations.zip</em> has the same structure but contains only the *.csv files with all POS annotations.</p> <p>The subfolders denote different recording sources and there may or may not be overlap between classes of interest from different wav files.</p> <p> </p> <p><strong>Annotation structure</strong></p> <p>Each line of the annotation csv represents an event in the audio file. The column descriptions are as follows:<br> [ Audiofilename, Starttime, Endtime, Q ]</p> <p> </p> <p><strong>Classes</strong></p> <p>DCASE2021_task5_evaluation_set.csv provides a table with class code correspondance to class name for all the recordings of the Evaluation set.</p> <p>DCASE2021_task5_evaluation_set.csv<br> -------------------<br> dataset, recording, class_code, class_name</p> <p> </p> <p><strong>Development Set</strong></p> <p>The development set for the same task can be found at: <a href="https://doi.org/10.5281/zenodo.5412896">https://doi.org/10.5281/zenodo.5412896</a></p> <p> </p> <p><strong>Open Access</strong></p> <p>This dataset is available under a Creative Commons Attribution 4.0 International (CC BY 4.0) license.<br> </p> <p><strong>Contact info</strong></p> <p>Please send any feedback or questions to:<br> Veronica Morfi: g.v.morfi@qmul.ac.uk</p>
DCASE 2021 Task 5: Few-shot Bioacoustic Event Detection Development Set
<p><strong>General Description</strong></p> <p>The development set for task 5 of DCASE 2021 "Few-shot Bioacoustic Event Detection" consists of 19 audio files acquired from different bioacoustic sources. The dataset is split into training and validation Sets. </p> <p>Multi-class annotations are provided for the training set with positive (POS), negative (NEG) and unkwown (UNK) values for each class. UNK indicates uncertainty about a class. </p> <p>Single-class (class of interest) annotations are provided for the validation set, with events marked as positive (POS) or unkwown (UNK) provided for the class of interest. </p> <p> </p> <p><strong>Folder Structure</strong></p> <p><em>Development_Set.zip</em></p> <p>|_Development_Set/</p> <p> |__Training_Set/</p> <p> |___BV/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> |___HT/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> |___JD/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> |___MT/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> |__Validation_Set/</p> <p> |___HV/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> |___PB/</p> <p> |____*.wav</p> <p> |____*.csv</p> <p> </p> <p><em>Development_Set_Audio.zip</em> has the same structure but contains only the *.wav files.</p> <p><em>Development_Set_Annotations.zip</em> has the same structure but contains only the *.csv files</p> <p> </p> <p><strong>Dataset statistics</strong></p> <p>Some statistics on this dataset are as follows, split between training and validation set and their sub-folders:</p> <p>-----------------------------------------------------<br> TRAINING SET<br> -----------------------------------------------------<br> Number of audio recordings | 11<br> Total duration | 14 hours and 20 mins<br> Total classes (excl. UNK) | 19<br> Total events (excl. UNK) | 4,686<br> -----------------------------------------------------<br> TRAINING SET/BV<br> -----------------------------------------------------<br> Number of audio recordings | 5<br> Total duration | 10 hours<br> Total classes (excl. UNK) | 11<br> Total events (excl. UNK) | 2,662<br> Sampling rate | 24,000 Hz<br> -----------------------------------------------------<br> TRAINING SET/HT<br> -----------------------------------------------------<br> Number of audio recordings | 3<br> Total duration | 3 hours<br> Total classes (excl. UNK) | 3<br> Total events (excl. UNK) | 435<br> Sampling rate | 6,000 Hz<br> -----------------------------------------------------<br> TRAINING SET/JD<br> -----------------------------------------------------<br> Number of audio recordings | 1<br> Total duration | 10 mins<br> Total classes (excl. UNK) | 1<br> Total events (excl. UNK) | 355<br> Sampling rate | 22,050 Hz<br> -----------------------------------------------------<br> TRAINING SET/MT<br> -----------------------------------------------------<br> Number of audio recordings | 2<br> Total duration | 1 hour and 10 mins<br> Total classes (excl. UNK) | 4<br> Total events (excl. UNK) | 1,234<br> Sampling rate | 8,000 Hz<br> -----------------------------------------------------</p> <p><br> -----------------------------------------------------<br> VALIDATION SET<br> -----------------------------------------------------<br> Number of audio recordings | 8<br> Total duration | 5 hours<br> Total classes (excl. UNK) | 4<br> Total events (excl. UNK) | 310<br> -----------------------------------------------------<br> VALIDATION SET/HV<br> -----------------------------------------------------<br> Number of audio recordings | 2<br> Total duration | 2 hours<br> Total classes (excl. UNK) | 2<br> Total events (excl. UNK) | 50<br> Sampling rate | 6,000 Hz<br> -----------------------------------------------------<br> VALIDATION SET/PB<br> -----------------------------------------------------<br> Number of audio recordings | 6<br> Total duration | 3 hours<br> Total classes (excl. UNK) | 2<br> Total events (excl. UNK) | 260<br> Sampling rate | 44,100 Hz<br> -----------------------------------------------------</p> <p> </p> <p><strong>Annotation structure</strong></p> <p>Each line of the annotation csv represents an event in the audio file. The column descriptions are as follows:</p> <p>TRAINING SET<br> ---------------------<br> Audiofilename, Starttime, Endtime, CLASS_1, CLASS_2, ...CLASS_N</p> <p>VALIDATION SET<br> ---------------------<br> Audiofilename, Starttime, Endtime, Q</p> <p> </p> <p><strong>Classes</strong></p> <p>DCASE2021_task5_training_set_classes.csv and DCASE2021_task5_validation_set_classes.csv provide a table with class code correspondace to class name for all classes in the Development set.</p> <p>DCASE2021_task5_training_set_classes.csv<br> ---------------------<br> dataset, class_code, class_name</p> <p>DCASE2021_task5_validation_set_classes.csv<br> ---------------------<br> dataset, recording, class_code, class_name</p> <p> </p> <p><strong>Evaluation Set</strong></p> <p>The Evaluation set for the same task can be found at: <a href="https://doi.org/10.5281/zenodo.5413149">https://doi.org/10.5281/zenodo.5413149</a></p> <p> </p> <p><strong>Open Access</strong></p> <p>This dataset is available under a Creative Commons Attribution 4.0 International (CC BY 4.0) license.</p> <p><br> <strong>Contact info</strong></p> <p>Please send any feedback or questions to:<br> Veronica Morfi: g.v.morfi@qmul.ac.uk<br> </p>
British Library Books genre detection model
<p><strong>Model description</strong></p> <p>This model is intended to predict, from the title of a book, whether it is 'fiction' or 'non-fiction'.</p> <p>This model was trained on data created from the <a href="https://www.bl.uk/collection-guides/digitised-printed-books">Digitised printed books (18th-19th Century)</a> book collection. The datasets in this collection are comprised and derived from 49,455 digitised books (65,227 volumes), mainly from the 19th Century. This dataset is dominated by English language books and includes books in several other languages in much smaller numbers. </p> <p>This model was originally developed for use as part of the <a href="https://livingwithmachines.ac.uk/">Living with Machines</a> project to be able to 'segment' this large dataset of books into different categories based on a 'crude' classification of genre i.e. whether the title was `fiction` or `non-fiction`.</p> <p>The model's training data (discussed more below) primarily consists of 19th Century book titles from the <a href="https://www.bl.uk/collection-guides/digitised-printed-books">British Library Digitised printed books (18th-19th century)</a> collection. These books have been catalogued according to British Library cataloguing practices. The model is likely to perform worse on any book titles from earlier or later periods. While the model is multilingual, it has training data in non-English book titles; these appear much less frequently.</p> <p><strong>How to use</strong></p> <p>To use this within fastai, first install version 2 of the fastai library. Following the documentation <a href="https://docs.fast.ai/#Installing">instructions</a>. Once you have fastai installed, you can use the model as follows:</p> <pre><code class="language-python">from fastai.text.all import load_learner learn = load_learner("20210928-model.pkl") learn.predict("Oliver Twist")</code></pre> <p><strong>Limitations and bias</strong></p> <p>The model was developed based on data from the <a href="https://www.bl.uk/collection-guides/digitised-printed-books">British Library's Digitised printed books (18th-19th Century)</a> collection. This dataset is not representative of books from the period covered with biases towards certain types (travel) and a likely absence of books that were difficult to digitise.</p> <p>The formatting of the British Library books corpus titles may differ from other collections, resulting in worse performance on other collections. It is recommended to evaluate the performance of the model before applying it to your own data. Likely, this model won't perform well for contemporary book titles without further fine-tuning.</p> <p><strong>Training data</strong></p> <p>The training data for this model will be available from the British Libary Research Repository shortly.</p> <p>The training data was created using the Zooniverse platform. British Library cataloguers carried out the majority of the annotations used as training data. More information on the process of creating the training data will be available soon. </p> <p><strong>Training procedure</strong></p> <p>Model training was carried out using the fastai library version 2.5.2. </p> <p>The notebook using for training the model will be available at: https://github.com/Living-with-machines/bl-books-genre-prediction</p> <p><strong>Eval result</strong></p> <p>The model was evaluated on a held out test set:</p> <pre> precision recall f1-score support Fiction 0.91 0.88 0.90 296 Non-fiction 0.94 0.95 0.95 554 accuracy 0.93 850 macro avg 0.93 0.92 0.92 850 weighted avg 0.93 0.93 0.93 850</pre>
Dataset for supervised bot detection on Twitter
<p>This is the dataset I used for my Bachelor Thesis "Fake-tweet: Desarrollo de un modelo para la detección de bots en Twitter", where I developed a supervised method for bot detection on Twitter.</p> <p>This dataset contains both genuine users (3474) and social spambots (4912) and has 69 features defined for each of these accounts. Such features can be divided in 3 categories: content, account information or account usage features.</p> <p> </p>
Rees River, New Zealand - Geomorphic Change Detection - Example Dataset
<p>A simple<a href="https://gcd.riverscapes.net/Tutorials/example-data-sets.html"> Example GCD Dataset </a>illustrating topographic change detection on a long (31 km) dataset. Great for learning about analyses with DEMs produced from a hybrid of survey types. Used in <a href="https://gcd.riverscapes.net/Tutorials/ErrorModelling/multimethoderror.html">Multi-Method Error Estimation Tutorial</a> and <a href="https://gcd.riverscapes.net/Tutorials/GeomorphicInterpretation/morphological-approach.html">Morphological Approach Tutorial</a>. This is part of the dataset from:</p> <ul> <li>2011. Richard Williams, James Brasington, Damia Vericat, Murray Hicks, Fred Labrosse, Mark Neal. Chapter Twenty - Monitoring Braided River Change Using Terrestrial Laser Scanning and Optical Bathymetric Mapping. Editor(s): Mike J. Smith, Paolo Paron, James S. Griffiths. Developments in Earth Surface Processes. Elsevier, Volume 15, Pages 507-532, ISSN 0928-2025. DOI: <a href="https://doi.org/10.1016/B978-0-444-53446-0.00020-3">10.1016/B978-0-444-53446-0.00020-3</a>.</li> </ul> <p>Dataset is from:</p> <ul> <li>2km of braided river near <a href="https://www.google.com/maps/place/44%C2%B046'38.6%22S+168%C2%B024'17.9%22E/@-44.7767196,168.3891697,7451m/data=!3m1!1e3!4m5!3m4!1s0x0:0x0!8m2!3d-44.777379!4d168.404972">Queenstown, New Zealand</a></li> <li>Two LiDAR surveys</li> <li>0.5m cell resolution</li> <li><a href="https://s3-us-west-2.amazonaws.com/etalweb.joewheaton.org/GCD/GCD7/Tutorials/GeoTERM_Rees.zip">Download Full</a></li> <li><a href="https://s3-us-west-2.amazonaws.com/etalweb.joewheaton.org/GCD/GCD7/Tutorials/MaskOnly_MorphologicalApproach.zip">Download Morphological Only</a></li> </ul> <p>Dataset includes raw data to run exercises, as well as full *.gcd projects that can be opened. </p>
DNA origami book biosensor for multiplex detection of cancer-associated nucleic acids
<p>This dataset contains the raw data that were used for the publication entitled, "DNA origami book biosensor for multiplex detection of cancer-associated nucleic acids" published in Nanoscale.</p> <p> </p> <p>Abstract</p> <p>DNA nanotechnology provides a promising approach for the development of biomedical point-of-care diagnostic nanoscale devices that are easy to use and cost-effective, highly sensitive and thus constitute an alternative to expensive, complex diagnostic devices. Moreover, DNA nanotechnology-based devices are particularly advantageous for applications in oncology, owing to being ideally suited for the detection of cancer-associated nucleic acids, including circulating tumor-derived DNA fragments (ctDNAs), circulating microRNAs (miRNAs) and other RNA species. Here, we present a dynamic DNA origami book biosensor that is precisely decorated with arrays of fluorophores acting as donors and acceptors and also fluorescence quenchers that produce a strong optical readout upon exposure to external stimuli for the single or dual detection of target oligonucleotides and miRNAs. This biosensor allowed the detection of target molecules either through the decrease of Förster resonance energy transfer (FRET) or an increase in the fluorescence intensity profile owing to a rotation of the constituent top layer of the structure. Single-DNA origami experiments showed that detection of two targets can be achieved simultaneously within 10 min with a limit of detection in the range of 1–10 pM. Overall, our DNA origami book biosensor design showed sensitive and specific detection of synthetic target oligonucleotides and natural miRNAs extracted from cancer cells. Based on these results, we foresee that our DNA origami biosensor may be developed into a cost-effective point-of-care diagnostic strategy for the specific and sensitive detection of a variety of DNAs and RNAs, such as ctDNAs, miRNAs, mRNAs, and viral DNA/RNAs in human samples.</p>
A common NFKB1 variant detected through antibody analysis in UK Biobank predicts risk of infection and allergy: Summary statistics - Health records
<p>Infectious agents contribute significantly to the global burden of diseases, through both acute infection and their chronic sequelae. We leveraged the UK Biobank to identify genetic loci that influence humoral immune response to multiple infections. From 45 genome-wide association studies in 9,611 participants from UK Biobank, we identified NFKB1 as a locus associated with quantitative antibody responses to multiple pathogens including those from the herpes, retro- and polyoma-virus families. An insertion-deletion variant thought to affect NFKB1 expression (rs28362491), was mapped as the likely causal variant. This variant has persisted throughout hominid evolution and could play a key role in regulation of the immune response. Using 121 infection and inflammation related traits in 487,297 UK Biobank participants, we show that the deletion allele was associated with an increased risk of infection from diverse pathogens but had a protective effect against allergic disease. We propose that altered expression of NFKB1, as a result of the deletion, modulates haematopoietic pathways, and likely impacts cell survival, antibody production, and inflammation. Taken together, we show that disruptions to the tightly regulated immune processes may tip the balance between exacerbated immune responses and allergy, or increased risk of infection and impaired resolution of inflammation. </p> <p>-------------------------------------------------------------------------------------</p> <p>This dataset contains GWAS summary statistics for infection, inflammation, and allergy related traits in 487,297 individuals</p>
A common NFKB1 variant detected through antibody analysis in UK Biobank predicts risk of infection and allergy: Summary statistics - Serology
<p>Infectious agents contribute significantly to the global burden of diseases, through both acute infection and their chronic sequelae. We leveraged the UK Biobank to identify genetic loci that influence humoral immune response to multiple infections. From 45 genome-wide association studies in 9,611 participants from UK Biobank, we identified NFKB1 as a locus associated with quantitative antibody responses to multiple pathogens including those from the herpes, retro- and polyoma-virus families. An insertion-deletion variant thought to affect NFKB1 expression (rs28362491), was mapped as the likely causal variant. This variant has persisted throughout hominid evolution and could play a key role in regulation of the immune response. Using 121 infection and inflammation related traits in 487,297 UK Biobank participants, we show that the deletion allele was associated with an increased risk of infection from diverse pathogens but had a protective effect against allergic disease. We propose that altered expression of NFKB1, as a result of the deletion, modulates haematopoietic pathways, and likely impacts cell survival, antibody production, and inflammation. Taken together, we show that disruptions to the tightly regulated immune processes may tip the balance between exacerbated immune responses and allergy, or increased risk of infection and impaired resolution of inflammation. </p> <p>-------------------------------------------------------------------------------------</p> <p>This dataset contains GWAS summary statistics for quantitative antibody responses in 9611 individuals and results for a meta-analysis of UK Biobank and CoLaus/PsyCoLaus antibody responses.</p> <p> </p>
Three-way model differencing and conflict detection
<p>We have further enhanced our practice, DSMCompare, to detect semantic differences and conflicts based on a three-way domain-specific comparison approach.</p> <p>To evaluate our practice, using a novel technique; we first used a reverse engineering method to transform the minimal collection of conflicting files of source codes involved in each commit into a three model for 95 conflicting commits over 13 open source GitHub projects and then calculated a high precision and recall compared to RefConfMiner's result.<br> The repository contains the results of the evaluation including the common ancestor model, left version mode, right version model, and the results of semantic comparison and conflict detection for each commit.</p> <p>The source code and relevant artifacts such as meta-models are available at:<br> https://github.com/geodes-sms/DSMCompare/</p>
Polymer simulations guide the detection and quantification of chromatin loop extrusion by imaging
<p><strong>Dataset description</strong></p> <p>This dataset contains coordinates of the two anchors of a 150 kb simulated loop (static imaging) and anchor-anchor distances of a 150 kb loop in simulations where the extruder was allowed to unbind from the polymer (dynamic imaging).</p> <p><strong>Dataset description - Static imaging</strong></p> <p>This dataset contains coordinates of the two anchors of a 150 kb simulated loop.</p> <p>The subfolder 'Free' contains coordinates from a polymer not submitted to loop extrusion (1,000 independent simulations). The subfolder 'Loop' contains loop anchor coordinates in a polymer submitted to loop extrusion (4,000 independent simulations). In simulations with extrusion, the polymer chain was simulated such as it went through 3 different states : i) Open state (absence of loops) ii) Extruding state where the loop size increases with time (anchor-anchor distance decreases) and iii) Closed state corresponding to a stable loop with the two anchors in contact.</p> <p> </p> <p><strong>Structure of data - Static imaging</strong></p> <p>In each .txt file, the first three columns correspond to the XYZ coordinates of the anchor (in µm), the fourth column indicates the state label (0=Open, 1=Extruding, 2=Closed). Each row corresponds to a simulation timepoint (2991 timepoints in polymers submitted to loop extrusion).</p> <p>The simulation ID is indicated at the end of each .txt file.</p> <p>The two anchors of the loop are bead #275 and bead #324.</p> <p> </p> <p><strong>Structure of data - Dynamic imaging</strong></p> <p>Each .txt file contains the anchor-anchor distance (in µm) as function of time for approximately 10,000 independent simulations. Each column is an independent simulation. Each row is a simulation timepoint (0.3 s / simulation unit). The different .txt files correspond to different localization errors, indicated in µm in XY and Z.</p> <p>'list_deb_closed_10000.p' is a dictionary whose keys are the simulation ID (corresponding to the columns of the .txt files), and the values are the frame at which extrusion begins.</p> <p>'list_end_closed_10000.p' is a dictionary whose keys are the simulation ID (corresponding to the columns of the .txt files), and the values are the frame at which extrusion ends.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.