Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
16
datasets available to search
ShareScore release 0.9.0
Dataset results
16 results for “traffic flow”
Short-term traffic flow prediction based on secondary hybrid decomposition and deep echo state networks
<p>The publication titled "Short-term traffic flow prediction based on secondary hybrid decomposition and deep echo state networks" is supported by the STRIDE K3 project. The dataset used in the publication is uploaded here.</p>
Network traffic datasets created by Single Flow Time Series Analysis
<p><strong>Network traffic datasets created by Single Flow Time Series Analysis</strong></p> <p>Datasets were created for the paper: Network Traffic Classification based on Single Flow Time Series Analysis -- Josef Koumar, Karel Hynek, Tomáš Čejka -- which was published at The 19th International Conference on Network and Service Management (CNSM) 2023. Please cite usage of our datasets as:<br> </p> <blockquote> <p>J. Koumar, K. Hynek and T. Čejka, "Network Traffic Classification Based on Single Flow Time Series Analysis," <em>2023 19th International Conference on Network and Service Management (CNSM)</em>, Niagara Falls, ON, Canada, 2023, pp. 1-7, doi: 10.23919/CNSM59352.2023.10327876.</p> </blockquote> <p>This Zenodo repository contains 23 datasets created from 15 well-known published datasets which are cited in the table below. Each dataset contains 69 features created by Time Series Analysis of Single Flow Time Series. The detailed description of features from datasets is in the file: <em>feature_description.pdf</em></p> <p> </p> <p>In the following table is a description of each dataset file:</p> <table> <tbody> <tr> <td><strong>File name</strong></td> <td><strong>Detection problem</strong></td> <td><strong>Citation of original raw dataset</strong></td> </tr> <tr> <td>botnet_binary.csv </td> <td>Binary detection of botnet </td> <td>S. García et al. An Empirical Comparison of Botnet Detection Methods. Computers & Security, 45:100–123, 2014. </td> </tr> <tr> <td>botnet_multiclass.csv </td> <td>Multi-class classification of botnet </td> <td>S. García et al. An Empirical Comparison of Botnet Detection Methods. Computers & Security, 45:100–123, 2014. </td> </tr> <tr> <td>cryptomining_design.csv</td> <td>Binary detection of cryptomining; the design part </td> <td>Richard Plný et al. Datasets of Cryptomining Communication. Zenodo, October 2022 </td> </tr> <tr> <td>cryptomining_evaluation.csv </td> <td>Binary detection of cryptomining; the evaluation part </td> <td>Richard Plný et al. Datasets of Cryptomining Communication. Zenodo, October 2022 </td> </tr> <tr> <td>dns_malware.csv </td> <td>Binary detection of malware DNS </td> <td>Samaneh Mahdavifar et al. Classifying Malicious Domains using DNS Traffic Analysis. In DASC/PiCom/CBDCom/CyberSciTech 2021, pages 60–67. IEEE, 2021. </td> </tr> <tr> <td>doh_cic.csv </td> <td>Binary detection of DoH </td> <td> <p>Mohammadreza MontazeriShatoori et al. Detection of doh tunnels using time-series classification of encrypted traffic. In DASC/PiCom/CBDCom/CyberSciTech 2020, pages 63–70. IEEE, 2020 </p> </td> </tr> <tr> <td>doh_real_world.csv </td> <td>Binary detection of DoH </td> <td>Kamil Jeřábek et al. Collection of datasets with DNS over HTTPS traffic. Data in Brief, 42:108310, 2022 </td> </tr> <tr> <td>dos.csv </td> <td>Binary detection of DoS </td> <td>Nickolaos Koroniotis et al. Towards the development of realistic botnet dataset in the Internet of Things for network forensic analytics: Bot-IoT dataset. Future Gener. Comput. Syst., 100:779–796, 2019.</td> </tr> <tr> <td>edge_iiot_binary.csv </td> <td>Binary detection of IoT malware </td> <td>Mohamed Amine Ferrag et al. Edge-iiotset: A new comprehensive realistic cyber security dataset of iot and iiot applications: Centralized and federated learning, 2022.</td> </tr> <tr> <td>edge_iiot_multiclass.csv</td> <td>Multi-class classification of IoT malware</td> <td>Mohamed Amine Ferrag et al. Edge-iiotset: A new comprehensive realistic cyber security dataset of iot and iiot applications: Centralized and federated learning, 2022.</td> </tr> <tr> <td>https_brute_force.csv</td> <td>Binary detection of HTTPS Brute Force</td> <td>Jan Luxemburk et al. HTTPS Brute-force dataset with extended network flows, November 2020</td> </tr> <tr> <td>ids_cic_binary.csv</td> <td>Binary detection of intrusion in IDS</td> <td>Iman Sharafaldin et al. Toward generating a new intrusion detection dataset and intrusion traffic characterization. ICISSp, 1:108–116, 2018.</td> </tr> <tr> <td>ids_cic_multiclass.csv </td> <td>Multi-class classification of intrusion in IDS </td> <td>Iman Sharafaldin et al. Toward generating a new intrusion detection dataset and intrusion traffic characterization. ICISSp, 1:108–116, 2018. </td> </tr> <tr> <td>ids_unsw_nb_15_binary.csv </td> <td>Binary detection of intrusion in IDS </td> <td>Nour Moustafa and Jill Slay. Unsw-nb15: a comprehensive data set for network intrusion detection systems (unsw-nb15 network data set). In 2015 military communications and information systems conference (MilCIS), pages 1–6. IEEE, 2015.</td> </tr> <tr> <td>ids_unsw_nb_15_multiclass.csv </td> <td>Multi-class classification of intrusion in IDS </td> <td>Nour Moustafa and Jill Slay. Unsw-nb15: a comprehensive data set for network intrusion detection systems (unsw-nb15 network data set). In 2015 military communications and information systems conference (MilCIS), pages 1–6. IEEE, 2015.</td> </tr> <tr> <td>iot_23.csv </td> <td>Binary detection of IoT malware </td> <td>Sebastian Garcia et al. IoT-23: A labeled dataset with malicious and benign IoT network traffic, January 2020. More details here https://www.stratosphereips.org /datasets-iot23</td> </tr> <tr> <td>ton_iot_binary.csv </td> <td>Binary detection of IoT malware </td> <td>Nour Moustafa. A new distributed architecture for evaluating ai-based security systems at the edge: Network ton iot datasets. Sustainable Cities and Society, 72:102994, 2021</td> </tr> <tr> <td>ton_iot_multiclass.csv </td> <td>Multi-class classification of IoT malware </td> <td>Nour Moustafa. A new distributed architecture for evaluating ai-based security systems at the edge: Network ton iot datasets. Sustainable Cities and Society, 72:102994, 2021</td> </tr> <tr> <td>tor_binary.csv </td> <td>Binary detection of TOR </td> <td>Arash Habibi Lashkari et al. Characterization of Tor Traffic using Time based Features. In ICISSP 2017, pages 253–262. SciTePress, 2017. </td> </tr> <tr> <td>tor_multiclass.csv </td> <td>Multi-class classification of TOR </td> <td>Arash Habibi Lashkari et al. Characterization of Tor Traffic using Time based Features. In ICISSP 2017, pages 253–262. SciTePress, 2017. </td> </tr> <tr> <td>vpn_iscx_binary.csv </td> <td>Binary detection of VPN </td> <td>Gerard Draper-Gil et al. Characterization of Encrypted and VPN Traffic Using Time-related. In ICISSP, pages 407–414, 2016. </td> </tr> <tr> <td>vpn_iscx_multiclass.csv </td> <td>Multi-class classification of VPN </td> <td>Gerard Draper-Gil et al. Characterization of Encrypted and VPN Traffic Using Time-related. In ICISSP, pages 407–414, 2016. </td> </tr> <tr> <td>vpn_vnat_binary.csv </td> <td>Binary detection of VPN </td> <td>Steven Jorgensen et al. Extensible Machine Learning for Encrypted Network Traffic Application Labeling via Uncertainty Quantification. CoRR, abs/2205.05628, 2022</td> </tr> <tr> <td>vpn_vnat_multiclass.csv</td> <td>Multi-class classification of VPN </td> <td>Steven Jorgensen et al. Extensible Machine Learning for Encrypted Network Traffic Application Labeling via Uncertainty Quantification. CoRR, abs/2205.05628, 2022</td> </tr> </tbody> </table> <p> </p>
Network traffic datasets with novel extended IP flow called NetTiSA flow
<p><strong>Network traffic datasets with novel extended IP flow called NetTiSA flow</strong></p> <p>Datasets were created for the paper: NetTiSA: Extended IP Flow with Time-series Features for Universal Bandwidth-constrained High-speed Network Traffic Classification -- Josef Koumar, Karel Hynek, Jaroslav Pešek, Tomáš Čejka -- which is published in The International Journal of Computer and Telecommunications Networking <a href="https://doi.org/10.1016/j.comnet.2023.110147" rel="nofollow">https://doi.org/10.1016/j.comnet.2023.110147</a><br><br>Please cite the usage of our datasets as:</p> <blockquote> <p>Josef Koumar, Karel Hynek, Jaroslav Pešek, Tomáš Čejka, "NetTiSA: Extended IP flow with time-series features for universal bandwidth-constrained high-speed network traffic classification", Computer Networks, Volume 240, 2024, 110147, ISSN 1389-1286<br><br></p> <pre><code>@article{KOUMAR2024110147, title = {NetTiSA: Extended IP flow with time-series features for universal bandwidth-constrained high-speed network traffic classification}, journal = {Computer Networks}, volume = {240}, pages = {110147}, year = {2024}, issn = {1389-1286}, doi = {https://doi.org/10.1016/j.comnet.2023.110147}, url = {https://www.sciencedirect.com/science/article/pii/S1389128623005923}, author = {Josef Koumar and Karel Hynek and Jaroslav Pešek and Tomáš Čejka} } </code></pre> </blockquote> <p>This Zenodo repository contains 23 datasets created from 15 well-known published datasets, which are cited in the table below. Each dataset contains the NetTiSA flow feature vector.<br><br> </p> <p><strong>NetTiSA flow feature vector</strong></p> <p><br>The novel extended IP flow called NetTiSA (Network Time Series Analysed) flow contains a universal bandwidth-constrained feature vector consisting of 20 features. We divide the NetTiSA flow classification features into three groups by computation. The first group of features is based on classical bidirectional flow information---a number of transferred bytes, and packets. The second group contains statistical and time-based features calculated using the time-series analysis of the packet sequences. The third type of features can be computed from the previous groups (i.e., on the flow collector) and improve the classification performance without any impact on the telemetry bandwidth.</p> <p> </p> <p><strong>Flow features</strong></p> <p>The flow features are:</p> <ul> <li><strong><em>Packets</em></strong> is the number of packets in the direction from the source to the destination IP address.</li> <li><em><strong>Packets in reverse order</strong></em> is the number of packets in the direction from the destination to the source IP address.</li> <li><strong><em>Bytes</em> </strong>is the size of the payload in bytes transferred in the direction from the source to the destination IP address.</li> <li><strong><em>Bytes in reverse order</em></strong> is the size of the payload in bytes transferred in the direction from the destination to the source IP address.</li> </ul> <p> </p> <p><strong>Statistical and Time-based features</strong></p> <p>The features that are exported in the extended part of the flow. All of them can be computed (exactly or in approximative) by stream-wise computation, which is necessary for keeping memory requirements low. The second type of feature set contains the following features:</p> <ul> <li><strong><em>Mean</em></strong> represents mean of the payload lengths of packets</li> <li><strong><em>Min</em></strong> is the minimal value from payload lengths of all packets in a flow</li> <li><strong><em>Max</em></strong> is the maximum value from payload lengths of all packets in a flow</li> <li><strong><em>Standard deviation</em></strong> is a measure of the variation of payload lengths from the mean payload length</li> <li><strong><em>Root mean square</em></strong> is the measure of the magnitude of payload lengths of packets</li> <li><strong><em>Average dispersion</em></strong> is the average absolute difference between each payload length of the packet and the mean value</li> <li><strong><em>Kurtosis</em></strong> is the measure describing the extent to which the tails of a distribution differ from the tails of a normal distribution</li> <li><em><strong>Mean of relative times</strong></em> is the mean of the relative times which is a sequence defined as <span>\(st = \{t_1 - t_1, t_2 - t_1, ..., t_n - t_1\} \)</span></li> <li><em><strong>Mean of time differences</strong></em> is the mean of the time differences which is a sequence defined as <span>\(dt = \{ t_j - t_i | j = i + 1, i \in \{1, 2, \dots, n - 1\} \}.\)</span></li> <li><em><strong>Min from time differences</strong></em> is the minimal value from all time differences, i.e., min space between packets.</li> <li><em><strong>Max from time differences</strong></em> is the maximum value from all time differences, i.e., max space between packets.</li> <li><em><strong>Time distribution</strong></em> describes the deviation of time differences between individual packets within the time series. The feature is computed by the following equation:<br><span>\(tdist = \frac{ \frac{1}{n-1} \sum_{i=1}^{n-1} \left| \mu_{\{dt_{n-1}\}} - dt_i \right| }{ \frac{1}{2} \left(max\left(\{dt_{n-1}\}\right) - min\left(\{dt_{n-1}\}\right) \right) }\)</span></li> <li><em><strong>Switching ratio</strong></em> represents a value change ratio (switching) between payload lengths. The switching ratio is computed by equation:<br><span>\(sr = \frac{s_n}{\frac{1}{2} (n - 1)}\)</span></li> </ul> <p> where <span>\(s_n\)</span> is number of switches.</p> <p> </p> <p><strong>Features computed at the collector</strong><br>The third set contains features that are computed from the previous two groups prior to classification. Therefore, they do not influence the network telemetry size and their computation does not put additional load to resource-constrained flow monitoring probes. The NetTiSA flow combined with this feature set is called the Enhanced NetTiSA flow and contains the following features:</p> <ul> <li><em><strong>Max minus min</strong></em> is the difference between minimum and maximum payload lengths</li> <li><em><strong>Percent deviation</strong></em> is the dispersion of the average absolute difference to the mean value</li> <li><em><strong>Variance</strong></em> is the spread measure of the data from its mean</li> <li><em><strong>Burstiness</strong></em> is the degree of peakedness in the central part of the distribution</li> <li><em><strong>Coefficient of variation</strong></em> is a dimensionless quantity that compares the dispersion of a time series to its mean value and is often used to compare the variability of different time series that have different units of measurement</li> <li><em><strong>Directions</strong></em> describe a percentage ratio of packet direction computed as <span>\(\frac{d_1}{ d_1 + d_0}\)</span>, where <span>\(d_1\)</span> is a number of packets in a direction from source to destination IP address and <span>\(d_0\)</span> the opposite direction. Both <span>\(d_1\)</span> and <span>\(d_0\)</span> are inside the classical bidirectional flow.</li> <li><em><strong>Duration</strong></em> is the duration of the flow</li> </ul> <p> </p> <p>The NetTiSA flow is implemented into IP flow exporter <a href="https://github.com/CESNET/ipfixprobe">ipfixprobe</a>.</p> <p> </p> <p><strong>Description of dataset files</strong></p> <p>In the following table is a description of each dataset file:</p> <table> <tbody> <tr> <td> <p><strong>File name</strong></p> </td> <td> <p><strong>Detection problem</strong></p> </td> <td> <p><strong>Citation of the original raw dataset</strong></p> </td> </tr> <tr> <td>botnet_binary.csv </td> <td>Binary detection of botnet </td> <td>S. García et al. An Empirical Comparison of Botnet Detection Methods. Computers & Security, 45:100–123, 2014. </td> </tr> <tr> <td>botnet_multiclass.csv </td> <td>Multi-class classification of botnet </td> <td>S. García et al. An Empirical Comparison of Botnet Detection Methods. Computers & Security, 45:100–123, 2014. </td> </tr> <tr> <td>cryptomining_design.csv </td> <td>Binary detection of cryptomining; the design part </td> <td>Richard Plný et al. Datasets of Cryptomining Communication. Zenodo, October 2022 </td> </tr> <tr> <td>cryptomining_evaluation.csv </td> <td>Binary detection of cryptomining; the evaluation part </td> <td>Richard Plný et al. Datasets of Cryptomining Communication. Zenodo, October 2022 </td> </tr> <tr> <td>dns_malware.csv </td> <td>Binary detection of malware DNS </td> <td>Samaneh Mahdavifar et al. Classifying Malicious Domains using DNS Traffic Analysis. In DASC/PiCom/CBDCom/CyberSciTech 2021, pages 60–67. IEEE, 2021. </td> </tr> <tr> <td>doh_cic.csv </td> <td>Binary detection of DoH </td> <td>Mohammadreza MontazeriShatoori et al. Detection of doh tunnels using time-series classification of encrypted traffic. In DASC/PiCom/CBDCom/CyberSciTech 2020, pages 63–70. IEEE, 2020 </td> </tr> <tr> <td>doh_real_world.csv </td> <td>Binary detection of DoH </td> <td>Kamil Jeřábek et al. Collection of datasets with DNS over HTTPS traffic. Data in Brief, 42:108310, 2022 </td> </tr> <tr> <td>dos.csv </td> <td>Binary detection of DoS </td> <td>Nickolaos Koroniotis et al. Towards the development of realistic botnet dataset in the Internet of Things for network forensic analytics: Bot-IoT dataset. Future Gener. Comput. Syst., 100:779–796, 2019. </td> </tr> <tr> <td>edge_iiot_binary.csv </td> <td>Binary detection of IoT malware </td> <td>Mohamed Amine Ferrag et al. Edge-iiotset: A new comprehensive realistic cyber security dataset of iot and iiot applications: Centralized and federated learning, 2022. </td> </tr> <tr> <td>edge_iiot_multiclass.csv </td> <td>Multi-class classification of IoT malware </td> <td>Mohamed Amine Ferrag et al. Edge-iiotset: A new comprehensive realistic cyber security dataset of iot and iiot applications: Centralized and federated learning, 2022. </td> </tr> <tr> <td>https_brute_force.csv </td> <td>Binary detection of HTTPS Brute Force </td> <td>Jan Luxemburk et al. HTTPS Brute-force dataset with extended network flows, November 2020 </td> </tr> <tr> <td>ids_cic_binary.csv </td> <td>Binary detection of intrusion in IDS </td> <td>Iman Sharafaldin et al. Toward generating a new intrusion detection dataset and intrusion traffic characterization. ICISSp, 1:108–116, 2018. </td> </tr> <tr> <td>ids_cic_multiclass.csv </td> <td>Multi-class classification of intrusion in IDS </td> <td>Iman Sharafaldin et al. Toward generating a new intrusion detection dataset and intrusion traffic characterization. ICISSp, 1:108–116, 2018. </td> </tr> <tr> <td>unsw_binary.csv </td> <td>Binary detection of intrusion in IDS </td> <td>Nour Moustafa and Jill Slay. Unsw-nb15: a comprehensive data set for network intrusion detection systems (unsw-nb15 network data set). In 2015 military communications and information systems conference (MilCIS), pages 1–6. IEEE, 2015. </td> </tr> <tr> <td>unsw_multiclass.csv </td> <td>Multi-class classification of intrusion in IDS </td> <td>Nour Moustafa and Jill Slay. Unsw-nb15: a comprehensive data set for network intrusion detection systems (unsw-nb15 network data set). In 2015 military communications and information systems conference (MilCIS), pages 1–6. IEEE, 2015. </td> </tr> <tr> <td>iot_23.csv </td> <td>Binary detection of IoT malware </td> <td>Sebastian Garcia et al. IoT-23: A labeled dataset with malicious and benign IoT network traffic, January 2020. More details here https://www.stratosphereips.org /datasets-iot23 </td> </tr> <tr> <td>ton_iot_binary.csv </td> <td>Binary detection of IoT malware </td> <td>Nour Moustafa. A new distributed architecture for evaluating ai-based security systems at the edge: Network ton iot datasets. Sustainable Cities and Society, 72:102994, 2021 </td> </tr> <tr> <td>ton_iot_multiclass.csv </td> <td>Multi-class classification of IoT malware </td> <td>Nour Moustafa. A new distributed architecture for evaluating ai-based security systems at the edge: Network ton iot datasets. Sustainable Cities and Society, 72:102994, 2021 </td> </tr> <tr> <td>tor_binary.csv </td> <td>Binary detection of TOR </td> <td>Arash Habibi Lashkari et al. Characterization of Tor Traffic using Time based Features. In ICISSP 2017, pages 253–262. SciTePress, 2017. </td> </tr> <tr> <td>tor_multiclass.csv </td> <td>Multi-class classification of TOR </td> <td>Arash Habibi Lashkari et al. Characterization of Tor Traffic using Time based Features. In ICISSP 2017, pages 253–262. SciTePress, 2017. </td> </tr> <tr> <td>vpn_iscx_binary.csv </td> <td>Binary detection of VPN </td> <td>Gerard Draper-Gil et al. Characterization of Encrypted and VPN Traffic Using Time-related. In ICISSP, pages 407–414, 2016. </td> </tr> <tr> <td>vpn_iscx_multiclass.csv </td> <td>Multi-class classification of VPN </td> <td>Gerard Draper-Gil et al. Characterization of Encrypted and VPN Traffic Using Time-related. In ICISSP, pages 407–414, 2016. </td> </tr> <tr> <td>vpn_vnat_binary.csv </td> <td>Binary detection of VPN </td> <td>Steven Jorgensen et al. Extensible Machine Learning for Encrypted Network Traffic Application Labeling via Uncertainty Quantification. CoRR, abs/2205.05628, 2022 </td> </tr> <tr> <td>vpn_vnat_multiclass.csv </td> <td>Multi-class classification of VPN </td> <td>Steven Jorgensen et al. Extensible Machine Learning for Encrypted Network Traffic Application Labeling via Uncertainty Quantification. CoRR, abs/2205.05628, 2022 </td> </tr> </tbody> </table> <p> </p> <p> </p> <p> </p> <p> </p>
Intersection Vehicular Traffic Flow Scheduling Datasets
<p><strong>Background</strong></p> <p>Vehicular traffic congestion remains a major problem in most modern cities of the world. Therefore, efforts to minimize these congestions and their accompanying effects continuously receive much attention from researchers, traffic engineers, policymakers, etc.</p> <p>One important element required in the efforts of traffic engineering for the minimization of traffic congestion is data. Data influence the modeling and deployment of traffic scheduling systems. Most importantly, the objectives of modeling and deploying the traffic scheduling system influence the nature of the data to be used.</p> <p><strong>Aim</strong></p> <p>The aim of this study was to generate and provide a dataset that may be used in the training of computationally intelligent systems having basic objects of minimizing waiting time, travel time, etc. at various intersections (isolated intersections or roundabouts).</p> <p><strong>Methodology</strong></p> <p>The dataset (<strong><em>.csv</em></strong>) consisted of waiting time (W), queue length (Q), and phase duration (P). The waiting time is the time duration vehicles have waited at an intersection/roundabout before being scheduled to utilize the intersection/roundabout. The queue length refers to the number of vehicles (vehicular count) waiting at an intersection/roundabout. Phase duration is the time period a given vehicular flow (lane) is assigned the green wave to utilize the intersection/roundabout. The dataset was obtained through repeated training, testing, and modification of phase duration and the Adaptive Neuro-Fuzzy Inference System (ANFIS) model.</p> <p>The dataset considered bounded conditions on the three parameters (W, Q, P). The W and Q were bounded between zero and ninety – [0, 90] and the P is [13, 50]. That is, when W and Q are greater than or equal to the upper bound, the upper bound is used. Every flow may be assigned a minimum P of 13s and a maximum of 50s. The P-bounds assumed that the lower bound is large enough for vehicles on the assigned traffic flow to move to the safe region of the intersection before the scheduling system switches assignment to another traffic flow. </p> <p><strong>Conclusion</strong></p> <p>The dataset may be used as a benchmark dataset for the improvement of traffic flow controllers as well as other datasets.</p>
NDVI, nocturnal road traffic noise and traffic flow over the canton of Geneva
<p>This dataset relates the spatial distribution of several environmental variables (including NDVI and nocturnal road traffic noise) over the territory of the canton of Geneva (Switzerland) with the aim of studying the potential attenuation effect of vegetation on road traffic noise. Traffic flow measurement points are in this regard also included.</p> <p>The dataset contains two distinct group of files. The first one (hec_grid_ge) contains the hectometric vector grid discretization of the canton of Geneva excluding Lake Geneva. Each cell is characterized by the mean, median and standard deviation of several environmental variables (NDVI, nocturnal road traffic noise, daily road traffic noise and land surface temperature). In addition, BiLISA local Moran's I, p-value and spatial association type for the spatial correlation of median NDVI and spatial lag of median nocturnal road traffic noise are defined for each cell. The second group of files (traffic_ge) contains the traffic flow measurements points which are characterized with "hec_grid_ge" layer variables of the hectometric cell to which they belong to.</p>
Traffic flow formation in termites
<p>The material shared here is part of the research project on the mechanism of traffic flow formation. We use termites as a biological model and their natural foraging activity as a method. Here, we present some video fragments extracted from the recordings of the full foraging process of the termites <em>Constrictotermes </em><em>cyphergaster</em> at laboratory conditions. This research project is supported by the Brazilian Government through the Minas Gerais State Agency for Research (FAPEMIG), the Brazilian Council for Research (CNPq) and the Coordination for the Improvement of Higher Education Personnel (CAPES).</p> <p>Details of the videos: Each file recording is named with the ID of the nest used for each test. A test consisted of the passage of the termites from the box containing the entire nest to the foraging box through a bridge. The width and the form of the bridge were modified between tests. In the fragment, 2018-IX-07-RCB-N09 we tested a bridge with a constant width of 7.5 cm, while in the fragment 2018-IX-07-RCB-N18 we tested a "bottleneck" bridge with a hybrid width of 2.5 cm - 1.5 cm - 2.5cm.</p> <p>For aditional information, please contact us: Julieth Castiblanco (castiblancoq.j@gmail.com), Og DeSouza (og.souza@ufv.br).</p>
IoT network traffic dataset using the custom flow representation
Open the record for dataset details and reuse information.
The dataset of "Characteristics of Urban Interaction Network in Shandong Province from the Perspective of Traffic Flow and Information Flow"
<p>There are the datasets of the research named "Characteristics of Urban Interaction Network in Shandong Province from the Perspective of Traffic Flow and Information Flow".</p>
Learn from Human-driving Accidents to Attack Autonomous Driving_Practical Traffic Flow Attacks on Decision-making
<p>We provide some demo videos of attack patterns</p>
UNSW IoT traffic data with packets, flows, and protocols
Open the record for dataset details and reuse information.
EXPERIMENTAL STUDY OF THE INTENSITY AND COMPOSITION OF TRAFFIC FLOW AT INTERSECTIONS IN THE TERRITORY OF THE CITY OF NUKUS
Open the record for dataset details and reuse information.
Automated vehicles and central business district parking: the effects of drop-off-travel on traffic flow and vehicle emissions
Open the record for dataset details and reuse information.
IoT-deNAT: Outbound flow-based network traffic data of IoT and non-IoT devices behind a home NAT
<p>This dataset is comprised of NetFlow records, which capture the outbound network traffic of 8 commercial IoT devices and 5 non-IoT devices, collected during a period of 37 days in a lab at Ben-Gurion University of The Negev. The dataset was collected in order to develop a method for telecommunication providers to detect vulnerable IoT models behind home NATs. Each NetFlow record is labeled with the device model which produced it; for research reproducibilty, each NetFlow is also allocated to either the "training" or "test" set, in accordance with the partitioning described in:</p> <p>Y. Meidan, V. Sachidananda, H. Peng, R. Sagron, Y. Elovici, and A. Shabtai, A novel approach for detecting vulnerable IoT devices connected behind a home NAT, Computers & Security, Volume 97, 2020, 101968, ISSN 0167-4048, https://doi.org/10.1016/j.cose.2020.101968. (http://www.sciencedirect.com/science/article/pii/S0167404820302418)</p> <p> </p> <p>Please note:</p> <ul> <li>The dataset itself is free to use, however users are requested to cite the above-mentioned paper, which describes in detail the research objectives as well as the data collection, preparation and analysis.</li> <li>Following is a brief description of the features used in this dataset.</li> </ul> <p> </p> <p># NetFlow features, used in the related paper for analysis</p> <p>'FIRST_SWITCHED': System uptime at which the first packet of this flow was switched<br> 'IN_BYTES': Incoming counter for the number of bytes associated with an IP Flow<br> 'IN_PKTS': Incoming counter for the number of packets associated with an IP Flow<br> 'IPV4_DST_ADDR': IPv4 destination address<br> 'L4_DST_PORT': TCP/UDP destination port number<br> 'L4_SRC_PORT': TCP/UDP source port number<br> 'LAST_SWITCHED': System uptime at which the last packet of this flow was switched<br> 'PROTOCOL': IP protocol byte (6: TCP, 17: UDP)<br> 'SRC_TOS': Type of Service byte setting when there is an incoming interface<br> 'TCP_FLAGS': Cumulative of all the TCP flags seen for this flow</p> <p> </p> <p># Features added by the authors</p> <p>'IP': Prefix of the destination IP address, representing the network (without the host)<br> 'DURATION': Time (seconds) between first/last packet switching</p> <p> </p> <p># Label<br> 'device_model': <type>.<manufacturer>.<model number></p> <p> </p> <p># Partition<br> 'partition': Training or test</p> <p> </p> <p># Additional NetFlow features (mostly zero-variance)<br> 'SRC_AS': Source BGP autonomous system number<br> 'DST_AS': Destination BGP autonomous system number<br> 'INPUT_SNMP': Input interface index<br> 'OUTPUT_SNMP': Output interface index<br> 'IPV4_SRC_ADDR': IPv4 source address<br> 'MAC': MAC address of the source</p> <p> </p> <p># Additional data<br> 'category': IoT or non-IoT<br> 'type': IoT, access_point, smartphone, laptop<br> 'date': Datepart of FIRST_SWITCHED<br> 'inter_arrival_time': Time (seconds) between successive flows of the same device (identified by its MAC address)</p>
High-resolution traffic flow data in Glasgow
<p><strong>Description of the dataset</strong></p> <p>This dataset offers a long-term traffic flow data at an intra-city scale with high spatio-temporal granularity. The dataset covers the Glasgow City Council area for four consecutive years spanning the COVID-19 pandemic, from October 2019 to September 2023, providing comprehensive temporal and spatial coverage. </p> <p>The code used to produce the indicators is available at: <a href="https://github.com/YueLi-0816/TrafficFlowData">https://github.com/YueLi-0816/TrafficFlowData</a>.</p> <p>This work is funded by the China Scholarship Council (CSC) from the Ministry of Education of P.R. China, the ESRC’s ongoing support for the Urban Big Data Centre (UBDC), and the Royal Society International Exchange Scheme.</p> <p><strong>Contents</strong></p> <p>Sensor status metadata - status.csv</p> <table> <tbody> <tr> <td> <p><span>Column name</span></p> </td> <td><span>Description</span></td> </tr> <tr> <td> <p><span>id</span></p> </td> <td><span>Unique ID for each sensor, e.g., GA0601_T.</span></td> </tr> <tr> <td> <p><span>latitude</span></p> </td> <td><span>The Latitude in decimal degrees of WGS84 coordinates, e.g., 55.86238129.</span></td> </tr> <tr> <td> <p><span>longitude</span></p> </td> <td><span>The Longitude in decimal degrees of WGS84 coordinates, e.g., -4.26570708.</span></td> </tr> <tr> <td> <p><span>step 1</span></p> </td> <td><span>The status of sensors at the current step is 1 if retained and 0 if removed.</span></td> </tr> <tr> <td> <p><span>step 2</span></p> </td> <td><span>The status of sensors at the current step is 1 if retained and 0 if removed.</span></td> </tr> <tr> <td> <p><span>step 3</span></p> </td> <td><span>The status of sensors at the current step is 1 if retained and 0 if removed.</span></td> </tr> <tr> <td> <p><span>step 4</span></p> </td> <td><span>The status of sensors at the current step is 1 if retained and 0 if removed.</span></td> </tr> <tr> <td> <p><span>step 5.1</span></p> </td> <td><span>The status of sensors at the current step is 1 if retained and 0 if removed.</span></td> </tr> <tr> <td> <p><span>step 5.2</span></p> </td> <td><span>The status of sensors at the current step is 1 if retained and 0 if removed.</span></td> </tr> </tbody> </table> <p>Sensor location metadata - locations.csv</p> <table> <tbody> <tr> <td>Column name</td> <td>Description</td> </tr> <tr> <td>id</td> <td>Unique ID for each sensor, e.g., GA0601_T.</td> </tr> <tr> <td>latitude</td> <td>The Latitude in decimal degrees of WGS84 coordinates, e.g., 55.86238129.</td> </tr> <tr> <td>longitude</td> <td>The Longitude in decimal degrees of WGS84 coordinates, e.g., -4.26570708.</td> </tr> </tbody> </table> <p> </p> <p>Traffic flows metadata</p> <table> <tbody> <tr> <td>File name</td> <td>Description</td> </tr> <tr> <td>[sensor_id].csv</td> <td>Traffic flows. [sensor_id] refers to the ‘id’ from the locations.csv</td> </tr> </tbody> </table> <p> </p> <table> <tbody> <tr> <td>Column name</td> <td>Description</td> </tr> <tr> <td>date</td> <td>The date the data is collected (YYYY-MM-DD), e.g., 2021-11-04.</td> </tr> <tr> <td>time</td> <td>The hours of the day the data is collected range from 0 to 23, 0 = [0,1), 23 = [23,24).</td> </tr> <tr> <td>flow</td> <td>Number of vehicles that pass the sensor location during the one-hour interval. </td> </tr> </tbody> </table>
Data from: Rapid transporter regulation prevents substrate flow traffic jams in boron transport
Open the record for dataset details and reuse information.
doi_dedup___::97c0f6fcb2e0e4d6cb87ef23ab4c41d5
Open the record for dataset details and reuse information.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.