Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
1,041
datasets available to search
ShareScore release 0.9.0
Dataset results
1,041 results for “Internet”
Dataset of DNS over HTTPS (DoH) Internet Servers
<p><strong>Description</strong></p> <p>The DoH Internet Servers dataset comprises a verified list of Internet servers offering DNS over HTTPS (DoH). This is an updated <a href="http://doi.org/10.17632/ny4m53g6bw.1">10.17632/ny4m53g6bw.1</a> The list was created through the aggregation of a previously existing, but incomplete, list of DoH servers. The servers in this dataset went through a verification phase where it was confirmed they were active and working as advertised. The verification was done between May 1st, 2022, and May 4th, 2022. The dataset contains a total of 254 unique DoH servers, out of which 136 are over IPv4 and 118 over IPv6. The DoH servers belong to 59 unique Autonomous Systems and are associated with a total of 106 unique domain names.</p> <p>The following public lists of existing DoH servers were used to create this dataset:</p> <ul> <li>https://developers.google.com/speed/public-dns/docs/doh/json</li> <li>https://blog.nightly.mozilla.org/2018/06/01/improving-dns-privacy-in-firefox/</li> <li>https://github.com/curl/curl/wiki/DNS-over-HTTPS</li> <li>https://help.keenetic.com/hc/en-us/articles/360007687159-DNS-over-TLS-and-DNS-over-HTTPS-proxy-servers-for-DNS-requests-encryption</li> <li>https://dnsprivacy.org/wiki/display/DP/DNS+Privacy+Public+Resolvers</li> <li>https://kb.adguard.com/en/general/dns-providers</li> <li>https://applied-privacy.net/services/dns/</li> <li>https://www.pacnog.org/pacnog24/presentations/DoT-DoH-DNS-Privacy.pdf</li> <li>https://www.privacytools.io/providers/dns/</li> </ul> <p> </p> <p>The verification of the DoH servers was performed using a custom-made python script. The script is available at: https://github.com/stratosphereips/DoH-Research/tree/main/validation-script</p>
Client data for churn prediction for an internet shipment reselling company
<p> Dataset to train and test a churn classifier model for a ecommerce company.</p>
MineDojo Internet Knowledge Base (Reddit)
<p><strong>Project website:</strong> <a href="https://minedojo.org">minedojo.org</a></p> <p><strong>Paper:</strong> <a href="https://arxiv.org/abs/2206.08853">arxiv.org/abs/2206.08853</a></p> <p><strong>GitHub:</strong> <a href="https://github.com/MineDojo/MineDojo">github.com/MineDojo/MineDojo</a></p> <p><strong>We collect 340K+ Reddit posts along with 6.6M comments under the “<a href="https://www.reddit.com/r/minecraft">r/Minecraft</a>” subreddit.</strong> These posts ask questions on how to solve certain tasks, showcase cool architectures and achievements in image/video snippets, and discuss general tips and tricks for players of all expertise levels. Large language models can be finetuned on our Reddit corpus to internalize Minecraft-specific concepts and develop sophisticated strategies.</p> <p>Check out our paper!</p> <p> </p> <pre><code class="language-markdown">@article{fan2022minedojo, title = {MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge}, author = {Linxi Fan and Guanzhi Wang and Yunfan Jiang and Ajay Mandlekar and Yuncong Yang and Haoyi Zhu and Andrew Tang and De-An Huang and Yuke Zhu and Anima Anandkumar}, year = {2022}, journal = {arXiv preprint arXiv: Arxiv-2206.08853} }</code></pre> <p> </p>
MineDojo Internet Knowledge Base (Wiki)
<p><strong>Project website:</strong> <a href="https://minedojo.org">minedojo.org</a></p> <p><strong>Paper:</strong> <a href="https://arxiv.org/abs/2206.08853">arxiv.org/abs/2206.08853</a></p> <p><strong>GitHub:</strong> <a href="https://github.com/MineDojo/MineDojo">github.com/MineDojo/MineDojo</a></p> <p>The Minecraft Wiki pages cover almost every aspect of the game mechanics, and supply a rich source of unstructured knowledge in multimodal tables, recipes, illustrations, and step-by-step tutorials. <strong>We scrape 6,735 pages that interleave text, images, tables, and diagrams.</strong> To preserve the layout information, we also save the screenshots of entire pages and extract bounding boxes of the visual elements.</p> <p>There are two files in our Wiki knowledge base.</p> <ul> <li><strong>wiki_samples.zip:</strong> A sample version of the full knowledge base (10 pages). </li> <li><strong>wiki_full.zip:</strong> The full knowledge base (6,735 pages). </li> </ul> <p>Check out our paper!</p> <pre><code class="language-markdown">@article{fan2022minedojo, title = {MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge}, author = {Linxi Fan and Guanzhi Wang and Yunfan Jiang and Ajay Mandlekar and Yuncong Yang and Haoyi Zhu and Andrew Tang and De-An Huang and Yuke Zhu and Anima Anandkumar}, year = {2022}, journal = {arXiv preprint arXiv: Arxiv-2206.08853} }</code></pre>
ARIA - Accessible Rich Internet Applications Landmarks classified dataset
<p>ARIA Landmarks classified dataset. ARIA Landmarks are regions of web applications that can be accessed by specific keyboard shortcuts and are specially useful for blind users. They comprise the banner, complementary, contentinfo, form, main, navigation, region and search classes.</p> <p>In the dataset, samples represent DOM elements of web applications with different attributes extracted when these elements are rendered in the browser.</p>
Internet AS Router Graphs
<p>Internet graph dataset that contains AS-level edges associated with major border router manufactures. </p>
The Cloud that Runs the Mobile Internet: A Measurement Study of Mobile Cloud Services
<p>In order to assess the performance of domains hosted in Cloud Service Providers (CSP), we run a dedicated measurements campaign on the MONROE measurements platform.</p> <p>For this study we use nodes in 4 countries and the Mobile Network Operators (MNO) over which we measure are:</p> <ul> <li>Norway: Telenor, Telia, <strong>Telia (SE)</strong></li> <li>Italy: Vodafone, Wind, TIM</li> <li>Spain: Yoigo, Orange, <strong>Vodafone (IT)</strong></li> <li>Sweden: Telia, Telenor, 3</li> </ul> <p>* MNOs written in bold letters are SIM cards that are roaming internationally (home country code in brackets).</p> <p>We benefit from MONROE’s openness and capabilities to run long-lived active measurements in realistic but controlled scenarios in commercial MNOs.</p> <p>Namely:</p> <ul> <li><strong>DNS test:</strong> We run DNS lookups for each target mobile domain towards: 1) the default MNO DNS resolver, 2) Google's public resolver and 3) OpenDNS's public resolver. This will allow us to compare the quality of the responses and identify possible DNS-level inefficiencies during the replica selection. All our DNS queries include the EDNS edns-client-subnet flag as it may be used by CSPs like EdgeCast and Amazon services to locate the end user and improve the quality of replica selection. If we do not receive a reply, as it occurs for Vodafone (IT) possibly due to the presence of an in-path DNS proxy filtering those requests, we repeat the request without the flag.</li> <li><strong>Traffic performance test:</strong> We measure the TCP connection and TLS session establishment time, if applicable, towards the resolved IP addresses. We repeat the same experiment over TCP ports 80 and 443, in case the MNO performs traffic shaping or deploys TCP-splitting proxies. The TCP connection, as well as the TLS session establishment are triggered by an HTTP GET request for the favicon.ico object. The presence of the object in the server is not relevant as the handshakes are triggered regardless of its existence.</li> <li><strong>Network topology test: </strong>For each resolved IP address, we run UDP traceroutes to study CSP-MNO peering and topological relationships. We also run pings towards the same IP address.</li> </ul> <p>We also log all the related metadata that are provided by the platform.</p> <p>The schema of the database can be found at:</p> <p>https://github.com/FoivosMichelinakis/cloudmap/blob/master/supportingFiles/parsers/cloudmap.sql</p> <p>The container code used on the MONROE nodes to generate this dataset can be found at:</p> <p>https://github.com/FoivosMichelinakis/cloudmap/</p> <p> </p> <p>We run the aforementioned experiments in isolation from other experiments continuously over 4 weeks, from April 5, 2017 until May 6, 2017.</p> <p>The combined results of the three tests for a given FQDN produce a "sample". The measurements are continuously run and the periodicity of the same sample varies between 4 and 24 hours. Thus, each sample has several instances across time of day and various radio conditions.</p>
Figure 7 in Internet-based data platforms re-define the distributions of some large crabronid wasps in Arkansas (Hymenoptera: Crabronidae)
Figure 7. Map of the known geographic distributions for Sphecius speciosus (circle), Stictia carolina (triangle), Stizus brevipennis (square) in Arkansas.
Figure 8 in Internet-based data platforms re-define the distributions of some large crabronid wasps in Arkansas (Hymenoptera: Crabronidae)
Figure 8. Number of county records for three species of wasps in the University of Arthropod Arthropod Museum (UAAM), and three internet-based data platforms.
Dataset: First Trust Dow Jones International Internet ETF (FDNI) Stock Performance
This dataset provides historical stock market performance data for specific companies. It enables users to analyze and understand the past trends and fluctuations in stock prices over time. This information can be utilized for various purposes such as investment analysis, financial research, and market trend forecasting.
Dataset: Global X Internet of Things ETF (SNSR) Stock Performance
This dataset provides historical stock market performance data for specific companies. It enables users to analyze and understand the past trends and fluctuations in stock prices over time. This information can be utilized for various purposes such as investment analysis, financial research, and market trend forecasting.
Dataset: Invesco NASDAQ Internet ETF (PNQI) Stock Performance
This dataset provides historical stock market performance data for specific companies. It enables users to analyze and understand the past trends and fluctuations in stock prices over time. This information can be utilized for various purposes such as investment analysis, financial research, and market trend forecasting.
Dataset: First Internet Bancorp (INBK) Stock Performance
This dataset provides historical stock market performance data for specific companies. It enables users to analyze and understand the past trends and fluctuations in stock prices over time. This information can be utilized for various purposes such as investment analysis, financial research, and market trend forecasting.
Mapa 1 in La contribución de registros fotográficos en internet para estudios faunísticos: el caso de la expansión iberobalear de la especie invasora Leptoglossus occidentalis Heidemann, 1910 (Hemiptera, Coreidae).
Mapa 1.- Registros de L. occidentalis en el área iberobalear. Se sombrean en color gris claro las provincias con registros tomados de la bibliografía, en color gris medio las provincias con nuevos registros y en color gris oscuro las provincias con ambos tipos de registros. Las cifras corresponden al número total de registros en cada provincia.
Q5. Do you believe that the internet can be used with antisocial purpose?-Computer-Mediated Security Threats into the Web 2.0 Society
<p>With a median value of 7 it is obvious that a large part of the sample consider that the Internet can be used in a consistent manner for various antisocial purposes (59.3% evaluated this risk above 7). Even if this is a subjective evaluation, the focusing of answers on the high part of the scale confirms the relevance of this topic. Once again, without a direct experience in the security issues, the users that have answered to the questionnaire recognize that in the digital world can be infiltrated people, contents, information, actions, and applications with less ethical intentions.</p>
Q3. To what extent that information from the Internet should be censored?-Computer-Mediated Security Threats into the Web 2.0 Society
<p>Following this distribution, we can observe that a large part of the subjects (44,7%) consider that the information from the internet should be moderately censored (against various risks and social dangerous). Beside them, 26.6% evaluate that this process should be wider, and 28.7% think it should be lower. These two almost equal groups consolidate the central trend, and reflect a quite important worry concerning this perspective. The Internet has begun as an almost totally free of control medium, a quasi-anarchic structure, a symbol for the freedom of expression for any users. In time, it has become more and more accessible, and a large amount of information has become available inside the Info-sphere. Now, due to some negative consequences, it looks like starting to censure some information is not a prohibitive idea anymore, but rather a desirable one. We want to stress on the fact that the sample was formed by regular users that are not experts in security issues and thus, the recognizing of the importance of having a moderate censuring onto the Internet is a very significant conclusion. With an indirect connection to the previous item, the next question has directly approached a special topic related to the user’s knowledge about the dark web and/or deep web. These represent a quite particularly topic among the Internet users, and represent an area where the IP tracking is difficult or not-possible. Into this kind of sites and applications any user can remain anonymous, no matter what he/she does, posts or accesses.</p>
Q1. How do you assess the evolution of the Internet in the last 5 years?-Computer-Mediated Security Threats into the Web 2.0 Society
<p>The answers at this question indicated a quasi-total trend of increasing into the evolution of the Internet during the last 5 years (96% for “increased” and “high increased”) with a median value of 5 (corresponding to “high increased”). This public perception is strictly related to the current developing of the Internet applications, utilizations and related behaviors. In accordance with the above theoretical framework can be expected that this extensive evolution will include soon or later various antisocial content and negative manifestation. This is not a compulsory trend but only a natural extension, after the digitalization of almost all regular domains (education, mass-media, transportation, health, public administration, government, culture and so on) the areas of human manifestations that are at the law limits or beyond these will become on-line. At this moment the extension of the Internet is a quite solid fact.</p>
Internet of Things from a Business Perspective - The IoT Literature Classification Framework
<p>The Internet of Things (IoT) is an important development in the context of business information systems. The IoT, as a foundation for cyber-physical information systems, has similar potential for revolutionizing business as cloud computing over the last decade. The purpose of the current article is to formulate and apply a framework in order to take a quantitative snapshot of current literature on the IoT from a business perspective. Our results give an overview on important areas and will support future studies in research and practice. </p> <p>This dataset contains the IoT literature classification framework as MS Excel file.</p>
Internet AS-Graph Edgelist for Network Analysis
<p>This edgelist serves network analyses.</p>
Survey on Internet attitudes
<p>The dataset on Alternative Internet survey is part of the research on Alternative Internets carried out in the project <strong>netCommons</strong>: Network Infrastructure as Commons H2020 EU project (Grant Number 688768, project URL: <a href="http://netcommons.eu">http://netcommons.eu</a>).</p> <p>The netCommons project aspires to study, support and further promote an emerging trend, community-based networking and communication services that can offer a complement, or even a sustainable alternative, to the global Internet’s current dominant model. Community networks not only provide citizens with access to a neutral, bottom-up network infrastructure, which naturally increases the transparency of data flow, but they also represent an archetype of networked collective cooperation and action, mixing common or communal ownership and management of an infrastructure with a balanced set of services supported by the local stakeholders. Community networks, however, are complex systems that require multiple skills to thrive: technical, legal, socio-economic, and political. They face many challenges and they also need abstractions, models and practical tools to grow and produce a higher beneficial impact on our society.</p> <p>The Alternative Internet survey examines the concerns about internet usage that can be identified among sufficiently competent and regular internet users. Such concerns provide useful input both to community networks and to other stakeholders such as policy-makers and regulators who play significant roles in the telecommunications and internet landscape and, consequently, need to take informed steps as to the regulation of the internet and the ways in which community networks can be part of this landscape. In addition, the survey results provide input as to the attitudes of those internet users regarding the possibility of using community networks.</p> <p>The online survey run on platform limesurvey, which is built on open source code, whilst it also presents convenient functionality, including the possibility of anonymisation of the user. It run for seven months (from June 2017 until 22 January 2018) and resulted in 1000 completed online questionnaires. Respondents were targeted through specific mailing lists and have included: academics/university researchers, university administrators, IT professionals in products and services, and students, while some clerical workers have also filled in the questionnaire. The selected groups were assumed to be both regular and competent internet users and therefore suitable for providing rich and relevant responses on Internet usage.</p> <p>The data presented are both quantitative and qualitative. Whilst the full results are included in the above mentioned file (<a href="https://zenodo.org/api/files/f9cf69e8-7493-4b29-8ac8-719f566724b9/Survey_357528_Survey_on_Internet_Attitudes.pdf?versionId=a4f6c35d-e6ce-4e21-9462-385ac40e07d6">Survey_357528_Survey_on_Internet_Attitudes.pdf </a>), we have also produced a number of graphs, as described in the relevant README file.</p> <p>The data are responses to different categories of questions.</p> <p>Question QA1 is the relevant consent form.</p> <p>Questions QB1, QB2, QB3, QB5 and QB6 are about some dimensions of the Internet usage of the respondent. QB8A asks the respondent to grade their skills on a number of different Internet uses.</p> <p>Question QC1A asks whether the user has experienced privacy violations, with certain options provided as answers. QC1B requests more details about the kind of privacy violation experienced.</p> <p>Questions QC2A, QC2B, QC2C, QC2D, QC2E address privacy concerns, while questions QC3A, QC3b, QC3C are about possible steps taken by the respondent to address such concerns. QC4 is about consideration of alternative platforms.</p> <p>Questions QC5, QC7, QC8 provide a measure of advertising and commercialisation concerns, while QC9 is about consideration of alternatives to address such concerns.</p> <p>Questions QC10A, QC11A, QC11B, QC12A, QC12B are on monopolies, and examine attitudes towards the dominant presence of an Internet service provider, social networking site, or search engine. QC13 is about consideration of alternatives to address monopoly concerns.</p> <p>Questions QC15, QC16, QC17, QC18 and QC18B relate to the theme of Internet governance and electronic democracy; more specifically on: taxation of large Internet corporations, equality of access and skills (digital divide), unequal online visibility on social networks, and access to online content. </p> <p>Questions QD1, QD2 and QD2B explicitly ask respondents to consider community networks as an alternative and also seeks to elicit their views as to the potential of such networks.</p> <p>Finally, questions QE1 to QE8 include demographics of the respondents, as well as certain attitudes that they might have towards life and society, which might be indicative of the likelihood to support community initiatives.</p> <p>The elaboration of the data available here (mainly the analysis of open, qualitative answers) has been published as netCommons Deliverable 5.4 "Alternative Internet's Political Economy" available at: <a href="https://www.netcommons.eu/?q=content/alternative-internets-political-economy">https://www.netcommons.eu/?q=content/alternative-internets-political-economy</a></p> <p>The quantitative answers are available through the netCommons website at: <a href="https://www.netcommons.eu/?q=survey">https://www.netcommons.eu/?q=survey</a></p> <p>For any information concerning the Survey, please contact Dimitris Boucas, email: D.Boucas(at)westminster.ac.uk and Maria Michalis, email: M.Michalis(at)westminster.ac.uk.</p> <p>For details about the quantitative data processing, please contact Renato Lo Cigno, web: http://disi.unitn.it/locigno, email: locigno(at)disi.unitn.it.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.