Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
80
datasets available to search
ShareScore release 0.9.0
Dataset results
80 results for “Crawling”
Twitter Crawling for "Viral or Heboh" News
<p>The data we take is about tweet form 10 official account of news portal on twitter that mentioned word "Viral" or "Heboh". The dataset contain 5 columns and more than 500 tweet sorted by time.</p>
Spanish Biomedical Crawled Corpus
<p>The largest Spanish biomedical and heath corpus to date gathered from a massive Spanish health domain crawler over more than 3,000 URLs were downloaded and preprocessed. All the collected data have been preprocessed to produce the CoWeSe (Corpus Web Salud Español) resource, a large-scale and high-quality corpus intended for biomedical and health NLP in Spanish.</p> <p>Enlarged version with less restrictive document and sentence deduplication.</p> <p><strong>Citation</strong></p> <p>If you use this resource in your work, please cite our paper:</p> <pre>@misc{carrino2021spanish, title={Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Models}, author={Casimiro Pio Carrino and Jordi Armengol-Estapé and Ona de Gibert Bonet and Asier Gutiérrez-Fandiño and Aitor Gonzalez-Agirre and Martin Krallinger and Marta Villegas}, year={2021}, eprint={2109.07765}, archivePrefix={arXiv}, primaryClass={cs.CL} } </pre> <p>Copyright (c) 2022 Secretaría de Estado de Digitalización e Inteligencia Artificial</p> <p> </p>
Hasil Crawling Produk Kursi IKEA
<p>Data ini merupakan hasil crawling produk kursi pada website IKEA dengan detail pada masing-masing produk seperti merek, jenis, harga, dan sebagainya.</p>
Spanish SciELO Crawled Biomedical Corpus
<p>We present a corpus of Spanish medical articles extracted from the SciELO website (https://scielo.cl/). The corpus was constructed using web scraping extraction techniques and consists of 5694 articles published between 2002 and 2020 across 34 journals specialized in health and biology (specified below).</p> <p>Two variables of the corpus are presented here: the first contains the text without pre-processing, which makes it possible to adapt the corpus for different purposes. The second and third have been subjected to pre-processing, which is carried out with the NLTK library in Python and removes capital letters, accents, punctuation, and any non-alphanumeric symbols. In addition, the corpus was tokenized by sentences, obtaining a total of 500828 sentences and 13M tokens. In both cases, the articles are grouped by journal, in order of publication from most recent to oldest. These journals and their respective total of issues correspond to:</p> <ol> <li> <p>Acta bioethica (43 issues)</p> </li> <li> <p>Anales del Instituto de la Patagonia (31 issues)</p> </li> <li> <p>Andes pediatrica (3 issues)</p> </li> <li> <p>Biological Research (63 issues)</p> </li> <li> <p>Ciencia y enfermería - Revista iberoamericana de investigación (45 issues)</p> </li> <li> <p>Gayana (Concepción) - International Journal of Biodiversity, Oceanology and Conservation (45 issues)</p> </li> <li> <p>Gayana. Botánica (41 issues)</p> </li> <li> <p>International Journal of Morphology (79 issues)</p> </li> <li> <p>International journal of interdisciplinary dentistry (5 issues)</p> </li> <li> <p>International journal of odontostomatology (39 issues)</p> </li> <li> <p>Latin american journal of aquatic research (58 issues)</p> </li> <li> <p>Revista chilena de cardiología (37 issues)</p> </li> <li> <p>Revista chilena de enfermedades respiratorias (76 issues)</p> </li> <li> <p>Revista chilena de entomología (5 issues)</p> </li> <li> <p>Revista chilena de historia natural (64 issues)</p> </li> <li> <p>Revista chilena de infectología (131 issues)</p> </li> <li> <p>Revista chilena de neuro-psiquiatría (89 issues)</p> </li> <li> <p>Revista chilena de nutrición (86 issues)</p> </li> <li> <p>Revista chilena de obstetricia y ginecología (117 issues)</p> </li> <li> <p>Revista chilena de radiología (79 issues)</p> </li> <li> <p>Revista de biología marina y oceanografía (58 issues)</p> </li> <li> <p>Revista de cirugía (16 issues)</p> </li> <li> <p>Revista de otorrinolaringología y cirugía de cabeza y cuello (52 issues)</p> </li> <li> <p>Revista médica de Chile (264 issues)</p> </li> </ol> <p> </p> <p><strong>Non-current titles</strong></p> <ol> <li> <p> Boletín chileno de parasitología (5 issues) - Jan 2002: Completed; Continued as Parasitología latinoamericana</p> </li> <li> <p>Ciencia & trabajo (18 issues) - Feb 2020: Indexing interrupted</p> </li> <li> <p> Electronic Journal of Biotechnology (84 issues) - April 2017: Indexing interrupted</p> </li> <li> <p> Investigaciones marinas (22 issues) - Nov 2007: Completed; Continued as Latin american journal of aquatic research</p> </li> <li> <p> Parasitología al día (9 issues) - Jul 2001: Completed; Continued as Parasitología latinoamericana</p> </li> <li> <p>Parasitología latinoamericana (13 issues) - Dec 2008: Completed</p> </li> <li> <p>Revista chilena de anatomía (14 issues) - 2002: Completed ; Continued as International Journal of Morphology</p> </li> <li> <p>Revista chilena de cirugía (78 issues) - May 2019: Completed ; Continued as Revista de cirugía</p> </li> <li> <p>Revista chilena de pediatría (476 números) - March 2021: Completed ; Continued as Andes pediatrica</p> </li> <li> <p>Revista clínica de periodoncia, implantología y rehabilitación oral (30 números) - April 2020: Completed ; Continued as International journal of interdisciplinary dentistry</p> </li> </ol>
Four videos showing surface-crawling locomotion and pedal surface collection in Lymnaea stagnalis (Lymnaeidae, Gastropoda)
<p> </p> <p>Many freshwater and marine gastropods can glide along the water surface with the sole of the foot facing upward. The force driving this surface-crawling locomotion is generated by the epithelial cilia on the sole, which push a ribbon of mucus produced on the anterior sole backwards into the water. If cilia on the posterior part of the sole stop beating, mucus accumulates on the posterior sole together with particles from the water surface. This so-called pedal surface collection enables gastropods to harvest edible materials from the surface. To perform pedal surface collection, the animals may either float or attach themselves with the posterior tip of the foot to solid substrates such as aquatic plants or aquarium walls.</p> <p>The four videos presented here show surface-crawling locomotion and pedal surface collection in the great pond snail, <em>Lymnaea stagnalis</em> (L., 1758), a common holarctic species. The animals came from a pond in a forest near Frankfurt am Main, west central Germany. Shell lengths of the snails shown range from 31 to 37 mm. Videos were captured with various inexpensive digital cameras without special equipment for illumination etc. Video material was processed with ImageJ (https://imagej.nih.gov/ij/) and QuickTimePro (https://support.apple.com/downloads/quicktime).</p> <p> </p> <p><strong>LYMNAEA-1 surface-crawling locomotion 1:</strong> <em>Lymnaea stagnalis</em> crawls onto the water surface from the wall of the tank it is kept in, glides along the surface, and returns to the tank wall. The animal can be seen breathing, and particles move at constant velocity along the entire sole of the crawling snail. The earliest description of this behavior I know of is found in LISTER (1694: p. 8).</p> <p> </p> <p><strong>LYMNAEA-2 pedal surface collection 1:</strong> (A) <em>Lymnaea stagnalis</em> crawls along the water surface. (B) The floating animal collects mucus and particles from the surface on its posterior sole and (C) eats the accumulated material. This is the behavior BROCKMEIER (1898) called 'Planktonfischen' (plankton fishing).</p> <p> </p> <p><strong>LYMNAEA-3 pedal surface collection 2:</strong> <em>Lymnaea stagnalis</em> attached to plants conducts pedal surface collection. Similar behavior was mentioned by KAISER (1960).</p> <p> </p> <p><strong>LYMNAEA-4 pedal surface collection 3:</strong> <em>Lymnaea stagnalis</em> conducts pedal surface collection in an upright position, being attached to a vertical solid substrate (a flower pot, in this case). Pedal surface collection in this posture has been studied previously in members of the families Ampullariidae (JOHNSON 1952) and Planorbidae (DELIAGINA & ORLOVSKY 1990).</p> <p> </p>
Tranco 16-5-22 top 10K crawled with T.EX
<p>Multiple simultaneous and stateful crawls (6 x Chrome, 6 x Brave, 6 x Firefox) of the Tranco top 10K websites (as of 16th of May 2022) were performed on the 12th of August 2022 with T.EX (see: <a href="https://github.com/t-ex-tools/t.ex">https://github.com/t-ex-tools/t.ex</a>). Measurements had been carried out on 18 Amazon Web Services instances (c5.large) running Windows Server. All instances were launched in Frankfurt, Germany (eu-central-1).</p> <p>After completing the crawls, each instance's extension storage was extracted (see <a href="https://github.com/t-ex-tools/t.ex">https://github.com/t-ex-tools/t.ex</a> for help using the datasets). Note: 2 of the 6 Firefox instances crashed during the crawl. Therefore, only 4 Firefox datasets are available. Results and statistics for each crawl are included in a separate ZIP archive (Results and Statistics.zip).</p>
FIGURE 1 in Coming out of your shell or crawling back in: multiple interphylum host switching events within a clade of bivalve- and ascidian-associated shrimps (Caridea: Palaemonidae)
FIGURE 1 An overview of the diversity in morphology, colouration, and host-associations of the studied clade. A, Anchiopontonia hurii (Holthuis, 1981) in the spiny oyster Spondylus sp.; B, Ascidonia quasipusilla (Chace, 1972) in a solitary ascidian; C, Conchodytes meleagrinae Peters, 1852 in the spiny oyster Spondylus sp.; D, Conchodytes pteriae Fransen, 1994 in the pearl oyster Pteria loveni (Dunker, 1879); E, male-female pair of Dactylonia ascidicola (Borradaile, 1898) from the solitary ascidian Ascidia sp.; F, Odontonia katoi (Kubo, 1940) in the solitary ascidian Polycarpa aurata (Quoy & Gaimard, 1834); G, Odontonia plurellicola De Gier & Fransen, 2018 in the colonial ascidian Plurella sp.; H, Odontonia sibogae (Bruce, 1973) in the solitary ascidian Polycarpa sp.; I, Platypontonia hyotis Hipeau-Jacquotte, 1971 in the giant honeycomb oyster Hyotissa hyotis (Linnaeus, 1758); J, Pontonia manningi Fransen, 2000 in the spiny oyster Spondylus americanus Hermann, 1781. PHOTO CREDIT: C.H.J.M. FRANSEN
FIGURE 5 in Coming out of your shell or crawling back in: multiple interphylum host switching events within a clade of bivalve- and ascidian-associated shrimps (Caridea: Palaemonidae)
FIGURE 5 Phylogeny based on the RAxML tree topology of the TE approach (fig. 4), with ancestral biogeographic range reconstructions on the internal nodes (probabilities are shown as pie charts). Indo-West Pacific genera simplified as genus names, except for Odontonia kerangcaris Fransen, Groenhof & De Gier, 2021 due to its position outside of the genus. Colours indicate distribution ranges, both for the species as well as the ancestral distribution ranges. Species/genera of which only morphological data was analysed are indicated with an asterisk (*).
FIGURE 4 in Coming out of your shell or crawling back in: multiple interphylum host switching events within a clade of bivalve- and ascidian-associated shrimps (Caridea: Palaemonidae)
FIGURE 4 Phylogeny based on the RAxML tree topology of the TE approach. RAxML bootstrap support and Bayesian posterior probabilities expressed as percentages are indicated respectively. Dashes (--) indicate values <50; asterisk (*) indicates different topology of RAxML or MrBayes tree. Four major clades can be recognized. Newly acquired barcodes are indicated with a collection accession number (RMNH.CRUS.D., MZB.), otherwise GenBank accession numbers are given. The selection of species can be found in the appendices (supplementary table S1), and species of which only morphological data was analysed are indicated with an asterisk (*) and no accession number. Colours indicate various host associations. The host association of Pontonia longispina Holthuis, 1951 is unknown, indicated with a question mark (?), and the known host association of Pontonia chimaera Holthuis, 1951 is with gastropod molluscs, which is indicated with an outline of a shell.
FIGURE 2 in Coming out of your shell or crawling back in: multiple interphylum host switching events within a clade of bivalve- and ascidian-associated shrimps (Caridea: Palaemonidae)
FIGURE 2 Phylogeny based on the RAxML tree topology of the concatenated molecular dataset (COI, H3, 16S, 18S). RAxML bootstrap support and Bayesian posterior probabilities expressed as percentages are indicated respectively. Dashes (--) indicate values <50; asterisk (*) indicates different topology of RAxML or MrBayes tree. Four branches are shortened for convenience. Three major clades can be recognized. Newly acquired barcodes are indicated with a collection accession number (RMNH.CRUS.D., MZB.), otherwise GenBank accession numbers are given. The selection of species can be found in the appendices (supplementary table S1). Colours indicate various host associations.
FIGURE 6 in Coming out of your shell or crawling back in: multiple interphylum host switching events within a clade of bivalve- and ascidian-associated shrimps (Caridea: Palaemonidae)
FIGURE 6 Phylogeny based on the RAxML tree topology of the TE approach (fig. 4), with ancestral character state reconstructions on the internal nodes (probabilities are shown as pie charts). Colours indicate various host associations, both for the species as well as the ancestral character states. The host association of Pontonia longispina Holthuis, 1951 is unknown, indicated with a question mark (?), and the known host association of Pontonia chimaera Holthuis, 1951 is with gastropod molluscs, which is indicated with an outline of a shell. Species of which only morphological data was analysed are indicated with an asterisk (*).
FIGURE 3 The 50 in Coming out of your shell or crawling back in: multiple interphylum host switching events within a clade of bivalve- and ascidian-associated shrimps (Caridea: Palaemonidae)
FIGURE 3 The 50% majority rule consensus tree of the morphological analysis in PAUP. Five distinct clades can be recognized. Support values are given at every dichotomous or polytomous branching. Colours indicate various host associations. The host association of Pontonia longispina Holthuis, 1951 is unknown, indicated with a question mark (?), and the known host association of Pontonia chimaera Holthuis, 1951 is with gastropod molluscs, which is indicated with an outline of a shell.
FIGURE 16 in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 16. Scatter plot of PC2 vs. PC1 of body outlines of larvae of Haliplidae and the new fossils. The differentiated stages are all representatives of Haliplus. Note how tightly together the fossils cluster, indicating a very similar overall shape. This is different for the larvae of the extant forms that show quite some variation, especially over ontogeny.
FIGURE 15 in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 15. Scatter plot of head length over total length of larvae of Haliplidae and the new fossils. The differentiated stages are all representatives of Haliplus. Note the possible three stages of the fossils: a single one on the lower left might represent a stage 1 larva; those clustering in the middle might represent stage 2 larvae, the single fossil far up right might represent a stage 3 larva.
FIGURE 13. Fossil larva BUB 1222. A. Overview ventral side. B in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 13. Fossil larva BUB 1222. A. Overview ventral side. B. Colour-marked version of A. C. Dorsal side. D. Close-up on head. E. Close-up trunk end. F. Close-up on leg; arrow points to claw. Abbreviations: ad = abdomen; at = antenna; fe = femur; hc = head capsule; ms = mesothorax; mt = metathorax; pl = palp; pt = prothorax.
FIGURE 17 in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 17. Scatter plot of PC1 versus total length of larvae of Haliplidae and the new fossils. The differentiated stages are all representatives of Haliplus. Note that modern day stage 1 and 2 larvae plot away from the smaller fossils, with a single exception. For the fossils, the outline seems to be very similar, independent of the size.
FIGURE 11. Fossil larva BUB 4436, specimen 9. A. Overview dorsal side. B in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 11. Fossil larva BUB 4436, specimen 9. A. Overview dorsal side. B. Colour-marked version of A. C. Ventral side. D. Close-up trunk end. E. Close-up on head. F. Close-up on thorax. Abbreviations: ad = abdomen; at = antenna; fe = femur; hc = head capsule; ms = mesothorax; mt = metathorax; pt = prothorax.
FIGURE 10. Fossil larva BUB 4436, specimen 8. A. Overview ventral side. B in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 10. Fossil larva BUB 4436, specimen 8. A. Overview ventral side. B. Colour-marked version of C. C. Dorsal side. D. Close-up on head. E. Close-up trunk end. F. Close-up on leg. G. Close-up on tergites. Abbreviations: ad = abdomen; at = antenna; hc = head capsule; ms = mesothorax; mt = metathorax; pt = prothorax.
FIGURE 12. Fossil larvae BUB 4436, specimens 10 and 11. A–F. Specimen 10. A. Overview dorsal side. B in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 12. Fossil larvae BUB 4436, specimens 10 and 11. A–F. Specimen 10. A. Overview dorsal side. B. Colourmarked version of A. C. Ventral side. D. Close-up on head. E. Close-up trunk end. F. Close-up on leg. G–K. Specimen 11. G. Overview ventral side. H. Colour-marked version of G. I. Dorsal side. J. Close-up on head. K. Close-up on trunk end. Abbreviations: ad = abdomen; at = antenna; hc = head capsule; ms = mesothorax; mt = metathorax; pt = prothorax; th = thorax; ti = tibia.
FIGURE 5. Fossil larva BUB 4436, specimen 2. A in An overview of crawling water beetle larvae and a first possible record from 100-million-years-old Myanmar amber
FIGURE 5. Fossil larva BUB 4436, specimen 2. A. Overview on lateral side. B. Colour-marked version of A. C. Other side. D. Close-up on trunk end. E. Close-up on thorax. Abbreviations: ad = abdomen; at = antenna; hc = head capsule; ms = mesothorax; mt = metathorax; pt = prothorax.
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.