Extracted external domains from Wikipedia dump - 20/03/2024

<p>This dataset contains 6,459,779 distinct domains derived from the external links section of Wikipedia pages.</p> <p>The external links section of a page such as <a href="https://en.wikipedia.org/wiki/OpenWeb" target="_blank" rel="noopener">OpenWeb</a>&nbsp; contains only one <a href="https://www.openweb.com/" target="_blank" rel="noopener">link</a>.</p> <p>The primary objective of assembling this dataset is to improve content prioritization and filtering in web crawling techniques.</p> <p>The dataset is structured as a text file, with each line representing a distinct domain.<br><br><br></p>