Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
4
datasets available to search
ShareScore release 0.9.0
Dataset results
4 results for “weakly supervised learning”
Weakly Supervised Learning for Industrial Optical Inspection
<p><strong>Abstract</strong></p> <p>In the following, we present a synthetic benchmark corpus for detect detection on statistically textured surfaces.We hope that it facilitates to further develop and benchmark classification algorithms for applications of industrial optical inspection. All data is publicly available and can be downloaded from this page.</p> <p><strong>Competition at DAGM 2007 symposium</strong></p> <p>The <a href="https://www.dagm.de/">DAGM (Deutsche Arbeitsgemeinschaft für Mustererkennung e.V., German chapter of the IAPR (International Association for Pattern Recognition))</a> and the <a href="http://www.gnns.de/">GNSS (German Chapter of the European Neural Network Society)</a> offered an open competition on <em>Weakly Supervised Learning for Industrial Optical Inspection</em> held as part of the DAGM symposium in 2007.<br><br>The competition was inspired by the fact that automated optical inspection allows to reduce the cost of industrial quality control significantly. The competitors had to design a classification algorithm which:</p> <ul> <li>detects miscellaneous defects on various statistically textured backgrounds.</li> <li>learns to discern defects automatically from a weakly labelled training data.</li> <li>works on data whose exact characteristics are unknown at development time.</li> <li>adapts all parameters automatically and does not require any human intervention.</li> <li>has a moderate running time (in this competition 24 hours for training and 12 hours for the test phase).</li> <li>takes into account asymmetric costs for false positive and false negative decisions (1:20 was used for the competition).</li> </ul> <p><strong>Data description</strong></p> <p>Preview Image: <a href="../api/iiif/record:12750201:examples_small.jpg/full/!800,800/0/default.jpg" target="_blank" rel="noopener">https://zenodo.org/api/iiif/record:12750201:examples_small.jpg/full/!800,800/0/default.jpg</a></p> <p>The data is artificially generated, but similar to real world problems. The first six out of ten datasets, denoted as development datasets, are supposed to be used for algorithm development. The remaining four datasets, which are referred to as competition datasets, can be used to evaluate the performance. Researchers should consider not using or analyzing the competition datasets before the development is completed as a code of honour.<br>In the following we provide some details about the datasets:</p> <ul> <li>Each development (competition) dataset consists of 1000 (2000) 'non-defective' and of 150 (300) 'defective' images saved in grayscale 8-bit PNG format.</li> <li>Each dataset is generated by a different texture model and defect model.</li> <li>'Non-defective' images show the background texture without defects, 'defective' images have exactly one labelled defect on the background texture.</li> <li>All datasets has been randomly split into a training and testing sub-dataset of equal size.</li> <li>Weak labels are provided as ellipses roughly indicating the defective area. Technically, defective images are augmented with a separate grayscale 8-bit image in the PNG format located in a folder 'Label'. The values 0 and 255 denote background and defective area, respectively.</li> </ul> <p>All meta-data is subsumed in a separate ASCII textfile called 'Labels.txt' which is located in the 'Label' folder. The structure is as follows:<br>1 \n<br>[id of item no. 1] \t [0 if non-defective, 1 if defective] \t [filename of raw image no. 1] \t 0 \t [filename of label image no. 1 if defective, 0 otherwise] \n<br>...<br>[id of item no. N] \t [0 if non-defective, 1 if defective] \t [filename of raw image no. N] \t 0 \t [filename of label image no. N if defective, 0 otherwise] \n</p>
Experimental Data for the Paper 'Hierarchical Fusion and Divergent Activation Based Weakly Supervised Learning for Object Detection from Remote Sensing Images'
<p><strong>Experimental Data for the Paper 'Hierarchical Fusion and Divergent Activation Based Weakly Supervised Learning for Object Detection from Remote Sensing Images'</strong></p> <p>In this repository, we provide the implementation of the algorithms developed in the paper 'Hierarchical Fusion and Divergent Activation Based Weakly Supervised Learning for Object Detection from Remote Sensing Images' along with the experimental results, and the methods used for comparison.<br> The goal is to provide the elements needed to validate and reproduce our research work as well as all the tools needed to reach the same conclusions as we did.<br> The data used in our experiments that we have the copyright of [<a href="http://doi.org/10.1109/ACCESS.2020.3019956">A</a>],[<a href="http://doi.org/10.5281/zenodo.3843229">B</a>] is already published <a href="http://doi.org/10.5281/zenodo.3843229">on zenodo</a>.<br> The licences valid for the elements of this repository are discussed under point "3. Licenses" below.</p> <p><strong>1. Structure</strong></p> <p>The repository contains the following items:</p> <ol> <li>"CODE_AND_RESULTS.zip" with the source codes and results of our method and the comparison methods,</li> <li>"README" - this text here.</li> <li>"LICENSE" - the <a href="https://mit-license.org/">MIT License</a></li> </ol> <p>We now focus on the structure of the file CODE_AND_RESULTS.zip.<br> It contains the following items:</p> <ol> <li>The directory "new_methods" contains the source code and results of the new methods proposed in our paper.</li> <li>The directory "comparison" contains the source code of the two approaches used for comparison: ACoL [<a href="https://doi.org/10.1109/CVPR.2018.00144">A</a>] and DANet [<a href="http://doi.org/10.1109/ICCV.2019.00669">B</a>].</li> <li>The folder "tools_and_metrics" holds additional libraries, software tools, and metrics using in our experiments. </li> <li>"README" - this text here.</li> <li>"LICENSE" - the <a href="https://mit-license.org/">MIT License</a></li> </ol> <p>Inside the folder "new_methods," the following sub-folders are provided:</p> <ol> <li>"data" includes data loading code and code for how organizing the input data of the neural network.</li> <li>"expr" includes training code.</li> <li>"model" includes neural network model, basic network and additional modules, depending on the file name, including improved network, and comparison model.</li> <li>"utils" includes some used library functions and test codes when testing, including image segmentation, searching for the largest connected area and data visualization, etc. Verification on the WSADD dataset is done via test_airplane.py and on the DIOR dataset via val_model.py.</li> </ol> <p>In our experiments, we used two datasets:</p> <p>"WSADD" [<a href="http://doi.org/10.1109/ACCESS.2020.3019956">A</a>],[<a href="http://doi.org/10.5281/zenodo.3843229">B</a>], which is already published <a href="http://doi.org/10.5281/zenodo.3843229">on zenodo</a> under the <a href="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International</a> license.<br> The "<a href="https://doi.org/10.1109/CVPR.2018.00144">DIOR</a>" proposed in [<a href="http://doi.org/10.1016/j.isprsjprs.2019.11.023">C</a>].</p> <p><strong>2. References</strong></p> <p>[<a href="http://doi.org/10.1109/ACCESS.2020.3019956">A</a>] Z.-Z. Wu, T. Weise, Y. Wang, Y. Wang, Convolutional neural network based weakly supervised learning for aircraft detection from remote sensing image, <em>IEEE Access</em> 8 (2020) 158097-158106. doi:<a href="http://doi.org/10.1109/ACCESS.2020.3019956">10.1109/ACCESS.2020.3019956</a>. <br> [<a href="http://doi.org/10.5281/zenodo.3843229">B</a>] Z.-Z. Wu. Weakly Supervised Airplane Detection Dataset: WSADD. May 2020. zenodo.org. doi:<a href="http://doi.org/10.5281/zenodo.3843229">10.5281/zenodo.3843229</a>.<br> [<a href="http://doi.org/10.1016/j.isprsjprs.2019.11.023">C</a>] K. Li, G. Wan, G. Cheng, L. Meng, J. Han, Object detection in optical remote sensing images: A survey and a new benchmark, <em>ISPRS Journal of Photogrammetry and Remote Sensing</em> 159 (2020) 296-307. doi:<a href="http://doi.org/10.1016/j.isprsjprs.2019.11.023">10.1016/j.isprsjprs.2019.11.023</a>. <br> [<a href="https://doi.org/10.1109/CVPR.2018.00144">D</a>] X. Zhang, Y. Wei, J. Feng, Y. Yang, T. S. Huang, Adversarial complementary learning for weakly supervised object localization, in: <em>Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition</em> (CVPR'18), Jun. 18-22, 2018, Salt Lake City, UT, USA, IEEE Computer Society, 2018, pp. 1325-1334. doi:<a href="https://doi.org/10.1109/CVPR.2018.00144">10.1109/CVPR.2018.00144</a>. <br> [<a href="http://doi.org/10.1109/ICCV.2019.00669">E</a>] H. Xue, C. Liu, F. Wan, J. Jiao, X. Ji, Q. Ye, DANet: Divergent activation for weakly supervised object localization, in: <em>Proceedings of the IEEE/CVF International Conference on Computer Vision</em> (ICCV'19), Oct. 27-Nov. 2, 2019, Seoul, Korea, IEEE, 2019, pp. 6588-6597. doi:<a href="http://doi.org/10.1109/ICCV.2019.00669">10.1109/ICCV.2019.00669</a>.</p> <p><strong>3. Licenses</strong></p> <p>The following licenses apply for the files and folders in the archive "CODE_AND_RESULTS.zip":</p> <ul> <li>The files in the folder `new_methods` are under the <a href="https://mit-license.org/">MIT License</a>.</li> <li>The files in the folder `comparison/ACoL` have been obtained from https://github.com/xiaomengyc/ACoL, which is under the <a href="https://mit-license.org/">MIT License</a>.</li> <li>We put our code and data under the </li> <li>The files in the folder "comparison/DANet" have been obtained from <a href="https://github.com/xuehaolan/DANet">https://github.com/xuehaolan/DANet</a>, which is an open source project without associated license at the time of this writing. They will therefore remain under the copyright of the user <a href="https://github.com/xuehaolan/">https://github.com/xuehaolan/</a>.</li> <li>The files in the folder "tools_and_metrics/detections_DIOR" are related to the repository <a href="https://github.com/rafaelpadilla/Object-Detection-Metrics">https://github.com/rafaelpadilla/Object-Detection-Metrics</a>, which is under the <a href="https://mit-license.org/">MIT License</a>, and therefore are under the same license.</li> <li>The files in the folder "tools_and_metrics/Nest-pytorch" are based on the repository <a href="https://github.com/ZhouYanzhao/Nest">https://github.com/ZhouYanzhao/Nest</a>, which is under the <a href="https://mit-license.org/">MIT License</a>.</li> <li>The files in the folder "tools_and_metrics/PRM-pytorch" are based on the repository <a href="https://github.com/ZhouYanzhao/PRM">https://github.com/ZhouYanzhao/PRM</a>, which is an open source project without associated license at the time of this writing. They will therefore remain under the copyright of the user <a href="https://github.com/ZhouYanzhao/">https://github.com/ZhouYanzhao/</a>.</li> </ul> <p>The <a href="https://mit-license.org/">MIT License</a> is included here as file "LICENSE".</p> <p><strong>4. Contact</strong></p> <p>1. Dr. <a href="http://iao.hfuu.edu.cn/146">Zhize WU</a>, wuzz@hfuu.edu.cn<br> 2. Dr. <a href="http://iao.hfuu.edu.cn/5">Thomas WEISE</a>, tweise@hfuu.edu.cn, tweise@ustc.edu.cn</p> <p>Institute of Applied Optimization, <br> School of Artificial Intelligence and Big Data, <br> Hefei University, South Campus 2, Jinxiu Dadao 99, <br> Hefei Economic and Technological Development Area, <br> Shushan District, Hefei 230601, Anhui, China<br> </p>
AbdomenCT-1K: Weakly Supervised Learning Benchmark
<p>This is the dataset of AbdomenCT-1K: Weakly Supervised Learning Benchmark.</p> <p>Related paper: <a href="https://ieeexplore.ieee.org/document/9497733/">https://ieeexplore.ieee.org/document/9497733/</a></p> <p>Benchmark homepage: https://abdomenct-1k-weaklysupervisedlearning.grand-challenge.org/</p>
Weakly-Supervised Learning Significantly Reduces the Number of Labels Required for Intracranial Hemorrhage Detection on Head CT
<p>Modern machine learning pipelines, in particular those based on deep learning (DL) models, require large amounts of labeled data. For classification problems, the most common learning paradigm consists of presenting labeled examples during training, thus providing \emph{strong supervision} by directly presenting examples from the different classes, e.g. positive and negative samples. As a result, the adequate training of these models demands the curation of large datasets with high-quality labels. This constitutes a major obstacle for the development of DL models in radiology---in particular for cross-sectional imaging (e.g., computed tomography [CT] scans)---where labels must come from manual annotations by expert radiologists at the image or slice-level (as opposed to the examination level, such as could be obtained using natural language processing of radiology reports). <br> This work studies the question of what kind of labels should be collected for the problem of intracranial hemorrhage detection in brain CT. We investigate whether image-level annotations should be preferred to examination-level ones. By framing this task as a Multiple Instance Learning (MIL) problem, and employing modern attention-based DL architectures, we analyze the degree to which different levels of supervision improve the detection performance. We find that strong supervision (learning with local image-level annotations) and weak supervision (learning with only global examination-level labels) achieve comparable performance in both examination- and image-level hemorrhage detection, as well as in hemorrhage localization at the pixel-level (explainability). Furthermore, we study this behavior as a function of the number of labels available during training. Our results suggest that local labels may not be necessary at all, drastically reducing the time and cost involved in collecting and curating datasets.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.