Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
901
datasets available to search
ShareScore release 0.9.0
Dataset results
901 results for “Modality”
MOVING: a Multi-MOdal dataset of EEG signals and VIrtual Glove hand trackING
<p>A new Multi-modal dataset comprising neural EEG signals and kinematic data associated with three hand movements — open/close, finger tapping, and wrist rotation — along with a rest period. The dataset, obtained from eleven subjects using a 32-channel dry wireless EEG system, also includes synchronized kinematic data captured by a Virtual Glove (VG) system equipped with two orthogonal Leap Motion Controllers. The use of these two devices allows for fast assembly (~ 1 minute) while introducing more noise than the gold standard devices for data acquisition. The data set, obtained from 11 subjects using a 32-channel dry wireless EEG system, also includes synchronized kinematic data captured by a Virtual Glove (VG) system equipped with two orthogonal Leap Motion Controllers. </p> <p>For citation please refer to the paper:<br>Mattei, E.; Lozzi, D.; Di Matteo, A.; Cipriani, A.; Manes, C.; Placidi, G. MOVING: A Multi-Modal Dataset of EEG Signals and Virtual Glove Hand Tracking. Sensors 2024,24, 5207. https://doi.org/10.3390/s24165207 </p> <p><strong>References</strong>:</p> <p>Placidi, Giuseppe. "<em>A smart virtual glove for the hand telerehabilitation.</em>" Computers in Biology and Medicine 37.8 (2007): 1100-1107.</p> <p>Placidi, Giuseppe, et al. "<em>Measurements by a LEAP-based virtual glove for the hand rehabilitation.</em>" Sensors 18.3 (2018): 834.</p> <p>Placidi, Giuseppe, et al. "<em>Patient–therapist cooperative hand telerehabilitation through a novel framework involving the virtual glove system.</em>" Sensors 23.7 (2023): 3463.</p>
WildfireSpreadTS: A dataset of multi-modal time series for wildfire spread prediction
<p>We present a <strong>multi-temporal</strong>, <strong>multi-modal</strong> remote-sensing dataset for predicting <strong>how active wildfires will spread</strong> at a resolution of 24 hours. The dataset consists of <strong>13.607 images</strong> across 607 fire events in the United States from January 2018 to October 2021. For each fire event, the dataset contains a <strong>full time series of daily observations</strong>, containing detected active fires and variables related to <strong>fuel, topography and weather conditions</strong>.</p><h2>Documentation</h2><p><i><strong>WildfireSpreadTS_Documentation.pdf</strong></i> includes further details about the dataset, following Gebru et al.'s <strong>"Datasheets for Datasets"</strong> framework. This documentation is similar to the supplementary material of the associated NeurIPS paper, excluding only information about experimental setup and results. For full details, please refer to the associated paper. </p><h2>Code: Getting started</h2><p>Get started working with the dataset at <a href="https://github.com/SebastianGer/WildfireSpreadTS">https://github.com/SebastianGer/WildfireSpreadTS</a>. </p><p>The code includes a <strong>PyTorch Dataset</strong> and <strong>Lightning DataModule </strong>to allow for easy access. We recommend converting the GeoTIFF files provided here to HDF5 files (bigger files, but much faster). The necessary code is also available in the repository.</p><p> </p><p>This work is funded by Digital Futures in the project EO-AI4GlobalChange. The computations were enabled by resources provided by the National Academic Infrastructure for Supercomputing in Sweden (NAISS) at C3SE partially funded by the Swedish Research Council through grant agreement no. 2022-06725.</p>
Behavior-relevant top-down cross-modal predictions in mouse neocortex
<p>Simultaneously recorded S1 and PPC neuronal population activity from awake mice during a texture discrimination task. Data acquired with two-photon calcium imaging.</p>
Variation in personality shaped by evolutionary history, genotype, and developmental plasticity in response to feeding modalities in the Arctic charr
<p>Animal personality has been shown to be influenced by both genetic and environmental factors and shaped by natural selection. Currently, little is known about mechanisms influencing the development of personality traits. This study examines the extent to which personality development is genetically influenced and/or environmentally responsive (plastic). We also investigated the role of evolutionary history, assessing whether personality traits could be canalized along a genetic and ecological divergence gradient. We tested the plastic potential of boldness in juveniles of five Icelandic Arctic charr morphs (<em>Salvelinus</em> <em>alpinus</em>), including two pairs of sympatric morphs, displaying various degrees of genetic and ecological divergence from the ancestral anadromous charr, split between treatments mimicking benthic vs. pelagic feeding modalities. We show that differences in mean boldness are mostly affected by genetics. While the benthic treatment led to bolder individuals overall, the environmental effect was rather weak, suggesting that boldness lies under strong genetic influence with reduced plastic potential. Finally, we found hints of differences by morphs in boldness canalization through reduced variance and plasticity, and higher consistency in boldness within morphs. These findings provide new insights into how behavioural development may impact adaptive diversification.</p>
VISIONE Feature Repository for VBS: Multi-Modal Features and Detected Objects from VBSLHE Dataset
<p>This repository contains a diverse set of features extracted from the VBSLHE dataset (laparoscopic gynecology) . These features will be utilized in the VISIONE system [Amato et al. 2023, Amato et al. 2022] in the next editions of the Video Browser Showdown (VBS) competition (<a href="https://www.videobrowsershowdown.org/">https://www.videobrowsershowdown.org/</a>). </p> <p>We used a snapshot of the dataset provided by the Medical University of Vienna and Toronto that can be downloaded using the instructions provided at <a href="https://download-dbis.dmi.unibas.ch/mvk/">https://download-dbis.dmi.unibas.ch/mvk/</a>. It comprises 75 video files. We divided each video into video shots with a maximum duration of 5 seconds.</p> <p>This repository is released under a Creative Commons Attribution license. If you use it in any form for your work, please cite the following paper:</p> <blockquote> <p>@inproceedings{amato2023visione, title={VISIONE at Video Browser Showdown 2023}, author={Amato, Giuseppe and Bolettieri, Paolo and Carrara, Fabio and Falchi, Fabrizio and Gennaro, Claudio and Messina, Nicola and Vadicamo, Lucia and Vairo, Claudio}, booktitle={International Conference on Multimedia Modeling}, pages={615--621}, year={2023}, organization={Springer} } </p> </blockquote> <p> </p> <p>This repository (v2) comprises the following files:</p> <ul> <li><em><strong>msb.tar.gz </strong></em> contains tab-separated files (.tsv) for each video. Each tsv file reports, for each video segment, the timestamp and frame number marking the start/end of the video segment, along with the timestamp of the extracted middle frame and the associated identifier ("id_visione").</li> <li><em><strong>extract-keyframes-from-msb.tar.gz</strong></em> contains a Python script designed to extract the middle frame of each video segment from the MSB files. To run the script successfully, please ensure that you have the original VBSLHE videos available.</li> <li><em><strong>features-aladin.tar.gz†</strong></em><strong> </strong>contains <a href="https://github.com/mesnico/ALADIN">ALADIN</a> [Messina N. et al. 2022] features extracted for all the segment's middle frames.</li> <li><em><strong>features-clip-laion.tar.gz†</strong></em> contains <a href="https://huggingface.co/laion/CLIP-ViT-H-14-laion2B-s32B-b79K">CLIP ViT-H/14 - LAION-2B </a>[Schuhmann et al. 2022] features extracted for all the segment's middle frames.</li> <li><em><strong>features-clip-openai.tar.gz† </strong></em>contains <a href="https://huggingface.co/openai/clip-vit-large-patch14">CLIP ViT-L/14</a> [Radford et al. 2021] features extracted for all the segment's middle frames.</li> <li><em><strong>features-clip2video.tar.gz† </strong></em>contains <a href="https://github.com/CryhanFang/CLIP2Video">CLIP2Video</a> [Fang H. et al. 2021] extracted for all the video segments. <strong> </strong></li> <li><em><strong>objects-frcnn-oiv4.tar.gz* </strong></em>contains the objects detected using <a href="http://tfhub.dev/google/faster_rcnn/openimages_v4/inception_resnet_v2/1">Faster R-CNN+Inception ResNet</a> (trained on the Open Images V4 [Kuznetsova et al. 2020]).</li> <li><em><strong>objects-mrcnn-lvis.tar.gz*</strong></em> contains the objects detected using Mask R-CNN [He et al. 2017] (trained on LVIS).</li> <li><em><strong>objects-vfnet64-coco.tar.gz*</strong></em> contains the objects detected using VfNet [Zhang et al. 2021] (trained on COCO dataset).</li> </ul> <p>*Please be sure to use the <strong>v2 version </strong>of this repository, since v1 feature files may contain inconsistencies that have now been corrected</p> <p><em><strong>*Note on the object annotations:</strong></em> Within an object archive, there is a jsonl file for each video, where each row contains a record of a video segment (the <em>"_id"</em> corresponds to the <em>"id_visione"</em> used in the msb.tar.gz) . Additionally, there are three arrays representing the objects detected, the corresponding scores, and the bounding boxes. The format of these arrays is as follows:</p> <ul> <li><em>"object_class_names"</em>: vector with the class name of each detected object.</li> <li><em>"object_scores"</em>: scores corresponding to each detected object.</li> <li><em>"object_boxes_yxyx"</em>: bounding boxes of the detected objects in the format <em>(ymin, xmin, ymax, xmax).</em></li> </ul> <p> </p> <p><em><strong>†Note on the cross-modal features: </strong></em>The extracted multi-modal features (ALADIN, CLIPs, CLIP2Video) enable internal searches within the VBSLHE dataset using the query-by-image approach (features can be compared with the dot product). However, to perform searches based on free text, the text needs to be transformed into the joint embedding space according to the specific network being used (see links above). Please be aware that t<strong>he service for transforming text into features is not provided within this repository and should be developed independently using the original feature repositories linked above.</strong></p> <p>We have plans to release the code in the future, allowing the reproduction of the VISIONE system, including the instantiation of all the services to transform text into cross-modal features. However, this work is still in progress, and the code is not currently available.</p> <p> </p> <p><strong>References:</strong></p> <p>[Amato et al. 2023] Amato, G.et al., 2023, January. VISIONE at Video Browser Showdown 2023. In International Conference on Multimedia Modeling (pp. 615-621). Cham: Springer International Publishing.</p> <p>[Amato et al. 2022] Amato, G. et al. (2022). VISIONE at Video Browser Showdown 2022. In: , et al. MultiMedia Modeling. MMM 2022. Lecture Notes in Computer Science, vol 13142. Springer, Cham. </p> <p>[Fang H. et al. 2021] Fang H. et al., 2021. Clip2video: Mastering video-text retrieval via image clip. arXiv preprint arXiv:2106.11097.</p> <p>[He et al. 2017] He, K., Gkioxari, G., Dollár, P. and Girshick, R., 2017. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision (pp. 2961-2969).</p> <p>[Kuznetsova et al. 2020] Kuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A. and Duerig, T., 2020. The open images dataset v4. International Journal of Computer Vision, 128(7), pp.1956-1981.</p> <p>[Lin et al. 2014] Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P. and Zitnick, C.L., 2014, September. Microsoft coco: Common objects in context. In European conference on computer vision (pp. 740-755). Springer, Cham.</p> <p>[Messina et al. 2022] Messina N. et al., 2022, September. Aladin: distilling fine-grained alignment scores for efficient image-text matching and retrieval. In Proceedings of the 19th International Conference on Content-based Multimedia Indexing (pp. 64-70).</p> <p>[Radford et al. 2021] Radford A. et al., 2021, July. Learning transferable visual models from natural language supervision. In International conference on machine learning (pp. 8748-8763). PMLR.</p> <p>[Schuhmann et al. 2022] Schuhmann C. et al., 2022. Laion-5b: An open large-scale dataset for training next generation image-text models. Advances in Neural Information Processing Systems, 35, pp.25278-25294.</p> <p>[Zhang et al. 2021] Zhang, H., Wang, Y., Dayoub, F. and Sunderhauf, N., 2021. Varifocalnet: An iou-aware dense object detector. In Proceedings of the IEEE/CV</p>
VISIONE Feature Repository for VBS: Multi-Modal Features and Detected Objects from MVK Dataset
<p>This repository contains a diverse set of features extracted from the marine video (underwater) dataset (MVK) . These features were utilized in the VISIONE system [Amato et al. 2023, Amato et al. 2022] during the latest editions of the Video Browser Showdown (VBS) competition (<a href="https://www.videobrowsershowdown.org/">https://www.videobrowsershowdown.org/</a>). </p> <p>We used a snapshot of the MVK dataset from 2023, that can be downloaded using the instructions provided at <a href="https://download-dbis.dmi.unibas.ch/mvk/">https://download-dbis.dmi.unibas.ch/mvk/</a>. It comprises 1,372 video files. We divided each video into 1 second segments. </p> <p>This repository is released under a Creative Commons Attribution license. If you use it in any form for your work, please cite the following paper:</p> <blockquote> <pre>@inproceedings{amato2023visione, title={VISIONE at Video Browser Showdown 2023}, author={Amato, Giuseppe and Bolettieri, Paolo and Carrara, Fabio and Falchi, Fabrizio and Gennaro, Claudio and Messina, Nicola and Vadicamo, Lucia and Vairo, Claudio}, booktitle={International Conference on Multimedia Modeling}, pages={615--621}, year={2023}, organization={Springer} }</pre> </blockquote> <p> </p> <p>This repository comprises the following files:</p> <ul> <li><strong><em>msb.tar.gz </em></strong> contains tab-separated files (.tsv) for each video. Each tsv file reports, for each video segment, the timestamp and frame number marking the start/end of the video segment, along with the timestamp of the extracted middle frame and the associated identifier ("id_visione"). </li> <li><em><strong>extract-keyframes-from-msb.tar.gz</strong></em> contains a Python script designed to extract the middle frame of each video segment from the MSB files. To run the script successfully, please ensure that you have the original MVK videos available.</li> <li><strong><em>features-aladin.tar.gz<sup>†</sup></em> </strong>contains <a href="https://github.com/mesnico/ALADIN">ALADIN</a> [Messina N. et al. 2022] features extracted for all the segment's middle frames. </li> <li><em><strong>features-clip-laion.tar.gz<sup>†</sup></strong></em> contains <a href="https://huggingface.co/laion/CLIP-ViT-H-14-laion2B-s32B-b79K">CLIP ViT-H/14 - LAION-2B </a>[Schuhmann et al. 2022] features extracted for all the segment's middle frames.</li> <li><em><strong>features-clip-openai.tar.gz<sup>†</sup> </strong></em>contains <a href="https://huggingface.co/openai/clip-vit-large-patch14">CLIP ViT-L/14</a> [Radford et al. 2021] features extracted for all the segment's middle frames. </li> <li><em><strong>features-clip2video.tar.gz<sup>†</sup> </strong></em>contains <a href="https://github.com/CryhanFang/CLIP2Video">CLIP2Video</a> [Fang H. et al. 2021] extracted for all the 1s video segments. <strong> </strong></li> <li><em><strong>objects-frcnn-oiv4.tar.gz<sup>*</sup> </strong></em>contains the objects detected using <a href="http://tfhub.dev/google/faster_rcnn/openimages_v4/inception_resnet_v2/1">Faster R-CNN+Inception ResNet</a> (trained on the Open Images V4 [Kuznetsova et al. 2020]). </li> <li><em><strong>objects-mrcnn-lvis.tar.gz<sup>*</sup></strong></em> contains the objects detected using Mask R-CNN [He et al. 2017] (trained on LVIS).</li> <li><em><strong>objects-vfnet64-coco.tar.gz<sup>*</sup></strong></em> contains the objects detected using VfNet [Zhang et al. 2021] (trained on COCO dataset).</li> </ul> <p>*Please be sure to use the <strong>v2 version </strong>of this repository, since v1 feature files may contain inconsistencies that have now been corrected</p> <p><em><strong>*Note on the object annotations:</strong></em> Within an object archive, there is a jsonl file for each video, where each row contains a record of a video segment (the <em>"_id"</em> corresponds to the <em>"id_visione"</em> used in the msb.tar.gz) . Additionally, there are three arrays representing the objects detected, the corresponding scores, and the bounding boxes. The format of these arrays is as follows:</p> <ul> <li><em>"object_class_names"</em>: vector with the class name of each detected object.</li> <li><em>"object_scores"</em>: scores corresponding to each detected object.</li> <li><em>"object_boxes_yxyx"</em>: bounding boxes of the detected objects in the format <em>(ymin, xmin, ymax, xmax).</em></li> </ul> <p> </p> <p><em><strong><sup>†</sup>Note on the cross-modal features: </strong></em>The extracted multi-modal features (ALADIN, CLIPs, CLIP2Video) enable internal searches within the MVK dataset using the query-by-image approach (features can be compared with the dot product). However, to perform searches based on free text, the text needs to be transformed into the joint embedding space according to the specific network being used (see links above). Please be aware that t<strong>he service for transforming text into features is not provided within this repository and should be developed independently using the original feature repositories linked above.</strong></p> <p>We have plans to release the code in the future, allowing the reproduction of the VISIONE system, including the instantiation of all the services to transform text into cross-modal features. However, this work is still in progress, and the code is not currently available.</p> <p> </p> <p><strong>References:</strong></p> <p>[Amato et al. 2023] Amato, G.et al., 2023, January. VISIONE at Video Browser Showdown 2023. In International Conference on Multimedia Modeling (pp. 615-621). Cham: Springer International Publishing.</p> <p>[Amato et al. 2022] Amato, G. et al. (2022). VISIONE at Video Browser Showdown 2022. In: , et al. MultiMedia Modeling. MMM 2022. Lecture Notes in Computer Science, vol 13142. Springer, Cham. </p> <p>[Fang H. et al. 2021] Fang H. et al., 2021. Clip2video: Mastering video-text retrieval via image clip. arXiv preprint arXiv:2106.11097.</p> <p>[He et al. 2017] He, K., Gkioxari, G., Dollár, P. and Girshick, R., 2017. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision (pp. 2961-2969).</p> <p>[Kuznetsova et al. 2020] Kuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A. and Duerig, T., 2020. The open images dataset v4. International Journal of Computer Vision, 128(7), pp.1956-1981.</p> <p>[Lin et al. 2014] Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P. and Zitnick, C.L., 2014, September. Microsoft coco: Common objects in context. In European conference on computer vision (pp. 740-755). Springer, Cham.</p> <p>[Messina et al. 2022] Messina N. et al., 2022, September. Aladin: distilling fine-grained alignment scores for efficient image-text matching and retrieval. In Proceedings of the 19th International Conference on Content-based Multimedia Indexing (pp. 64-70).</p> <p>[Radford et al. 2021] Radford A. et al., 2021, July. Learning transferable visual models from natural language supervision. In International conference on machine learning (pp. 8748-8763). PMLR.</p> <p>[Schuhmann et al. 2022] Schuhmann C. et al., 2022. Laion-5b: An open large-scale dataset for training next generation image-text models. Advances in Neural Information Processing Systems, 35, pp.25278-25294.</p> <p>[Zhang et al. 2021] Zhang, H., Wang, Y., Dayoub, F. and Sunderhauf, N., 2021. Varifocalnet: An iou-aware dense object detector. In Proceedings of the IEEE/CV</p>
Supplemental material to "Solving Quantified Modal Logic Problems by Translation to Classical Logics"
<p>These files are associated with the manuscript entitled<br>"Solving Quantified Modal Logic Problems by Translation to Classical Logics"<br>by Alexander Steen, Geoff Sutcliffe, Christoph Benzmüller.</p> <p>Contact: Alexander Steen <alexander.steen@uni-greifswald.de></p> <p>Contents<br>-----------</p> <p> - QMLTP-monomodal-NX0.tar.gz<br> This archive contains the TPTP NX0 representations of the 580 mono-modal<br> problems translated from the QMLTP library [1,2].<br> <br> - QMLTP-monomodal-TF0-embedded-rigid-local.tar.gz<br> This archive contains the embedded TF0 files created <br> from the monomodal NX0 files using the Logic Embedding Tool [3].<br> <br> - QMLTP-monomodal-TH0-embedded-rigid-local.tar.gz<br> This archive contains the embedded TH0 files created <br> from the monomodal NX0 files using the Logic Embedding Tool [3,4].<br> <br> - QMLTP-multimodal-NX0-and-embedded.tar.gz<br> This archive contains the TPTP NX0 representations of the 20 multi-modal<br> problems translated from the QMLTP library [1,2]. Additionally, it<br> contains the 20 embedded TF0 and the 20 embedded THF files created <br> from the NX0 files using the Logic Embedding Tool [3,4].<br> <br> - QMLTP-primary-evaluation-results-QMLTP.zip<br> This archive contains the primary evaluation data creating from<br> running E 3.0.03, Leo-III 1.7.8, Nitpick 2016, Vampire 4.8, <br> MleanCoP 1.3, nanoCoP-M 2.0 on the problem files.<br> All reasoning systems except Nitpick were run on the StarExec Miami cluster with a 60s<br> wall clock and 480 CPU time limit. The StarExec Miami computers have an<br> octa-core Intel Xeon E5-2667 3.20 GHz CPU, 128 GiB memory, and run the<br> CentOS Linux release 7.4.1708 operating system. Nitpick was run on a server<br> with a 60s wall clock time limit. The server has an octa-core Intel Xeon E5-<br> 2609 2.50 GHz CPU, 64 GiB memory, and the CentOS Linux release 7.9.2009<br> operating system.<br> <br> - README<br> This file.<br> <br> <br> <br>[1] T. Raths and J. Otten. The QMLTP Problem Library for First-Order Modal Logics.<br> In B. Gramlich, D. Miller, and U. Sattler, editors, Proceedings of the 6th International Joint Conference on Automated Reasoning,<br> number 7364 in Lecture Notes in Artificial Intelligence, pages 454–461. Springer, 2012.<br>[2] http://www.iltp.de/qmltp/<br>[3] A. Steen. An extensible logic embedding tool for lightweight non-classical reasoning (short paper).<br> In B. Konev, C. Schon, and A. Steen, editors, Proceedings of the 8th Workshop on Practical Aspects of Automated<br> Reasoning, number 3201 in CEUR Workshop Proceedings, 2022.<br>[4] https://github.com/leoprover/logic-embedding</p>
Multi-modal dataset for music genre recognition based on six different modalities for LMD-aligned and SLAC datasets
<p>Multi-modal dataset for music genre recognition based on six different modalities for the LMD-aligned [1] and SLAC [2] datasets. Further details are provided in [3].</p> <p><strong>Descriptions of files</strong></p> <table> <thead> <tr> <th scope="col">Link</th> <th scope="col">Description</th> </tr> </thead> <tbody> <tr> <td><a href="https://zenodo.org/record/5651429/files/LMD-aligned_Filelist.arff">LMD-aligned_Filelist.arff</a></td> <td>File list with 1575 music tracks selected from the LMD-aligned dataset [1] with tagtraum genre annotations [4] (only a subset of LMD-aligned is used, which includes only pieces for which all six modalities were accessible, and which includes only well-represented genres)</td> </tr> <tr> <td><a href="https://zenodo.org/record/5651429/files/LMD-aligned_ExtractedFeatures.tar.gz">LMD-aligned_ExtractedFeatures.tar.gz</a></td> <td>Raw audio signal and model-based features extracted with AMUSE [5]</td> </tr> <tr> <td><a href="https://zenodo.org/record/5651429/files/LMD-aligned_ProcessedFeatures.tar.gz">LMD-aligned_ProcessedFeatures.tar.gz</a></td> <td>Processed features: audio signal and model-based features aggregated for 4 s time frames with 2 s step size / all other features (see the table below) with the same values for all time frames</td> </tr> <tr> <td><a href="https://zenodo.org/record/5651429/files/LMD-aligned_Datasets.tar.gz">LMD-aligned_Datasets.tar.gz</a></td> <td>Training, optimization, and test datasets for 3 splits for the recognition of 5 genres in [3]</td> </tr> <tr> <td><a href="https://zenodo.org/record/5651429/files/SLAC_Filelist.arff">SLAC_Filelist.arff</a></td> <td>File list with 250 music tracks from the SLAC dataset [2] (genres and sub-genres are provided in the folder structure)</td> </tr> <tr> <td><a href="https://zenodo.org/record/5651429/files/SLAC_ExtractedFeatures.tar.gz">SLAC_ExtractedFeatures.tar.gz</a></td> <td>Raw audio signal and model-based features extracted with AMUSE [5]</td> </tr> <tr> <td><a href="https://zenodo.org/record/5651429/files/SLAC_ProcessedFeatures.tar.gz">SLAC_ProcessedFeatures.tar.gz</a></td> <td>Processed features: audio signal and model-based features aggregated for 4 s time frames with 2 s step size / all other features (see the table below) with the same values for all time frames</td> </tr> <tr> <td><a href="https://zenodo.org/record/5651429/files/SLAC_Datasets.tar.gz">SLAC_Datasets.tar.gz</a></td> <td>Training, optimization, and test datasets for 3 splits for the recognition of 5 genres and 10 sub-genres in [3]</td> </tr> </tbody> </table> <p><strong>Modalities and feature sub-groups</strong></p> <table> <thead> <tr> <th scope="col">Modality</th> <th scope="col">Sub-group</th> <th scope="col"> <p>Dimensions in processed</p> <p>features of LMD-aligned</p> </th> <th scope="col"> <p>Dimensions in processed</p> <p>features of SLAC</p> </th> </tr> </thead> <tbody> <tr> <td>Audio signal</td> <td>Low-level</td> <td>1-524</td> <td>1-524</td> </tr> <tr> <td>Audio signal</td> <td>Semantic</td> <td>525-810</td> <td>525-810</td> </tr> <tr> <td>Audio signal</td> <td>Structural complexity</td> <td>811-908</td> <td>811-908</td> </tr> <tr> <td>Model-based</td> <td>Instruments</td> <td>909-1018</td> <td>909-1018</td> </tr> <tr> <td>Model-based</td> <td>Moods</td> <td>1019-1146</td> <td>1019-1146</td> </tr> <tr> <td>Model-based</td> <td>Various</td> <td>1147-1402</td> <td>1147-1402</td> </tr> <tr> <td>Playlists</td> <td>Genres</td> <td>1403-1973</td> <td>1403-1973</td> </tr> <tr> <td>Playlists</td> <td>Styles</td> <td>1974-1695</td> <td>1974-1695</td> </tr> <tr> <td>Symbolic</td> <td>Pitch</td> <td>1696-1757</td> <td>1696-1757</td> </tr> <tr> <td>Symbolic</td> <td>Melodic</td> <td>1758-1781</td> <td>1758-1781</td> </tr> <tr> <td>Symbolic</td> <td>Chords</td> <td>1782-1836</td> <td>1782-1836</td> </tr> <tr> <td>Symbolic</td> <td>Rhythm</td> <td>1837-1935</td> <td>1837-1935</td> </tr> <tr> <td>Symbolic</td> <td>Tempo</td> <td>1936-1963</td> <td>1936-1963</td> </tr> <tr> <td>Symbolic</td> <td>Instrument presence</td> <td>1964-2441</td> <td>1964-2441</td> </tr> <tr> <td>Symbolic</td> <td>Instruments</td> <td>2442-2456</td> <td>2442-2456</td> </tr> <tr> <td>Symbolic</td> <td>Texture</td> <td>2457-2480</td> <td>2457-2480</td> </tr> <tr> <td>Symbolic</td> <td>Dynamics</td> <td>2481-2484</td> <td>2481-2484</td> </tr> <tr> <td>Album covers</td> <td>SIFT</td> <td>2485-2584</td> <td>2485-2584</td> </tr> <tr> <td>Lyrics</td> <td>jLyrics descriptors</td> <td>2585-2603</td> <td>2585-2671</td> </tr> <tr> <td>Lyrics</td> <td>Bag-of-Words</td> <td>2604-2703</td> <td> </td> </tr> <tr> <td>Lyrics</td> <td>Doc2Vec</td> <td>2704-2803</td> <td> </td> </tr> </tbody> </table>
Shifting balances in the weighting of sensory modalities are predicted by divergence in brain morphology in incipient species of Heliconius butterflies
<p>Integrating and weighting sensory perception across modalities is crucial to how animals adapt to their environment. Divergence in brain structure is often in sensory processing regions, suggesting that investment reflects ecological needs. Here, we use two parapatric closely related species, <em>Heliconius erato cyrbia</em> and <em>Heliconius himera</em>, to test the hypothesis that divergence in sensory brain regions affects foraging decisions. These butterflies are isolated across an ecological gradient, which is linked to differences in brain morphology, with <em>H. e. cyrbia </em>investing more in visual centres and <em>H. himera</em> investing in olfactory centres. Here, we demonstrate that these two species vary in how they associate visual and olfactory cues with positive food rewards. We found that when individuals were trained on paired olfactory and visual stimuli, then presented with these stimuli in conflict, they showed distinct behavioural responses. <em>Heliconius himera</em> was more likely to favour positive olfactory cues than <em>H. e. cyrbia</em>, which favoured visual cues regardless of the paired stimulus. This suggests that these species have diverged in the emphasis placed on these different sensory domains during foraging, consistent with observed differences in brain morphology. This result strengthens evidence that speciation initiated by local adaptation is partly facilitated by changes in the neural basis of key behavioural functions.</p>
GloPrSM: Global Prediction of Sand Modal Composition
<p>GloPrSM is a global prediction of sand modal composition that depicts relative abundances of quartz, feldspar, and lithic grain types (and related subcompositions) in modern river sand deposits.</p>
Cross-Modality Domain Adaptation Challenge 2022 (crossMoDA)
<p>Official training and validation sets of crossMoDA 2022.</p> <p><strong>All data will be made available online with a permissive non-commercial copyright-license (<a href="https://creativecommons.org/licenses/by-nc-sa/4.0/">CC BY-NC-SA 4.0</a>), allowing for data to be shared, distributed and improved upon</strong>.</p> <p> </p> <p>If you use the data, please cite:</p> <p>1. Shapey, J., Kujawa, A., Dorent, R., Wang, G., Bisdas, S., Dimitriadis, A., Grishchuck, D., Paddick, I., Kitchen, N., Bradford, R., Saeed, S., Ourselin, S., & Vercauteren, T. (2021). Segmentation of Vestibular Schwannoma from Magnetic Resonance Imaging: An Open Annotated Dataset and Baseline Algorithm [Data set]. The Cancer Imaging Archive. <a href="https://doi.org/10.7937/TCIA.9YTJ-5Q73">https://doi.org/10.7937/TCIA.9YTJ-5Q73</a> </p> <p>2. Dorent, R. et al (2022). CrossMoDA 2021 challenge: Benchmark of Cross-Modality Domain Adaptation techniques for Vestibular Schwannoma and Cochlea Segmentation. ArXiv <a href="https://arxiv.org/abs/2201.02831">https://arxiv.org/abs/2201.02831</a></p> <p> </p> <p>Acknowledgments:</p> <p>This challenge is supported by Wellcome Trust (203145Z/16/Z, 203148/Z/16/Z), EPSRC (NS/A000050/1,<br> NS/A000049/1) and ZonMw (project number: 10070012010006) funding. All the organizers will have access to the<br> test set if needed.</p>
Data for: Investigating signal modalities of aposematism in a poison frog
<p>Aposematic species combine a conspicuous signal with a secondary defense, the majority of which are studied in the context of a visual signal. While multimodality of the aposematic signal appears to be common in invertebrate species, we know very little about the presence or absence of multimodality in vertebrates. Here we examine the possibility of multimodality of aposematism in the green and black poison frog, <em>Dendrobates auratus. </em>Using a non-visual predator (the cat-eyed snake, <em>Leptodeira annulata</em>) and extractions of chemicals in frog skins, we test whether there is sufficient non-visual information for predators to avoid this aposematic species without using visual cues. We found that experienced predators avoid chemicals in this poison frog's skin by olfactory cues alone in trials with live frogs and extracts from captive poison frogs, whereas extracts from wild poison frogs did not lead to avoidance behaviors in predators. Further, in our limited sampling, naïve predators demonstrate no avoidance. This not only indicates that predators can make informed decisions from the frog's odor but also indicates that avoidance based on olfactory cue is a learned response.</p>
OpenPack: Public multi-modal dataset for packaging work recognition in logistics domain
<p><strong>OpenPack</strong> is an open-access logistics dataset for human activity recognition, which contains human movement and package information from 16 subjects in four scenarios. Human movement information is subdivided into three types of data, acceleration, physiological, and depth-sensing. The package information includes the size and number of items included in each packaging job. </p> <p>In the "Humanware laboratory" at IST Osaka University, with the supervision of industrial engineers, an experiment to mimic logistic center labor was designed. 12 workers with previous packaging experience and 4 without experience performed a set of packaging tasks according to an instruction manual from a real-life logistics center. During the different scenarios, subjects were recorded while performing packing operations using Lidar, Kinect, and Realsense depth sensors while wearing 4 ATR IMU devices and 2 Empatica E4 wearable sensors. Besides sensor data, this dataset contains timestamp information collected from the hand terminal used to register product, packet, and address label codes as well as package details that can be useful to relate operations to specific packages.</p> <p>The 4 different scenarios include; sequential packing, worker-decided sequence changes, pre-ordered item packing, and time-sensitive stressors. Each of the subjects performed 20 packing jobs in 5 work sessions for a total of 100 packing jobs. <strong>53+</strong> hours of packaging operations have been labeled into 10 global operation classes and 16 sub-action classes for this dataset. Action classes are not unique to each operation but may only appear in one or two operations. </p> <p>You can find information on how to use this dataset at: <a href="https://open-pack.github.io/">https://open-pack.github.io/</a>. For details on how this dataset was collected please check the following publication "OpenPack: A Large-Scale Dataset for Recognizing Packaging Works in IoT-Enabled Logistic Environments" <a href="https://doi.ieeecomputersociety.org/10.1109/PerCom59722.2024.10494448">10.1109/PerCom59722.2024.10494448</a>.</p> <p> </p> <p><strong>Full Dataset</strong></p> <p>In this repository, the data and label files are contained in separate files for each worker. Each worker's file contains; IMU, E4, 2d keypoint, 3d keypoint, annotation, and system-related<em> </em>data<em>.</em></p> <p><em><strong>Preprocessed Dataset (IMU with operation and action Labels)</strong></em></p> <p>We have received many comments that it was difficult to combine multiple workers' IMU and annotation data. Therefore, we have created several CSV files containing the four IMU's sensor data and the operation labels in a single file. These files are now included as "imu-with-operation-action-labels.zip". </p> <p><em><strong>Preprocessed Dataset (Kinect 2D and 3D keypoint data with operation and action Labels)</strong></em></p> <p>We have received several requests for a preprocessed dataset containing only specific types of keypoint data with its assigned operation and action labels. Two new preprocessed files have been added for 2D and 3D keypoint data extracted from the frontal view Kinect camera. These files are:</p> <p>"<a href="11059235" target="_blank" rel="noopener noreferrer">kinect-2d-kpt-with-operation-action-labels.zip</a>", and</p> <p>"<a href="11059235" target="_blank" rel="noopener noreferrer">kinect-3d-kpt-with-operation-action-labels.zip</a>".</p> <p> </p> <p>Work is continuously being done to update and improve this dataset. When downloading and using this dataset please verify that the version is up to date with the latest release. The latest release <strong>[1.1.0]</strong> was uploaded on 24/04/2024. </p> <p><strong><em>Changes LOG:</em></strong></p> <ul> <li>v1.0.0: Add tutorial preprocessed dataset for IMU data with operation labels.</li> <li>v1.1.0: Update preprocessed datasets. (Include Kinect 2d and 3d keypoint data with Operation and action labels)</li> </ul> <p> </p> <p><strong>We hosted an activity recognition competition using this dataset (OpenPack v0.3.x) awarded at a PerCom 2023 Workshop! The task was very simple: Recognize 10 work operations from the OpenPack dataset. You can refer to this website for coding materials relevant to this dataset. </strong><a href="https://open-pack.github.io/challenge2022"><strong>https://open-pack.github.io/challenge2022</strong></a></p>
Data for: Bi-modal response strategy in Daphnia to ambush predation risk
<p>Predation, a well-established major selective force, can manifest through either consumptive or non-consumptive effects. The relative impact of such effects is predicted to vary depending on the predator hunting strategy. In aquatic systems, great attention has been paid to coursing predators, such as fish, and their effects on the behaviour of zooplankton. However, less information is available regarding more ambush-style predators. To remedy this paucity, we utilised a 3D-tracking platform to record groups of <em>Daphnia </em>magna under control or predation risk conditions from the ambush, invertebrate predator <em>Erythromma najas</em>. This design allowed us to test if there are anti-predator responses in multiple metrics of swimming behaviours. Furthermore, we recorded actual predation events allowing the distinction between predator exuded info-chemicals and those produced during the predation event. We demonstrate that predation risk was greatest for those that swam at 85% of the available depth and averaged 8.1 mm/s. Examining each individuals swimming behaviour separately shows that predation risk did not exert an impact on any of the prey response metrics. Interestingly, however, we show that <em>Daphnia </em>conform to one of two strategies whilst under predation risk; either swim fast high up in the water column or swim slowly close to the bottom. Hence, this dichotomous behaviour is driven by strategies combining speed and depth in different constellations. As a result, our study demonstrates that <em>Daphnia</em> can detect the presence of a predator, but not immediately the act of predation. In a broader context, our findings highlight the importance of considering both the spatial and temporal dimensions of predation events in order correctly detect anti-predator responses.</p> <p>The data here is the raw positions of each individual tracked for the above study.</p>
FAPM: Functional annotation of proteins using multi-modal models beyond structural modeling
<p>Assigning accurate property labels to proteins, like functional terms and catalytic activity, is challenging, especially for proteins without homologs and "tail labels" with few known examples. Unlike previous methods that mainly focused on protein sequence features, we use a pretrained large natural language model to understand the semantic meaning of protein labels. Specifically, we introduce FAPM, a contrastive multi-modal model that links natural language with protein sequence language. This model combines a pretrained protein sequence model with a pretrained large language model to generate labels, such as Gene Ontology (GO) functional terms and catalytic activity predictions, in natural language. Our results show that FAPM excels in understanding protein properties, outperforming models based solely on protein sequences or structures. It achieves state-of-the-art performance on public benchmarks and in-house experimentally annotated phage proteins, which often have few known homologs. Additionally, FAPM's flexibility allows it to incorporate extra text prompts, like taxonomy information, enhancing both its predictive performance and explainability. This novel approach offers a promising alternative to current methods that rely on multiple sequence alignment for protein annotation.</p>
Multi-modal image analysis for large scale cancer tissue studies within IMMUcan: multiplex immunofluorescence images
<p>In cancer research, multiplexed imaging has enabled the in-depth characterization of the tumor microenvironment (TME) and how it relates to patient prognosis. However, standardized, multi-modal data from large numbers of patients to identify robust biomarkers is missing. To provide such data across five cancer indications, the IMMUcan consortium performs broad molecular and cellular spatial profiling of thousands of cancer samples. Two reproducible and scalable workflows have been developed for whole slide multiplexed immunofluorescence (mIF) and imaging mass cytometry (IMC) to overcome challenges of reproducibility and scalability. For mIF we developed IFQuant, a web-based tool optimized for user-friendliness and reproducibility. This Zenodo record contains the mIF images and IFQuant settings to reproduce the results presented in the referenced publication. The companion IMC dataset is available as a joint Zenodo record.</p>
Cross-modal (text and figures) Analysis of a Scientific Corpus from Semantic Scholar - model weights
<p>In the related <a href="https://github.com/HybridNLP2018/tutorial">notebook </a>we show the application of cross-modal techniques to improve the categorization of scientific papers through content related to figures, using both the textual part (captions) and the visual part (figures, diagrams, images) jointly. To this purpose, we use several CNN models and execute some experiments, illustrating our approach. This deposit contains the model weights trained on such large corpora.</p>
Cross-modal (text and figures) Analysis of a Scientific Corpus from Semantic Scholar - images
<p>In this notebook we show the application of cross-modal techniques to improve the categorization of scientific papers through content related to figures, using both the textual part (captions) and the visual part (figures, diagrams, images) jointly. To this purpose, we use several CNN models and execute some experiments, illustrating our approach. This deposit contains high quality versions of the images used in the analysis.</p>
ChessRender360: High-Fidelity Rendered Chess Dataset with Multi-Modal Annotations
<p>ChessRender360 is a synthetically crafted dataset featuring 10,000 rendered chess positions. Designed for computer vision and machine learning research, this dataset provides a rich collection of RGB images, depth maps, instance masks, and semantic segmentation masks for each chess piece and board element.</p> <p>Each chess position is rendered in high resolution (2000x2000 pixels), capturing the intricate details of the board and pieces from various angles. The dataset includes:</p> <ul> <li><strong>RGB Images:</strong> High-quality rendered images of chess positions, showcasing a diverse range of board configurations.</li> <li><strong>Depth Maps:</strong> Accurate depth representations of the scene, capturing depth in the range of 20 cm to 120 cm. In the depth maps, black corresponds to a depth of 20 cm, and white corresponds to 120 cm, providing spatial information for each position.</li> <li><strong>Instance Masks:</strong> Unique instance masks for each chess piece, enabling precise identification and localization.</li> <li><strong>Semantic Segmentation Masks:</strong> Segmentation masks that differentiate between piece types and board elements, with distinct hue values assigned to each type.</li> <li><strong>Bounding Boxes:</strong> Each sample has an annotation <code>.json</code> file containing bounding boxes for each piece.</li> <li><strong>Board Corners:</strong> Same annotation <code>.json</code> contains positions of corners of the board in order: white left, white right, black left, black right.</li> <li><strong>FENs:</strong> A CSV file containing the FEN (Forsyth-Edwards Notation) for each chess position in the dataset, listed in order. This allows users to easily recognize and replicate the exact board position from any image.</li> </ul> <p><strong>Bounding Box Generation:</strong></p> <ul> <li>The dataset does not include predefined bounding boxes, but they can be easily generated from the provided semantic and instance masks. This allows for flexible bounding box creation tailored to specific research needs.</li> </ul> <p><strong>Rendering Details:</strong></p> <ul> <li><strong>3D Models and Materials:</strong> The dataset uses a consistent set of 3D models for all chess pieces, with three different material/color schemes applied across the dataset, along with random perturbations in material brightness, contrast and saturation to introduce visual variety.</li> <li><strong>Camera Angles:</strong> Camera angles are randomly selected, with yaw ranging from 0 to 360 degrees and pitch between 30 to 80 degrees, providing diverse perspectives of the chess positions.</li> <li><strong>Background Variability:</strong> The chessboard is randomly placed on different types of tables, with the floor material randomly sampled to create a variety of backgrounds.</li> <li><strong>Lighting:</strong> Lighting conditions are randomly generated, adding further diversity and realism to the rendered scenes.</li> </ul> <p><strong>Augmentation Potential:</strong></p> <ul> <li>The instance and semantic masks can be used to further augment the dataset. Researchers can selectively modify specific parts of the images—such as the board, background, or individual pieces—enabling the creation of new variations and enhancing the dataset's utility for model training and testing.</li> </ul> <p><strong>Color Mapping:</strong></p> <ul> <li>The semantic masks are color-coded using a hue-based system, where the board frame, squares, and each piece type are assigned specific hues. Instances of the same piece type are differentiated by varying the value component, with saturation consistently set to 1. A detailed <code>color_mapping.json</code> file is included, providing a comprehensive guide to interpreting the masks.</li> </ul> <p><strong>Applications:</strong> ChessRender360 is ideal for tasks such as object detection, instance segmentation, depth estimation, and scene understanding in synthetic environments. Researchers and developers can leverage this dataset for training and evaluating models in computer vision, robotics, and artificial intelligence.</p> <p><strong>Dataset Highlights:</strong></p> <ul> <li>10,000 uniquely rendered chess positions</li> <li>High-resolution images (2000x2000 pixels) with diverse visual characteristics</li> <li>Comprehensive annotations with RGB, depth (20 cm to 120 cm), instance, and semantic maps</li> <li>Side identification map for distinguishing white and black sides of the board</li> <li>FEN notation CSV file for easy position recognition and replication</li> <li>Variety introduced through different material schemes and lighting setups</li> <li>Randomized camera angles for enhanced perspective diversity</li> <li>Potential for further augmentation by modifying specific image components</li> <li>Detailed color mapping for easy interpretation of segmentation masks</li> <li>Suitable for a wide range of computer vision and AI applications</li> </ul> <p>ChessRender360 offers a rich and versatile dataset for advancing research and development in the field of computer vision, providing a synthetic yet highly realistic environment for model training and testing.</p> <p>For any questions, feedback, or collaboration opportunities, or if you are interested in custom artificial datasets, please contact me:</p> <ul> <li><strong>Name:</strong> Marko Kojić</li> <li><strong>LinkedIn:</strong> https://www.linkedin.com/in/mmkoya</li> </ul> <p>I welcome inquiries from researchers, developers, and organizations interested in utilizing or collaborating on artificial datasets.</p>
EMOPIA: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generation
<p>EMOPIA (pronounced ‘yee-mò-pi-uh’) dataset is a shared multi-modal (audio and MIDI) database focusing on perceived emotion in <strong>pop piano music</strong>, to facilitate research on various tasks related to music emotion. The dataset contains <strong>1,087</strong> music clips from 387 songs and <strong>clip-level</strong> emotion labels annotated by four dedicated annotators. </p> <p>For more detailed information about the dataset, please refer to our paper: <a href="https://arxiv.org/abs/2108.01374"><strong>EMOPIA: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generation</strong></a>. </p> <p><strong>File Description</strong></p> <ul> <li><em><strong>midis/</strong></em>: midi clips transcribed using GiantMIDI. <ul> <li>Filename `Q1_xxxxxxx_2.mp3`: Q1 means this clip belongs to Q1 on the V-A space; xxxxxxx is the song ID on YouTube, and the `2` means this clip is the 2nd clip taken from the full song.</li> </ul> </li> <li><em><strong>metadata/</strong></em>: metadata from YouTube. (Got when crawling)</li> <li> <p><em><strong>songs_lists/</strong></em>: YouTube URLs of songs.</p> </li> <li> <p><em><strong>tagging_lists/</strong></em>: raw tagging result for each sample.</p> </li> <li> <p><em><strong>label.csv</strong></em>: metadata that records filename, 4Q label, and annotator.</p> </li> <li> <p><em><strong>metadata_by_song.csv</strong></em>: list all the clips by the song. Can be used to create the train/val/test splits to avoid the same song appear in both train and test.</p> </li> <li> <p><em><strong>scripts/prepare_split.ipynb:</strong></em> the script to create train/val/test splits and save them to csv files.</p> </li> </ul> <p>------</p> <p><strong>2.2 Update</strong></p> <ul> <li>Add tagging files in <em><strong>tagging_lists/</strong></em> that are missing in the previous version.</li> <li>Add <em><strong>timestamps.json</strong></em> for easier usage. It records all the timestamps in dict format. You can see <em><strong>scripts/load_timestamp.ipynb</strong></em> for the format example.</li> <li>Add <em><strong>scripts/timestamp2clip.py</strong></em>: After the raw audio are crawled and put in <em><strong>audios/raw</strong></em>, you can use this script to get audio clips. The script will read <em><strong>timestamps.json</strong></em> and use the timestamp to extract clips. The clips will be saved to <em><strong>audios/seg</strong> </em>folder.</li> <li>remove 7 midi files that were added by mistake, and also corrected the number in <em><strong>metadata_by_song.csv</strong></em>.</li> </ul> <p> </p> <p><strong>2.1 Update</strong></p> <p>Add one file and one folder:</p> <ul> <li><em><strong>key_mode_tempo.csv</strong></em>: key, mode, and tempo information extracted from files.</li> <li><strong><em>CP_events/</em></strong>: CP events used in our paper. Extracted using this <a href="https://github.com/YatingMusic/compound-word-transformer/blob/main/dataset/representations/uncond/cp/corpus2events.py">script</a>, and add the emotion event to the front.</li> </ul> <p>Modify one folder:</p> <ul> <li>The <strong><em>REMI_events/</em></strong> files in version 2.0 contain some information that is not related to the paper, so remove it.</li> </ul> <p> </p> <p><strong>2.0 Update</strong></p> <p>Add two new folders:</p> <ul> <li><strong><em>corpus/</em></strong>: processed data that following <a href="https://github.com/YatingMusic/compound-word-transformer/blob/main/dataset/Dataset.md">the preprocessing flow</a>. (Please notice that although we have <code>1078</code> clips in our dataset, we lost some clips during steps 1~4 of the flow, so the final number of clips in this <strong><code>corpus</code></strong> is <code>1052</code>, and that's the number we used for training the generative model.)</li> <li><strong><em>REMI_events/</em></strong>: REMI event for each midi file. They are generated using this <a href="https://github.com/YatingMusic/compound-word-transformer/blob/main/dataset/representations/uncond/remi/corpus2events.py">script</a>.</li> </ul> <p>-------- </p> <p> </p> <p> </p> <p> </p> <p><strong>Cite this dataset</strong></p> <pre><code>@inproceedings{{EMOPIA}, author = {Hung, Hsiao-Tzu and Ching, Joann and Doh, Seungheon and Kim, Nabin and Nam, Juhan and Yang, Yi-Hsuan}, title = {{MOPIA}: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generation}, booktitle = {Proc. Int. Society for Music Information Retrieval Conf.}, year = {2021} }</code></pre>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.