Find research datasets worth reusing

openother-atMay 2020View details →

Audio captioning DCASE 2020 evaluation (testing) split

This is the evaluation split for Task 6, Automated Audio Captioning, in DCASE 2020 Challenge.  This evaluation split is the Clotho testing split, which is thoroughly described in the corresponding paper:  K. Drossos, S. Lipping and T. Virtanen, "Clotho: an Audio Captioning Dataset," IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 2020, pp. 736-740, doi: 10.1109/ICASSP40776.2020.9052990. available online at: <a href="https://arxiv.org/abs/1910.09387">https://arxiv.org/abs/1910.09387</a> and at: <a href="https://ieeexplore.ieee.org/document/9052990 ">https://ieeexplore.ieee.org/document/9052990 </a> This evaluation split is meant to be used for the purposes of the Task 6 at the scientific challenge DCASE 2020. This split it is not meant to be used for developing audio captioning methods. For developing audio captioning methods, you should use the development and evaluation splits of Clotho.  If you want the development and evaluation splits of Clotho dataset, you can find them also in Zenodo, at: <a href="https://zenodo.org/record/3490684">https://zenodo.org/record/3490684</a> -------------------------------------------------------------------------------------------------------- == License == The audio files in the archives: <ul> <li>clotho_audio_test.7z </li> </ul> and the associated meta-data in the CSV file: <ul> <li>clotho_metadata_test.csv</li> </ul> are under the corresponding licences (mostly CreativeCommons with attribution) of Freesound [1] platform, mentioned explicitly in the CSV file for each of the audio files. That is, each audio file in the 7z archive is listed in the CSV file with the meta-data. The meta-data for each file are:  <ul> <li>File name</li> <li>Start and ending samples for the excerpt that is used in the Clotho dataset</li> <li>Uploader/user in the Freesound platform (manufacturer)</li> <li>Link to the licence of the file</li> </ul> -------------------------------------------------------------------------------------------------------- == References == [1] Frederic Font, Gerard Roma, and Xavier Serra. 2013. Freesound technical demo. In Proceedings of the 21st ACM international conference on Multimedia (MM '13). ACM, New York, NY, USA, 411-412. DOI: https://doi.org/10.1145/2502081.2502245

opencc-by-4.0Nov 2023View details →

IPBES Invasive Alien Species Assessment: Summary for Policymakers. Figures, tables and captions

Figures, tables and their captions from the Summary for Policymakers of the Thematic Assessment Report on Invasive Alien Species and their Control of the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services.

IPBES Invasive Alien Species Assessment: Summary for Policymakers. Figures, tables and captions in Arabic

Arabic translations of the figures, tables and their captions from the Summary for Policymakers of the Thematic Assessment Report on Invasive Alien Species and their Control of the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services.

IPBES Invasive Alien Species Assessment: Summary for Policymakers. Figures, tables and captions in Chinese

Chinese translations of the figures, tables and their captions from the Summary for Policymakers of the Thematic Assessment Report on Invasive Alien Species and their Control of the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services.

IPBES Invasive Alien Species Assessment: Summary for Policymakers. Figures, tables and captions in French

French translations of the figures, tables and their captions from the Summary for Policymakers of the Thematic Assessment Report on Invasive Alien Species and their Control of the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services.

IPBES Invasive Alien Species Assessment: Summary for Policymakers. Figures, tables and captions in Russian

Russian translations of the figures, tables and their captions from the Summary for Policymakers of the Thematic Assessment Report on Invasive Alien Species and their Control of the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services.

opencc-by-4.0Nov 2022View details →

Keyframe-level Captions for V3C

Image captions generated using <a href="https://github.com/j-min/CLIP-Caption-Reward">CLIP-Caption-Reward</a> and <a href="https://github.com/rmokady/CLIP_prefix_caption">CLIP_prefix_caption</a> for every Keyframe in the Vimeo Creative Commons Collection. Captions are grouped by captioning method and dataset shard and provided as CSV.

openJun 2023View details →

Charades-STA Speech Caption Dataset

<ul> <li>Dataset introduction: This dataset is an extension of Charades-STA dataset, where audio is read from text using machine simulation method "microsoft/speecht5_tts"</li> <li>Associated Code: <a href="https://github.com/xian-sh/UniSDNet">https://github.com/xian-sh/UniSDNet</a></li> <li>Associated Paper: <a href="https://arxiv.org/abs/2403.14174">https://arxiv.org/abs/2403.14174</a> </li> <li>Disclaimer: This dataset is for academic research only, non-commercial use, if you use this dataset please cite the <a href="https://arxiv.org/abs/2403.14174">associated paper</a></li> <li>Cite:</li> </ul> @article{hu2024unified,   title={Unified Static and Dynamic Network: Efficient Temporal Filtering for Video Grounding},   author={Jingjing Hu and Dan Guo and Kun Li and Zhan Si and Xun Yang and Xiaojun Chang and Meng Wang},   year={2024},   Journal={CoRR},   volume={abs/2403.14174}, }

openJun 2023View details →

TACoS Speech Caption Dataset

<ul> <li>Dataset Introduction: This dataset is an extension of Charades-STA dataset, where audio is read from text using machine simulation method "microsoft/speecht5_tts"</li> <li>Associated Code: <a href="https://github.com/xian-sh/UniSDNet">https://github.com/xian-sh/UniSDNet</a></li> <li>Associated Paper: <a href="https://arxiv.org/abs/2403.14174">https://arxiv.org/abs/2403.14174</a> </li> <li>Disclaimer: This dataset is for academic research only, non-commercial use, if you use this dataset please cite the <a href="https://arxiv.org/abs/2403.14174">associated paper</a></li> <li>Cite:</li> </ul> @article{hu2024unified,   title={Unified Static and Dynamic Network: Efficient Temporal Filtering for Video Grounding},   author={Jingjing Hu and Dan Guo and Kun Li and Zhan Si and Xun Yang and Xiaojun Chang and Meng Wang},   year={2024},   Journal={CoRR},   volume={abs/2403.14174}, }

opencc-by-4.0Aug 2023View details →

CAPTDURE: Captioned Sound Dataset of Single Sources

Description This is a dataset with captions for a single-source sound that can be used in various tasks that use environmental sounds. The dataset consists of 1,044 single-source sounds and 4,902 captions (3 or more captions per single-source sound). This dataset also consists of 1,044 multiple-source sounds and 3,132 captions (3 captions per multiple-source sound). The detail of the dataset is described in [1]. Conditions of use This dataset was made by Hitachi, Ltd. and is available under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) license. Citation If you use this dataset, please cite as follow: [1] Yuki Okamoto, Kanta Shimonishi, Keisuke Imoto, Kota Dohi, Shota Horiguchi, and Yohei Kawaguchi, "CAPTDURE: Captioned sound Dataset of Single Sources," Proc. INTERSPEECH, pp. 1683-1687, 2023. Feedback If there is any problem, please contact us <ul> <li>Yuki Okamoto, <a href="mailto:y-okamoto@ieee.org">y-okamoto@ieee.org</a></li> <li>Yohei Kawaguchi, <a href="mailto:yohei.kawaguchi.xk@hitachi.com">yohei.kawaguchi.xk@hitachi.com</a></li> </ul>

openOct 2023View details →

IPBES Invasive Alien Species Assessment: Chapter 1. Figures, tables and captions

Figures, tables and captions from Chapter 1: Introducing biological invasions and the IPBES thematic assessment of invasive alien species and their control. In: Thematic Assessment Report on Invasive Alien Species and their Control of the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services.

opencc-by-4.0Oct 2023View details →

IPBES Invasive Alien Species Assessment: Chapter 2. Figures, tables, captions and data management reports

This folder contains the figures and tables included in Chapter 2 of the IPBES Invasive Alien Species and their Control Assessment Report. Each figure is provided in pdf and svg format. In addition, the R scripts and the data sets required to generate the figures are provided as well.The figures and tables showing information about alien species numbers or distributions are all based on two data sets, which are stored on Zenodo folders. One data set contains the records of alien species per region worldwide (https://doi.org/10.5281/zenodo.7554428) and the workflow including R scripts have been published (https://doi.org/10.3897/neobiota.59.53578). This data set is called the 'chapter database'. Version 2.4.1 of this data set was used to extract the numbers shown in figures and tables of this chapter.  The second data set (https://doi.org/10.5281/zenodo.6458083) contains coordinates of alien species occurrences worldwide and the workflow including R scripts have also been published elsewhere (https://doi.org/10.3897/neobiota.74.81082). Version 1.0.1 of this data set was used here.The folder also contains the data management reports for the generation of the chapter database and figures.

opencc-by-nc-4.0Apr 2024View details →

Abstractive News Captions with High- level cOntext Representation (ANCHOR) dataset

The Abstractive News Captions with High-level cOntext Representation (ANCHOR) dataset contains 70K+ samples sourced from 5 different news media organizations. This dataset can be utilized for Vision & Language tasks such as Text-to-Image Generation, Image Caption Generation, etc.

opencc-by-4.0Nov 2021View details →

Places Audio Captions (Japanese) 100k

The Places Audio Caption (Japanese) 100K Corpus contains approximately 100,000 Japanese spoken captions for natural images drawn from the Places 205 image dataset. This speech corpus was collected to investigate the learning of spoken language (words, sub-word units, higher-level semantics, etc.) from visually-grounded speech. For a description of the corpus, see: <pre><code>@INPROCEEDINGS{Ohishi2020trilingual, author={Ohishi, Yasunori and Kimura, Akisato and Kawanishi, Takahito and Kashino, Kunio and Harwath, David and Glass, James}, booktitle={ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, title={Trilingual Semantic Embeddings of Visually Grounded Speech with Self-Attention Mechanisms}, year={2020}, pages={4352-4356}, }</code></pre> The corpus only includes audio recordings, and not the associated images. You will need to separately download the Places image dataset <a href="http://places.csail.mit.edu/">here</a>. The data is distributed under the Creative Commons Attribution-ShareAlike (CC BY-SA) license <a href="https://creativecommons.org/licenses/by-sa/4.0/legalcode">(link)</a>. If you use this data in your own publications, please cite the paper above.

opencc-by-4.0May 2019View details →

Audio Caption Dataset (Hospital & Car)

This dataset consists of the Hospital scene of our Audio Caption dataset. Details can be seen in our paper <a href="https://arxiv.org/abs/1902.09254">Audio Caption: Listen and Tell</a> published at ICASSP2019.  Car scene, detailed in <a href="https://arxiv.org/abs/1905.13448">Audio Caption in a Car Setting with a Sentence-Level Loss</a> published at ISCSLP 2021. Original captions in Mandarin Chinese, with English translations provided.

opencc-by-4.0Oct 2022View details →

Datasets related to the paper " Inception Models for Fashion Image Captioning: An Extensive Study on Multiple Datasets"

This collection contains three datasets in HDF5 format: FashionCap, ReducedInFashAI, ReducedFACAD.