zenodoopen

Multimodal datataset of EEG, ECG and audio recordings of individual musicians playing emotional music

This dataset contains EEG, ECG and audio recordings of 11 individual musicians playing emotional music on their instrument. The dataset consists of two parts: <ol> <li> Experiment: Musicians’ self-reported ratings, audio recordings, and physiological recordings where the 11 expert musicians were asked to play at least 4~2-minute unfamiliar (non-popularly known) musical pieces. Participants were asked to play at least once one of the following  emotions:  happiness, sadness, relaxation, and anger. For the  physiological recordings EEG, ECG, and GSR signals were recorded. Each musican’s data is denoted by MS_ followed by the order in which they were recorded. </li> <li> Self-report questionnaire: A self-assessment questionnaire and their answers where 11 expert musicians were asked to rate musical pieces recorded based on: <ol> <li> Objective valence & arousal they felt the piece had; </li> <li> Felt valence & arousal during playing. </li> </ol> </li> </ol>   For a more detailed explanation of the dataset, its recording procedure, and its contents, see  L. Turchet, B. O'Sullivan, R. Ortner & C. Gugher (2024). Emotion Recognition of Playing Musicians from EEG, ECG, and Acoustic Signals. IEEE Transactions on Human-Machine Systems.   <h2>File Listing</h2> The following files are available (each explained in more detail below): <div> <table> <tbody> <tr> <td> Name </td> <td> Format </td> <td> Contents </td> </tr> <tr> <td> EEG_ECG_data_for_each_musician </td> <td> mat </td> <td> This folder contains the raw EEG, ECG, & GSR data for all 11 musicians for each piece they played as well as a resting state recording, which was recorded while a neutral audio stimulus was played. </td> </tr> <tr> <td> audio_data_for_each_musician </td> <td> wav, JSON, csv </td> <td> This folder contains 3 subfolders: 1) wav_audio_files_original: This is the raw audio data recorded for each musician and includes all 56 pieces included in the paper reported above, please see below regarding rejected trials. 2) wav_audio_files (original split_into_3_parts): Here, the 56 pieces are appropriately split into 3 separate parts. 3) analysis_audio_files: This folder contains the acoustic features extracted, 1714 acoustic features were extracted from each split trial. Each result is stored in .JSON, however, the collated results can be seen in all_results.csv. </td> </tr> <tr> <td> self_report_questionnaire </td> <td> pdf, xls </td> <td> Two files exist in this folder: 1. The self-reported questionnaire given to the musicians of the questionnaire during the experiment. 2.  </td> </tr> </tbody> </table> </div> <h2>File Details</h2>   <h3>EEG_ECG_data_for_each_musician</h3> These are the original raw data recordings. EEG data were recorded using a g.GAMMAcap2 by g.tec Medical Engineering, a 64-channel cap with g.SCARABEO active electrodes, with two g.GAMMAsys reference active ear clip electrodes. Two g.GAMMAbox electrode connector boxes were used to connect the active electrodes to two g.USBamp biosignal amplifiers with a sampling frequency of 256 Hz. The following 31 EEG channels were used: Fp1, Fp2, AFz, AF3, AF4, AF7, AF8, Fz, F3, F4, F7, F8, Cz, C3, C4, CP3, CP4, CP5, CP6, P1, P2, P3, P4, P5, P6, P7, P8, PO7, PO8, O1, and O2. AFz was used as a ground electrode and Cz was used as a re-reference electrode. The right-side ear clip electrode was used as a reference electrode.  ECG data were recorded using a single g.GAMMAclip active electrode clip connected directly to the g.GAMMAbox, sharing the same ground electrode with the EEG cap and placed on position V4 of the subjects. GSR data was recorded using the g.GSRsensor² box which contains two small dry electrodes placed underneath the participant’s toes (due to the amount of hand movement required for playing an instrument). The g.GSRsensor² was connected directly to a g.GAMMAbox, using jumper cables connected to different ports in the g.USBAMPs to share the same reference and ground electrodes as the EEG cap.    The locations of the channels and their corresponding number in the raw data is as follows: <div> <table> <tbody> <tr> <td> Channel Number </td> <td> Channel Name </td> </tr> <tr> <td> 1 </td> <td> Time series </td> </tr> <tr> <td> 2 </td> <td> AF3 </td> </tr> <tr> <td> 3 </td> <td> AF4 </td> </tr> <tr> <td> 4 </td> <td> AF7 </td> </tr> <tr> <td> 5 </td> <td> AF8 </td> </tr> <tr> <td> 6 </td> <td> CP3 </td> </tr> <tr> <td> 7 </td> <td> CP4 </td> </tr> <tr> <td> 8 </td> <td> CP5 </td> </tr> <tr> <td> 9 </td> <td> CP6 </td> </tr> <tr> <td> 10 </td> <td> P1 </td> </tr> <tr> <td> 11 </td> <td> P2 </td> </tr> <tr> <td> 12 </td> <td> P5 </td> </tr> <tr> <td> 13 </td> <td> P6 </td> </tr> <tr> <td> 14 </td> <td> P7 </td> </tr> <tr> <td> 15 </td> <td> P8 </td> </tr> <tr> <td> 16 </td> <td> O1 </td> </tr> <tr> <td> 17 </td> <td> O2 </td> </tr> <tr> <td> 18 </td> <td> Cz </td> </tr> <tr> <td> 19 </td> <td> Fp1 </td> </tr> <tr> <td> 20 </td> <td> Fp2 </td> </tr> <tr> <td> 21 </td> <td> F3 </td> </tr> <tr> <td> 22 </td> <td> F4 </td> </tr> <tr> <td> 23 </td> <td> F7 </td> </tr> <tr> <td> 24 </td> <td> F8 </td> </tr> <tr> <td> 25 </td> <td> C3 </td> </tr> <tr> <td> 26 </td> <td> C4 </td> </tr> <tr> <td> 27 </td> <td> P3 </td> </tr> <tr> <td> 28 </td> <td> P4 </td> </tr> <tr> <td> 29 </td> <td> PO7 </td> </tr> <tr> <td> 30 </td> <td> PO8 </td> </tr> <tr> <td> 31 </td> <td> AFz </td> </tr> <tr> <td> 32 </td> <td> GSR </td> </tr> <tr> <td> 33 </td> <td> ECG </td> </tr> </tbody> </table> </div> <h3>audio_data_for_each_musician/wav_audio_files_original</h3> This folder contains all of the raw audio files recorded during the experiment. All pieces were recorded using the software Audacity and exported as WAV files encoded with a bit depth of 32-bits and a sampling rate of 44.1 kHz. 56 of the included trials are present in this folder.   <h3>audio_data_for_each_musician/wav_audio_files (original split_into_3_parts)</h3> This folder contains the above mentioned 56 raw audio pieces separated into 3 appropriately sized recordings.   audio_data_for_each_musician/analysis_audio_files This folder contains the 1714 acoustic features from each of the 3 separated trials from 56 accepted pieces, these are denoted by MS_ followed by the order in which the musicians were recorded and the order in which the trails were split, the individual features are in JSON format. Within this folder, we have collated all results in a csv file (all_results.csv) where the columns show the intended emotion, trial name and number, followed by the names of the acoustic features.    self_report_questionnaire This pdf is the questionnaire which each musician was given following each trial relating to the emotions communicated and felt during each trial. Most* questions in the questionnaire were multiple-choice and speak pretty much for themselves. The answers for which were collated and are described below.   self_report_questionnaire_anwsers This .xls file contains the results of all the musicians self-reported ratings from the above described questionnaire.  <div> <table> <tbody> <tr> <td> Column name </td> <td> Description </td> </tr> <tr> <td> Subject </td> <td> The subject code of the musician, denoted by MS_ </td> </tr> <tr> <td> recording_filename </td> <td> The name of the trial denoted by MS_01_ followed by the trial number. </td> </tr> <tr> <td> intended_emotion </td> <td> The intended emotion the musician was instructed to communicate. The emotions are as follows: <ol> <li> Angry </li> <li> Sad </li> <li> Relaxed </li> <li> Happy </li> </ol> They are intended to be reported by using the valence-arousal space. </td> </tr> <tr> <td> valence_communicated </td> <td> The valence rating (integer between 1 and 5), that participants were asked to objectively rate how they thought the music played would be perceived.  </td> </tr> <tr> <td> arousal_communicated </td> <td> As above, but relating to arousal rather than valence. </td> </tr> <tr> <td> valence_felt </td> <td> The valence rating (integer between 1 and 5), that participants were asked to rate how they felt while playing the piece. </td> </tr> </tbody> </table> </div>   <div> <table> <tbody> <tr> <td> arousal_felt </td> <td> As above, but relating to arousal rather than valence. </td> </tr> <tr> <td> instrument_played </td> <td> The instrument played for each trial. </td> </tr> </tbody> </table> </div>

ShareScore

36/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship: 8
Harmonization: 4
Access: 16
Reuse readiness: 8
Engagement: 0