Skip to main content
Powered by ShareScore

Find research datasets worth reusing

Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.

6

datasets available to search

ShareScore release 0.9.0

Reset

Dataset results

6 results for “facial tracking”

Learn how ShareScore rates datasets ↗
zenodo40/100

EEG and eye-tracking data from a go/no-go saccadic task based on facial expression cues

<p>Electroencephalographic (EEG) and eye-tracking data from 20 healthy individuals who performed a&nbsp;go/no-go saccadic task based on facial expression cues aimed at studying error monitoring processes.</p> <p>&nbsp;</p> <p>Version 2 includes only the EEG data, but&nbsp; with triggers of correct and erroneous actions. Version 2 has an error that was corrected for version 3.</p> <p>&nbsp;</p> <p>EEG Triggers</p> <table> <tbody> <tr> <td> <p><span>19</span></p> </td> <td> <p><span>Eye tracker starts recording</span></p> </td> </tr> <tr> <td> <p><span>1</span></p> </td> <td> <p><span>Beginning of each trial</span></p> </td> </tr> <tr> <td> <p><span>200</span></p> </td> <td> <p><span>Gap between neutral and instruction</span></p> </td> </tr> <tr> <td> <p><span>99</span></p> </td> <td> <p><span>Fixation cross between instruction and saccade</span></p> </td> </tr> <tr> <td> <p><span>2</span></p> </td> <td> <p><span>Instruction no-go happy</span></p> </td> </tr> <tr> <td> <p><span>21</span></p> </td> <td> <p><span>Target left no-go happy</span></p> </td> </tr> <tr> <td> <p><span>22</span></p> </td> <td> <p><span>Target right no-go happy</span></p> </td> </tr> <tr> <td> <p><span>121</span></p> </td> <td> <p><span>Response period for no-go happy after target left</span></p> </td> </tr> <tr> <td> <p><span>122</span></p> </td> <td> <p><span>Response period for no-go happy after target right</span></p> </td> </tr> <tr> <td> <p><span>3</span></p> </td> <td> <p><span>Instruction no-go sad</span></p> </td> </tr> <tr> <td> <p><span>31</span></p> </td> <td> <p><span>Target left no-go sad</span></p> </td> </tr> <tr> <td> <p><span>32</span></p> </td> <td> <p><span>Target right no-go sad</span></p> </td> </tr> <tr> <td> <p><span>131</span></p> </td> <td> <p><span>Response period for no-go sad after target left</span></p> </td> </tr> <tr> <td> <p><span>132</span></p> </td> <td> <p><span>Response period for no-go sad after target right</span></p> </td> </tr> <tr> <td> <p><span>4</span></p> </td> <td> <p><span>Instruction pro-right</span></p> </td> </tr> <tr> <td> <p><span>42</span></p> </td> <td> <p><span>Target right pro-right</span></p> </td> </tr> <tr> <td> <p><span>142</span></p> </td> <td> <p><span>Response period for pro-right</span></p> </td> </tr> <tr> <td> <p><span>5</span></p> </td> <td> <p><span>Instruction pro-left</span></p> </td> </tr> <tr> <td> <p><span>51</span></p> </td> <td> <p><span>Target left pro-left</span></p> </td> </tr> <tr> <td> <p><span>151</span></p> </td> <td> <p><span>Response period for pro-left</span></p> </td> </tr> <tr> <td> <p><span>6</span></p> </td> <td> <p><span>Instruction anti-left</span></p> </td> </tr> <tr> <td> <p><span>61</span></p> </td> <td> <p><span>Target left anti-left</span></p> </td> </tr> <tr> <td> <p><span>161</span></p> </td> <td> <p><span>Response period for anti-left</span></p> </td> </tr> <tr> <td> <p><span>7</span></p> </td> <td> <p><span>Instruction anti-right</span></p> </td> </tr> <tr> <td> <p><span>72</span></p> </td> <td> <p><span>Target right anti-right</span></p> </td> </tr> <tr> <td> <p><span>172</span></p> </td> <td> <p><span>Response period for anti-right</span></p> </td> </tr> <tr> <td> <p><span>199</span></p> </td> <td> <p><span>Final fixation period (1.5s black screen after last saccade)</span></p> </td> </tr> <tr> <td> <p><span>190</span></p> </td> <td> <p><span>Eye tracker stops recording</span></p> </td> </tr> <tr> <td> <p><span>proCorr</span></p> </td> <td> <p><span>Beginning of saccade in the correct direction following a pro-saccade intruction</span></p> </td> </tr> <tr> <td> <p><span>proErr</span></p> </td> <td> <p><span>Beginning of saccade in the erroneous direction following a pro-saccade intruction</span></p> </td> </tr> <tr> <td> <p><span>antiCorr</span></p> </td> <td> <p><span>Beginning of saccade in the correct direction following a anti-saccade intruction</span></p> </td> </tr> <tr> <td> <p><span>antiErr</span></p> </td> <td> <p><span>Beginning of saccade in the erroneous direction following a anti-saccade intruction</span></p> </td> </tr> <tr> <td> <p><span>nogoErr</span></p> </td> <td> <p><span>Beginning of saccade in the erroneous direction following a no-go intruction</span></p> </td> </tr> </tbody> </table>

opencc-by-4.0Oct 2021View details →
zenodo40/100

RAVDESS Facial Landmark Tracking

<p><strong>Contact Information</strong></p> <p>If you would like further information about the RAVDESS Facial Landmark Tracking data set, or if you experience any issues downloading files, please contact us at <a href="mailto:ravdess@gmail.com?subject=RAVDESS%20feedback%20from%20Zenodo">ravdess@gmail.com</a>.&nbsp;</p> <p><strong>Tracking Examples</strong></p> <p>Watch a sample of the <a href="https://youtu.be/cxMK2J0P7J0">facial tracking results</a>.</p> <p><strong>Description</strong></p> <p>The <a href="https://affectivedatascience.com/datasets.html#landmark-tracking">RAVDESS Facial Landmark Tracking dataset</a> set contains tracked facial landmark movements from the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) [<a href="https://zenodo.org/record/1188976">RAVDESS Zenodo page</a>].&nbsp; Motion tracking of actors' faces was produced by OpenFace 2.1.0 (Baltrusaitis, T., Zadeh, A., Lim, Y. C., &amp; Morency, L. P., 2018).&nbsp; Tracked information includes: facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.</p> <p>The Facial Landmark Tracking dataset was created in the <a href="https://affectivedatascience.com">Affective Data Science Lab</a>.</p> <p>This data set contains tracking for all 2452 RAVDESS trials.&nbsp; All tracking movement data are contained in "FacialTracking_Actors_01-24.zip", which contains 2452 .CSV files.&nbsp; Each actor has 104 tracked trials (60 speech, 44 song).&nbsp; Note, there are no song files for Actor 18.</p> <p>Total Tracked Files = (24 Actors x 60 Speech trials) + (23 Actors x 44 Song trials) = 2452 files.</p> <p>Tracking results for each trial are provided as individual comma separated value files (CSV format).&nbsp; File naming convention of tracked files is identical to that of the RAVDESS.&nbsp; For example, tracked file "01-01-01-01-01-01-01.csv" corresponds to RAVDESS audio-video file "01-01-01-01-01-01-01.mp4".&nbsp; For a complete description of the RAVDESS file naming convention and experimental manipulations, please see the <a href="https://zenodo.org/record/1188976">RAVDESS Zenodo page</a>.&nbsp;</p> <p>Tracking overlay videos for all trials are also provided (720p Xvid, .avi), one zip file per Actor.&nbsp; As the RAVDESS does not contain "ground truth" facial landmark locations, the overlay videos provide a visual 'sanity check' for researchers to confirm the general accuracy of the tracking results.&nbsp; The file naming convention of tracking overlay videos also matches that of the RAVDESS.&nbsp; For example, tracking video "01-01-01-01-01-01-01.avi" corresponds to RAVDESS audio-video file "01-01-01-01-01-01-01.mp4".</p> <p><strong>Tracking File Output Format</strong></p> <p>This data set retained OpenFace's data output format, <a href="https://github.com/TadasBaltrusaitis/OpenFace/wiki/Output-Format">described here in detail</a>.&nbsp; The resolution of all input videos was 1280x720.&nbsp; When tracking output units are in pixels, their range of values is (0,0) (top left corner) to (1280,720) (bottom right corner).&nbsp;</p> <p><em>Columns 1-3 = Timing and Detection Confidence</em></p> <ul> <li>1. Frame - The number of the frame (source videos 30 fps), range = 1 to n</li> <li>2. Timestamp - Time of frame, range = 0 to m</li> <li>3. Confidence - Tracker confidence level in current landmark detection estimate, range = 0 to 1</li> </ul> <p><em>Columns 4-291 = Eye Gaze Detection</em></p> <ul> <li>4-6. gaze_0_x, gaze_0_y, gaze_0_z - Eye gaze direction vector in world coordinates for eye 0 (normalized), eye 0 is the leftmost eye in the image (think of it as a ray going from the left eye in the image in the direction of the eye gaze).</li> <li>7-9. gaze_1_x, gaze_1_y, gaze_1_z - Eye gaze direction vector in world coordinates for eye 1 (normalized), eye 1 is the rightmost eye in the image (think of it as a ray going from the right eye in the image in the direction of the eye gaze).</li> <li>10-11. gaze_angle_x, gaze_angle_y - Eye gaze direction in radians in world coordinates, averaged for both eyes. If a person is looking left-right this will results in the change of gaze_angle_x (from positive to negative) and, if a person is looking up-down this will result in change of gaze_angle_y (from negative to positive), if a person is looking straight ahead both of the angles will be close to 0 (within measurement error).</li> <li>12-123. eye_lmk_x_0, ..., eye_lmk_x55, eye_lmk_y_0,..., eye_lmk_y_55 - Location of 2D eye region landmarks in pixels. A figure describing the landmark index <a href="https://raw.githubusercontent.com/wiki/TadasBaltrusaitis/OpenFace/images/eye_lmk_markup.png">can be found here</a>.</li> <li>124-291. eye_lmk_X_0, ..., eye_lmk_X55, eye_lmk_Y_0,..., eye_lmk_Y_55,..., eye_lmk_Z_0,..., eye_lmk_Z_55 - Location of 3D eye region landmarks in millimeters. A figure describing the landmark index <a href="https://raw.githubusercontent.com/wiki/TadasBaltrusaitis/OpenFace/images/eye_lmk_markup.png">can be found here</a>.</li> </ul> <p><em>Columns 292-297 = Head pose</em></p> <ul> <li>292-294. pose_Tx, pose_Ty, pose_Tz - Location of the head with respect to camera in millimeters (positive Z is away from the camera).</li> <li>295-297. pose_Rx, pose_Ry, pose_Rz - Rotation of the head in radians around X,Y,Z axes with the convention R = Rx * Ry * Rz, left-handed positive sign. This can be seen as pitch (Rx), yaw (Ry), and roll (Rz). The rotation is in world coordinates with the camera being located at the origin.</li> </ul> <p><em>Columns 298-433 = Facial Landmarks locations in 2D</em></p> <ul> <li>298-433. x_0, ..., x_67, y_0,...y_67 - Location of 2D landmarks in pixels. A figure describing the landmark index <a href="https://raw.githubusercontent.com/TadasBaltrusaitis/OpenFace/master/imgs/landmark_scheme_68.png">can be found here</a>.</li> </ul> <p><em>Columns 434-637 = Facial Landmarks locations in 3D</em></p> <ul> <li>434-637. X_0, ..., X_67, Y_0,..., Y_67, Z_0,..., Z_67 - Location of 3D landmarks in millimetres. A figure describing the landmark index <a href="https://raw.githubusercontent.com/TadasBaltrusaitis/OpenFace/master/imgs/landmark_scheme_68.png">can be found here</a>.&nbsp; For these values to be accurate, OpenFace needs to have good estimates for fx,fy,cx,cy.</li> </ul> <p><em>Columns 638-677 = Rigid and non-rigid shape parameters</em></p> <p>Parameters of a point distribution model (PDM) that describe the rigid face shape (location, scale and rotation) and non-rigid face shape (deformation due to expression and identity). For more details, please refer to chapter 4.2 of my Tadas Baltrusaitis's PhD thesis [<a href="https://www.repository.cam.ac.uk/handle/1810/245253">download link</a>].</p> <ul> <li>638-643. p_scale, p_rx, p_ry, p_rz, p_tx, p_ty - Scale, rotation, and translation terms of the PDM.</li> <li>644-677. p_0, ..., p_33 - Non-rigid shape parameters.</li> </ul> <p><em>Columns 687-712 = Facial Action Units</em></p> <p>Facial Action Units (AUs) are a way to describe human facial movements (Ekman, Friesen, and Hager, 2002) [<a href="https://en.wikipedia.org/wiki/Facial_Action_Coding_System">wiki link</a>].&nbsp; More information on OpenFace's implementation of AUs <a href="https://github.com/TadasBaltrusaitis/OpenFace/wiki/Action-Units">can be found here</a>.</p> <ul> <li>678-694. AU01_r, AU02_r, AU04_r, AU05_r, AU06_r, AU07_r, AU09_r, AU10_r, AU12_r, AU14_r, AU15_r, AU17_r, AU20_r, AU23_r, AU25_r, AU26_r, AU45_r - Intensity of AU movement, range from 0 (no muscle&nbsp; contraction) to 5 (maximal muscle contraction).</li> <li>695-712. AU01_c, AU02_c, AU04_c, AU05_c, AU06_c, AU07_c, AU09_c, AU10_c, AU12_c, AU14_c, AU15_c, AU17_c, AU20_c, AU23_c, AU25_c, AU26_c, AU28_c, AU45_c - Presence or absence of 18 AUs, range 0 (absent, not detected) to 1 (present, detected).</li> </ul> <p>Note, OpenFace's columns 2 and 5 (face_id and success, respectively) were not included in this data set. These values were redundant as a single face was detected in all frames, in all 2452 trials.</p> <p><strong>Tracking Overlay Videos</strong></p> <p>Tracking overlay videos visualize most aspects of the tracking output described above.</p> <ul> <li>Frame - Column 1, Top left corner of video</li> <li>Eye Gaze - Columns 4-11. Indicated by green ray emanating from left and right eyes.</li> <li>Eye region landmarks 2D - Columns 12-123. Red landmarks around left and right eyes, and black circles surrounding left and right irises.</li> <li>Head pose - Columns 292-297. Blue bounding box surrounding the actor's head.</li> <li>Facial landmarks 2D - Columns 298-433. Red landmarks on the participant's left and right eyebrows, nose, lips, and jaw.</li> <li>Facial Action Unit Intensity - Columns 687-694. All 17 AUs are listed on the left side of the video in black text.&nbsp; Intensity level (0-5) of each AU is indicated by the numeric value and blue bar.</li> <li>Facial Action Unit Presence - Columns 695-712. All 18 AUs are listed on the right side of the video in black &amp; green text.&nbsp; Absence of an AU (0) is in black text with the numeric value 0.0. Presence of an AU (1) is in green text with the numeric value 1.0.</li> </ul> <p><strong>Camera Parameters and 3D Calibration Procedure</strong></p> <p>This data set contains accurate estimates of actors' 3D head poses. To produce these, camera parameters at the time of recording were required (distance from camera to actor, and camera field of view).&nbsp; These values were used with OpenCV's camera calibration procedure, <a href="https://opencv-python-tutroals.readthedocs.io/en/latest/py_tutorials/py_calib3d/py_calibration/py_calibration.html">described here</a>, to produce estimates of the camera's focal length and optical center at the time of actor recordings.&nbsp; The four values produced by the calibration procedure (fx,fy,cx,cy) were input to OpenFace as command line arguments during facial tracking, <a href="https://github.com/TadasBaltrusaitis/OpenFace/wiki/Command-line-arguments">described here</a>, to produce accurate estimates of 3D head pose.</p> <p><em>Camera Parameters</em></p> <ul> <li>Distance between camera and actor = 1.4 meters</li> <li>Camera field of view = 0.5 meters</li> <li>Focal length in x (fx) = 6385.9</li> <li>Focal length in y (fy) = 6339.6</li> <li>Optical center in x (cx) = 824.241</li> <li>Optical center in y (cy) = 1033.6</li> </ul> <p>The use of OpenCV's calibration procedure was required as the video camera used in the RAVDESS recordings did not report focal length values.&nbsp; Unlike SLR cameras, most video cameras do not provide this information to the user due to their dynamic focus feature.&nbsp; For all RAVDESS recordings, camera distance, field of view, and focal point (manual fixed camera focus) were kept constant.</p> <p><strong>License information</strong></p> <p>The RAVDESS Facial Landmark Tracking data set is released under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License,&nbsp;<a href="https://creativecommons.org/licenses/by-nc-sa/4.0/">CC BY-NA-SC 4.0</a>.</p> <p><strong>How to cite the RAVDESS Facial Tracking data set</strong></p> <p><em>Academic citation&nbsp;</em><br>If you use the RAVDESS Facial Tracking data set in an academic publication, please cite both references:&nbsp;</p> <ol> <li>Swanson, R., Livingstone, SR., &amp; Russo, FA. (2019). RAVDESS Facial Landmark Tracking (Version 1.0.0) [Data set]. Zenodo. http://doi.org/10.5281/zenodo.3255102</li> <li>Livingstone SR, Russo FA (2018) The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE 13(5): e0196391. <a href="https://doi.org/10.1371/journal.pone.0196391">https://doi.org/10.1371/journal.pone.0196391</a>.</li> </ol> <p><em>All other attributions&nbsp;</em><br>If you use the RAVDESS in a form other than an academic publication, such as in a blog post, school project, or non-commercial product, please use the following attribution: "<a href="https://zenodo.org/record/3255102">RAVDESS Facial Landmark Tracking</a>" by Swanson, Livingstone, &amp; Russo is licensed under&nbsp;<a href="https://creativecommons.org/licenses/by-nc-sa/4.0/">CC BY-NA-SC 4.0</a>.</p> <p><strong>Related Data sets</strong></p> <ul> <li>The Ryerson Audio-Visual Database of Emotional Speech and Song [<a href="https://zenodo.org/record/1188976">Zenodo project page</a>].</li> </ul>

opencc-by-nc-sa-4.0Jun 2019View details →
zenodo40/100

Facial Expression and Landmark Tracking (FELT) dataset

<p><strong>Contact Information</strong></p> <p>If you would like further information about the Facial expression and landmark tracking data set, or if you experience any issues downloading files, please contact us at <a href="mailto:ravdess@gmail.com?subject=RAVDESS%20feedback%20from%20Zenodo">ravdess@gmail.com</a>.&nbsp;</p> <p><strong>Facial Expression examples</strong></p> <p>Watch a sample of the <a href="https://youtu.be/OA5gZ6iycPc">facial expression tracking results</a>.</p> <p><strong>Commercial Licenses</strong></p> <p>Commercial licenses for this dataset can be purchased.&nbsp; For more information, please contact us at <a href="mailto:ravdess@gmail.com?subject=RAVDESS%20Commercial%20License">ravdess@gmail.com</a>.</p> <p><strong>Description</strong></p> <p>The <a href="https://affectivedatascience.com/datasets.html#felt">Facial Expression and Landmark Tracking (FELT) dataset</a> dataset contains tracked facial expression movements and animated videos from the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) [<a href="../record/1188976">RAVDESS Zenodo page</a>]. Tracking data and videos were produced by Py-Feat 0.6.2 (2024-03-29 release) (Cheong, J.H., Jolly, E., Xie, T. <em>et al.</em> Py-Feat: Python Facial Expression Analysis Toolbox. <em>Affec Sci</em> <strong>4</strong>, 781&ndash;796 (2023). https://doi.org/10.1007/s42761-023-00191-4) and custom code (<a href="https://github.com/harveyliao/Py-feat-RAVDESS">github repo</a>). Tracked information includes: facial emotion classification estimates, facial landmark detection (68 points), head pose estimation (yaw, pitch, roll, x, y), and facial Action Unit (AU) recognition. Videos include: landmark overlay videos, AU activation animations, and landmark plot animations.</p> <p>The FELT dataset was created at the <a href="https://affectivedatascience.com">Affective Data Science Lab</a>.</p> <p>This dataset contains tracking data and videos for all 2452 RAVDESS trials. Raw and smoothed tracking data are provided. All tracking movement data are contained in the following archives: raw_motion_speech.zip, smoothed_motion_speech.zip, raw_motion_song.zip, and smoothed_motion_song.zip. Each actor has 104 tracked trials (60 speech, 44 song).&nbsp; Note, there are no song files for Actor 18.</p> <p>Total Tracked Files = (24 Actors x 60 Speech trials) + (23 Actors x 44 Song trials) = 2452 CSV files.</p> <p>Tracking results for each trial are provided as individual comma separated value files (CSV format).&nbsp; File naming convention of raw and smoothed tracked files is identical to that of the RAVDESS.&nbsp; For example, smoothed tracked file "01-01-01-01-01-01-01.csv" corresponds to RAVDESS audio-video file "01-01-01-01-01-01-01.mp4".&nbsp; For a complete description of the RAVDESS file naming convention and experimental manipulations, please see the <a href="../record/1188976">RAVDESS Zenodo page</a>.&nbsp;</p> <p>Landmark overlays, AU activation, and landmark plot videos for all trials are also provided (720p h264, .mp4). Landmark overlays present tracked landmarks and head pose overlaid on the original RAVDESS actor video. As the RAVDESS does not contain "ground truth" facial landmark locations, the overlay videos provide a visual 'sanity check' for researchers to confirm the general accuracy of the tracking results. Landmark plot animations present landmarks only, anchored to the top left corner of the head bounding box with translational head motion removed. AU activation animations visualize intensity of AU activations (0-1 normalized) as a heatmap over time. The file naming convention of all videos also matches that of the RAVDESS.&nbsp; For example, "Landmark_Overlay/01-01-01-01-01-01-01.mp4", "Landmark_Plot/01-01-01-01-01-01-01.mp4", "ActionUnit_Animation/01-01-01-01-01-01-01.mp4", all correspond to RAVDESS audio-video file "01-01-01-01-01-01-01.mp4".</p> <p><strong>Smoothing procedure<br></strong></p> <p>Raw tracking data were first low-pass filtered with a 5th order butterworth filter (cutoff_freq = 6, sampling_freq = 29.97, order = 5) to remove high-frequency noise. Data were then smoothed with a Savitzky-Golay filter (window_length = 11, poly_order = 5). Scipy.signal (v 1.13.1) was used for both procedures.</p> <p><strong>Landmark Tracking models</strong></p> <p>Six separate machine learning models were used by Py-Feat to perform various aspects of tracking and classification. Video outputs generated by different combinations of ML models were visually compared, with final model choice determined by voting of first and second authors. Models were specified in the call to <code>Detector</code> class (<a href="https://py-feat.org/basic_tutorials/02_detector_imgs.html?highlight=facescore">described here</a>). Exact function call as follows:</p> <p><code>&nbsp; &nbsp; Detector(face_model='img2pose',</code><br><code>&nbsp; &nbsp; landmark_model='mobilenet',</code><br><code>&nbsp; &nbsp; au_model='xgb',</code><br><code>&nbsp; &nbsp; emotion_model='resmasknet',</code><br><code>&nbsp; &nbsp; facepose_model='img2pose-c',</code><br><code>&nbsp; &nbsp; identity_model='facenet',</code><br><code>&nbsp; &nbsp; device='cuda',</code><br><code>&nbsp; &nbsp; n_jobs=1,</code><br><code>&nbsp; &nbsp; verbose=False,</code><br><code>&nbsp; &nbsp; )</code></p> <p>Default Py_feat parameters to each model were used in most cases. Non-defaults were specified in the call to <code>detect_video</code> function (<a href="https://py-feat.org/pages/api.html?highlight=detect_video">described here</a>). Exact function call as follows:<br><br><code>&nbsp;&nbsp;&nbsp; (video_path,</code><br><code>&nbsp;&nbsp;&nbsp; skip_frames=None,</code><br><code>&nbsp;&nbsp;&nbsp; output_size=(720, 1280),</code><br><code>&nbsp;&nbsp;&nbsp; batch_size=5,</code><br><code>&nbsp;&nbsp;&nbsp; num_workers=0,</code><br><code>&nbsp;&nbsp;&nbsp; pin_memory=False,</code><br><code>&nbsp;&nbsp;&nbsp; face_detection_threshold=0.83,</code><br><code>&nbsp;&nbsp;&nbsp; face_identity_threshold=0.8</code><br><code>&nbsp;&nbsp;&nbsp; )</code></p> <p><strong>Tracking File Output Format</strong></p> <p>This data set retained Py-Feat's data output format. The resolution of all input videos was 1280x720.&nbsp; Tracking output units are in pixels, their range of values is (0,0) (top left corner) to (1280,720) (bottom right corner).&nbsp;</p> <p><em>Column 1 = Timing information</em></p> <ul> <li>1. frame - The number of the frame (source videos 29.97 fps), range = 1 to n</li> </ul> <p><em>Columns 2-5 = Head bounding box<br></em></p> <ul> <li>2-3. FaceRectX, FaceRectY - X and Y coordinates of top-left corner of head bounding box (pixels)</li> <li>4-5. FaceRectWidth, FaceRectHeightF - Width and Height of head bounding box (pixels)</li> </ul> <p><em>Column 6 = Face detection confidence<br></em></p> <ul> <li>FaceScore - Confidence level that a human face was deteceted, range = 0 to 1</li> </ul> <p><em>Columns 7-142 = Facial landmark locations in 2D<br></em></p> <ul> <li>7-142. x_0, ..., x_67, y_0,...y_67 - Location of 2D landmarks in pixels. A figure describing the landmark index&nbsp;<a href="https://raw.githubusercontent.com/TadasBaltrusaitis/OpenFace/master/imgs/landmark_scheme_68.png">can be found here</a>.</li> </ul> <p><em>Columns 143-145 = Head pose</em></p> <ul> <li>143-145. Pitch, Roll, Yaw - Rotation of the head in degrees (<a href="https://py-feat.org/basic_tutorials/02_detector_imgs.html?highlight=facerect#:~:text=single_face_prediction.poses%20%23%20(in%20degrees)">described here</a>). The rotation is in world coordinates with the camera being located at the origin.</li> </ul> <p><em>Columns 146-165 = </em><em>Facial Action Units</em></p> <p>Facial Action Units (AUs) are a way to describe human facial movements (Ekman, Friesen, and Hager, 2002) [<a href="https://en.wikipedia.org/wiki/Facial_Action_Coding_System">wiki link</a>].&nbsp; More information on Py-Feat's implementation of AUs <a href="https://py-feat.org/pages/au_reference.html">can be found here</a>.</p> <ul> <li>145-150, 152-153, 155-158, 160-165. AU01, AU02, AU04, AU05, AU06, AU09, AU10, AU12, AU14, AU15, AU17, AU23, AU24, AU25, AU26, AU28, AU43 - Intensity of AU movement, range from 0 (no muscle&nbsp; contraction) to 1 (maximal muscle contraction).</li> <li>151, 154, 159. AU07, AU11, AU20 - Presence or absence of AUs, range 0 (absent, not detected) to 1 (present, detected).</li> </ul> <p><em>Columns 166-172 = Emotion classification confidence<br></em></p> <ul> <li>162-172. anger, disgust, fear, happiness, sadness, surprise, neutral - Confidence of classified emotion category, range 0 (0%) to 1 (100%) confidence.</li> </ul> <p><em>Columns 173-685 = Face identity score<br></em></p> <p>Identity of faces contained in the video were classified using the FaceNet model&nbsp;(<a href="https://arxiv.org/pdf/1503.03832">described here</a>). This procedure generates at 512 dimension Euclidean embedding space.</p> <ul> <li>173. Identity - Predicated individual identifyed in the RAVDESS video. Note, value is always Person_0, as each video only contains a single actor at all times (categorical).</li> <li>174-685. Identity_1, ..., Identity_512 - Face embedding vector used by FaceNet to perform facial identity matching.</li> </ul> <p><em>Column 686 = Input video<br></em></p> <ul> <li>686. frame - The number of the frame (source videos 29.97 fps), range = 1 to n</li> </ul> <p><em>Columns 687-688 = Timing information<br></em></p> <ul> <li>687. frame.1 - The number of the frame (source videos 29.97 fps), duplicated column, range = 1 to n</li> <li>688. approx_time - Approximate time of current frame (0.0 to x.x, in seconds)</li> </ul> <p><strong>Tracking videos<br></strong></p> <p>Landmark Overlay and Landmark Plot videos were produced with <code>plot_detections</code> function call (<a href="https://py-feat.org/pages/api.html?highlight=plot_detections#feat.data.Fex.plot_detections">described here</a>). This function generated invidual images for each frame, which were then compiled into a video using the imageio library (<a href="https://pypi.org/project/imageio/">described here</a>).</p> <p>AU Activation videos were produced with plot_face function call (<a href="https://py-feat.org/pages/api.html?highlight=plot_face#feat.plotting.plot_face">described here</a>). This function also generated invidual images for each frame, which were then compiled into a video using the imageio library. Some frames could not be correctly generated by Py-Feat, producing only the AU heatmap but failing to plot/locate facial landmarks. These frames were dropped prior to compositing the output video. Drop rate was approximately 10% of all frames, in each video. Dropped frames were distributed evenly across the video timeline (i.e. no apparent clustering).</p> <p><strong>License information</strong></p> <p>The RAVDESS Facial expression and landmark tracking data set is released under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, <a href="https://creativecommons.org/licenses/by-nc-sa/4.0/">CC BY-NA-SC 4.0</a>.</p> <p><strong>How to cite the RAVDESS Facial Tracking data set</strong></p> <p><em>Academic citation&nbsp;</em><br>If you use the RAVDESS Facial Tracking data set in an academic publication, please cite both references:&nbsp;</p> <ol> <li>Liao, Z., Livingstone, SR., &amp; Russo, FA. (2024). RAVDESS Facial expression and landmark tracking (Version 1.0.0) [Data set]. Zenodo. http://doi.org/10.5281/zenodo.13243600</li> <li>Livingstone SR, Russo FA (2018). The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE 13(5): e0196391. <a href="https://doi.org/10.1371/journal.pone.0196391">https://doi.org/10.1371/journal.pone.0196391</a>.</li> </ol> <p><em>All other attributions&nbsp;</em><br>If you use the RAVDESS Facial expression and landmark tracking dataset in a form other than an academic publication, such as in a blog post, data science project or competition, school project, or non-commercial product, please use the following attribution: "<a href="../records/13243600">RAVDESS Facial expression and landmark tracking</a>" by Liao, Livingstone, &amp; Russo is licensed under <a href="https://creativecommons.org/licenses/by-nc-sa/4.0/">CC BY-NA-SC 4.0</a>.</p> <p><strong>Related Data sets</strong></p> <ul> <li>The Ryerson Audio-Visual Database of Emotional Speech and Song [<a href="../record/1188976">Zenodo project page</a>].</li> </ul> <p>&nbsp;</p>

openAug 2024View details →
ClinicalTrials.gov24/100

Effect of Release of Upper Track of Deep Front Facial Line Versus Myofascial Release With IASTM on Patients With Upper Cross Syndrome

ClinicalTrials.gov study NCT06907459. IPD Sharing: Not stated. Countries: 0. Publications: 0.

restrictedIPD-UNDECIDEDFeb 2026View details →
ClinicalTrials.gov24/100

Facial Skin Health Tracking Feasibility in Breast Cancer Patients

ClinicalTrials.gov study NCT04035408. IPD Sharing: NO. Countries: 1. Publications: 0.

closedIPD-NOFeb 2026View details →
ClinicalTrials.gov24/100

Eye-Tracking FP "A Pilot Study of the Quantitative Evaluation of the Attention Paid to Faces With Facial Palsy by the Eye-tracking Technology.

ClinicalTrials.gov study NCT04886245. IPD Sharing: NO. Countries: 1. Publications: 0.

closedIPD-NOFeb 2026View details →

ScienceDex guides

Understand access before you commit

These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.

Compare curated datasets

Allen Brain Atlas

Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.

allen-brain-atlas
neuroscienceopenDocumentation, web resources, and API references are available online.
Last verified 2026-04-30Open record

Annotated Behaviour and Observability Dataset (ABODe)

ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.

abode-home-cage
behavioral-neuroscienceopenThe DataShare record exposes download links for annotations, documentation, license text, and the zipped per-snippet data directory.
Last verified 2026-04-30Open record

DANDI Archive for NWB datasets

DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.

dandi-nwb
electrophysiologyopenPublished Dandiset metadata and archive endpoints are available through the production DANDI API.
Last verified 2026-04-30Open record

International Brain Laboratory public data

The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.

ibl
behavioral-neuroscienceopenPublic sessions can be searched and loaded from the IBL public data server through ONE.
Last verified 2026-04-29Open record

OpenNeuro

OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.

openneuro
neuroscienceopenPublished datasets are available on demand over the internet.
Last verified 2026-04-29Open record