Find research datasets worth reusing
Search datasets from major research repositories and use ShareScore to quickly assess how well each record supports discovery, access, and reuse.
63
datasets available to search
ShareScore release 0.9.0
Dataset results
63 results for “pose estimation”
DeepLabCut: markerless pose estimation of user-defined body parts with deep learning
<p>This data entry contains <strong>annotated mouse data from the <a href="https://www.nature.com/articles/s41593-018-0209-y">DeepLabCut Nature Neuroscience paper</a></strong>.</p> <p>This data entry contains a public release of annotated mouse data from the DeepLabCut paper. The trail-tracking behavior is part of an investigation into odor guided navigation, where one or multiple wildtype (C57BL/6J) mice are running on a paper spool and following odor trails. These experiments were carried out by Alexander Mathis & Mackenzie Mathis in the Murthy lab at Harvard University. </p> <p>Data was recorded by two different cameras (640×480 pixels with Point Grey Firefly (FMVU-03MTM-CS), and at approximately 1,700×1,200 pixels with Grasshopper 3 4.1MP Mono USB3 Vision (CMOSIS CMV4000-3E12)) at 30 Hz. The latter images were cropped around mice to generate images that are approximately 800×800. </p> <p>Here we share 1066, frames from multiple experimental sessions observing 7 different mice. Pranav Mamidanna labeled the snout, the tip of the left and right ear as well as the base of the tail in the example images. The data is organized in <a href="https://www.nature.com/articles/s41596-019-0176-0">DeepLabCut 2.0 project structure</a> with images and annotations in the labeled-data folder. The names are pseudocodes indicating mouse id and session id, e.g. m4s1 = mouse 4 session 1.</p> <p>Code for loading, visualizing & training deep neural networks available at <a href="http://https://github.com/DeepLabCut/DeepLabCut"> https://github.com/DeepLabCut/DeepLabCut</a>.</p>
Spacecraft Pose Estimation Dataset (SPEED)
<p>The SPEED dataset is the official dataset of <strong>ESA's Kelvins</strong> <strong>"Pose Estimation challenge" </strong>in collaboration<strong> with Stanford Universitiy's Space Rendezvous Lab (SLAB)</strong>. It features images and poses of the Tango spacecraft (PRISMA mission), 12000 of them generated by SLAB's Optical Simulator using a high fidelity texture model and 300 images from the TRON facility, using a physical mock-up model of Tango.</p> <p>The goal of the competition was estimate the relative pose (distance and orientation) from pixel images only.</p> <ul> <li>Detailed information about the original competition can be found at <a href="https://kelvins.esa.int/satellite-pose-estimation-challenge/">https://kelvins.esa.int/satellite-pose-estimation-challenge/</a></li> <li>A follow-up competition with a larger and improved dataset <strong>(SPEED+)</strong> is available on Zenodo as well: <a href="https://zenodo.org/record/5588480">https://zenodo.org/record/5588480</a></li> </ul> <p>A publication about the results of the pose estimation challenge has been published as</p> <ul> <li>Kisantal, Mate, et al. "Satellite pose estimation challenge: Dataset, competition design, and results." <em>IEEE Transactions on Aerospace and Electronic Systems</em> 56.5 (2020): 4083-4098.</li> </ul>
MC-hands-1M: A glove-wearing hand dataset for pose estimation
<p>We introduce MC-hands-1M, a synthetic glove-wearing hand dataset for pose estimation. In the zip folder, there exist two subfolders: one containing roughly 750K images (Big set) and another with 250K images (Small set) along with the 2D camera plane and 3D world ground truth data of the corresponding poses. Each set is organized in folders named as Rendered View X, representing a specific camera in the 3D space with a fixed rotation and location. In each of those folders, there exist a json file containing corresponding data for the camera (location, rotation, intrinsics' matrix and images' relative paths) along with the aforementioned ground truth per image (pose). For each of those views, there exist other subfolders named as Scene 's Collection 's Objects' States' Combination Y. Each of those folders contains images of the different poses from the set camera view, given a different combination of background, lighting, glove- and cloth-like materials, and hand's a priori scaling state.</p><p>!!!!! IMPORTANT NOTE !!!!!</p><p>After some testing, an error in the ground truth of the small set of images was found. Please use only the big set found in the zip. For further instructions and questions, please contact us at prod@iti.gr.</p>
3D Stereo Body Pose Estimation - Evaluation Plots
<p>Evaluation plots for the "3D Stereo Body Pose Estimation" project, aimed at estimating 3d keypoints from humans captured using a OAK-D camera.</p> <p>The project is originated in the context of the activities of the postgraduate course IA904 - Model Project in Visual Computing, offered in the first semester of 2024, at Unicamp, under the supervision of Prof. Dr. Leticia Rittner and Prof. Paula D. Paro Costa, both from the Department of Computer and Automation Engineering (DCA) of the Faculty of Electrical and Computer Engineering (FEEC).</p> <p>The <a href="https://github.com/Disciplinas-FEEC/IA904-2024S1/tree/main/projetos/3DStereoBodyPoseEstimation">project page</a> have a full description of the project (portuguese).</p>
SEENIC: dataset for Spacecraft posE Estimation with NeuromorphIC vision
<p>Dataset used in the paper "Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing" (<a href="https://doi.org/10.48550/arXiv.2209.11945">arXiv</a>, <a href="https://ieeexplore.ieee.org/document/10160531">IEEE Xplore</a>), for the purpose of satellite pose estimation with an event camera.</p> <p>Both events and ground truth camera poses were captured across the 20 scenes in total. There are two trajectories, five lighting configurations and two camera speeds. All combinations of trajectory type, speed and lighting configuration were enumerated for capture. Sample event frames and dataset statistics are available in the paper linked above, along with our pose estimation method used on this dataset.</p> <p> </p> <p>Live-capture scene names use the following encoding: {satellite model}-{trajectory}-{speed}-{lighting configuration}</p> <p>The calibration scene (calibration.tar.gz) includes multiple views of a chessboard used to calibrate the camera intrinsics and extrinsics for the live-capture scenes. Camera parameters calibrated using this scene can be found in the <strong>calib.txt</strong> file, with the format: fx fy cx cy k1 k2 p1 p2 k3.</p> <p> </p> <p>All <strong>live-capture</strong> scenes have the same data format:</p> <p>scene/</p> <p> poses/ -- Raw timestamped robot gripper to base transforms</p> <p> cam-poses.csv -- Ground truth camera poses with the format {timestamp, Rx, Ry, Rz, x, y, z}</p> <p> events.csv -- Event stream with the format {timestamp, x, y, polarity (0=off, 1=on)}</p> <p> meta.json -- Metadata file with camera frame dimensions</p> <p>Note: all timestamps are in microseconds.</p> <p> </p> <p>The <strong>synthetic</strong> scene (synthetic.tar.gz) has the following data format:</p> <p>synthetic/</p> <p> poses/ -- Sequential poses captured at a constant time interval</p> <p> events.txt -- Event stream with the format: time (float s), x, y, polarity (0=off, 1=on) as specified at <a href="https://rpg.ifi.uzh.ch/davis_data.html">https://rpg.ifi.uzh.ch/davis_data.html</a></p> <p> camera_intrinsics.txt -- The camera intrinsic matrix (space separated)</p> <p>Note: please refer to the paper referenced below for further details on using this synthetic scene.</p> <p> </p> <p><strong>When using the data in an academic context, please cite the following paper.</strong></p> <pre>@INPROCEEDINGS{10160531, author={Jawaid, Mohsi and Elms, Ethan and Latif, Yasir and Chin, Tat-Jun}, booktitle={2023 IEEE International Conference on Robotics and Automation (ICRA)}, title={Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing}, year={2023}, volume={}, number={}, pages={11866-11873}, keywords={Adaptation models;Satellites;Pose estimation;Lighting;Robot sensing systems;Robustness;Data models}, doi={10.1109/ICRA48891.2023.10160531} }</pre>
replicAnt - Plum2023 - Pose-Estimation Datasets and Trained Models
<p>This dataset contains all recorded and hand-annotated as well as all synthetically generated data as well as representative trained networks used for semantic and instance segmentation experiments in the<em> replicAnt - generating annotated images of animals in complex environments using Unreal Engine</em> manuscript. Unless stated otherwise, all 3D animal models used in the synthetically generated data have been generated with the open-source photgrammetry platform scAnt <a href="http://peerj.com/articles/11155/">peerj.com/articles/11155/</a>. All synthetic data has been generated with the associated replicAnt project available from <a href="https://github.com/evo-biomech/replicAnt">https://github.com/evo-biomech/replicAnt</a>.</p> <p><strong>Abstract:</strong></p> <p>Deep learning-based computer vision methods are transforming animal behavioural research. Transfer learning has enabled work in non-model species, but still requires hand-annotation of example footage, and is only performant in well-defined conditions. To overcome these limitations, we created replicAnt, a configurable pipeline implemented in Unreal Engine 5 and Python, designed to generate large and variable training datasets on consumer-grade hardware instead. replicAnt places 3D animal models into complex, procedurally generated environments, from which automatically annotated images can be exported. We demonstrate that synthetic data generated with replicAnt can significantly reduce the hand-annotation required to achieve benchmark performance in common applications such as animal detection, tracking, pose-estimation, and semantic segmentation; and that it increases the subject-specificity and domain-invariance of the trained networks, so conferring robustness. In some applications, replicAnt may even remove the need for hand-annotation altogether. It thus represents a significant step towards porting deep learning-based computer vision tools to the field.</p> <p><strong>Benchmark data</strong></p> <p>Two pose-estimation datasets were procured. Both datasets used first instar <em>Sungaya nexpectata</em> (Zompro 1996) stick insects as a model species. Recordings from an evenly lit platform served as representative for controlled laboratory conditions; recordings from a hand-held phone camera served as approximate example for serendipitous recordings in the field. </p> <p>For the platform experiments, walking <em>S. inexpectata</em> were recorded using a calibrated array of five FLIR blackfly colour cameras (Blackfly S USB3, Teledyne FLIR LLC, Wilsonville, Oregon, U.S.), each equipped with 8 mm c-mount lenses (M0828-MPW3 8MM 6MP F2.8-16 C-MOUNT, CBC Co., Ltd., Tokyo, Japan). All videos were recorded with 55 fps, and at the sensors’ native resolution of 2048 px by 1536 px. The cameras were synchronised for simultaneous capture from five perspectives (top, front right and left, back right and left), allowing for time-resolved, 3D reconstruction of animal pose.<br> <br> The handheld footage was recorded in landscape orientation with a Huawei P20 (Huawei Technologies Co., Ltd., Shenzhen, China) in stabilised video mode: <em>S. inexpectata </em>were recorded walking across cluttered environments (hands, lab benches, PhD desks etc), resulting in frequent partial occlusions, magnification changes, and uneven lighting, so creating a more varied pose-estimation dataset.<br> <br> Representative frames were extracted from videos using DeepLabCut (DLC)-internal k-means clustering. 46 key points in 805 and 200 frames for the platform and handheld case, respectively, were subsequently hand-annotated using the DLC annotation GUI.</p> <p><strong>Synthetic data</strong></p> <p>We generated a synthetic dataset of 10,000 images at a resolution of 1500 by 1500 px, based on a 3D model of a first instar <em>S. inexpectata </em>specimen, generated with the <a href="https://peerj.com/articles/11155/"><em>scAnt</em> photogrammetry workflow</a>. Generating 10,000 samples took about three hours on a consumer-grade laptop (6 Core 4 GHz CPU, 16 GB RAM, RTX 2070 Super). We applied 70\% scale variation, and enforced hue, brightness, contrast, and saturation shifts, to generate 10 separate sub-datasets containing 1000 samples each, which were combined to form the full dataset.</p> <p><strong>Funding</strong></p> <p>This study received funding from Imperial College’s President’s PhD Scholarship (to Fabian Plum), and is part of a project that has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation program (Grant agreement No. 851705, to David Labonte). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</p>
Synthetic data (Part 2) for HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields
<p>#############</p> <p>HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields, CVPR 2024</p> <p>#############</p> <p>Haozhe Qi, Chen Zhao, Mathieu Salzmann, Alexander Mathis.</p> <p>Affiliation: EPFL</p> <p>Date: June, 2024</p> <p>Link to the CVPR article: https://openaccess.thecvf.com/content/CVPR2024/papers/Qi_HOISDF_Constraining_3D_Hand-Object_Pose_Estimation_with_Global_Signed_Distance_CVPR_2024_paper.pdf</p> <p>Link to the Arxiv article: https://arxiv.org/abs/2402.17062</p> <p>--------------------------------</p> <div> <div>Here we provide the data of our article "HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields". It contains the rendered images and the segmentation masks that we use to train our model on HO3Dv2 dataset. </div> <br> <div>The overall structure of the data is:</div> <br> <div>├── <a href="../api/records/13228003/draft/files/render_sdf_ho3d.zip/content" target="_blank" rel="noopener noreferrer">render_sdf_ho3d.zip</a> - Contains the rendered images for HO3Dv2.</div> <div> </div> <br> <div>The code to reproduce the results is available at: https://github.com/amathislab/HOISDF</div> <div> </div> <div>--------------------------------</div> </div> <p>If you find our code, weights, predictions or ideas useful, please cite:</p> <p>@inproceedings{qi2024hoisdf,<br> title={HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields},<br> author={Qi, Haozhe and Zhao, Chen and Salzmann, Mathieu and Mathis, Alexander},<br> booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},<br> pages={10392--10402},<br> year={2024}<br>}</p>
Synthetic data (Part 1) for "HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields"
<p>#############</p> <p>HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields, CVPR 2024</p> <p>#############</p> <p>Haozhe Qi, Chen Zhao, Mathieu Salzmann, Alexander Mathis.</p> <p>Affiliation: EPFL</p> <p>Date: June, 2024</p> <p>Link to the CVPR article: https://openaccess.thecvf.com/content/CVPR2024/papers/Qi_HOISDF_Constraining_3D_Hand-Object_Pose_Estimation_with_Global_Signed_Distance_CVPR_2024_paper.pdf</p> <p>Link to the Arxiv article: https://arxiv.org/abs/2402.17062</p> <p>--------------------------------</p> <div> <div>Here we provide the data of our article "HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields". It contains the preprocessed SDF samples. Meanwhile, we also include rendered data for HO3Dv2 here. </div> <br> <div>The overall structure of the data is:</div> <br> <div>├── <a href="../api/records/13228003/draft/files/render_sdf_ho3d.zip/content" target="_blank" rel="noopener noreferrer">render_sdf_ho3d.zip</a> - Contains the processed SDF files for HO3Dv2 rendered images.</div> <div>├── <a href="../api/records/13228003/draft/files/train_ho3d.zip/content" target="_blank" rel="noopener noreferrer">train_ho3d.zip</a> - Contains the processed SDF files for HO3Dv2 training set.</div> <div>├── <a href="../api/records/13228003/draft/files/full_test_dexycb.zip/content" target="_blank" rel="noopener noreferrer">full_test_dexycb.zip</a> - Contains the processed SDF files for DexYCB full test set.</div> <div> </div> <br> <div>The code to reproduce the results is available at: https://github.com/amathislab/HOISDF</div> <div> </div> <div>--------------------------------</div> </div> <p>If you find our code, weights, predictions or ideas useful, please cite:</p> <p>@inproceedings{qi2024hoisdf,<br> title={HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields},<br> author={Qi, Haozhe and Zhao, Chen and Salzmann, Mathieu and Mathis, Alexander},<br> booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},<br> pages={10392--10402},<br> year={2024}<br>}</p>
Processed data and trained models for "HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields"
<p>#############</p> <p>HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields, CVPR 2024</p> <p>#############</p> <p>Haozhe Qi, Chen Zhao, Mathieu Salzmann, Alexander Mathis.</p> <p>Affiliation: EPFL</p> <p>Date: June, 2024</p> <p>Link to the CVPR article: <a href="https://openaccess.thecvf.com/content/CVPR2024/papers/Qi_HOISDF_Constraining_3D_Hand-Object_Pose_Estimation_with_Global_Signed_Distance_CVPR_2024_paper.pdf">https://openaccess.thecvf.com/content/CVPR2024/papers/Qi_HOISDF_Constraining_3D_Hand-Object_Pose_Estimation_with_Global_Signed_Distance_CVPR_2024_paper.pdf</a></p> <p>Link to the Arxiv article: <a href="https://arxiv.org/abs/2402.17062">https://arxiv.org/abs/2402.17062</a></p> <p>--------------------------------</p> <div> <div>Here we provide the data of our article "HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields". It contains the preprocessed data of the interacting objects and SDF samples. Meanwhile, we also include the trained model weights here.</div> <br> <div>The overall structure of the data is:</div> <br> <div>├── <a href="../api/records/11668766/draft/files/ckpts.zip/content" target="_blank" rel="noopener noreferrer">ckpts.zip</a> - Contains the trained weights model on different datasets (DexYCB and HO3Dv2)</div> <div>├── <a href="../api/records/11668766/draft/files/annotations.zip/content" target="_blank" rel="noopener noreferrer">annotations.zip</a> - Contains the preprocessed annotations of DexYCB and HO3Dv2 for efficient data loading.</div> <div>├── <a href="../api/records/11668766/draft/files/simple_ycb_models.zip/content" target="_blank" rel="noopener noreferrer">simple_ycb_models.zip</a> - Contains the preprocessed YCB objects for batched evaluation.</div> <div>├── <a href="../api/records/11668766/draft/files/test.zip/content" target="_blank" rel="noopener noreferrer">test.zip</a> - Contains the processed SDF files for DexYCB test set.</div> <div>├── <a href="https://zenodo.org/api/records/14190951/draft/files/ho3d_release.zip/content" target="_blank" rel="noopener noreferrer">ho3d_release.zip</a> - Contains the HO3Dv2 submission trained with HO3D training set.</div> <div>├── <a href="https://zenodo.org/api/records/14190951/draft/files/ho3d_render_release.zip/content" target="_blank" rel="noopener noreferrer">ho3d_render_release.zip</a> - Contains the HO3Dv2 submission trained with HO3D training set and rendering set.</div> <div> </div> <br> <div>The code to reproduce the results is available at: <a href="https://github.com/amathislab/HOISDF">https://github.com/amathislab/HOISDF</a></div> <div> </div> <div>--------------------------------</div> </div> <p>If you find our code, weights, predictions or ideas useful, please cite:</p> <p>@inproceedings{qi2024hoisdf,<br> title={HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields},<br> author={Qi, Haozhe and Zhao, Chen and Salzmann, Mathieu and Mathis, Alexander},<br> booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},<br> pages={10392--10402},<br> year={2024}<br>}</p>
DoPose: dataset for object segmentation and 6D pose estimation
<p>DoPose (Dortmund Pose)is a dataset of highly cluttered and closely stacked objects. The dataset is saved in the <a href="https://github.com/thodan/bop_toolkit/blob/master/docs/bop_datasets_format.md">BOP format</a>. The dataset includes RGB images, Depth images, 6D Pose of objects, segmentation mask (all and visible), COCO Json annotation, camera transformations, and 3D model of all objects. The dataset contains 2 different types of scenes (table and bin). Each scene contains different view angles. For the bin scenes, the data contains 183 scenes with 2150 image views. In those 183 scenes 35 scenes contain 2 views, 20 contains 3 views and 128 contains 16 views. And for table scenes, the data contains 118 scenes with 1175 image views. in Those 118 scenes, 20 scenes contain 3 views, 50 scenes with 6 images, and 48 scenes with 17 images. So in total, our data contains 301 scenes and 3325 view images. Most of the scenes contain mixed objects. The dataset contains 19 objects in total.</p> <p>For more info about the dataset content and collection process please refer to our <a href="https://arxiv.org/abs/2204.13613">Arxiv preprint</a></p> <p>If you have any questions about the dataset, please contact <strong>anas.gouda@tu-dortmund.de</strong></p>
Validating marker-less pose estimation with 3D x-ray radiography
<p class="MsoNormal"><span>These data were generated to evaluate the accuracy of DeepLabCut (DLC), a deep learning marker-less motion capture approach, by comparing it to a 3D x-ray video radiography system that tracks markers placed under the skin (XROMM). We recorded behavioral data simultaneously with XROMM and RGB video as marmosets foraged and reconstructed three-dimensional kinematics in a common coordinate system. We used XMALab to track 11 XROMM markers, and we used the toolkit Anipose to filter and triangulate DLC trajectories of 11 corresponding markers on the forelimb and torso. We performed a parameter sweep of relevant Anipose and post-processing parameters to characterize their effect on tracking quality. We compared the median error of DLC+Anipose to human labeling performance and placed this error in the context of the animal's range of motion. </span></p>
Goat-CNN: A Lightweight Convolutional Neural Network for Pose-Independent Body Condition Score Estimation in Goats
<p>Here we introduce the dataset utilized in our published paper entitled "<a href="https://www.sciencedirect.com/science/article/pii/S2666154324002114">Goat-CNN: A Lightweight Convolutional Neural Network for Pose-Independent Body Condition Score Estimation in Goats</a>".</p> <p>Contained within the "bcs" folder are all the videos collected for this study. Each video file is named with a format denoting its respective details. The first number signifies the sequence of collection, the second denotes the ear tag, and the final figure represents the body condition score (BCS) value.</p> <p>For example: "1_158734_2.50" indicates the first sampling of an animal with the ear tag "158734" and a BCS value of "2.50".</p> <p>Additionally, we provide two Python scripts in this repository. The first script, "Video2Frame.py", facilitates the splitting of videos into individual frames. The second script, "Frames2npy.py", converts these frames into two numpy-friendly files with the extension ".npy". These files contain both the images ("X_train_bcs300.npy") and their corresponding labels ("Y_train_bcs300.npy").</p> <p>Furthermore, for the convenience of swift experimentation, we have included the desired .npy files within the repository.</p> <p>To load these files into your Python environment, you can use the following code snippet:</p> <div> <div>th4figs = '/content/drive/MyDrive/compag_2023/'</div> <br> <div>path4images = "/content/drive/MyDrive/CodeRefarm/datasets/BCS/X_train_bcs300.npy"</div> <div>Xtrain = np.load(path4images)</div> <br> <div>path4labels = "/content/drive/MyDrive/CodeRefarm/datasets/BCS/Y_train_bcs300.npy"</div> <div>Ytrain = np.load(path4labels).astype(float)</div> <br> <div>print("X train : ", Xtrain.shape)</div> <div>print("Y train : ", Ytrain.shape)</div> <div> <div> <div> <div> <div> <div> <div> </div> </div> <div> </div> </div> </div> </div> </div> <div> <div> <div> <div> <div> <div> <div> <div> <pre>X train : (5332, 300, 300, 3) Y train : (5332,)<br> </pre> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div>
Pose Selector Workflow - Docking Poses, Absolute Binding Free Energy Estimates and Structure Input Files for Machine Learning
<p>The Pose Selector (PS) workflow calculates absolute binding free energies (ABFEs) for binding poses of protein-ligand complexes. First, it converts the binding poses (both docking poses as well as experimentally observed ligand binding poses), which are provided as a combination of protein PDB file and ligand MOL2 file, into input files for molecular dynamics (MD) simulations with GROMACS after they have passed extensive quality checks and repair steps. Next, the PS workflow post-processes and analyses the last frame of the resulting eight 100 ps trajectories per binding pose with the Generalised Born model of implicit solvation as implemented in gmx_MMPBSA to obtain the ABFE estimates. The workflow was designed for soluble proteins without post-translational modifications, co-factors and non-standard amino acids, and it has limited support for coordinated ions.</p> <p>For the dataset published here, the PS workflow was run on docking poses generated for the PDBbind 2020 dataset (http://www.pdbbind.org.cn/index.php), shared in dockingPosesPDBBind2020.tar.gz. This entry and its partner entry 10.5281/zenodo.11397486 also share the intial coordinates used in the MD simulations of >800,000 docking poses of 4022 protein-ligand complexes (structureFiles_dockingPoses1.tar.gz in this entry and structureFiles_dockingPoses2.tar.gz in 10.5281/zenodo.11397486) and of the experimental ligand binding pose of 4549 complexes (structureFiles_experimentalStructures.tar.gz) as well as the corresponding ABFE estimates (absoluteBindingFreeEnergyEstimates.tar.gz). The MD simulations were run on the LUMI and MeluXina supercomputers while the implicit-solvent calculations were carried out on Galileo (Cineca).</p> <p>The README file describes the structure of the shared data in more detail and points out how to reproduce the MD trajectories and the subsequent implicit-solvent calculations yielding the free-energy estimates as well as how to use the data provided in this entry to train a machine-learning model predicting the ABFE of binding poses of protein-ligand complexes. The workflow scripts can be downloaded from GitHub (https://github.com/LigateProject/Pose-Selector-workflow). The MD simulations were run with GROMACS 2023.2 (https://manual.gromacs.org/2023.2/index.html), and the implicit-solvent calculations were carried out with gmx_MMPBSA 1.6.1 (https://valdes-tresanco-ms.github.io/gmx_MMPBSA/v1.6.1/).</p>
YCB-M: A Multi-Camera RGB-D Dataset for Object Recognition and 6DoF Pose Estimation
<p>While a great variety of 3D cameras have been introduced in recent years, most publicly available datasets for object recognition and pose estimation focus on one single camera. This dataset consists of 32 scenes that have been captured by 7 different 3D cameras, totaling 49,294 frames. This allows evaluating the sensitivity of pose estimation algorithms to the specifics of the used camera and the development of more robust algorithms that are more independent of the camera model. Vice versa, our dataset enables researchers to perform a quantitative comparison of the data from several different cameras and depth sensing technologies and evaluate their algorithms before selecting a camera for their specific task. The scenes in our dataset contain 20 different objects from the common benchmark YCB object and model set. We provide full ground truth 6DoF poses for each object, per-pixel segmentation, 2D and 3D bounding boxes and a measure of the amount of occlusion of each object.</p> <p>If you use this dataset in your research, please cite the following publication:</p> <p>T. Grenzdörffer, M. Günther, and J. Hertzberg, “YCB-M: A Multi-Camera RGB-D Dataset for Object Recognition and 6DoF Pose Estimation,” in <em>2020 IEEE International Conference on Robotics and Automation, ICRA 2020, Paris, France, May 31-June 4, 2020</em>. IEEE, 2020.</p> <pre><code>@InProceedings{Grenzdoerffer2020ycbm, title = {{YCB-M}: A Multi-Camera {RGB-D} Dataset for Object Recognition and {6DoF} Pose Estimation}, author = {Grenzd{\"{o}}rffer, Till and G{\"{u}}nther, Martin and Hertzberg, Joachim}, booktitle = {2020 {IEEE} International Conference on Robotics and Automation, {ICRA} 2020, Paris, France, May 31-June 4, 2020}, year = {2020}, publisher = {{IEEE}} }</code></pre> <p>This paper is also available on arXiv: <a href="https://arxiv.org/abs/2004.11657">https://arxiv.org/abs/2004.11657</a></p> <p> </p> <p>To visualize the dataset, follow these instructions (tested on Ubuntu Xenial 16.04):</p> <pre><code class="language-bash"># IMPORTANT: the ROS setup.bash must NOT be sourced, otherwise the following error occurs: # ImportError: /opt/ros/kinetic/lib/python2.7/dist-packages/cv2.so: undefined symbol: PyCObject_Type # nvdu requires Python 3.5 or 3.6 sudo add-apt-repository -y ppa:deadsnakes/ppa # to get python3.6 on Ubuntu Xenial sudo apt-get update sudo apt-get install -y python3.6 libsm6 libxext6 libxrender1 python-virtualenv python-pip # create a new virtual environment virtualenv -p python3.6 venv_nvdu cd venv_nvdu/ source bin/activate # clone our fork of NVIDIA's Dataset Utilities that incorporates some essential fixes pip install -e 'git+https://github.com/mintar/Dataset_Utilities.git#egg=nvdu' # download and transform the meshes # (alternatively, unzip the meshes contained in the dataset # to <path to venv_nvdu>/lib/python3.6/site-packages/nvdu/data/ycb/aligned_cm) nvdu_ycb -s # run nvdu_viz to visualize the dataset cd <a subdirectory of the YCB-M dataset with some frames> nvdu_viz --name_filters '*.jpg' </code></pre> <p>For further details, see README.md.</p>
Poses of People in Art: A Data Set for Human Pose Estimation in Digital Art History
<p>Throughout the history of art, the pose—as the holistic abstraction of the human body's expression—has proven to be a constant in numerous studies. However, due to the enormous amount of data that so far had to be processed by hand, its crucial role to the formulaic recapitulation of art-historical motifs since antiquity could only be highlighted selectively. This is true even for the now automated estimation of human poses, as domain-specific, sufficiently large data sets required for training computational models are either not publicly available or not indexed at a fine enough granularity. With the <em>Poses of People in Art</em> data set, we introduce the first openly licensed data set for estimating human poses in art and validating human pose estimators. It consists of 2,454 images from 22 art-historical depiction styles, including those that have increasingly turned away from lifelike representations of the body since the 19<sup>th</sup> century. A total of 10,749 human figures are precisely enclosed by rectangular bounding boxes, with a maximum of four per image labeled by up to 17 keypoints; among these are mainly joints such as elbows and knees. For machine learning purposes, the data set is divided into three subsets—training, validation, and testing—, that follow the established JSON-based Microsoft COCO format, respectively. Each image annotation, in addition to mandatory fields, provides metadata from the art-historical online encyclopedia WikiArt.</p>
HoloSet - A Dataset for Visual-Inertial Pose Estimation in Extended Reality
<p>HoloSet was published at DATA'22 workshop at ACM SenSys'22. <br> <br> Overview: There is a lack of datasets for visual-inertial odometry applications in Mixed Reality (MR). To the best of our knowledge, there is no dataset available that is captured from an MR headset with a human as a carrier. To bridge this gap, we present a novel pose estimation dataset — called HoloSet — collected using Microsoft Hololens 2, which is a state-of-the-art head mounted device for XR. Potential applications for HoloSet include visual-inertial odometry, simultaneous localization and mapping (SLAM), and additional applications in XR that leverage visual-inertial data.</p> <p>HoloSet captures both macro and micro movements. For macro movements, the dataset consists of more than 66,000 samples of visual, inertial, and depth camera data in a variety of environments<br> (indoor, outdoor) and scene setups (trails, suburbs, downtown) under multiple user action scenarios (walk, jog). For micro movements, the dataset consists of more than 12,000 samples of additional articulated hand depth camera images while a user plays games that exercise fine motor skills and hand-eye coordination. We present basic visualizations and high-level statistics of the data and outline the potential research use cases for HoloSet.<br> <br> Please find the relevant publication at https://dl.acm.org/doi/abs/10.1145/3560905.3567763. </p>
Validating marker-less pose estimation with 3D x-ray radiography
Open the record for dataset details and reuse information.
mRI: multi-modal 3d human pose estimation dataset using mmwave, rgb-d, and inertial sensors
<p>The ability to estimate 3D human body pose and movement, also known as human pose estimation~(HPE), enables many applications for home-based health monitoring, such as remote rehabilitation training. Several possible solutions have emerged using sensors ranging from RGB cameras, depth sensors, millimeter-Wave (mmWave) radars, and wearable inertial sensors. Despite previous efforts on datasets and benchmarks for HPE, few datasets exploit multiple modalities and focus on home-based health monitoring.</p> <p>To bridge this gap, we present <em>mRI</em>, a multi-modal 3D human pose estimation dataset with mmWave, RGB-D, and Inertial Sensors. Our dataset consists of over 5 million frames from 20 subjects performing rehabilitation exercises and supports the benchmarks of HPE and action detection. We perform extensive experiments using our dataset and delineate the strength of each modality.</p> <p>We hope that the release of <em>mRI</em> can catalyze the research in pose estimation, multi-modal learning, and action understanding, and more importantly, facilitate the applications of home-based health monitoring.</p>
Multi-modal pose estimation in XR applications leveraging integrated sensing and communication: Dataset
<p>This dataset refers to paper Multi-modal pose estimation in XR applications leveraging integrated sensing and communication in workshop of ACM Mobicom. CSI of 3 people performing a set of 8 poses. This dataset contain discrete classes and corresponding CSI data. Kinect poses can be found here (https://github.com/nisarnabeel/multi-modal-pose-estimation-CSI-mmWave).</p> <p> </p> <p>Abstract: Mobile extended reality (XR) applications are anticipated to generate substantial traffic for 6G. Such applications not only require high data rate and low-latency transmissions, but also accurate and real-time pose estimation to enable interactive and immersive experiences. While sub-6 GHz signals have been exploited for pose estimation, they cannot cope up with multi-gigabit data rates required by XR applications. Instead, mobile communications at mmWave frequencies can potentially support data rates up to several giga-bits per second (Gbps) and, therefore, can be used to deliver XR content wirelessly to the Head-Mounted Display (HMD). Moreover, mmWave frequencies can offer improved sensing due to the large available bandwidth. Therefore, mmWave communications can play a crucial role in enabling device-free interactivity by offering both high-speed communication and accurate sensing capabilities. However, mmWave propagation characteristics are different from sub-6 GHz. Path loss plays a significant role, and can lead to degraded sensing performance. Therefore, our proposal supplements wireless sensing at mmWave frequencies with wireless electromyography (EMG) armbands. By capturing patterns of muscle activities, we can counteract the limitations of mmWave-based pose estimation, thereby enriching the granularity and precision of pose estimation. This paper proposes a conceptual architecture to achieve multi-modal pose estimation for XR applications. Early results highlight the shortcomings of mmWave-based sensing, and we identify future steps and opportunities on integration of both approaches.</p>
INTELLIMAN_WP2_Application Requirements and Integration_T2.4_Fresh food handling use case analysis, integration and validation_Apple 6D pose estimation dataset_v0
<p>The dataset contains the data generated for the training of the 6D pose estimation neural network<br>DOPE related to the publication:<br>M. Costanzo, M. De Simone, S. Federico, C. Natale and S. Pirozzi, "Enhanced 6D Pose Estimation for<br>Robotic Fruit Picking," 2023 9th International Conference on Control, Decision and Information<br>Technologies (CoDIT), Rome, Italy, 2023, pp. 901-906, doi: 10.1109/CoDIT58514.2023.10284072.</p>
ScienceDex guides
Understand access before you commit
These curated guides explain access requirements, typical timelines, costs, and reuse considerations for widely used research datasets.
Allen Brain Atlas
Allen Brain Atlas is an Allen Institute collection of brain map atlases, datasets, APIs, and analysis tools covering mouse, human, and non-human primate brain resources.
Annotated Behaviour and Observability Dataset (ABODe)
ABODe is a University of Edinburgh DataShare dataset for behavior classification in group-housed mice using home-cage video, identities, bounding boxes, ground-plate positions, and annotator labels.
DANDI Archive for NWB datasets
DANDI is a BRAIN Initiative archive for publishing and sharing neurophysiology data, including electrophysiology, optophysiology, and behavioral data packaged as NWB and related standards.
International Brain Laboratory public data
The International Brain Laboratory public data releases expose standardized mouse decision-making experiments, including Neuropixels recordings, widefield calcium imaging, behavior, and session metadata accessed through the ONE API.
OpenNeuro
OpenNeuro is a free, open platform for sharing neuroimaging datasets, with public search, dataset pages, and download paths for web, S3, DataLad, and the OpenNeuro CLI.