zenodoopen

ROV-Based Multi-Sensor Dataset: Synchronized Camera and Sonar images taken in the Tropical Waters of the Red Sea, Eilat

Description: This dataset consists of approximately 46,928 synchronized image pairs collected by the  Blue-ROV2. The images were captured using a machine-vision camera (IDS UI-3260CP-C-HQ)  and a BluePrint Oculus M1200d Forward-Looking Sonar (FLS). Both sensors were installed with the FLS tilted 15 degrees downward to achieve optimal coverage of the terrain and optimal FOV overlap. The data was collected to train and evaluate a comprehensive perception and obstacle avoidance framework.   Context: This dataset is the second installment in our collection of synchronized multi-sensor underwater  datasets, aimed at enabling advanced research in multi-modal sensor fusion, obstacle  detection, and navigation for autonomous underwater vehicles (AUVs). The data was collected  using the Blue-ROV2 Remotely Operated Vehicle (ROV) in the tropical waters of the Red Sea,  off the coast of Eilat, Israel. This data captures diverse underwater environments and is part of a  research project focused on developing fusion models for improved obstacle detection and  navigation in AUVs.   Content: The data encompasses several sites within the tropical waters of the Red Sea, Eilat, including  corals, rocks, shipwrecks, man-made structures, piers, and caves. The ROV platform was  operated by divers, ensuring accurate positioning and coverage. Data was acquired at depths  ranging from 3 to 12 meters at different times from dawn to dusk.   Dataset Composition: <div> <table> <tbody> <tr> <td> Site </td> <td> Recording Session </td> <td> Image Pairs </td> <td> Description </td> </tr> <tr> <td> Tropical Site 1 </td> <td> 20221211_092506 20221211_133252 </td> <td> 10,915 7,978 </td> <td> Pier, rocks, corals </td> </tr> <tr> <td> Tropical Site 2 </td> <td> 20221212_095821 20221212_141308 </td> <td> 9,900 8,475 </td> <td> Man-made structure,  rocks, corals </td> </tr> <tr> <td> Tropical Site 3 </td> <td> 20221213_102542 </td> <td> 9,390 </td> <td> Rocks, corals </td> </tr> <tr> <td> Total </td> <td> </td> <td> 46,928  </td> <td> </td> </tr> </tbody> </table> </div>   The dataset is organized into separate sessions, each representing a specific dive or  experiment. Within each session, data is further categorized into modalities: camera (FLC  images), sonar (FLS images), and depth. Each modality directory contains the corresponding  data files in PNG format for images and CSV format for depth data.   Each modality directory includes: <ul> <li> A `camera.csv` file for the camera modality that maps each image file to its respective  timestamp. </li> <li> A `sonar.csv` file for the sonar modality that maps each image file to its respective timestamp. </li> <li> The depth data in `depth.csv` formatted with `timestamp` and `value`. </li> </ul> Additionally, a `samples.json` file documents the relationship between uni-modal and  multi-modal samples, enabling easy association of data from different modalities.   Technical Details: <ul> <li> Camera: IDS UI-3260CP-C-HQ </li> <ul> <li> Image dimensions: 1936x1216 pixels (downscaled to 968 × 608 for this dataset) </li> <li> Sensor type: Sony IMX249 1/1.2" CMOS </li> <li> Lens: Tamron M112FM06 </li> <li> Captured bit depth: 8-bit </li> <li> Frame rate: 5 Hz </li> </ul> <li> Sonar: BluePrint Oculus M1200d </li> <ul> <li> Operating frequency: 1.2 MHz (low frequency mode) </li> <li> Maximum range: 40 m (set to 15 m for this dataset) </li> <li> Horizontal aperture: 130° </li> <li> Vertical aperture: 20° </li> <li> Number of beams: 512 </li> <li> Angular resolution: 0.6° </li> <li> Beam separation: 0.25° </li> <li> Image resolution: 544x300 pixels </li> <li> Coordinate system: Polar </li> <li> Frame rate: 5 Hz </li> </ul> <li> Depth: Blue-Robotics Ping2 Sonar Altimeter and Echosounder </li> <ul> <li> Frequency: 115 kHz </li> <li> Source Level: 198 dB re 1µPa @ 1m </li> <li> Beamwidth: 25 degrees </li> <li> Typical Minimum Range: 0.3 m (1 ft) </li> <li> Typical Usable Range: 100 m (328 ft) </li> <li> Range Resolution: 0.5% of range </li> <li> Depth Rating: 300 m (984 ft) </li> <li> Data format: CSV </li> <li> Columns: </li> <ul> <li> timestamp: Unix timestamp (seconds) </li> <li> value: Depth value (meters) </li> </ul> <li> Sample rate: 5 Hz </li> </ul> </ul>   Example File Tree Layout: ``` ${session}/ ${dataset}/ camera/ camera.csv 00000001.png 00000002.png … sonar/ sonar.csv 00000001.png 00000002.png … depth/ depth.csv samples.json ``` Example File Content:  camera.csv ``` timestamp,filename 1644234340.181234,00000001.png 1644234343.375667,00000002.png ```  sonar.csv ``` timestamp,filename 1644234340.181234,00000001.png 1644234343.375667,00000002.png ```  depth.csv ``` timestamp,value 1644234340.181234,5.4 1644234343.375667,6.1 ```  samples.json ``` {     "samples": [         {             "camera": [                 0             ],             "depth": [                 0             ],             "sonar": [                 0             ]         },         {             "camera": [                 1             ],             "depth": [                 1             ],             "sonar": [                 1             ]         } ] ``` By providing synchronized and aligned camera, sonar imagery, and depth data, this dataset  enables researchers to explore novel algorithms and techniques for multi-modal sensor fusion in  the context of autonomous underwater vehicles operating in the tropical waters of the Red Sea. Acknowledgements The data in this repository is part of the DeeperSense project that received funding from the European Commission, Program H2020-ICT-2020-2 ICT-47-2020, Project Number: 101016958.

ShareScore

28/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship: 4
Harmonization: 4
Access: 16
Reuse readiness: 0
Engagement: 4