Skip to main content
ConductScienceScienceDex
zenodoopen

Benchmarking data on worker reactions to triggering events

<p>1. Real-world Benchmarking Data</p> <p>The objective of this task was to determine if Virtual Reality-based captured behavioral data on responses to notifications are similar to what is expected in real-world settings.&nbsp;For this purpose, a&nbsp;real-world bench mark experiment was designed to capture&nbsp;participant&nbsp;response times to wearable watch alarms triggered upon simulated traffic near&nbsp;the&nbsp;mobile work zone on the experiment site&nbsp;in an urban setting.&nbsp;The proposed scope of data collection of the real-world study included the external environmental factors (e.g., site accessibility, weather). The key parameters of research are&nbsp;defined as reaction time to received alarms and the heart rate measures. Table 1&nbsp;provides the list of parameters that were controlled and measured during the experiments.</p> <table align="center"> <caption>Table 1. Key parameters measured and tracked during real-world experiments</caption> <tbody> <tr> <td>&nbsp;</td> <td>Variable name</td> <td>Descriptions</td> </tr> <tr> <td>Key parameters captured</td> <td>Reaction time</td> <td>The time that one takes from getting the haptic or sound alarm from a wearable alarm device, herein referring to the apple watch, to the point when the participant gives a response by stopping the alarm by pressing on the screen of the smartwatch</td> </tr> <tr> <td>&nbsp;</td> <td>Inter-beat interval (IBI, heart rate)</td> <td>The time interval between individual beats of the heart; the data is measured by using E4 application provided by Empatica</td> </tr> <tr> <td>External factors tracked</td> <td>Ambient noise</td> <td>The level of ambient noise in the area is a factor potentially influencing participants&rsquo; reactions and is considered in the experiment design</td> </tr> <tr> <td>&nbsp;</td> <td>Temperature</td> <td>Daytime temperature recorded at each experiment</td> </tr> <tr> <td>&nbsp;</td> <td>Number of pedestrians on site</td> <td>Number of participants counted during the time of the experiment to record on the varying factors in the external environment in real-world settings</td> </tr> </tbody> </table> <p><br> In the experiment, each participant was asked to participate in the experiment three&nbsp;times. In each trial, data was recorded separately for each alarm sent to smartwatch from the administrator at triggering events (precisely, every time the remote-controlled toy car reaches the line 30 ft apart from the designated work area). Each alarm signal at each&nbsp;trial was recorded for all 31 participants to the experiment.&nbsp;Timestamps are automatically recorded in server in&nbsp;the events recorded in the format of&nbsp;Table 2:&nbsp;</p> <table align="center"> <caption>Table 2. Format of raw data stored in the server, starting in December 2022.</caption> <tbody> <tr> <td>&nbsp;</td> <td>Timestamp</td> <td>From</td> <td>Event</td> </tr> <tr> <td>0</td> <td>2022-12-08 13:37:53.101391&nbsp; &nbsp; &nbsp;&nbsp;</td> <td>VR</td> <td>Received car approaching alert, mode=3, id=1000</td> </tr> <tr> <td>1</td> <td>2022-12-08 15:53:05.098288</td> <td>Watch</td> <td>Start Simulation</td> </tr> <tr> <td>2</td> <td>2022-12-08 15:53:07.437488&nbsp; &nbsp;</td> <td>VR</td> <td>Received car approaching alert, mode=4, id=1004</td> </tr> <tr> <td>3</td> <td>2022-12-08 15:53:13.064067</td> <td>Watch</td> <td>Stop Simulation</td> </tr> <tr> <td>4</td> <td>2022-12-08 15:53:13.163635</td> <td>Watch</td> <td>Stop Simulation</td> </tr> <tr> <td>...</td> <td>&nbsp;</td> <td>&nbsp;</td> <td>&nbsp;</td> </tr> <tr> <td>2417</td> <td>2023-03-03 16:17:46.166644</td> <td>Watch</td> <td>1398</td> </tr> <tr> <td>2418</td> <td>2023-03-03 16:18:00.004425</td> <td>Watch</td> <td>1398</td> </tr> <tr> <td>2419</td> <td>2023-03-03 16:18.01.272071</td> <td>Watch</td> <td>1398</td> </tr> <tr> <td>2420</td> <td>2023-03-03 16:18:07.359187</td> <td>Watch</td> <td>Stop Simulation</td> </tr> <tr> <td>2421</td> <td>2023-03-03 16:18:07.388183&nbsp;</td> <td>Watch</td> <td>Stop Simulation</td> </tr> </tbody> </table> <p>Some intervals used different timestamps as benchmarks to calibrate on the vehicle speed and user response time to the alarm signals, which include the following cases:&nbsp;</p> <p>1) At the beginning of each trial, vehicle travels 70 ft from start point to the 30 ft apart point, when the first alarm is signaled; given this travel distance, the travel time of the first trip the toy vehicle makes is calculated by subtracting tn_alarm1_sent from tn_start.</p> <p>2) Similarly, user response times to all alarms are recorded by subtracting the timestamps when the alarm is received by participant from when the alarm is sent from the server. (tn_alarmn_sent - tn_alarmn_received)</p> <p>&nbsp;</p> <p>2. Supplementary Data</p> <p>Ambient noise level data were collected using a noise meter, allowing to save&nbsp;noise level by&nbsp;seconds to multiple seconds (i.e., 5, 10, 30, 60 seconds). All noise data recorded were recorded in&nbsp;the interval of one second using the meter.<br> The collected data was processed to match the certain timestamps collected for&nbsp;user response time data collected in the experiment to allow comparisons and correlation analysis to be performed later on, which include the following: 1) worker response; 2) sending of alarm signals; 3) start and stop of experiments.<br> All data points were later modified using the rolling mean function of pandas python module to replace the missing data points by moving average method.&nbsp;&nbsp;</p>

ShareScore

32/100

Overall dataset sharing score

Score breakdown

These five areas show where the dataset supports — or may limit — practical reuse.

Stewardship
8
Harmonization
4
Access
16
Reuse readiness
4
Engagement
0

Topics

Dataset details

Repository
zenodo
Published
May 31, 2023
License
cc-by-4.0
DOI
10.5281/zenodo.7996349

Scored with release 0.9.0

ScienceDex for faculty

Your academic CV and NIH biosketch

Make your CV in your school's format and your NIH biosketch from it, then download both as Word files.