D4.1 A set of flexible modules for sensor data collection, integration and real-time processing Safe tolerance zone calculation and interventions for driver-vehicle-environment interactions under challenging conditions

Abstract

The i-DREAMS project aims at setting up a framework for the definition, development, testing and validation of a context-aware safety envelope for driving, called the ‘Safety Tolerance Zone’ (STZ). To accomplish this task, vehicles will have to be equipped with a suite of integrated technologies, applicable to modes of transport with different operational contexts, namely cars, heavy vehicles (buses and trucks), and rail transport (trains and trams). This deliverable describes the in-vehicle sensor technologies, that monitor the context, the operator, the vehicle and estimates the task complexity and coping capacity, and the system that will aggregate all the information and perform the real-time processing necessary to trigger the interventions to keep drivers in a safe driving zone. The central element of this platform is CardioGateway, an edge computing device with multiple communication interfaces and computing power for real-time processing of the data. The sensors that were selected are associated with each of monitoring the perspectives: a) driver state, b) driving task complexity, and c) driving performance. For the driver monitoring, two physiological sensor alternatives were considered: a steering wheel cover that acquires the ECG (CardioWheel), or a wearable, that acquires the PPG (PulseOn). For vehicle monitoring, and to allow compatibility between modes, CardioGW acquires inertial information and GPS. For trucks and buses, it also reads the FMS CAN information. The contextual information is obtained using Mobileye and a dash camera (CardioDashcam). The system includes a driver identification module to keep track of the identity of the drivers, which is especially relevant on vehicles with multiple drivers. It uses the intervention device as input, or in the case of professional vehicles, the FMS interface. The data upload is performed via 4G or Wi-Fi internet connection, allowing the synchronization of a local database with the cloud’s API. Several mechanisms and tools have been implemented to help verify the correct installation and functioning of the system, including a back-office platform and an Android application. The application is also used to document the installation procedure allowing to store evidence that the system was correctly installed and the vehicles were intact after the procedure.