FR - Face Recognition

From Idrive
Jump to navigation Jump to search

Face recognition systems identifies the driver of the vehicle and assigns all events to that particular driver.

Also, this information is taken into consideration when calculating the Event(s) scores.


When the driver is recognized, The Camera can trigger a "Face Recognized" Event

  • This is an optional feature (the default settings are for this event to be disabled)
  • The Event is uploaded on the idrive cloud system "iris" via cellular data by default


Face Recognition will be performed in the following circumstances:

  • At Ignition ON
  • When someone requests a Live Look in from a selected vehicle in iris>GPS Interface


Driver Face Detection

The detection of the driver face is based on the selected "driving side" (IRIS->Fleet Manager-> Vehicles).

Driving side.png


1. Left driving side (is considered default)
  • The Camera will perform a Face Detection over the whole image
  • and will analyze the face closest to the edge of the side that the driver is expected
  • that face is considered the driver face if the median of the face is placed in the correct half of the driver selected position (see below).
Valid left.pngInvalid left.png


2. Right driving side
  • Camera will perform a face detection over the whole image
  • and will analyze the face closest to the edge of the part that the driver is expected
  • that face is considered driver face if the median of the face is placed in the correct half of the driver selected position (see below).
Right invalid valid.png


3. Middle: This is a particular case when the camera will consider the detection closest to the center of the whole image
Middle invalid valid.png



Face Recognition Process

The face recognition process requires a cooperation from the fleet managers until the system learns all drivers faces but it does NOT require cooperation from the drivers.

In case of face unrecognized, the camera will upload the detected face in Idrive Cloud (see image below).

During a session (Ignition On / Ignition Off), the camera will upload maximum 3 faces to the idrive cloud.

Fr process 1.png


The managers have a section in the iris platform where they will be able to assign each face to a driver.

Unrec driver.png


At the next request, the idrive cloud will be able to recognize the driver.

The camera will not upload the face anymore; instead will add the detected face in the camera storage together with the driver information obtained from idrive cloud. Unrec driver 2.png


At the next ignition ON, the camera will try to recognize the driver itself using the faces from the local storage (Idrive Cloud will become the second option). Unrec driver 3.png


Based on the above mechanism:

  • each camera will be able to recognize all persons that are usually driving the car (in different conditions)
  • and the cloud will not be used anymore


When the recognition happens on the server:

  • a template is sent to the server for analysis and then the response is sent back to the camera
  • the transactions delay can in rare cases lead to face recognition video events with an empty car or with another driver
  • if the driver switch happened exactly after the recognition or the driver leaves the car exactly after the recognition (then the below event could take place)

Rec driver .png