Difference between revisions of "FR - Face Recognition"

From Idrive
Jump to navigation Jump to search
(Created page with "'''Face recognition systems identifies the driver of the vehicle and assigns all events to that particular driver.''' Also, this information is taken into consideration when c...")
 
Line 1: Line 1:
 
'''Face recognition systems identifies the driver of the vehicle and assigns all events to that particular driver.'''
 
'''Face recognition systems identifies the driver of the vehicle and assigns all events to that particular driver.'''
 +
 
Also, this information is taken into consideration when calculating the Event(s) scores.  
 
Also, this information is taken into consideration when calculating the Event(s) scores.  
 +
  
 
When the driver is recognized, The Camera can trigger a "Face Recognized" Event
 
When the driver is recognized, The Camera can trigger a "Face Recognized" Event
*this is an optional feature (the default settings are for this event to be disabled)
+
*This is an optional feature (the default settings are for this event to be disabled)
 
*The Event is uploaded on the idrive cloud system "iris" via cellular data by default
 
*The Event is uploaded on the idrive cloud system "iris" via cellular data by default
  
Line 16: Line 18:
 
The detection of the driver face is based on the selected "driving side" (IRIS->Fleet Manager-> Vehicles).
 
The detection of the driver face is based on the selected "driving side" (IRIS->Fleet Manager-> Vehicles).
  
+
::::::[[File:Driving side.png]]
 
 
1. Left driving side (is considered default) - Camera will perform a face detection over the whole image and will analyze the face closest to the edge of the part that the driver is supposed to be. That face is considered driver face if the median of the face is placed in the correct half of the driver selected position (see below).
 
 
 
 
 
 
 
 
 
2. Right driving side. Camera will perform a face detection over the whole image and will analyze the face closest to the edge of the part that the driver is supposed to be. That face is considered driver face if the median of the face is placed in the correct half of the driver selected position (see below).
 
 
 
 
 
 
 
 
 
 
 
 
 
  
  
 +
::1. '''Left driving side (is considered default)''' - The Camera will perform a Face Detection over the whole image and will analyze the face closest to the edge of the side that the driver is supposed to be. That face is considered driver face if the median of the face is placed in the correct half of the driver selected position (see below).
 +
::::::[[File:Valid left.png|362px]][[File:Invalid left.png|362px]]
  
  
3. Middle: This is a particular case when the camera will consider the detection closest to the center of the whole image
+
::2. Right driving side. Camera will perform a face detection over the whole image and will analyze the face closest to the edge of the part that the driver is supposed to be. That face is considered driver face if the median of the face is placed in the correct half of the driver selected position (see below).
 +
::::::[[File:Right invalid valid.png|732px]]
  
  
 +
::3. Middle: This is a particular case when the camera will consider the detection closest to the center of the whole image
 +
::::::[[File:Middle invalid valid.png|732px]]
  
  
  
 +
'''Face Recognition Process'''
  
Face recognition process
 
  
 
The face recognition process requires a cooperation from the fleet managers until the system learns all drivers faces but is does NOT require cooperation from the drivers.
 
The face recognition process requires a cooperation from the fleet managers until the system learns all drivers faces but is does NOT require cooperation from the drivers.

Revision as of 21:41, 8 July 2020

Face recognition systems identifies the driver of the vehicle and assigns all events to that particular driver.

Also, this information is taken into consideration when calculating the Event(s) scores.


When the driver is recognized, The Camera can trigger a "Face Recognized" Event

  • This is an optional feature (the default settings are for this event to be disabled)
  • The Event is uploaded on the idrive cloud system "iris" via cellular data by default


Face Recognition will be performed in the following circumstances:

  • At Ignition ON
  • When someone requests a Live Look in from a selected vehicle in iris>GPS Interface


Driver Face Detection

The detection of the driver face is based on the selected "driving side" (IRIS->Fleet Manager-> Vehicles).

Driving side.png


1. Left driving side (is considered default) - The Camera will perform a Face Detection over the whole image and will analyze the face closest to the edge of the side that the driver is supposed to be. That face is considered driver face if the median of the face is placed in the correct half of the driver selected position (see below).
Valid left.pngInvalid left.png


2. Right driving side. Camera will perform a face detection over the whole image and will analyze the face closest to the edge of the part that the driver is supposed to be. That face is considered driver face if the median of the face is placed in the correct half of the driver selected position (see below).
Right invalid valid.png


3. Middle: This is a particular case when the camera will consider the detection closest to the center of the whole image
Middle invalid valid.png


Face Recognition Process


The face recognition process requires a cooperation from the fleet managers until the system learns all drivers faces but is does NOT require cooperation from the drivers.

In case of face unrecognized, the camera will upload the detected face in Idrive Cloud (see image below). During a session (Ignition On / Ignition Off), the camera will upload maximum 3 faces in cloud.

The managers will have a section in the IRIS platform where they will be able to assign each face to a driver.


At the next request, the cloud will be able to recognize the driver. The camera will not upload the face anymore; instead will add the detected face in the camera storage together with the driver information obtained from cloud.


At the next ignition ON, the camera will try to recognize itself the driver by using the faces from the local storage (Idrive Cloud will become the second option).


Based on the above mechanism, each camera will be able to recognize all persons that are usually driving the car (in different conditions) and the cloud will not be used anymore.


When the recognition happens on the server, a template is sent to the server for analysis and then the response is sent back to the camera. The transactions delay can in rare cases lead to face recognition video events with an empty car or with another driver if the switches happened exactly after the recognition or the driver leaves the car exactly after the recognition.