Audio-Visual and Heart Signals for Attention and Emotion Analysis - Université Polytechnique des Hauts-de-France Access content directly
Conference Papers Year : 2020

Audio-Visual and Heart Signals for Attention and Emotion Analysis


The paper proposes a theoretical architecture model to analyze human emotion and attention. This model is basedon the concept of dissonances defined as conflicts between individual, collective, or organizational knowledgeas attention or emotion. The detection or the control of such abnormalities can produce negative emotions asdiscomfort, overload, stress, or misunderstanding, but both detection and control can be disrupted by inattention.Two studies motivated the proposed architecture. The first one concerns the Reverse Comic Strip to analyze feelingfeedback regarding emotional facial pictures and by reproducing thoughts with words. The second one concernsthe impact of the synchronization of alarms with heartbeats on attention. The theoretical model consists then inidentifying negative emotions due to a dissonance occurrence by being inspired by the Reverse Comic Strip supportto treat audio-visual signals from a subject, and takes into account the synchronization of dynamic events with theirheart rate that can affect attention and their human perception abilities
No file

Dates and versions

hal-03406166 , version 1 (27-10-2021)



Ilyes Bendjoudi, Denis Hamad, Frédéric Vanderhaegen, Fadi Dornaika. Audio-Visual and Heart Signals for Attention and Emotion Analysis. ESREL 2020 PSAM 15 -The 30th European Safety and Reliability Conference and the 15th Probabilistic Safety Assessment and Management Conference, Nov 2020, Venise, Italy. pp.2795-2801, ⟨10.3850/978-981-14-8593-0_4966-cd⟩. ⟨hal-03406166⟩
25 View
0 Download



Gmail Facebook X LinkedIn More