• News
  • Spirituality
    • Dream Interpretation
    • Angel Numbers
    • Tarot
    • Prayers
    • Spells
  • Health
  • Science
  • Celebs
  • Betting

Emotion Recognition Using A Transformer-Based Model

1.3KShares
55.1KViews

A Transformer-based approach for processing electrocardiograms is practical for boosting emotion recognition ability.

The Transformer's attention processes may be utilized to create contextualized representations of a signal, assigning greater weight to pertinent sections.

A fully connected network can then look at these representations to determine how people feel.

A team of researchers headed by Juan Vazquez-Rodriguez and Grégoire Lefebvre from the University of Grenoble Alpes in France collected numerous ECG datasets with no emotion labels to pre-train a model they subsequently fine-tuned for emotion identification using the AMIGOS dataset.

They use self-supervised learning to overcome the relatively modest number of datasets containing emotional descriptors.

COPYRIGHT_SZ: Published on https://stationzilla.com/emotion-recognition/ by Alexander McCaslin on 2022-04-26T06:53:09.038Z

Their technique achieved state-of-the-art performance for emotion identification using ECG data on AMIGOS.

The research demonstrated that transformers and pre-training are potential ways of recognizing emotions using physiological information.

Binary Emotion Recognition

A downstream task of binary emotion detection (high/low levels of arousal and valence) was tested on ECG signals.

The datasets utilized were presented, preprocesses were applied, and two phases of pre-training and fine-tuning were parametrized.

In this dataset, 40 respondents saw films specifically designed to elicit feelings.

Following each video, they do a self-assessment of their emotional condition.

Subjects assessed their degrees of arousal and valence on a scale of 1 to 9.

37 of the 40 individuals viewed 20 videos, while the other three subjects only watched 16 films.

ECG data were collected on both the left and right arms throughout each experiment.

To fine-tune our model, we exclusively utilized data from the left arm.

AMIGOS contains a preprocessed version of the data that has been down-sampled to 128Hz and filtered using a low-pass filter with a cut-off frequency of 60Hz.

These pre-processed data sets were utilized in studies, including the pre-training phase.

The ECG data utilized for fine-tuning consists of around 65 hours of recordings.

Signal Pre-processing, Pre-training, And Fine-tuning

Signals were filtered using the 8th order Butterworth band-pass filter with 0.8Hz low and 50Hz high cut-off frequencies.

Pre-training the model on many datasets should reduce overfitting when fine-tuning one.

Moreover, the model without pretraining tended to overfit soon, but the pre-trained model did not.

These findings showed the value of pretraining Transformers.

The pre-trained model outperforms the untrained model inaccuracy and F1 score.

Instead of employing a pre-trained signal encoder, The researchers evaluated architecture by fine-tuning our model on AMIGOS with all parameters randomly initialized.

Since these evaluations yield arousal and valence ratings from 1 to 9, we utilize the average as a low or high threshold.

The dataset's emotional self-assessments were utilized as labels.

The model was fine-tuned using the AMIGOS dataset for emotion identification.

The receptive field size was chosen because it is equivalent to the usual ECG signal interval between peaks, 0.6-1s.

Thus, the receiver field is 113 input values or 0.88s.

The first layer and encoder output apply layer normalization.

The input encoder is a 3D-CNN with ReLU activation.

Both models have 83401 10-second segments pre-trained.

When testing our model using AMIGOS segments, we fine-tune the pre-trained model with the other half of AMIGOS.

Then two models were pre-trained, one utilizing half of the AMIGOS data and the other half.

Because AMIGOS was utilized for fine-tuning, the same segments could not be used for pretraining and evaluation.

For pretraining, they employ ASCERTAIN, DREAMER, PsPM-FR, PsPM-RRM1-2, PsPM-VIS, and AMIGOg.

Segments of 10 seconds are ultimately added.

Each subject's signal is normalized to have zero mean and unit variance.

ECG display
ECG display

Future Of Using Transformers For Emotion Recognition From ECG Signals

This study yielded a variety of viewpoints.

New pre-training tasks may be investigated; alternative approaches, such as contrastive loss or triplet loss, may be more efficient in ECG signal specificities than masked points prediction, which was employed in this study.

Extending this study to additional input modalities (EEC, GSR, and even non-physiological inputs like environmental sensors) and, in general, processing multimodal scenarios might be beneficial for boosting emotion identification ability.

Finally, bigger stmowith more data from different places will help us better understand how this method works.

Final Words

The researchers looked at using transformers to detect arousal and valence in ECG signals.

This technique employed self-supervised learning for pre-training using unlabeled data, followed by fine-tuning with labeled data.

The trials showed that the model generates robust features for predicting arousal and valence on the AMIGOS dataset and outperforms current state-of-the-art techniques.

This study showed that self-supervision and attention-based models, such as Transformers, may be effectively employed in emotion recognition research.

Share: Twitter | Facebook | Linkedin

About The Authors

Alexander McCaslin

Alexander McCaslin

Recent Articles

  • Khushi Mukherjee - An Indian Actress And Model, Who Works In Hindi TV Shows And Web Series

    Celebs

    Khushi Mukherjee - An Indian Actress And Model, Who Works In Hindi TV Shows And Web Series

    Actress Khushi Mukherjee hails from India. Modeling was where Khushi's profession got its start. Anjalaturai, the film in which she first appeared, was released in 2013. In 2017, she made her debut in the reality program MTV Splitsvilla Season 10, which was her first appearance on television.

  • Rudhraksh Jaiswal An Indian Film And Television Actor

    Celebs

    Rudhraksh Jaiswal An Indian Film And Television Actor

    In the realm of Indian entertainment, the young performer Rudhraksh Jaiswal is quickly becoming a prominent figure. His most notable collaboration was with the well-known Hollywood actor Chris Hemsworth in the most recent movie to be released on Netflix, which was titled "Extraction."

  • What Does A Red Moon Symbolize? Time To Let Go And Heal

    Spirituality

    What Does A Red Moon Symbolize? Time To Let Go And Heal

    Today in this article you will discuss what does a red moon symbolize. In essence, the term "blood moon" is just a poetic moniker for what is known as a "total lunar eclipse." Normally, the moon receives its shine from sunlight bouncing off of its surface, but during a lunar eclipse, the moon passes into the Earth's umbra, which is the region of shadow that is the deepest and most central.

  • What Does The Peacock Represent? Symbol For Power, Strength, Confidence, And Even Divinity

    Spirituality

    What Does The Peacock Represent? Symbol For Power, Strength, Confidence, And Even Divinity

    In this article you will learn about what does the peacock represent. People have long admired peacocks because they are flamboyant, captivating, and breathtakingly beautiful. These elaborate and vibrant birds are frequently connected to splendor, grandeur, and luxury.

  • Getting Fired In A Dream - A Sign Of Dissatisfaction

    Dream Interpretation

    Getting Fired In A Dream - A Sign Of Dissatisfaction

    Getting fired in a dream from a job entails losing credibility and self-assurance. Something you adore so much will be taken from you. To get there, you'll have to put in more effort. You could experience stress. Getting fired in a dream signifies rejection. In your romantic life, rejection will happen. The rejection of a proposal will put the love life on hold.

  • Dreams Of Being Paralyzed And Unable To Speak - Means That Your Freedom Is Threatened

    Dream Interpretation

    Dreams Of Being Paralyzed And Unable To Speak - Means That Your Freedom Is Threatened

    Your potential is represented by the dreams of being paralyzed and unable to speak. You must address a problem or issue destroying your sense of equilibrium and harmony while being more hospitable and less judgmental of others. Being immobilized in a dream represents your difficulties in achieving a goal.

  • Court Sentences Life Imprisonment To Indian Guru Asaram In Second Rape Case

    News

    Court Sentences Life Imprisonment To Indian Guru Asaram In Second Rape Case

    According to his attorney, on Tuesday, the Indian court sentences life imprisonment to Indian Guru Asaram for rape and sodomy. In his ashram in the western Indian state of Gujarat, Asaram was found guilty of abusing the lady on many occasions between 2001 and 2006.

  • What Do Hiccups Symbolize? Mean You're Under A Curse Or Spell

    Spirituality

    What Do Hiccups Symbolize? Mean You're Under A Curse Or Spell

    In this article, you will learn about what do hiccups symbolize. The worst are the hiccups. You appear to have halted for a brief moment, remaining calm and steady. Your stomach reacts abruptly by contracting in some way. You feel it before you hear it: a swift, uncontrollable jerk followed by a loud popping noise made by your vocal cords vibrating as a result of your diaphragm.

  • Dream About Being Pregnant Christian Meaning - A Sign Of The Love Of God

    Dream Interpretation

    Dream About Being Pregnant Christian Meaning - A Sign Of The Love Of God

    In general, dream about being pregnant christian meaning is positive. While it might be a positive omen for all expectant mothers. One of every woman's regular prayers is to have a child. In actuality, the child is the soul of a marriage. To some extent, dreaming of becoming pregnant can have a positive meaning if you are currently pregnant.

  • What Does It Mean To See A Black Squirrel?

  • What Do Bananas Symbolize In The Bible?

  • Coping With Insomnia And Why Does It Happen?

  • Raajeshwari Sachdev - An Indian Television And Film Actress

  • Alice Kaushik - An Indian Model And Actress Who Is Known For Playing The Role Of Ravi In Television Series