Synaptic Plasticity-Inspired Neuromorphic Deep Learning for Real-Time Recognition of Micro-Expressions in Neurodivergent Individuals

Authors

  • Munam Javaid Department of Computer Science and Software Engineering, National University of Sciences and Technology, Islamabad, Pakistan
  • Jamshaid Basit Department of Computer Science and Software Engineering, National University of Sciences and Technology, Islamabad, Pakistan
  • Ayesha Arshad Department of Computer Science and Software Engineering, National University of Sciences and Technology, Islamabad, Pakistan

DOI:

https://doi.org/10.51846/vol7iss4pp173-182

Keywords:

Micro-Expression Recognition, Neuromorphic Deep Learning, CNN-LSTM Model, Synaptic Plasticity, Neurodiverse Emotional Interpretation

Abstract

Identification of micro-expressions is crucial for interpreting small signals displaying emotions, particularly in neurodiverse individuals who may struggle with ordinary social signs. This paper comes with a brand-new neuromorphic deep learning model that can recognize microexpressions in real-time and has synaptic plasticity. This model was not previously available for this particular population. Given a set of micro-expressions labeled images, we implemented a Conventional Neural Networks-Long Short Term Memory (CNN-LSTM) model, which integrates CNN and LSTM as they capture not only spatial patterns in the facial expression but also temporal sequence. Our outcomes show that our proposed approach has an accuracy of over 90% in predicting micro-expressions, which is much higher than conventional Machine Learning methodologies. Furthermore, we confirm its accuracy across various lighting conditions and subjects, demonstrating excellent generalization for practical use. We find that our model not only enhances recognition abilities but also aids in addressing affective and emotional understanding in a neurodivergent population. In conclusion, this study presents a new way to use neuromorphic deep learning to recognize microexpressions in real-time. This could be useful in psychological research, therapy, and improving social skills.

Downloads

Published

2024-12-31

How to Cite

[1]
M. Javaid, J. Basit, and A. Arshad, “Synaptic Plasticity-Inspired Neuromorphic Deep Learning for Real-Time Recognition of Micro-Expressions in Neurodivergent Individuals”, PakJET, vol. 7, no. 4, pp. 173–182, Dec. 2024.

Issue

Vol. 7 No. 4 (2024)

Section

Research Articles

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

COPYRIGHT POLICY

UOL journals follow an open-access publishing policy and full text of all articles is available free, immediately upon acceptance. Articles are published and distributed under the terms of the CC BY-SA 4.0 International License. Thus, work submitted to UOL Journals implies that it is original, unpublished work of the authors; neither published previously nor accepted/under consideration for publication elsewhere. 

Authors will be responsible for any information written/informed/reported in the submitted manuscript. Although we do not require authors to submit the data collection documents and coded sheets used to do quantitative or qualitative analysis, we may request it at any time during the publication process, including after the article has been published. It is author's responsibility to obtain signed permission from the copyright holder to use and reproduce text, illustrations, tables, etc., published previously in other journals, electronic or print media.

Conflict of interest statements will be published at the end of the article. If no conflict of interest exists, the following sentence will be used: "The authors declare no conflict of interest." Authors are required to disclose any sponsorship or funding received from any institution relating to their research. The editor(s) will determine what disclosures, if any, should be available to the readers.

Authors are not permitted to post the work on any website/blog/forum/board or at any other place, by any means, from the time such work is submitted to UOL journals until the final decision on the paper has been given to them. In case a paper is accepted for publication, the authors may not post the work in its entirety on any website/blog/forum/board or at any other place, by any means, till the paper is published in UOL Journals.

The authors may, however, post the title, authors’ names and their affiliations and abstract, with the following statement on the first page of the paper - "The manuscript has been accepted for publication in UOL Journals". After publication of the article, it may be posted anywhere with full journal citation included.

All articles published in UOL journals are open-access articles, published and distributed under the terms of the Creative Commons Attribution-ShareAlike 4.0 International License which permits remixing, transformation, or building upon the material, provided the original work is appropriately cited mentioning the authors and the publisher, as well as the produced work is distributed under the same license as the original.

In the future, UOL may reproduce printed copies of articles in any form. Without prejudice to the terms of the license given below, we retain the right to reproduce author's articles in this way.

Brief Summary Of The License Agreement

By submitting your research article(s) to UOL Journal(s), you agree to Creative Commons Attribution-ShareAlike 4.0 International License which states that:

Anyone is free:

o To copy and redistribute the material in any medium or format
o To remix, transform, or build upon the material for any purpose, even commercially

Provided:

o The author and the publisher have been appropriately credited
o The link to license is provided
o Indicated if any changes were made
o The material produced is distributed under the same license as the original

 

Most read articles by the same author(s)