ETwins: Enhanced Twins Transformer for Facial Expression Recognition
ETwins: Enhanced Twins Transformer for Facial Expression Recognition
Ali Mohammad Pazandeh1 Emad Fatemizadeh2
1) Electrical Engineering Department, Sharif University of Technology, Tehran, Iran.
2) Electrical Engineering Department, Sharif University of Technology, Tehran, Iran.
IOI Code
:
XKBA-AZGCZD
Publication :
3rd International Conference on Recent Advances in Engineering, Innovation and Technology - Belgium(eitconf.com/3rd)
Abstract :
Facial expression recognition (FER) requires distinguishing between subtle visual differences, making it a challenging fine-grained classification task. This paper presents ETwins, an Enhanced Twins transformer architecture specifically tailored for facial expression recogniton. ETwins builds on the Twins vision transformer and incorporates three key improvements: a weighted global average pooling layer that emphasizes critical facial regions, the integration of a class token for capturing both local and global features, and an enhanced positional encoding mechanism to embed essential contextual information. Our evaluations on widely used FER datasets demonstrate that ETwins achieves improved accuracy compared to larger baseline models while using fewer parameters. This result underscores the efficiency of custom vision transformers for fine-grained tasks, achieving competitive FER performance with a compact, parameter-efficient design.
Keywords : facial expression recognition vision transformers fine grained image classification deep learning