Welcome to Francis Academic Press

Frontiers in Art Research, 2025, 7(4); doi: 10.25236/FAR.2025.070411.

From Gesture to Voice: Advancing Human-Computer Interaction for the Deaf Community

Author(s)

Zichong Lu

Corresponding Author:
Zichong Lu
Affiliation(s)

The Hong Kong Polytechnic University, Hong Kong SAR, China

Abstract

This essay explores the future of interactive technology with a focus on sign language recognition as a vital means of communication for the deaf and hearing-impaired communities. It outlines the current state of sign language technologies, their limitations, and the significant challenges in achieving seamless human-computer interaction. By reviewing existing innovations such as smart sign language interpreter devices and AI-driven gesture recognition, the paper emphasises the transformative potential of these tools in everyday life, education, and public services. Moreover, it highlights the socio-economic impact of accessible communication technologies and calls for further interdisciplinary research and development. Through enhanced datasets, multimodal models, and ethical integration of artificial intelligence, the future holds the promise of more inclusive and human-centred interaction design.

Keywords

Sign language recognition; Human-computer interaction (HCI); Accessibility technology; Deaf communication; Artificial intelligence in assistive tech

Cite This Paper

Zichong Lu. From Gesture to Voice: Advancing Human-Computer Interaction for the Deaf Community. Frontiers in Art Research (2025), Vol. 7, Issue 4: 75-82. https://doi.org/10.25236/FAR.2025.070411.

References

[1] Murray, J. (2020). *World Federation of the Deaf*. http://wfdeaf.org/our-work/

[2] Tao, T., & Liu, T. (2022, December 14). A review of sign language recognition techniques based on sign language expression content and expression features. *Journal of Electronics and Information*, 1–19. http://kns.cnki.net/kcms/detail/11.4494.TN.20221107.1650.015.html [In Chinese]

[3] De Amorim, C. C., & Zanchettin, C. (2022). ASL Skeleton3D and ASL-phono: Two novel datasets for the American Sign Language. *arXiv preprint arXiv:2201.02065*.

[4] Bradley, J. V. (1978). Robustness? *British Journal of Mathematical and Statistical Psychology*, 31(2), 144–152.

[5] Mujahid, A., Awan, M. J., Yasin, A., Mohammed, M. A., Damaševičius, R., Maskeliūnas, R., & Abdulkareem, K. H. (2021). Real-time hand gesture recognition based on deep learning YOLOv3 model. *Applied Sciences*, 11(9), 4164. https://doi.org/10.3390/app11094164

[6] Rømen, D., & Svanæs, D. (2012). Validating WCAG versions 1.0 and 2.0 through usability testing with disabled users. *Universal Access in the Information Society*, 11(4), 375–385.

[7] Brajnik, G., Yesilada, Y., & Harper, S. (2010, October). Testability and validity of WCAG 2.0: The expertise effect. In *Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility* (pp. 43–50). https://doi.org/10.1145/1878803.1878813

[8] Kalyanathaya, K. P., Akila, D., & Rajesh, P. (2019). Advances in natural language processing – a survey of current research trends, development tools and industry applications. *International Journal of Recent Technology and Engineering*, 7(5C), 199–202.

[9] Bragg, D., Koller, O., Bellard, M., Berke, L., Boudreault, P., Braffort, A., ... & Ringel Morris, M. (2019, October). Sign language recognition, generation, and translation: An interdisciplinary perspective. In *Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility* (pp. 16–31). https://doi.org/10.1145/3308561.3353774

[10] Sobota, B., Korečko, Š., Hudák, M., Ondra, F., & Sivý, M. (2020, November). Disabled people and pictogram-text application with gesture recognition extension. In *2020 18th International Conference on Emerging eLearning Technologies and Applications (ICETA)* (pp. 640–645). IEEE. https://doi.org/10.1109/ICETA51985.2020.9379262

[11] Pfau, R., Steinbach, M., & Woll, B. (Eds.). (2012). *Sign language*. De Gruyter Mouton.

[12] Kyle, J. G., Kyle, J., Woll, B., Pullen, G., & Maddix, F. (1988). *Sign language: The study of deaf people and their language*. Cambridge University Press.

[13] Rastgoo, R., Kiani, K., & Escalera, S. (2021). Sign language recognition: A deep survey. *Expert Systems with Applications*, 164, 113794. https://doi.org/10.1016/j.eswa.2020.113794.