Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3650400.3650454acmotherconferencesArticle/Chapter ViewAbstractPublication PageseitceConference Proceedingsconference-collections
research-article

Intelligent Customer Service System Based on Speech Emotion Recognition

Authors Info & Claims
Published:17 April 2024Publication History

ABSTRACT

In real-life scenarios, artificial customer service is capable of accurately recognizing customer feedback emotions. However, it faces limitations in terms of working hours and high costs. While intelligent customer service can handle most tasks, it lacks the ability to perceive real-time changes in user emotions through tone, thus affecting the overall user experience. Considering these social pain points, this paper proposes the use of Support Vector Machine (SVM) algorithm for Speech Emotion Recognition. By extracting ten distinct speech features and applying classification techniques, the results indicate that the model achieves an accuracy rate of 90%. The system consists of both hardware and software components. When the system detects user input data, it autonomously analyzes the emotions and generates a radar chart as the result. Human and machine customer service representatives utilize the emotion recognition results to develop a tailored solution for the user. A mobile application displays the detection results and provides specific solutions based on different emotions. In addition to its application in intelligent customer service and other smart interactive domains, this system can also be applied in various fields such as healthcare and transportation safety.

References

  1. Li, Y., Tao, J., Schuller, B., Shan, S., Jiang, D., & Jia, J. 2018, May. Mec 2017: Multimodal emotion recognition challenge. In 2018 First Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia) (pp. 1-5). IEEE.Google ScholarGoogle Scholar
  2. Stappen, L., Baird, A., Christ, L., Schumann, L., Sertolli, B., Messner, E. M., ... & Schuller, B. W. 2021. The MuSe 2021 multimodal sentiment analysis challenge: sentiment, emotion, physiological-emotion, and stress. In Proceedings of the 2nd on Multimodal Sentiment Analysis Challenge (pp. 5-14)Google ScholarGoogle Scholar
  3. Koolagudi, S. G., & Rao, K. S. 2012. Emotion recognition from speech: a review. International journal of speech technology, 15, 99-117.Google ScholarGoogle Scholar
  4. Dileep, A. D., & Sekhar, C. C. 2013. GMM-based intermediate matching kernel for classification of varying lengt patterns of long duration speech using support vector machines. IEEE Transactions on Neural Networks and Learning Systems, 25(8), 1421-1432.Google ScholarGoogle Scholar
  5. Deng, L., & Yu, D. 2014. Deep learning: methods and applications. Foundations and trends® in signal processing, 7(3–4), 197-387.Google ScholarGoogle Scholar
  6. Wöllmer, M., Metallinou, A., Eyben, F., Schuller, B., & Narayanan, S. 2010. Context-sensitive multimodal emotion recognition from speech and facial expression using bidirectional lstm modeling.Google ScholarGoogle Scholar
  7. Niu, Y., Zou, D., Niu, Y., He, Z., & Tan, H. 2017. A breakthrough in speech emotion recognition using deep retinal convolution neural networks. arXiv preprint arXiv:1707.09917.Google ScholarGoogle Scholar
  8. Ramakrishnan, S., & El Emary, I. M. 2013. Speech emotion recognition approaches in human computer interaction. Telecommunication Systems, 52, 1467-1478.Google ScholarGoogle Scholar
  9. B. Yang and M. Lugger, “Emotion recognition from speech signals using new harmony features,” Signal Process., vol. 90, pp. 1415–1423, 2010.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Zepf, S., Hernandez, J., Schmitt, A., Minker, W., & Picard, R. W. 2020. Driver emotion recognition for intelligent vehicles: A survey. ACM Computing Surveys (CSUR), 53(3), 1-30.Google ScholarGoogle Scholar
  11. Albudoor, N., & Peña, E. D. 2022. Identifying language disorder in bilingual children using automatic speech recognition. Journal of Speech, Language, and Hearing Research, 65(7), 2648-2661.Google ScholarGoogle Scholar

Index Terms

  1. Intelligent Customer Service System Based on Speech Emotion Recognition

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      EITCE '23: Proceedings of the 2023 7th International Conference on Electronic Information Technology and Computer Engineering
      October 2023
      1809 pages
      ISBN:9798400708305
      DOI:10.1145/3650400

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 17 April 2024

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate508of972submissions,52%
    • Article Metrics

      • Downloads (Last 12 months)9
      • Downloads (Last 6 weeks)9

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format