Loading...
Search for: lipreading
0.135 seconds

    Design and Implementation of an Emotion Recognition and Expression System and Evaluation of Social Robots’ Effectiveness in Speech Therapy Interventions

    , Ph.D. Dissertation Sharif University of Technology Esfandbod, Alireza (Author) ; Meghdari, Ali (Supervisor) ; Taheri, Alireza (Supervisor) ; Alemi, Minoo (Co-Supervisor)
    Abstract
    Employing social robots in interactions with children for educational and healthcare objectives could enhance the efficiency of interventions and boost the children’s cognitive and affective outcomes by increasing engagement and providing motivation. This dissertation investigates three main subtopics to determine the efficacy of utilizing social robots in speech therapy sessions in interactions with children suffering from speech and language disorders. We hypothesize that interacting with social robots acting as therapists’ assistants in speech therapy interventions contributes to the formation of language-based communications and improves the individuals’ language skills. The first... 

    Designing an Automatic Lip-reading System for Persian Words Using Deep Neural Networks and Implementing it on Rasa Social Robot

    , M.Sc. Thesis Sharif University of Technology Gholipour, Amir (Author) ; Taheri, Alireza (Supervisor) ; Mohammadzadeh, Hoda (Supervisor)
    Abstract
    In Iranian Sign Language (ISL), alongside the movement of fingers, the movement of the lips is also essential for to perform words completely and correctly. The purpose of current study is to provide an automated lip-reading system using deep neural networks and implement it on Rasa social robot; So that the robot can recognize a limited number of specified Persian words. To do this, we propose an automated lip-reading system based on convolutional neural networks and long short-term memories. Convolutional neural networks in extracting features from images and long short-term memories in modeling temporal dynamics have achieved good results. We have also recorded a database in Persian...