About the Project

The advancement of technology in education, particularly for sign languages (SLs), can be transformative not only for learners, but also for educators. A SL teaching system that integrates explainable visual feedback and machine learning (ML) holds significant promise in enhancing the quality and effectiveness of SL teaching methodologies. This is especially crucial for training special education students, a group that plays a pivotal role in the educational journey of the Deaf and hard of hearing community.

VISTA-SL aims to protect the fundamental right of the Deaf to have access to SLs in their communication and to promote their dignity and their unique culture.

The VISTA-SL project is implemented within the Erasmus+ programme.

Objectives

• O1. Mitigate scarcity of SL teachers by developing teaching tools including (a) real-time visual feedback using AR and avatars, and (b) course personalization and coaching through a large-language-model based virtual instructor.
• O2. Promote inclusion and diversity by developing SL curricula and games in four EU languages.
• O3. Promote accessibility via an e-learning platform that includes the above tools and curricula, and is accessible at minimal cost.
• O4. Disseminate and plan exploitation.

Implementation

• I1. Development of software for AR and avatar - based visual feedback, LLM-based virtual instructor, course personalization, and e-learning platform.
• I2. Development of learning curricula and games by educators and SL- linguists in four EU languages.
• I3. Six transnational managerial and technical meetings.
• I4. Five multiplier events in different countries to connect with local and EU stakeholders and other dissemination actions.
• I5. Training activities for educators and technical staff.

Results

• R1. Requirements analysis and design documents for SL teaching tools.
• R2. Open source software tools/reports/guides for AR and avatar - based visual feedback, LLM-based virtual instructor, course personalization and e-learning platform.
• R3. Open interactive learning curricula and games in 4 EU SLs, that promote inclusion and mitigate lack of SL teachers.
• R4. Evaluation reports by different groups of users and stakeholders.
• R5. Scientific papers, workshops, multiplier events, policy development.