EASIER

30. Juli 2020

EASIER ist ein Horizon 2020-Projekt, dessen Ziel der Entwurf, die Entwicklung und die Validierung eines vollständigen Systems zur mehrsprachigen maschinellen Übersetzung ist, welches einen Rahmen für die barrierefreie Kommunikation zwischen tauben und hörenden Menschen bietet, sowie eine Plattform bereitstellt, um die Erstellung von Inhalten in Gebärdensprache zu unterstützen.

Das Projekt setzt auf eine starke Einbindung der Endnutzer:innen in Design, Entwicklung und Evaluation der EASIER-Plattform, in der Nutzer:innen verschiedener europäischer Gebärden- und Lautsprachen ihre bevorzugte Sprache für die Interaktion untereinander verwenden werden können.

Das Projektkonzept basiert auf einer einzigartigen Kombination von technologischen Gebärdensprachressourcen und Fachwissen aus der Gebärdensprachlinguistik. Dies ermöglicht die Nutzung einer robusten datengetriebenen Maschinerie zur Gebärdenspracherkennung, die Einbindung eines gebärdenden Avatars, der Merkmale der Grammatik und Prosodie von Gebärdensprachen integriert und so das fortschrittlichste synthetische Gebärden bietet, welches derzeit möglich ist, sowie modernste maschinelle Übersetzungstechnologie, die sowohl mit annotierten als auch nicht annotierten Daten arbeitet, um eine breite Palette von Anwendungsgebieten zu unterstützen.

Gebärdensprachcomputerlinguistik

Marc Schulder

Wissenschaftlicher Mitarbeiter für Computerlinguistik

Meine Forschungsinteressen umfassen Gebärdensprachen, Computerlinguistik und Open Science.

Publikationen

Corpus à la carte – Improving Access to the Public DGS Corpus

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

This article presents the fourth release of the Public DGS Corpus, a large corpus of German Sign Language (DGS). Since its first release in 2018, the Public DGS Corpus has provided its content through multiple portals to meet the needs of different user groups. Having started with a community portal and a research portal for general data access, the ANNIS portal for dynamic web-based exploration of the corpus was added in 2022. With this latest release, a fourth portal is added to allow sign language linguists to access the public corpus directly through the annotation software iLex. Furthermore, search capabilities and interconnectedness between the portals are strongly improved, allowing users to move between portals to combine their strengths. Additional improvements to the corpus include additional recordings, new pose information models, improved HamNoSys, enhanced type information and web interface revisions.

Reiner Konrad, Thomas Hanke, Amy Isard, Marc Schulder, Lutz König, Julian Bleicken, Oliver Böse

Signs and Synonymity: Continuing Development of the Multilingual Sign Language Wordnet

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

The Multilingual Sign Language Wordnet is the first publicly available wordnet resource for sign languages. It is a growing multilingual resource providing data for eight sign languages to date. During the initial phase of its creation, the focus lay on producing the infrastructure to support various languages and to produce initial sets of content for them. This article represents the start of the second phase, in which the focus is moved to establishing overlapping coverage across the different sign languages. Building on the data produced so far, a new feature to assist annotation is introduced which leverages established partial synonymy between signs (inter- and cross-lingually) to discover likely additional synonymies. Other improvements to the annotation interface and workflow build directly on the experiences from the first phase. Working with the updated annotation interface, new data is produced for Polish Sign Language, Greek Sign Language and Swedish Sign Language.

Marc Schulder, Sam Bigeard, Maria Kopf, Thomas Hanke, Anna Kuder, Joanna Wójcicka, Johanna Mesch, Thomas Björkstrand, Anna Vacalopoulou, Kyriaki Vasilaki, Theodoros Goulas, Athanasia-Lida Dimou, Stavroula-Evita Fotinea, Eleni Efthimiou

Statistical data from video processing other European SL datasets

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

EASIER has established a pipeline for processing datasets from European sign languages beyond those covered by the consortium, with the aim of providing pose analysis as an important entry point for data science on sign language resources. While discussions with third parties on using this service took place and are still ongoing, no data processing happened before the end of the project. Accordingly, there are no statistical data to report. Instead, the report analyses why no such uses have taken place.

Thomas Hanke, Marc Schulder

Extended Interlingual Index for the Project's Core Sign Languages and Languages covered in Work Package 9

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

The purpose of the interlingual index is to link the lexical resources of the sign languages of the project. This is the final project release of the index, which covers both the core sign languages of the project as well as additional sign languages.

Sam Bigeard, Maria Kopf, Marc Schulder, Thomas Hanke, Kiriaki Vasilaki, Anna Vacalopoulou, Theodor Goulas, Athanasia-Lida Dimou, Stavroula-Evita Fotinea, Eleni Efthimiou, Neil Fox, Onno Crasborn, Lianne Westenberg, Sarah Ebling, Laure Wawrinka, Johanna Mesch, Thomas Björkstrand, Anna Kuder, Joanna Wójcicka

Workshop and Training for Experts in Under-Resourced Languages – Session 2

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

This report describes the EASIER Autumn School, a workshop held on 25–26 September 2023 in Hamburg. Titled “Sign language data meets data science – data science meets sign linguistics”, the workshop had the goal of generating expertise for under-resourced sign languages (SLs) to extend the scope of EASIER to more European SLs. The idea was to not only support people who already work with SLs and train them in technological approaches, but also to train people from data science, language technologies, etc. in the handling of SLs. Two parallel tracks introduced both groups to relevant topics of the other area, followed by a joint track addressing language technologies of the EASIER pipeline and ethical considerations.

Maria Kopf, Thomas Hanke, Marc Schulder, Sam Bigeard, Tsubasa Uchida, Giacomo Inches, Eleni Pechlivanidou

Interlingual index for the project's core sign languages

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

The purpose of the interlingual index is to link the lexical resources of all sign languages of the project. This is the second version of the index, which covers all the languages of the project.

EASIER Notation – A Proposal for a Gloss-based Scripting Language for Sign Language Generation Based on Lexical Data

Dieser Artikel ist ©2023 IEEE. Ich empfehle die Nutzung der akzeptierten Fassung des Artikels, welche öffentlich zugänglich ist. Für die closed access veröffentlichte Fassung folgen sie der URL in der Zitiervorlage, wobei zu beachten ist, dass in jener Fassung die meisten Links und Verknüpfungen defekt sind. Die akzeptierte Fassung hat dieses Problem nicht.

Diese Publikation ist nur auf Englisch verfügbar.

Abstract

We introduce EASIER Notation, a gloss-based scripting language to describe sign language content to be signed by an avatar and describe the functionality a lexical database for a sign language needs to provide in order to fully support the notation approach. In addition, we present the prototype of a text editor supporting EASIER Notation for human post-editing of machine translation output as well as pre-scribing signed utterances from scratch.

Thomas Hanke, Lutz König, Reiner Konrad, Maria Kopf, Marc Schulder, Rosalee Wolfe

The Sign Language Interchange Format: Harmonising Sign Language Datasets for Computational Processing

Dieser Artikel ist ©2023 IEEE. Ich empfehle die Nutzung der akzeptierten Fassung des Artikels, welche öffentlich zugänglich ist. Für die closed access veröffentlichte Fassung folgen sie der URL in der Zitiervorlage, wobei zu bBeachten ist, dass in jener Fassung die meisten Links und Verknüpfungen defekt sind. Die akzeptierte Fassung hat dieses Problem nicht.

Diese Publikation ist nur auf Englisch verfügbar.

Abstract

We introduce the Sign Language Interchange Format, a new format for representing annotations and lexical inventories of sign language datasets. The format is designed as an intermediate step in data preparation for language technologies, unifying the annotation conventions of different corpora for further use. Complex gloss notations and implicit relations between tiers are made explicit through a hierarchy of machine-readable container structures. Sample implementations for converting to and from the new format are provided.

Marc Schulder, Sam Bigeard, Thomas Hanke, Maria Kopf

Tools for Harmonizing Available Annotations to a Common Format

Dieses Deliverable bietet Tools für die Harmonisierung bestehender Annotationen in einem gemeinsamen Austauschformat.

Marc Schulder, Sam Bigeard, Maria Kopf, Thomas Hanke

Facilitating the Spread of New Sign Language Technologies across Europe

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

For developing sign language technologies like automatic translation, huge amounts of training data are required. Even the larger corpora available for some sign languages are tiny compared to the amounts of data used for corresponding spoken language technologies. The overarching goal of the European project EASIER is to develop a framework for bidirectional automatic translation between sign and spoken languages and between sign languages. One part of this multi-dimensional project is that it will pool available language resources from European sign languages into a larger dataset to address the data scarcity problem. This approach promises to open the floor for lower-resourced sign languages in Europe. This article focusses on efforts in the EASIER project to allow for new languages to make use of such technologies in the future. What are the characteristics of sign language resources needed to train recognition, translation, and synthesis algorithms, and how can other countries including those without any sign resources follow along with these developments? The efforts undertaken in EASIER include creating workflow documents and organizing training sessions in online workshops. They reflect the current state of the art, and will likely need to be updated in the coming decade.

Hope E. Morgan, Onno Crasborn, Maria Kopf, Marc Schulder, Thomas Hanke

Introducing Sign Languages to a Multilingual Wordnet: Bootstrapping Corpora and Lexical Resources of Greek Sign Language and German Sign Language

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

Wordnets have been a popular lexical resource type for many years. Their sense-based representation of lexical items and numerous relation structures have been used for a variety of computational and linguistic applications. The inclusion of different wordnets into multilingual wordnet networks has further extended their use into the realm of cross-lingual research. Wordnets have been released for many spoken languages. Research has also been carried out into the creation of wordnets for several sign languages, but none have yet resulted in publicly available datasets. This article presents our own efforts towards an inclusion of sign languages in a multilingual wordnet, starting with Greek Sign Language (GSL) and German Sign Language (DGS). Based on differences in available language resources between GSL and DGS, we trial two workflows with different coverage priorities. We also explore how synergies between both workflows can be leveraged and how future work on additional sign languages could profit from building on existing sign language wordnet data. The results of our work are made publicly available.

Sam Bigeard, Marc Schulder, Maria Kopf, Thomas Hanke, Kyriaki Vasilaki, Anna Vacalopoulou, Theodore Goulas, Athanasia-Lida Dimou, Stavroula-Evita Fotinea, Eleni Efthimiou

The Sign Language Dataset Compendium: Creating an Overview of Digital Linguistic Resources

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

One of the challenges that sign language researchers face is the identification of suitable language datasets, particularly for cross-lingual studies. There is no single source of information on what sign language corpora and lexical resources exist or how they compare. Instead, they have to be found through extensive literature review or word-of-mouth. The amount of information available on individual datasets can also vary widely and may be distributed across different publications, data repositories and (potentially defunct) project websites. This article introduces the Sign Language Dataset Compendium, an extensive overview of linguistic resources for sign languages. It covers existing corpora and lexical resources, as well as commonly used data collection tasks. Special attention is paid to covering resources for many different languages from around the globe. All information is provided in a standardised format to make entries comparable, but kept flexible enough to allow for differences in content. The compendium is intended as a growing resource that will be updated regularly.

Maria Kopf, Marc Schulder, Thomas Hanke

Initial Interlingual Index for DGS and GSL

Diese Publikation ist nur auf Englisch verfügbar.

Zusammenfassung

The purpose of the interlingual index is to link the lexical resources of all sign languages of the project. D6.3 is the first version of this index, covering DGS and GSL.

Sam Bigeard, Marc Schulder, Maria Kopf, Thomas Hanke, Kiriaki Vasilaki, Anna Vacalopoulou, Theodor Goulas, Athanasia-Lida Dimou, Stavroula-Evita Fotinea, Eleni Efthimiou

Specification for the Harmonization of Sign Language Annotations

Diese Publikation ist nur auf Englisch verfügbar.

Versionen

Aktuellste Version:
Version 1:

Zusammenfassung

This document compiles information required for the joint use of several specific sign language corpora. It compares the annotations of 17 different corpora (some covering multiple languages) that include data for 17 signed languages. The comparison addresses annotation standards for manual and non-manual signs, describing their basic annotation format, formats for various specific phenomena and handshape coding approaches. This information is then used to formulate a strategy for the harmonization of these annotation standards that will result in a corpus-independent interchange format for the representation of all considered corpora.

Maria Kopf, Marc Schulder, Thomas Hanke, Sam Bigeard

Overview of Datasets for the Sign Languages of Europe

Diese Publikation ist nur auf Englisch verfügbar.

Versionen

Aktuellste Version:
Version 1:

Zusammenfassung

This document identifies linguistic corpora that can be explored as high-quality training data for automatic translation within EASIER (as opposed to loosely aligned broadcast data). For each data set, the document lists what parts of the data are available under what access conditions. It also lists the elicitation formats used in several corpora in order to identify those parts of the available corpora that could be explored to build multilingual resources.