Change search
Link to record
Permanent link

Direct link
Publications (10 of 136) Show all publications
Klezovich, A., Mesch, J. & Beskow, J. (2025). Motion Capture Driven Avatars for Swedish Sign Language. In: Patrick Gebhard; Tanja Schneeberger; Aike Horstmann; Stefán Ólafsson (Ed.), IVA Adjunct '25: Adjunct Proceedings of the 25th ACM International Conference on Intelligent Virtual Agents. Paper presented at IVA Adjunct '25: ACM International Conference on Intelligent Virtual Agents Berlin Germany September 16 - 19, 2025 (pp. 1-9). Association for Computing Machinery, Inc, Article ID 27.
Open this publication in new window or tab >>Motion Capture Driven Avatars for Swedish Sign Language
2025 (English)In: IVA Adjunct '25: Adjunct Proceedings of the 25th ACM International Conference on Intelligent Virtual Agents / [ed] Patrick Gebhard; Tanja Schneeberger; Aike Horstmann; Stefán Ólafsson, Association for Computing Machinery, Inc , 2025, p. 1-9, article id 27Conference paper, Published paper (Refereed)
Abstract [en]

This paper investigates the requirements for intelligible high-quality motion capture of sign language, with a particular focus on face animation. There are several methods for capturing facial animation, yet there is no established standard for which type of facial animation is the most optimal for sign languages. We compare two facial animation approaches — ARKit and Metahuman Animator (MHA) in terms of intelligibility. As expected, a human evaluation study with deaf Swedish Sign Language signers showed that MHA outperforms ARKit because MHA has a higher number of facial controls and an advanced depth data solver. In addition, we introduce a biLSTM-based occlusion infilling technique for MHA data as opposed to linear interpolation. Although biLSTM infilled MHA animations showed no improvement in human evaluation compared to original MHA animations, the model produces linguistically reasonable infillings upon qualitative exploration of the renders.

Place, publisher, year, edition, pages
Association for Computing Machinery, Inc, 2025
Keywords
animation occlusions infilling, face animation, intelligibility study, metahuman animator, motion capture, sign language motion capture dataset, Swedish Sign Language
National Category
Computer Sciences Comparative Language Studies and Linguistics
Identifiers
urn:nbn:se:su:diva-249791 (URN)10.1145/3742886.3756726 (DOI)2-s2.0-105020970603 (Scopus ID)979-8-4007-1996-7 (ISBN)
Conference
IVA Adjunct '25: ACM International Conference on Intelligent Virtual Agents Berlin Germany September 16 - 19, 2025
Available from: 2025-11-26 Created: 2025-11-26 Last updated: 2025-11-26Bibliographically approved
Tesfazion, M., Tiselius, E. & Mesch, J. (2025). Sign language interpreter education in Sweden. In: Jemina Napier; Stacey Webb; Robert Adam (Ed.), International Perspectives on Sign Language Translator and Interpreter Education: (pp. 342-360). Washington: Gallaudet University Press
Open this publication in new window or tab >>Sign language interpreter education in Sweden
2025 (English)In: International Perspectives on Sign Language Translator and Interpreter Education / [ed] Jemina Napier; Stacey Webb; Robert Adam, Washington: Gallaudet University Press, 2025, p. 342-360Chapter in book (Refereed)
Abstract [en]

Stretching over the northernmost parts of Europe, with Norway, Finland, and Denmark as its closest neighbors, Sweden remains a sparsely populated (10.5 million inhabitants) and linguistically a fairly uniform country. It is the cradle of the world famous social-democratic “welfare state,” which emerged over the course of the 20th century and is characterized by a strong vision of full inclusion for all members of society (Haualand & Holmström, 2018). Over the same period, Sweden also transformed from a monolingual and homogenous society to a much more multilingual and culturally diverse society; of Sweden’s approximately 10.5 million inhabitants, about 20% were born abroad (SCB, 2022). The deaf population consists of about 10,000 individuals (SDR, 2021), and in addition there are approximately 2,000 people who are deafblind (NKCDB, 2021). The Language Act states that the public society shall protect and promote Swedish Sign Language (svenskt teckenspråk [STS]) and that deaf people have the right to learn, develop, and use STS. This means that deaf people have the same legislated rights as other minority groups (Sami, Meänkieli, Finnish, Romani Chib, and Yiddish) or allophone language speakers to have access to interpreting services. Deaf people’s right to interpreters was affirmed in the 1994 Disability Reform (Swedish Government Official Reports [Statens offentliga utredningar;SOU], 2004:64). The right to use interpreters is also codified in several other Swedish laws. For example, the following laws all directly refer to interpreters: the Language Act (Swedish Code of Statutes [Svensk författningssamling; SFS],2009:600); the Health and Medical Services Act (SFS, 2017:30); the Support and Service for Persons With Certain Functional Impairments Act (SFS, 1993:387); the Administrative Procedure Act (SFS, 2017:900); the Code of Juridical Procedure (SFS, 1942:740); and the Administrative Court Procedure Act (SFS, 1971:201). Interpreting services are also codified, though more indirectly, in the Patient Act (SFS, 2014:821). We begin by contextualizing translation and interpreting of both signed and spoken languages in Sweden. We then talk about the status of STS and the professionalization of sign language interpreting (SLI) and discuss the development of interpreter education, with reference to deaf and hearing interpreters alike. We discuss the issue of readiness to work after formal education, as well as continuing professional development. Finally, we reflect on the status of STS/Swedish interpreting in the present day and on the current state of research into SLI and interpreter education.

Place, publisher, year, edition, pages
Washington: Gallaudet University Press, 2025
Keywords
Swedish Sign Language, sign language interpreter education
National Category
General Language Studies and Linguistics
Research subject
Sign Language; Translation Studies
Identifiers
urn:nbn:se:su:diva-237491 (URN)978-1-954622-43-2 (ISBN)978-1-954622-42-5 (ISBN)
Available from: 2025-01-03 Created: 2025-01-03 Last updated: 2025-01-07Bibliographically approved
Gavrilescu, R., Geraci, C. & Mesch, J. (2024). Content questions in sign language from theory to language description via corpus, experiments, and fieldwork. In: Eleni Efthimiou; Stavroula-Evita Fotinea; Thomas Hanke; Julie A. Hochgesang; Johanna Mesch; Marc Schulder (Ed.), Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Paper presented at 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Language Resources and Evaluation Conference (LREC-COLING 2024), Torino, Italy, 25 May, 2024 (pp. 298-306). Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL)
Open this publication in new window or tab >>Content questions in sign language from theory to language description via corpus, experiments, and fieldwork
2024 (English)In: Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources / [ed] Eleni Efthimiou; Stavroula-Evita Fotinea; Thomas Hanke; Julie A. Hochgesang; Johanna Mesch; Marc Schulder, Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL) , 2024, p. 298-306Conference paper, Published paper (Refereed)
Abstract [en]

The theory of language structure informs us about what we should expect when we want to investigate a certain construction. However, reality is often richer than what theories predict. In this study, we start from a theoretically informed set of hypotheses about the structure of wh-questions in sign language, we test them using a sign language corpus, a designed production experiment, and structured fieldwork in three sign languages, Swedish, Greek and French Sign Languages. The results will inform us on what type of contribution each research method can provide to reach accurate language descriptions.

Place, publisher, year, edition, pages
Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL), 2024
Keywords
sign language methodology, content questions, Wh-sign
National Category
General Language Studies and Linguistics
Research subject
Sign Language
Identifiers
urn:nbn:se:su:diva-229609 (URN)978-2-493814-30-2 (ISBN)
Conference
11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Language Resources and Evaluation Conference (LREC-COLING 2024), Torino, Italy, 25 May, 2024
Available from: 2024-05-26 Created: 2024-05-26 Last updated: 2024-06-10Bibliographically approved
Gavrilescu, R., Geraci, C. & Mesch, J. (2024). Content Questions in Sign Language From theory to language description via corpus, experiments, and fieldwork. In: 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources (pp. 86-94). Association for Computational Linguistics (ACL)
Open this publication in new window or tab >>Content Questions in Sign Language From theory to language description via corpus, experiments, and fieldwork
2024 (English)In: 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources, Association for Computational Linguistics (ACL) , 2024, p. 86-94Conference paper, Published paper (Refereed)
Abstract [en]

The theory of language structure informs us about what we should expect when we want to investigate a certain construction. However, reality is often richer than what theories predict. In this study, we start from a theoretically informed set of hypotheses about the structure of wh-questions in sign language, we test them using a sign language corpus, a designed production experiment, and structured fieldwork in three sign languages, Swedish, Greek and French Sign Languages. The results will inform us on what type of contribution each research method can provide to reach accurate language descriptions.

Place, publisher, year, edition, pages
Association for Computational Linguistics (ACL), 2024
Keywords
Content questions, Sign Language Methodology, Wh-sign
National Category
General Language Studies and Linguistics
Identifiers
urn:nbn:se:su:diva-239412 (URN)2-s2.0-85197532726 (Scopus ID)
Available from: 2025-02-11 Created: 2025-02-11 Last updated: 2025-02-11Bibliographically approved
Jantunen, T., Mesch, J. & Ferrara, L. (2024). Corpus research on signed languages in the Nordic countries. Nordic Journal of Linguistics
Open this publication in new window or tab >>Corpus research on signed languages in the Nordic countries
2024 (English)In: Nordic Journal of Linguistics, ISSN 0332-5865, E-ISSN 1502-4717Article in journal (Refereed) Epub ahead of print
Abstract [en]

This semi-systematic literature review examines signed language corpus research in the Nordic countries, with a quantitative and qualitative assessment of corpus research. The article first describes some critical components and functionalities of a signed language corpora. It then outlines the evolution of Nordic corpus research, highlighting Sweden’s pioneering role and subsequent developments in Finland and Norway. The findings suggest a progression from method-focused publications to those exploring linguistic phenomena within and across (signed) languages. Although the number of research publications is modest, there is a discernible shift towards comparative studies and applications in signed language teaching and learning.

Keywords
corpus research; Finnish Sign Language; literature review; Nordic signed languages; Norwegian Sign Language; signed language corpora; Swedish Sign Language
National Category
General Language Studies and Linguistics
Research subject
Sign Language
Identifiers
urn:nbn:se:su:diva-233747 (URN)10.1017/s0332586524000118 (DOI)001318049100001 ()2-s2.0-85205419674 (Scopus ID)
Funder
Swedish Research Council, 2017-00626
Available from: 2024-09-24 Created: 2024-09-24 Last updated: 2024-11-12
Malmberg, F., Klezovich, A., Mesch, J. & Beskow, J. (2024). Exploring latent sign language representations with isolated signs, sentences and in-the-wild data. In: Eleni Efthimiou; Stavroula-Evita Fotinea; Thomas Hanke; Julie A. Hochgesang; Johanna Mesch; Marc Schulder (Ed.), Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Paper presented at 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Language Resources and Evaluation Conference (LREC-COLING 2024), Torino, Italy, 25 May, 2024 (pp. 378-383). Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL)
Open this publication in new window or tab >>Exploring latent sign language representations with isolated signs, sentences and in-the-wild data
2024 (English)In: Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources / [ed] Eleni Efthimiou; Stavroula-Evita Fotinea; Thomas Hanke; Julie A. Hochgesang; Johanna Mesch; Marc Schulder, Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL) , 2024, p. 378-383Conference paper, Published paper (Refereed)
Abstract [en]

Unsupervised representation learning offers a promising way of utilising large unannotated sign language resources found on the Internet. In this paper, a VQ-VAE model is trained to learn a codebook of motion primitives from sign language data. For training, we use isolated signs and sentences from a sign language dictionary. Three models are trained: one on isolated signs, one on sentences, and one mixed model. We test these models by comparing how well they are able to reconstruct held-out data from the dictionary, as well as an in-the-wild dataset based on sign language videos from YouTube. These data are characterized by less formal and more expressive signing than the dictionary items. Results show that the isolated sign model yields considerably higher reconstruction loss for the YouTube dataset, while the sentence model performs the best on this data. Further, an analysis of codebook usage reveals that the set of codes used by isolated signs and sentences differ significantly. In order to further understand the different character of the datasets, we carry out an analysis of the velocity profiles, which reveals that signing data in-the-wild has much higher average velocity than dictionary signs and phrases. We believe these differences also explain the large differences in reconstruction loss observed

Place, publisher, year, edition, pages
Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL), 2024
Keywords
sign language data, VQ-VAE, Representation Learning, Pose Codebook
National Category
General Language Studies and Linguistics
Research subject
Sign Language
Identifiers
urn:nbn:se:su:diva-229608 (URN)2-s2.0-85197480349 (Scopus ID)978-2-493814-30-2 (ISBN)
Conference
11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Language Resources and Evaluation Conference (LREC-COLING 2024), Torino, Italy, 25 May, 2024
Available from: 2024-05-26 Created: 2024-05-26 Last updated: 2024-08-14Bibliographically approved
Bigeard, S., Schulder, M., Kopf, M., Hanke, T., Vasilaki, K., Vacalopoulou, A., . . . Wójcicka, J. (2024). Extended Interlingual Index for the Project's Core Sign Languages and Languages covered in Work Package 9.
Open this publication in new window or tab >>Extended Interlingual Index for the Project's Core Sign Languages and Languages covered in Work Package 9
Show others...
2024 (English)Report (Other academic)
Abstract [en]

The purpose of the interlingual index is to link the lexical resources of the sign languages of the project. This is the final project release of the index, which covers both the core sign languages of the project as well as additional sign languages.

Publisher
p. 31
Keywords
multilingual wordnet, lexical resource, crosslingual resource, semi-automatic resource creation, DGS (German Sign Language), GSL (Greek Sign Language), BSL (British Sign Language), NGT (Sign Language of the Netherlands), LSF (French Sign Language), DSGS (Swiss-German Sign Language), STS (Swedish Sign Language), PJM (Polish Sign Language)
National Category
General Language Studies and Linguistics
Research subject
Sign Language
Identifiers
urn:nbn:se:su:diva-225689 (URN)10.25592/uhhfdm.13847 (DOI)
Funder
European Commission, 101016982
Available from: 2024-01-19 Created: 2024-01-19 Last updated: 2024-08-30Bibliographically approved
Mesch, J. (2024). Jordan Fenlon and Julie A. Hochgesang (eds.), Signed Language Corpora. Washington, DC: Gallaudet University Press, 2022 [Review]. Journal of Linguistics, 60(3), 695-698
Open this publication in new window or tab >>Jordan Fenlon and Julie A. Hochgesang (eds.), Signed Language Corpora. Washington, DC: Gallaudet University Press, 2022
2024 (English)In: Journal of Linguistics, ISSN 0022-2267, E-ISSN 1469-7742, Vol. 60, no 3, p. 695-698Article, book review (Refereed) Published
Abstract [en]

Jordan Fenlon and Julie A. Hochgesang have done fantastic work in their collaboration on this long-awaited book on signed language corpora, which has been much anticipated by sign language researchers. This endeavor aims to propel conversations regarding the role of corpus linguistics as a methodology and its significance in sign language linguistics research. The book offers a practical and all-encompassing initiation into the application of corpus linguistics and corpus-based methodologies within the realm of sign language linguistics and applied linguistics, including sign language acquisition and teaching. The book unfolds across seven chapters authored by twelve well-known researchers and experts in their respective subfields. This collective expertise ensures a thorough exploration of the subject matter, making the book a valuable resource for those delving into the intricacies of signed language research and its practical applications in linguistic studies and language education.

Keywords
sign language, sign language corpus
National Category
General Language Studies and Linguistics
Research subject
Sign Language
Identifiers
urn:nbn:se:su:diva-228771 (URN)10.1017/S0022226724000100 (DOI)001196269700001 ()
Available from: 2024-04-26 Created: 2024-04-26 Last updated: 2024-11-19Bibliographically approved
Efthimiou, E., Fotinea, S.-E., Hanke, T., Hochgesang, J. A., Mesch, J. & Schulder, M. (Eds.). (2024). Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Paper presented at 11th Workshop on the Representation and Processing of Sign Languages. Language Resources and Evaluation Conference (LREC 2024), Torino, Italy, 25 May, 2024. Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL)
Open this publication in new window or tab >>Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources
Show others...
2024 (English)Conference proceedings (editor) (Refereed)
Place, publisher, year, edition, pages
Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL), 2024. p. 420
National Category
General Language Studies and Linguistics
Research subject
Sign Language
Identifiers
urn:nbn:se:su:diva-229605 (URN)978-2-493814-30-2 (ISBN)
Conference
11th Workshop on the Representation and Processing of Sign Languages. Language Resources and Evaluation Conference (LREC 2024), Torino, Italy, 25 May, 2024
Available from: 2024-05-26 Created: 2024-05-26 Last updated: 2024-06-10Bibliographically approved
Schulder, M., Bigeard, S., Kopf, M., Hanke, T., Kuder, A., Wójcicka, J., . . . Efthimiou, E. (2024). Signs and Synonymity: Continuing Development of the Multilingual Sign Language Wordnet. In: Eleni Efthimiou; Stavroula-Evita Fotinea; Thomas Hanke; Julie A. Hochgesang; Johanna Mesch; Marc Schulder (Ed.), Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Paper presented at 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Language Resources and Evaluation Conference (LREC-COLIG 2024), Torino, Italy, May 25, 2024 (pp. 343-353). Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL)
Open this publication in new window or tab >>Signs and Synonymity: Continuing Development of the Multilingual Sign Language Wordnet
Show others...
2024 (English)In: Proceedings of the LREC-COLING 2024 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources / [ed] Eleni Efthimiou; Stavroula-Evita Fotinea; Thomas Hanke; Julie A. Hochgesang; Johanna Mesch; Marc Schulder, Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL) , 2024, p. 343-353Conference paper, Published paper (Refereed)
Abstract [en]

The Multilingual Sign Language Wordnet is the first publicly available wordnet resource for sign languages. It is a growing multilingual resource providing data for eight sign languages to date. During the initial phase of its creation, the focus lay on producing the infrastructure to support various languages and to produce initial sets of content for them. This article represents the start of the second phase, in which the focus is moved to establishing overlapping coverage across the different sign languages. Building on the data produced so far, a new feature to assist annotation is introduced which leverages established partial synonymy between signs (inter- and cross-lingually) to discover likely additional synonymies. Other improvements to the annotation interface and workflow build directly on the experiences from the first phase. Working with the updated annotation interface, new data is produced for Polish Sign Language, Greek Sign Language and Swedish Sign Language.

Place, publisher, year, edition, pages
Paris: ELRA Language Resources Association (ELRA) and the International Committee on Computational Linguistics (ICCL), 2024
Keywords
multilingual wordnet, sign language wordnet, resource creation, dictionary reversal
National Category
General Language Studies and Linguistics
Research subject
Sign Language
Identifiers
urn:nbn:se:su:diva-229607 (URN)2-s2.0-85197518997 (Scopus ID)978-2-493814-30-2 (ISBN)
Conference
11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources. Language Resources and Evaluation Conference (LREC-COLIG 2024), Torino, Italy, May 25, 2024
Available from: 2024-05-26 Created: 2024-05-26 Last updated: 2025-02-13Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-0612-6304

Search in DiVA

Show all publications