Evaluating American Sign Language Generation Through the Participation of Native ASL Signers

1) Matt Huenerfauth, 2) Liming Zhao, Erdan Gu and Jan Allbeck


1) The City University of New York, USA
2) University of Pennsylvania, USA


We discuss important factors in the design of evaluation studies for systems that generate animations of American Sign Language (ASL) sentences. In particular, we outline how some cultural and linguistic characteristics of members of the American Deaf community must be taken into account so as to ensure the accuracy of evaluations involving these users. Finally, we describe our implementation and user-based evaluation (by native ASL signers) of a prototype ASL generator to produce sentences containing classifier predicates, frequent and complex spatial phenomena that previous ASL generators have not produced.

Full Paper:
Download Full Paper Here