Embedded Files
Summary
Summary
This project investigated patterns of language use in American Sign Language (ASL) through the systematic analysis of publicly available online videos. The project sought to expand knowledge of ASL grammar while establishing sustainable research infrastructure and supporting collaboration among scholars from different institutions.
The primary research focused on the four ASL signs pictured below (images from ASL Signbank, Hochgesang et al. 2026). We gloss these signs as [what.1], [what.do], [what.pu], and [what.fs]. These signs are all said to mean 'what', but very little is known about how these signs overlap or differ from one another in actual use.
Our approach is to study these signs by analyzing the constructions (meaningful sentence structures) that they are used in. Rather than relying on intuitions or elicited judgments, we analyze these signs as they are used in ASL videos posted online, by a variety of signers.
Dataset information
Dataset information
A primary research activity carried out under this grant was the creation of 155 ELAN annotation files to represent the ASL signing of individuals in 136 videos posted online, which total just under 25 hours in combined duration. The EAF files each have 7 tiers for annotations for signing activity and for additional notes. There is a combined total of 40,402 annotations across all tiers and files in the dataset. The annotations systematically target 'what' signs of interest in their surrounding grammatical context.
The citation for the dataset is:
Lepic, R., Barrett, B., Hou, L., & Wilkinson, E. (2026, August 7). Dataset: Form and function in the 'what' family of signs in ASL. https://doi.org/10.17605/OSF.IO/T9V2W
Note that the EAFs and a basic metadata CSV can be accessed directly through the OSF page linked above.
The same collection of EAFs and a more detailed metadata spreadsheet can be accessed here: EAF folder; Google Sheet
Conference presentations
Conference presentations
A primary goal for the project was to learn more about ASL's linguistic structure. Another main goal was for students to receive science and technology training. Both of these goals are supported through dissemination of research results at academic linguistics conferences.
Lepic, Ryan and Bonnie Barrett. (submitted). Examining 'what'-collocations in ASL signing online.
Lepic, Ryan and Bonnie Barrett. (2026, Jun 6). A first look at free relative clause constructions in ASL. 14th International Conference on Construction Grammar, Princeton University.
A main result reported in this presentation is that what-signs often appear as object relative clauses functioning as the objects of mental verbs. This is significant because free relative clauses have been claimed not to exist in ASL.
Barrett, Bonnie and Ryan Lepic. (2025, Jul 13). Examining the grammaticalization of ASL [what.do]. Usage-Based Approaches to Phonology Conference, University of Oregon.
A main result reported in this presentation is that the sign glossed [what.do] can be used with either a referential or a verbal function. This is significant because it supports a grammaticalization analysis of this sign as a merger of fingerspelled what and do.
Lepic, Ryan, Bonnie Barrett, Donovan Catt, Lynn Hou, and Erin Wilkinson. (2024, Nov 3). What is a rhetorical question in ASL? 16th High Desert Linguistics Society Conference, University of New Mexico.
A main result reported in this presentation is that overwhelmingly in internet data, 'what'-signs occur in Question-Answer Constructions, and less often in rhetorical questions. This is significant, because previous research has used the term "rhetorical question" too broadly, overlooking this difference.
Wilkinson, Erin, Ashley Beard, Sylvia Fullerton, Jessica Iske, Lynn Hou, and Ryan Lepic. (2024, Nov 3). The multifunctionality of HAPPEN constructions in ASL. 16th High Desert Linguistics Society Conference, University of New Mexico.
Lepic, Ryan. (2024, Oct 1). Studying sign distributions in American Sign Language online. Department of Language Sciences, University of Wisconsin, Madison.
Wilkinson, Erin, Lynn Hou, and Ryan Lepic. (2024, Sept 19). A dynamic network of WHAT constructions in ASL. 3rd Sign Cognitive and Functional Explorations Conference, University of Warsaw, Poland.
Lepic, Ryan, Bonnie Barrett, Donovan Catt, Lynn Hou, and Erin Wilkinson. (2024, Jun 29). Identifying ‘what’-constructions in ASL. 1st Cognitive Linguistics Association of North America Conference, University of Quebec, Montreal.
Hou, Lynn, Erin Wilkinson, and Ryan Lepic. (2022, Sept 28). The multi mapping of four ‘what’ signs, functions, and genres: Data from ASL on the internet. 14th Theoretical Issues in Sign Language Research Conference, Osaka, Japan.
Research team information
Research team information
This project was funded by the US National Science Foundation. The Division of Behavioral and Cognitive Sciences funded collaborative research between Gallaudet University (Award 2141363 to R. Lepic), the University of New Mexico (Award 2140575 to E. Wilkinson), and the University of California, Santa Barbara (Award 2141350 to L. Y-S. Hou). The award period was from October 2022 through March 2026.
The project PIs are thankful to the graduate research assistants and undergraduate research trainees who participated in and contributed to the project. Their roles varied, whether through identifying videos online, annotating project files, or developing their own related projects. The length of each student's participation also varied. These graduate and undergraduate students are recognized below with their first initial and last name, ordered alphabetically by last name: B. Barrett; C. Barutcu; A. Beard; D. Catt; A. Fawcett; S. Fullerton; S. Garcia; L. Hamilton; J. Iske; N. Mascarenas; J. Mills; A. Motley; S.J. Oates; A. Ortiz; N. Prieto; M. Sanchez; D. Tankersly; D. Vigil; L. Wheeler
This project is part of the Collections of ASL for Research and Documentation hub. You can find additional information on the CARD website: https://sites.google.com/gallaudet.edu/card/home
Page updated
Report abuse