NYU14

Cross-Modal Semantics

Philippe Schlenker

(LINGUAE, Institut Jean-Nicod, CNRS; New York University)

September-October 2014 - NYU

Instructor: Philippe Schlenker

Directeur de Recherche, Institut Jean-Nicod, Paris

Global Distinguished Professor, New York University

E-mail: philippe.schlenker@gmail.com

Topic

Most of formal semantics was initially developed on the basis of English data, and more recently of cross-linguistic data from other spoken languages. While sign language phonology, morphology and syntax were studied in some detail in the last decades (e.g. Sandler and Lillo-Martin 2006), it is only recently that sign language semantics underwent a comparable development. This emerging field has yielded two kinds of typological insights. First, sometimes some elements that are covert in spoken languages are overtly realized in sign languages. A case in point concerns the formal indices that are often postulated in semantics; while these are not pronounced in spoken languages, they arguably are in sign languages: in cases of binding, an antecedent sets up a position or 'locus', which is then retrieved by way of pointing by the bound pronoun. But a more radical insight has been gained from semantic studies of sign languages: these have iconic possibilities which only exist in very limited form in spoken languages. In fact, loci themselves have this property: they can simultaneously play the role of formal indices and of simplified pictures of what they denote. While one might initially try to neatly distinguish between a logical/grammatical component on the one hand, and an iconic/gestural component on the other, these are so intertwined that it might prove more fruitful to devise from the start a 'formal semantics with iconicity'; in other words, in order to be genuinely universal, semantics might well have to include a pictorial component.

These findings point towards two tantalizing possibilities. One is that in a variety of domains, sign languages are more expressive than spoken languages, and that due to the limitations of the vocal medium spoken language semantics is in some respects a 'degenerate' version of sign language semantics, one from which most of the iconic component was lost. If so, the full richness of Universal Semantics could only be seen by studying sign languages. An alternative possibility is that the difference in expressive power between sign and spoken languages is due to the fact that linguists have separated the latter from their gestural component, for no good theoretical reason. On this view, sign languages should be compared to spoken languages with co-speech gestures, with the possibility that when the latter are taken into account a number of rich expressive possibilities found in sign languages can in fact be replicated within spoken languages. If so, one may gain rich insights into the full power of Universal Semantics by studying spoken languages; but the way we study these should be modified: we should take their gestural component to be part and parcel of their expressive resources. Either way, we will argue that sign languages have the potential to change our view of the scope and methods of formal semantics.

Important

1. Please sign up here if you plan to attend some or all of the seminar (irrespective of whether you plan to enroll or not; this is just so that the instructor has your email address and can assess how many people will attend).

2. The student session (open to all students, whether registered or not) has yet to be scheduled. If you plan to attend the student session, please go to the following Doodle Poll to indicate your availability (we take Week 2 as representative, but the student session will be at a fixed time throughout the seminar).

3. NYU will offer ASL interpreting for all sessions for which it will be requested. Please contact the instructor ASAP if you know you will request interpreting for some or all sessions (if possible, specify which sessions you hope to attend).


Requirements

Besides active class participation:

(i) 1 squib/mini-literature review + 1 class presentation

(ii) 1 mini-term paper (to be emailed 10 days after the seminar end)

The squib and mini-term paper need not be on sign languages, but they should be connected to the broad typological questions that will be addressed in the seminar (including co-speech gestures and/or iconic phenomena in spoken languages).

Please contact the instructor as early as possible to discuss (i) and (ii).

Schedule

8 weeks in September-October 2014 - see below for sessions and readings. Note the non-standard schedule of the first session due to Labor Day.

–General sessions (2 hours 45 per week) are open to everyone

–Student sessions (1 hour 45 per week) are open to all students and postdocs (whether registered or not for the course).

Sessions and Readings (still tentative; to be adapted as we go)

Note: the slides and the readings which are not found below are made available via a Dropbox folder [send email to the instructor if you don't have the link to the folder].

4. Monday, September 22nd - 3:30pm-6:15pm - WP10 103

General session: Anaphora IV - Context Shift I

On iconic variables

Schlenker et al. 2013 (Iconic Variables, L&P)

Schlenker 2014 (Iconic Features, to appear in NALS) LingBuzz

Further reading:

Heim's Lectures on feature semantics

On co-speech gestures

Ebert and Ebert on gestural inferences: available here

Schlenker 2014: Gestural Presuppositions

On context shift

Anand and Nevins 2004

Quer 2013

Further reading:

Schlenker, Philippe: 2011, Indexicality and De Se Reports. In Semantics, edited by von Heusinger, Maienborn and Portner, Volume 2, Article 61, Mouton de Gruyter.

[survey of indexicality]

5. Monday, September 29th - 3:30pm-6:30pm - WP10 103

General session + Guest Lecture: Context Shift II

–3:30pm-4:30pm: General Session

–4:45pm-6:30pm: Kathryn Davidson (Yale) role shift, iconicity and quotation

Davidson 2014

Schlenker 2014:

Super Monsters I, available here

Super Monsters II, available here

6. Monday, October 6th - 3:30pm-6:15pm - WP10 10

–3:30pm-5:30pm: Guest lecture (first 2 hours): Annemarie Kocab on Nicaraguan Sign Language (in ASL, with English interpreting)

–5:30pm-6:30pm: Presentation (3rd hour): Itamar Kastner on Kafr Qasem Sign Language (in English, with ASL interpreting)

7. Monday, October 13th - NYU holiday. Optional session [with ASL interpreting]

8. Monday, October 20th - 3:30pm-6:15pm - WP10 103

General session: Focus - Conclusion

Mini-term paper due: November 3rd [by email]

3. Monday, September 15th - 3:30pm-6:15pm - WP10 103

General session: Anaphora III

On donkey anaphora

Schlenker 2011 (Donkey Anaphora: the View from Sign Language, L&P) or the shorter, less technical version available here.

Further reading:

More on dynamic semantics

Barbara Partee's Lectures on Semantics and Anaphora, Moscow, 2008 (3 lectures on dynamic semantics)

Advanced:

Heim, Irene: 1982, File Change Semantics and the Familiarity Theory of Definiteness [pdf]

Elbourne, Paul: 2005, Situations and Individuals [pdf]

Dekker, Paul: 2004 Cases, Adverbs, Situations and Events, pages 1-5 [pdf]

Heim, Irene: 1990, E-type Pronouns and Donkey Anaphora. Linguistics and Philosophy 13: 137-177

Main Sessions

(main readings appear in bold)

1. Tuesday, September 2nd - 3:30pm-6:15pm - WP10 408

General session: Introduction - Anaphora I

On sign language semantics

Zucchi 2012

Schlenker 2013, 'Anaphora: Insights from Sign Language (Summary)', available here.

On pronouns

Büring 2007

Further reading:

Kuhn 2014

Schlenker 2014: Featural Variables

Schlenker and Mathur 2013

Further reading:

Zucchi, S. 2009. Along the time line: tense and time adverbs in Italian Sign Language, Natural Language Semantics 17. 99–139.

2. Monday, September 8th - 3:30pm-6:15pm - WP10 103

General session: Anaphora II

On temporal and modal anaphora

Partee 1973

Schlenker 2013 (Temporal and Modal Anaphora in Sign Language, NLLT)

Schlenker 2013 Restrictor set readings across ontological domains in ASL

Further reading:

Schlenker 2006: Ontological Symmetry in Language

Student Sessions

1. Thursday, September 4th - 3pm-5pm - WP10 408

Presentation: Jeremy Kuhn on indefinites

Schwarz, Long-distance indefinites and Choice Functions

2. Thursday, September 11th - 3pm-5pm - WP10 408

Presentation: Jeremy Kuhn on indefinites

3. Thursday, September 18th - 3pm-5pm - WP10 408

Presentations:

–Jeremy Goodman on tense and modality

–Masha Esipova and Jeremy Kuhn on functional readings of indefinites

Optional but recommended: Chapter 3 and Chapter 4 Section 4.1. of Nouwen's dissertation

4. Thursday, September 25th - 3pm-5pm - WP10 408

Presentation:

–Rob Pasternak on co-speech gestures

–Jeremy Kuhn on functional readings

5. Thursday, October 2nd: no student session this week!!

Mini-squib due! (by email)

6. Thursday, October 9th - 3pm-5pm - WP10 408

Jeremy Kuhn on functional readings (continued)

7. Thursday, October 16th - 3pm-5pm - WP10 408

Masha Esipova on the Russian quotative particle 'mol'

8. Thursday, October 23rd - 3pm-5pm - WP10 408

Adina Williams on incorporation

Additional links

• Classics

Klima, Edward and Bellugi, Ursula: 1979, The Signs of Language

• Background

Padden, C.: 2011, Sign Language Geography

List of Sign Languages [Wikipedia]

• Pronouns in sign language

Lillo-Martin, Diane and Meier, Richard: to appear. On the linguistic status of 'agreement' in sign language. To appear as a target article in Theoretical Linguistics.

Sandler, Wendy and Lillo-Martin, Diane: 2006, Pronouns. From Sign Language and Linguistic Universals. [pdf]

• Temporal and Modal Anaphora

Schlenker, Philippe: to appear, Temporal and Modal Anaphora in Sign Language (ASL). To appear in Natural Language & Linguistic Theory [pdf]

Zucchi, Sandro: 2009, Along the time line Tense and time adverbs in Italian Sign Language, NALS. [pdf]

A Classic

Partee, Barbara: 1973, Some Structural Analogies Between Tense and Pronouns in English. Journal of Philosophy 70: 601-609

[pdf]

Some Lecture Notes

1. Intensional approach to time and world dependency [pdf]

2. Extensional approach to time and world dependency [pdf]

3. A fragment with time and world variables [pdf]

More on intensional semantics

Kai von Fintel and Irene Heim's Notes on Intensional Semantics [pdf]

• Donkey Anaphora

–Donkey anaphora in sign language

Schlenker, Philippe: "Quantifiers and Variables: Insights from Sign Language (ASL and LSF)". Accepted for publication in Partee, B.H., Glanzberg, M., & Skilters, J. (eds), Formal Semantics and Pragmatics: Discourse, Context, and Models. The Baltic International Yearbook of Cognition, Logic and Communication, Vol. 6, 2011. [non-technical discussion of 'donkey' anaphora and sign language]

Schlenker, Philippe: 2012, "Donkey Anaphora: the View from Sign Language (ASL and LSF)". To appear in Linguistics & Philosophy [technical discussion of 'donkey' anaphora and sign language](non-final version; last modified: February 2011)

–Dynamic semantics vs. E-type approaches

More on dynamic semantics

Barbara Partee's Lectures on Semantics and Anaphora, Moscow, 2008 (3 lectures on dynamic semantics)

Advanced:

Heim, Irene: 1982, File Change Semantics and the Familiarity Theory of Definitiness [pdf]

Elbourne, Paul: 2005, Situations and Individuals [pdf]

Dekker, Paul: 2004 Cases, Adverbs, Situations and Events, pages 1-5 [pdf]

Heim, Irene: 1990, E-type Pronouns and Donkey Anaphora. Linguistics and Philosophy 13: 137-177 [pdf]

Very Advanced:

Nouwen, Rick (2003) Plural Pronominal Anaphora in Context: Dynamic Aspects of Quantification, PhD-thesis, UiL-OTS, Utrecht University, No. 84 of the LOT dissertation-series. [pdf]

• Iconic Variables

Schlenker, Philippe: 2011, Iconic Agreement. To appear in Theoretical Linguistics. [pdf]

Schlenker, Lamberton and Santoro: 2012, Iconic Variables [pdf]

Emmorey and Herzig: Gradient properties of ASL classifiers [pdf]

• Role Shift

Emmorey and Reilly: 1998, The Development of Quotation and Reported Action: Conveying Perspective in ASL [pdf]

Quer, J. and Frigola, S. The workings of indexicals in role shift structures in Catalan Sign Language (LSC) [pdf]

Pyers and Senghas: 2007, Reported action in Nicaraguan and American Sign Languages: Emerging versus established systems [pdf]

Schlenker, P.: to appear. Indexicality and De Se Reports" [Survey Article]. To appear in the Handbook of Semantics edited by von Heusinger, Maienborn and Portner, Mouton de Gruyter [pdf]

• Ronnie Wilbur on Verbal Classes

[1. is introductory; 2. builds on 1.]

1. Wilbur, R. B. (2003). Representations of telicity in ASL. CLS 39, 354-368. [pdf]

2. Wilbur, R. B. (2008). Complex predicates involving events, time and aspect: Is this why sign languages look so similar? In J. Quer (ed.), Signs of the time: Selected papers from TISLR 2004, pp. 217-250. Hamburg: Signum Press. [pdf]

3. Wilbur, R. B., Malaia, E., Shay, R. A. (In press). Degree modification and intensification in ASL adjectives. 18th Amsterdam Colloquium. Springer FoLLI Publications on Logic, Language and Information. [pdf]

4. Wilbur, R. B. (2009). Productive reduplication in ASL, a fundamentally monosyllabic language. In M. Kenstowicz (ed.), Data and Theory: Papers in Phonology in Celebration of Charles W. Kisseberth, a special issue of Language Sciences 31: 325-342. [pdf]

• Semantics of pictures

Greenberg, Gabriel: Pictorial Semantics. Ms., UCLA. [pdf]

• Semantics of gestures

G. Giorgolo, A Formal Semantics for Iconic Spatial Gestures, in M. Aloni, B. Harald, T. de Jager and K. Schulz 'Logic, Language and Meaning, Springer', p. 305-314, 2010. [pdf]

Lascarides, A. and M. Stone [2009] Discourse Coherence and Gesture Interpretation, Gesture, 9(2), pp147--180, John Benjamins Publishing Company.

• Emergence of New Sign Languages

Ann Senghas's Homepage

Nicaraguan Sign Language

Coppola and Senghas: to appear, The emergence of deixis in Nicaraguan signing [pdf]

Senghas and Coppola: 2001, How Nicaraguan Sign Language Acquired a Spatial Grammar [pdf]

Historical Links

Note: for some of the links ['subscription'], you'll need to connect from NYU or use a proxy server so as to have access to institutional subscriptions.

• The French Deaf community before Abbé de l'Epée

A text by Deaf historian Yann Cantin [in French]

Pierre Desloges, Observations of a Deaf-Mute on an elementary course of instruction of the Deaf-Mute (1779) [in French]

• Abbé de l'Epée

Berthier, Ferdinand: L'Abbé de l'Epée [in French]

Abbé de l'Epée, The Art of Teaching the Deaf-Mute from Birth to Speak (1820) [in French]

• Abbé Sicard

Berthier, Ferdinand: L'Abbé Sicard [in French]

• Laurent Clerc

Short biography (handspeak.com)

Short biography (Encyclopedia of American Disability History)

Laurent Clerc's Address 'Before the Governor and Both Houses of the Legislature', Connecticut, 1818

Berthier, Ferdinand: Massieu et Clerc [in French]

Auguste Bébian

Auguste Bébian, Essay on the Deaf-Mute and Natural Language [in French]

• The Bells and oralism

"Visible Speech" [Wikipedia]

Halle, Knowledge Unlearned and Untaught [pdf]

• Martha's Vineyard Sign Language

Martha's Vineyard Sign Language" [Wikipedia]

Groce, Nora Ellen: 1985, Everyone Here Spoke Sign Language: Hereditary Deafness on Martha's Vineyard

• History of ASL

Emily Shaw Yves Delaporte: 2010, New Perspectives on the History of American Sign Language [pdf]

• International Sign

Rachel Rosenstock, Emergence of a Communication System: International Sign [subscription]

Other sign language resources

• ASL

Sign Savvy (dictionary of ASL)

ASL scientific vocabulary

Science/Mathematics ASL Lexicon

ASL fingerspelling

Deaf Mosaic (historical ASL news)

ASLized

Brief videos on ASL (in ASL)

Some linguistic topics in ASL

On sign language discourse (in ASL)

On Black ASL (J. Hill; in ASL)

Jewish History in ASL

Introduction to SignWriting (in ASL)

Singing in ASL (and English)

• LSF

Metadictionary of LSF

Elix dictionary (LSF dictionary, with some definitions in LSF)

Pisourd dictionary (LSF dictionary, from Geneva; with some definitions in LSF, and some transcriptions in Signwriting)

News in LSF (websourd)

L'Oeil et la Main (French LSF TV program)

Signes (Swiss LSF TV program)

Deaf people in Abbé de l'Epée's time (Yann Cantin, LSF)

Deaf history (Yann Cantin, LSF)

Kandinsky's life (LSF)

Bilingual education explained (LSF)