Beata Beigman Klebanov


Greetings!

I am a Senior Research Scientist at Educational Testing Service, Princeton, NJ.
I work on automated evaluation of essays, as well as, more generally, on automated analysis of texts for various purposes.

Some aspects I am interested in are: vocabulary choice, use of metaphor, effective argumentation, adherence to conventions of genre, topicality, stance-taking and sentiment, sourcing, and use of facts.


Before joining ETS, I was a post-doctoral fellow at Kellogg School of Business, Northwestern University where I used computational approaches to analyze political rhetoric.

To send me an email, put periods between the words in my tripartite name, at gmail.

DATA RELEASES:
Metaphor data and benchmarks have been released here.
Sentiment data for noun-noun compounds has been released here.


Publications

Book

Veale, T., Shutova, E., Beigman Klebanov, B. (2016)
Metaphor: A Computational Perspective. 
Synthesis Lectures in Human Language Technologies
Hirst, G. (Ed.). Morgan & Claypool Publishers. [link]


Book Chapters

Burstein, J., Beigman Klebanov, B., Madnani, N., Faulkner, A. (2013)

Sentiment Analysis for Essay Evaluation.
Handbook of Automated Essay Scoring: Current Applications and Future Directions.
Shermis, M.D., & Burstein, J. (Eds.). New York: Routledge.


Edited volumes
 

Beigman Klebanov, B., Shutova, E., Lichtenstein, P.  (eds.), 2016.
Proceedings of NAACL 2016 Workshop on Metaphor in NLP. San Diego, CA. [pdf] [bib]
 
Shutova, E., Beigman Klebanov, B., Lichtenstein, P.  (eds.), 2015.
Proceedings of NAACL-HLT 2015 Workshop on Metaphor in NLP. Denver, CO. [pdf] [bib]

Beigman Klebanov, B., Shutova, E., Lichtenstein, P.  (eds.), 2014.
Proceedings of ACL 2014 Workshop on Metaphor in NLP. Baltimore, MD. [pdf] [bib]
 
Shutova, E., Beigman Klebanov, B., Tetreault, J., Kozareva, Z. (eds.), 2013.
Proceedings of NAACL-HLT 2013 Workshop on Metaphor in NLP. Atlanta, GA. [pdf] [bib]


Journals

NEW
Beigman Klebanov, B., Burstein, J., Harackiewicz, J., Priniski, S., Mulholland, M. (2017) 
Reflective Writing About the Utility Value of Science as a Tool for Increasing STEM Motivation and Retention – Can AI Help Scale Up? 
International Journal of Artificial Intelligence in Education, DOI: 10.1007/s40593-017-0141-4[authors' final draft]
The final publication is available at Springer via http://dx.doi.org/10.1007/s40593-017-0141-4


Flor, M., Beigman Klebanov, B. (2014)
Associative lexical cohesion as a factor in text complexity.
International Journal of Applied Linguistics, 165(2): 223-256. [abstract] [authors' final draft]



NEW : DATA RELEASED
Beigman Klebanov, B., Burstein, J., Madnani, N. (2013)
Sentiment Profiles of Multi-Word Expressions in Test-Taker Essays: The Case of Noun-Noun Compounds.
ACM Transactions on Speech and Language Processing,
10(3):12 [pdf] [data]
 
 
Beigman Klebanov, B., Madnani, N., Burstein, J. (2013)
Using Pivot-Based Paraphrasing and Sentiment Profiles to Improve a Subjectivity Lexicon  for Essay Data.
Transactions of the Association for Computational Linguistics, 1: 99-110 [pdf]

Kaufer, D., Parry-Giles, S., Beigman Klebanov, B. (2012).
The “image bite” and political
language: NBC news coverage of Hillary Clinton from scorned wife to senate candidate.
Journal of Language and Politics, 11(3): 336-356 [pdf]


Beigman Klebanov, B., Kaufer, D., Franklin, H. (2010).
A figure in a field: Semantic fields based analysis of antithesis in political speech.
Cognitive Semiotics, 6: 121-154
[pdf]


Beigman Klebanov, B., Beigman, E. (2009).
From annotator agreement to noise models.
Computational Linguistics, 35(4): 495-503 [pdf]


Beigman Klebanov, B., Diermeier, D., Beigman, E. (2008).
Lexical cohesion analysis of political speech.
Political Analysis, 16(4): 447-463 [pdf]


Beigman Klebanov, B., Diermeier, D., Beigman, E. (2008).
Automatic annotation of semantic fields for political science research.
Journal of Information Technology and Politics, 5(1): 95-120 
[pdf]


Beigman Klebanov, B., Shamir, E. (2006).
Reader-based exploration of lexical cohesion.
Language Resources and Evaluation, 40(2): 109-126 
[pdf] [annotation protocol]


Proceedings

DATA RELEASED
Beigman Klebanov, B., Leong, C., Gutierrez, D., Shutova, E., Flor, M. 
Semantic classifications for detection of verb metaphors.
ACL 2016 [pdf] [bib] [data]


Beigman Klebanov, B., Stab, C., Burstein, J., Song, Y., Gyawali, B., Gurevych, I.
Argumentation: Content, Structure, and Relationship with Essay Quality
Argument Mining 2016 [pdf] [bib]

Burstein, J., Beigman Klebanov, B., Elliot, N., Molloy, H.
A Left Turn: Automated Feedback & Activity Generation for Student Writers.
Language Teaching and Language Technology 2016 [pdf]


Beigman Klebanov, B., Flor, M., Gyawali, B.
Topicality-based indices for Essay Scoring. 
NLP for Building Educational Applications 2016 [pdf] [bib]

Beigman Klebanov, B., Burstein, J., Harackiewicz, J., Priniski, S., Mulholland, M.
Enhancing STEM Motivation through Personal and Communal Values: NLP for Assessment of Utility Value in Student Writing. 
NLP for Building Educational Applications 2016 [pdf] [bib]

DATA RELEASED
Beigman Klebanov, B., Leong, C., Flor, M. 
Supervised Word-Level Metaphor Detection: Experiments with Concreteness and Reweighting of Examples. 
Metaphor in NLP 2015 [pdf] [bib] [data]


Flor, M., Beigman Klebanov, B.
ETS Lexical Associations System for the CogALex Shared Task.
Cognitive Aspects of the Lexicon (CogALex) 2014 [pdf] [bib]


 
Beigman Klebanov, B., Madnani, N., Burstein, J., Somasundaran, S.
Content Importance Models for Scoring Writing from Sources.
ACL 2014 [pdf] [bib]

 
 
Beigman Klebanov, B., Beigman, E.
Difficult cases: From Learning to Annotation, and Back.
ACL 2014 [pdf] [bib]

 
Beigman Klebanov, B., Leong, C., Heilman, M., Flor, M.
Different Texts, Same Metaphors: Unigrams and Beyond.
Metaphor in NLP 2014 [pdf] [bib]
 
 
Song, Y., Heilman, M., Beigman Klebanov, B., Deane, P.
Applying Argumentation Schemes to Essay Scoring
Argumentation Mining 2014 [pdf] [bib]
 

Beigman Klebanov, B., Flor, M. 
Word Association Profiles and their Use for Automated Scoring of Essays. 
ACL 2013 [pdf] [bib]

Beigman Klebanov, B., Flor, M. 
Associative Texture is Lost in Translation.
Discourse in Machine Translation 2013 [pdf] [bib]
  

Beigman Klebanov, B., Flor, M. 
Argumentation-relevant Metaphors in Text-Taker Essays.
Metaphor in NLP 2013 [pdf] [bib]
  
Flor, M., Beigman Klebanov, B., Sheehan, K. 
Lexical Tightness and Lexical Complexity.
NLP for Improving Textual Accessibility 2013 [pdf] [bib]
  

Beigman Klebanov, B., Higgins, D.
Measuring the use of factual information in test-taker essays.
NLP for Building Educational Applications 2012
[pdf] [bib]


Beigman Klebanov, B., Burstein, J., Madnani, N., Faulkner, A., Tetreault, J.
Building Subjectivity Lexicon(s) from Scratch for Essay Data.
CICLING 2012


Beigman Klebanov, B., Beigman, E.
A Game-Theoretic Model of Metaphorical Bargaining..
 
ACL 2010 [pdf] [bib]


Beigman Klebanov, B., Beigman, E., Diermeier, D.
Vocabulary choice as an indicator of perspective.

ACL 2010 [pdf] [bib]


Beigman Klebanov, B., Beigman, E.
Some empirical evidence for annotation noise in a benchmarked dataset.

NAACL 2010 [pdf] [bib]

Beigman, E., Beigman Klebanov, B.
Learning with annotation noise.

ACL 2009 
[pdf] [bib]


Beigman Klebanov, B., Beigman, E., Diermeier, D.
Discourse topics and metaphors.

Computational Approaches to Linguistic Creativity 2009 
[pdf] [bib]


Beigman Klebanov, B., Beigman, E., Diermeier, D.
Analyzing disagreements.

Human Judgments in Computational Linguistics 2008 
[pdf]


Beigman Klebanov, B.
Measuring semantic relatedness using people and WordNet.

NAACL 2006 
[pdf] [bib]


Beigman Klebanov, B.
Using readers to identify lexical cohesive structures in text.

Student Research Workshop at ACL 2005 
[pdf] [bib]

* This paper is superseded by the Language Resources and Evaluation paper "Reader-based exploration of lexical cohesion."


Beigman Klebanov, B.
, Knight, K., Marcu, D.
Text simplification for information-seeking applications.

Ontologies, Databases, and Applications of Semantics
 2004 
[pdf]

Klebanov, B., Wiemar-Hastings, P.
The role of world knowledge in pronominal anaphora resolution.

Reference Resolution for NLP Symposium 2002 


Klebanov, B., Wiemar-Hastings, P.
Using LSA for pronominal anaphora resolution.

CICLING 2002

Ċ
Beata Beigman Klebanov,
May 5, 2013, 12:11 PM
Ċ
Beata Beigman Klebanov,
Jan 20, 2015, 10:42 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:27 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:19 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:03 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:15 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:16 AM
Ċ
Beata Beigman Klebanov,
Jan 23, 2015, 10:19 AM
Ċ
Beata Beigman Klebanov,
May 27, 2016, 4:30 PM