Beata Beigman Klebanov


Greetings!

I am a Senior Research Scientist at Educational Testing Service, Princeton, NJ. 
 
I work on automated evaluation of essays, as well as, more generally, on automated analysis of texts for various purposes.
Some aspects I am interested in are: vocabulary choice, use of metaphor, effective argumentation, adherence to conventions 
of genre, topicality, stance-taking and sentiment, sourcing, and use of facts.

Before joining ETS, I was a post-doctoral fellow at Kellogg School of Business, Northwestern University where I used computational approaches to analyze political rhetoric.

To send me an email, put periods between the words in my tripartite name, at gmail.


Data Releases 
Metaphor data and benchmarks have been released here.
Sentiment data for noun-noun compounds has been released here.


Publications

Book

Veale, T., Shutova, E., Beigman Klebanov, B., (2016)
Metaphor: A Computational Perspective. 
Synthesis Lectures in Human Language Technologies. Hirst, G. (Ed.). Morgan & Claypool Publishers. [link]  


Book Chapters

Burstein, B., Beigman Klebanov, B., Madnani, N., Faulkner, A. (2013)
Sentiment Analysis for Essay Evaluation. 
Handbook of Automated Essay Scoring: Current Applications and Future Directions. Shermis, M.D., Burstein, J. (Eds.). New York: Routledge.  


Edited volumes

Beigman Klebanov, B., Shutova, E., Lichtenstein, P.  (eds.), 2016.
Proceedings of NAACL 2016 Workshop on Metaphor in NLP. San Diego, CA. [pdf] [bib]

Shutova, E., Beigman Klebanov, B., Lichtenstein, P.  (eds.), 2015.
Proceedings of NAACL 2015 Workshop on Metaphor in NLP. Denver, CO. [pdf] [bib]

Beigman Klebanov, B., Shutova, E., Lichtenstein, P.  (eds.), 2014.
Proceedings of ACL 2014 Workshop on Metaphor in NLP. Baltimore, MD. [pdf] [bib]

Shutova, E., Beigman Klebanov, B., Tetreault, J., Kozareva, Z. (eds.), 2013.
Proceedings of NAACL 2013 Workshop on Metaphor in NLP. Atlanta, GA. [pdf] [bib]


Journals

NEW
Beigman Klebanov, B., Burstein, J., Harackiewicz, J., Priniski, S., Mulholland, M. (2017) 
Reflective Writing About the Utility Value of Science as a Tool for Increasing STEM Motivation and Retention – Can AI Help Scale Up? 
International Journal of Artificial Intelligence in Education, DOI: 10.1007/s40593-017-0141-4[authors' final draft]
The final publication is available at Springer via http://dx.doi.org/10.1007/s40593-017-0141-4

NEW
Song, Y., Deane, P., Beigman Klebanov, B. (2017)
Toward the Automated Scoring of Written Arguments: Developing an Innovative Approach to Annotation. 
ETS Research Report Series. DOI:10.1002/ets2.12138  [pdf] 

Flor, M., Beigman Klebanov, B. (2014)
Associative lexical cohesion as a factor in text complexity.
International Journal of Applied Linguistics, 165(2): 223-256. [abstract] [authors' final draft]


Beigman Klebanov, B., Burstein, J., Madnani, N.(2013)
Sentiment Profiles of Multi-Word Expressions in Test-Taker Essays: The Case of Noun-Noun Compounds. 
ACM Transactions on Speech and Language Processing, 10(3):12 [pdf] [data]  

Beigman Klebanov, B., Madnani, N., Burstein, J. (2013)
Using Pivot-Based Paraphrasing and Sentiment Profiles to Improve a Subjectivity Lexicon for Essay Data. 
Transactions of the Association for Computational Linguistics (TACL), 1: 99-110 [pdf] 

Kaufer, D., Perry-Giles, S., Beigman Klebanov, B., (2012)
The "image-bite" and political language: NBC news coverage of Hillary Clinton from scorned wife to senate candidate.
Journal of Language and Politics, 11(3): 336-356 [pdf]

Beigman Klebanov, B., Kaufer, D., Franklin, H. (2010).
A figure in a field: Semantic fields based analysis of antithesis in political speech.
Cognitive Semiotics, 6: 121-154
[pdf]

Beigman Klebanov, B., Beigman, E. (2009).
From annotator agreement to noise models.
Computational Linguistics, 35(4): 495-503 [pdf]

Beigman Klebanov, B., Diermeier, D., Beigman, E. (2008).
Lexical cohesion analysis of political speech.
Political Analysis, 16(4): 447-463 [pdf]

Beigman Klebanov, B., Diermeier, D., Beigman, E. (2008).
Automatic annotation of semantic fields for political science research.
Journal of Information Technology and Politics, 5(1): 95-120 
[pdf]

Beigman Klebanov, B., Shamir, E. (2006).
Reader-based exploration of lexical cohesion.
Language Resources and Evaluation, 40(2): 109-126 
[pdf] [annotation protocol]


Proceedings


Beigman Klebanov, B., Leong, C., Gutierrez, D., Shutova, E., Flor, M. 
Semantic classifications for detection of verb metaphors.
ACL 2016 [pdf] [bib] [data]


Beigman Klebanov, B., Stab, C., Burstein, J., Song, Y., Gyawali, B., Gurevych, I.
Argumentation: Content, Structure, and Relationship with Essay Quality
Argument Mining 2016 [pdf] [bib]

Burstein, J., Beigman Klebanov, B., Elliot, N., Molloy, H.
A Left Turn: Automated Feedback & Activity Generation for Student Writers.
Language Teaching and Language Technology 2016 [pdf]


Beigman Klebanov, B., Flor, M., Gyawali, B.
Topicality-based indices for Essay Scoring. 
NLP for Building Educational Applications 2016 [pdf] [bib]

Beigman Klebanov, B., Burstein, J., Harackiewicz, J., Priniski, S., Mulholland, M.
Enhancing STEM Motivation through Personal and Communal Values: NLP for Assessment of Utility Value in Student Writing. 
NLP for Building Educational Applications 2016 [pdf] [bib]


Beigman Klebanov, B., Leong, C., Flor, M. 
Supervised Word-Level Metaphor Detection: Experiments with Concreteness and Reweighting of Examples. 
Metaphor in NLP 2015 [pdf] [bib] [data]


Flor, M., Beigman Klebanov, B.
ETS Lexical Associations System for the CogALex Shared Task.
Cognitive Aspects of the Lexicon (CogALex) 2014 [pdf] [bib]


 
Beigman Klebanov, B., Madnani, N., Burstein, J., Somasundaran, S.
Content Importance Models for Scoring Writing from Sources.
ACL 2014 [pdf] [bib]

 
 
Beigman Klebanov, B., Beigman, E.
Difficult cases: From Learning to Annotation, and Back.
ACL 2014 [pdf] [bib]

 
Beigman Klebanov, B., Leong, C., Heilman, M., Flor, M.
Different Texts, Same Metaphors: Unigrams and Beyond.
Metaphor in NLP 2014 [pdf] [bib]
 
 
Song, Y., Heilman, M., Beigman Klebanov, B., Deane, P.
Applying Argumentation Schemes to Essay Scoring
Argumentation Mining 2014 [pdf] [bib]
 

Beigman Klebanov, B., Flor, M. 
Word Association Profiles and their Use for Automated Scoring of Essays. 
ACL 2013 [pdf] [bib]

Beigman Klebanov, B., Flor, M. 
Associative Texture is Lost in Translation.
Discourse in Machine Translation 2013 [pdf] [bib]
  

Beigman Klebanov, B., Flor, M. 
Argumentation-relevant Metaphors in Text-Taker Essays.
Metaphor in NLP 2013 [pdf] [bib]
  
Flor, M., Beigman Klebanov, B., Sheehan, K. 
Lexical Tightness and Lexical Complexity.
NLP for Improving Textual Accessibility 2013 [pdf] [bib]
  

Beigman Klebanov, B., Higgins, D.
Measuring the use of factual information in test-taker essays.
NLP for Building Educational Applications 2012
[pdf] [bib]


Beigman Klebanov, B., Burstein, J., Madnani, N., Faulkner, A., Tetreault, J.
Building Subjectivity Lexicon(s) from Scratch for Essay Data.
CICLING 2012


Beigman Klebanov, B., Beigman, E.
A Game-Theoretic Model of Metaphorical Bargaining..
 
ACL 2010 [pdf] [bib]


Beigman Klebanov, B., Beigman, E., Diermeier, D.
Vocabulary choice as an indicator of perspective.

ACL 2010 [pdf] [bib]


Beigman Klebanov, B., Beigman, E.
Some empirical evidence for annotation noise in a benchmarked dataset.

NAACL 2010 [pdf] [bib]

Beigman, E., Beigman Klebanov, B.
Learning with annotation noise.

ACL 2009 
[pdf] [bib]


Beigman Klebanov, B., Beigman, E., Diermeier, D.
Discourse topics and metaphors.

Computational Approaches to Linguistic Creativity 2009 
[pdf] [bib]


Beigman Klebanov, B., Beigman, E., Diermeier, D.
Analyzing disagreements.

Human Judgments in Computational Linguistics 2008 
[pdf]


Beigman Klebanov, B.
Measuring semantic relatedness using people and WordNet.

NAACL 2006 
[pdf] [bib]


Beigman Klebanov, B.
Using readers to identify lexical cohesive structures in text.

Student Research Workshop at ACL 2005 
[pdf] [bib]

* This paper is superseded by the Language Resources and Evaluation paper "Reader-based exploration of lexical cohesion."


Beigman Klebanov, B.
, Knight, K., Marcu, D.
Text simplification for information-seeking applications.

Ontologies, Databases, and Applications of Semantics
 2004 
[pdf]

Klebanov, B., Wiemar-Hastings, P.
The role of world knowledge in pronominal anaphora resolution.

Reference Resolution for NLP Symposium 2002 


Klebanov, B., Wiemar-Hastings, P.
Using LSA for pronominal anaphora resolution.

CICLING 2002

Ċ
Beata Beigman Klebanov,
May 5, 2013, 12:11 PM
Ċ
Beata Beigman Klebanov,
Jan 20, 2015, 10:42 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:27 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:19 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:03 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:15 AM
Ċ
Beata Beigman Klebanov,
May 5, 2013, 11:16 AM
Ċ
Beata Beigman Klebanov,
Jan 23, 2015, 10:19 AM
Ċ
Beata Beigman Klebanov,
May 27, 2016, 4:30 PM