CMSC 191: Computational Social Network Analysis
Validity and Reliability in Network Data
The topic discusses the fundamental principles of validity and reliability as applied to computational social network data. Measurement error and sampling bias are analyzed as primary sources of distortion in network representation, distinguishing between omissions (missing edges or nodes) and commissions (false inclusions). Class exercises demonstrate how perturbations in the observed graph alter key metrics such as density and average shortest path, revealing the fragility of inference in incomplete datasets. Reliability is further examined through temporal analysis of dynamic networks, where measures such as the Jaccard Index and Quadratic Assignment Procedure (QAP) are used to test structural stability across time slices.Â
Distinguishing genuine social evolution from noise is achieved through permutation testing and null distribution analysis. The concept of triangulation is introduced to emphasize methodological redundancy as a safeguard against misinterpretation, and methodological pluralism is presented as a strategy for robust structural inference. Together, these discussions establish that the credibility of network analysis rests not only on computation but also on critical evaluation of its data and methods.
Assess the validity and reliability of network datasets under various sampling and measurement conditions.
Identify sources of bias and error that affect interpretation.
Implement triangulation and verification strategies to strengthen analytical confidence.
How does sampling bias affect the structural integrity of a network?
What distinguishes real social change from data error in longitudinal analysis?
Why is methodological pluralism essential to ensuring reliable results?
How can triangulation be used to enhance credibility in CSNA findings?
Validity and Reliability in Network Data* (class handout)
Interrogating the Trustworthiness of Data
Measurement Error and Sampling Bias
Modeling the Imperfect Graph: Distortion by Missing Data
Identifying and Mitigating Error Sources
Reliability Across Temporal Snapshots
Stability Checks: Analyzing Network Time-Slices
Distinguishing Signal from Noise: True Change vs. Artifact
Triangulation and Verification Strategies
Cross-Validation: Converging on Confidence
Methodological Pluralism: The Power of Multiple Lenses
From Error to Evidence
Note: Links marked with an asterisk (*) lead to materials accessible only to members of the University community. Please log in with your official University account to view them.
The semester at a glance:
Validity and Reliability . . .
Project Development . . .
Implementation . . .
Borgatti, Stephen P., Everett, Martin G., and Johnson, Jeffrey C. Analyzing Social Networks. SAGE Publications, 2018.
Wasserman, Stanley, and Katherine Faust. Social Network Analysis: Methods and Applications. Cambridge University Press, 1994. (Core Text)
Access Note: Published research articles and books are linked to their respective sources. Some materials are freely accessible within the University network or when logged in with official University credentials. Others will be provided to enrolled students through the class learning management system (LMS).