To explore the relationship between information that we can glean from the argument structures to the holistic domain 1 score for writing applications determined by graders for the ASAP dataset, we generate scatter plots with points represented with density to compare either the number of optimized relations or the proportion of supported claims to the holistic score. For both, we find statistically significant relationships and satisfactory R-squared values. Therefore, we conclude that visualizing the structure of persuasive essays may be a useful tool for evaluating their writing quality. However, it is worth noting that there is considerable heteroskedasticity for the relation between scores and optimized relations, which may be a result of our implementation and call into question our statistical findings.
Here are some visualized essay examples with varying quality (higher the D1 Score the better the quality).