RQ2: What types of operations are performed by the models?
Results regarding the operations performed by the models:
- Overview
- Syntactic Correctness
- Operation & Bug Coverage
- Qualitative Examples
Overview
Overview
Overview of the models' performances in terms of perfect predictions, operation and bug coverage, and syntactic correctness.
Syntactic Correctness
Syntactic Correctness
The table shows the percentage of syntactically correct fixes generated by the models with different beam size
Operations & Bug Coverage
Operations & Bug Coverage
Operation and bug coverage values for different beam widths
Qualitative Examples
Qualitative Examples
Interesting examples of perfect fixes generated by the models. More examples available in the Example page.
