RQ4: Efficiency Analysis

To thoroughly evaluate the efficiency of the SAST tools, all 8,981 contract files were analyzed, independent of the analysis outcome. 

We set a timeout limit of one hour for each tool. Taking inspiration from Ren et al.'s work [12], which underscores the importance of the maximum recursive depth on the effectiveness and efficiency of symbolic execution tools, we uniformly set this value at 45 across the tools. This parameter choice was based on the conclusions and insights derived from Ren's work. However, Manticore was an exception to this setting as it does not support user-defined maximum recursive depth settings.

Here, we display the efficiency data via tabular data, and the raw data is stored in "Evaluation Data" along with the test results .

[12] M. Ren, Z. Yin, F. Ma, Z. Xu, Y. Jiang, C. Sun, H. Li, and Y. Cai, “Empirical evaluation of smart contract testing: What is the best choice?” in Proceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis, ser. ISSTA2021. New York, NY, USA: Association for Computing Machinery, 2021, p. 566–579. [Online]. Available: https://doi.org/10.1145/3460319.3464837.