Related Work

Related Works About Testing and Evaluation Methods

Related Works About Testing and Evaluation Frameworks

Detailed Information for Testing and Evaluation Methods

• Test and evaluate by features

• Test and evaluate by benchmarks

• Test and evaluate by usage scenarios

Detailed Information for Testing and Evaluation Frameworks

Reference

1. Linux Virtualization Tests: URL https://github.com/autotest/virt-test

2. Hu, W., Hicks, A., Zhang, L., Dow, E.M., Soni, V., Jiang, H., Bull, R., Matthews, J.N.: A Quantitative Study of Virtual Machine Live Migration. Proceedings of the 2013 ACM Cloud and Autonomic Computing Conference (2013)

3. Svard, P., Hudzia, B., Walsh, S., Tordsson, J., Elmroth, E.: Principles and Performance Characteristics of Algorithms for Live VM Migration. ACM SIGOPS Operating Systems Review 49(1), 142-155 (2015)

4. Ye, K., Wu, Z., Zhou, B.B., Jiang, X., Wang, C., Zomaya, A.Y.: Virt-B: Towards Performance Benchmarking of Virtual Machine Systems. IEEE Internet Computing 18(3), 64-72 (2014)

5. Lockwood, G.K., Tatineni, M., Wagner, R.: SR-IOV: Performance Benefits for Virtualized Interconnects. Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment p. 47 (2014)

6. Che, J., Yu, Y., Shi, C., Lin, W.: A Synthetical Performance Evaluation of OpenVZ, Xen and KVM. Proceedings of the 2010 IEEE Asia-Pacific Services Computing Conference pp. 587-594 (2010)

   1. Padala, P., Zhu, X., Wang, Z., Singhal, S., Shin, K.G.: Performance Evaluation of Virtualization Technologies for Server Consolidation. Tech. rep., HP Labs (2007)

   2. Ghoshal, D., Canon, R.S., Ramakrishnan, L.: I/O Performance of Virtualized Cloud Environments. Proceedings of the Second International Workshop on Data Intensive Computing in the Clouds pp. 71-80 (2011)

   3. SPEC VIRT: URL https://www.spec.org/virt sc2013

   4. VMmark: URL http://www.vmware.com/products/vmmark

   5. Almari, F.N., Zavarsky, P., Ruhl, R., Lindskog, D., Aljaedi, A.: Performance Analysis of Oracle Database in Virtual Environments. Proceedings of the 2012 26th International Conference on Advanced Information Networking and Applications Workshops pp. 1238-1245 (2012)

   6. Carrozza, G., Battaglia, L., Manetti, V., Marotta, A., Canonico, R., Avallone, S.: On the Evaluation of VM Provisioning Time in Cloud Platforms for Mission-Critical Infrastructures. Proceedings of the 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing pp. 802-810 (2014)

   7. Barker, S.K., Shenoy, P.: Empirical Evaluation of Latency-Sensitive Application Performance in the Cloud. Proceedings of the First Annual ACM SIGMM Conference on Multimedia Systems pp. 35-46 (2010)

   8. Varrette, S., Guzek, M., Plugaru, V., Besseron, X., Bouvry, P.: HPC Performance and Energy-Efficiency of Xen, KVM and VMware Hypervisors. Proceedings of the 25th International Symposium on Computer Architecture and High Performance Computing pp. 89-96 (2013)

   9. Pham, C., Chen, D., Kalbarczyk, Z., Iyer, R.K.: CloudVal: A Framework for Validation of Virtualization Environment in Cloud Infrastructure. Proceedings of the IEEE/IFIP 41st International Conference on Dependable Systems and Networks pp. 189-196 (2011)

   10. Jenkins, W., Vilkomir, S., Sharma, P., Pirocanac, G.: Framework for Testing Cloud Platforms and Infrastructures. Proceedings of the 2011 International Conference on Cloud and Service Computing pp. 134-140 (2011)

   11. Rings, T., Grabowski, J., Schulz, S.: A Testing Framework for Assessing Grid and Cloud Infrastructure Interoperability. International Journal on Advances in Systems and Measurements 4(1-2), 95-108 (2011)

   12. Jayasinghe, D., Swint, G., Malkowski, S., Li, J., Wang, Q., Park, J., Pu, C.: Expertus: A Generator Approach to Automate Performance Testing in IaaS Clouds. Proceedings of the 2012 IEEE 5th International Conference on Cloud Computing pp. 115-122 (2012)

   13. Zhao, L., Liu, A., Keung, J.: Evaluating Cloud Platform Architecture with the CARE Framework. Proceedings of the 2010 Asia Pacific Software Engineering Conference pp. 60-69 (2010)

   14. Zhao, L., Liu, A., Keung, J.: Evaluation Framework of Virtualization Systems for Cloud Computing. Proceedings of the 2012 IEEE Asia Pacific Cloud Computing Congress pp. 48-52 (2012)

   15. Reddy, P.V.V., Rajamani, L.: Performance Evaluation of Operating Systems in the Private Cloud with XenServer Hypervisor using SIGAR Framework. Proceedings of the 9th International Conference on Computer Science and Education pp. 183-188 (2014)

   16. Yigitbasi, N., Iosup, A., Epema, D., Ostermann, S.: C-Meter: A Framework for Performance Analysis of Computing Clouds. Proceedings of 9th IEEE/ACM International Symposium on Cluster Computing and the Grid pp. 472-477 (2009)

   17. Nasiri, R., Hosseini, S.: A Novel Framework for Cloud Testing. International Journal of Electronics Communication and Computer Engineering 5(4), 850-854 (2014)

   18. Ye, K., Wu, Z., Zhou, B.B., Jiang, X., Wang, C., Zomaya, A.Y.: Virt-B: Towards Performance Benchmarking of Virtual Machine Systems. IEEE Internet Computing 18(3), 64-72 (2014)