Performance Engineering

Performance Engineering Tools

I have been interested in performance engineering of complex software systems for many years. Initially this was from time I worked in the software industry and investigated relational database indexing strategies and optimisation in the late 1980s, along with performance engineering of operating systems I undertook in my Honors degree in the late 1980s. In the late 1990s Ian Gorton and Anna Liu at the CSIRO introduced me to the Middleware Technology Evaluation (MTE) project which sparked further interest and collaborative research with Anna. Rainbow Cai, now at NICTA in Canberra did a Masters and PhD with me (2001-2008) which investigated model-driven engineering techniques and tools for performance engineering. I worked with XSOL in the early 2000s on further object-relational technology optimisation and performance engineering and later optimisation of system integration techniques and tools.

Currently I am interested in performance engineering for Cloud Computing systems, specifically data optimisation for the cloud (storage vs transmission vs re-creation) and performance assessment of cloud platforms and architectures. I am also interested in performance engineering tools for very large scale enterprise systems.

Representative funding

  • ARC DP 110101340 - 2011-2013 - Y Yang, J Chen, J Grundy, $360,000 for 3 years, Cost effective storage of massive intermediate data in cloud computing applications;

  • ARC LP 100100622 - 2010 - 2012 - J Han, J Grundy, J-G Schneider, L Grunske, J Radford, $470,000 for 3 years, Large-Scale Emulation for Enterprise Software Systems

  • FRST RFI 2007 - 2007-2012 - J Grundy, J Hosking, RJ Noble, E Tempero, E Mendes, N Churcher, S MacDonnell, J Dietrich, $3,800,000 for 4.75 years, Software Process and Product Improvement

  • FRST RFI 2002 - 2002 - 2005 - J Grundy, J Hosking, R Amor, E Mendes, E Tempero, RJ Noble, R Biddle, $2,300,000 for 5 years, Domain-specific software tools

  • FRST NERF 2002 - 2002-2003 - J Blackham, J Grundy, J Hosking, $842,000 for 2 years, A Real-time Dataset for Enterprise Application Integration

  • FRST NERF 1999 - 1999-2001 - J Blackham, $1,250,000 for 2.5 years, Database Aggregation for E-Commerce

Representative papers and projects

New Performance Metrics and Analysis for Object-Oriented Systems

  • Maplesden, D., Tempero, E., Hosking, J.G., Grundy, J.C. A Cost/Benefit Approach to Performance Analysis, 6th ACM/SPEC International Conference on Software Performance Engineering (ICPE 2016), Delft, Netherlands, 12-18 March, 2016, ACM Press. -- Final publication available at DOI or ACM Author pre-published version PDF

  • Maplesden, D., Tempero, E., Hosking, J.G., Grundy, J.C. Performance Analysis for Object-Oriented Software: A Systematic Mapping, IEEE Transactions on Software Engineering, vol 41, no. 7, July 2015, pp 691-710 . -- Final publication available at DOI Author pre-published version PDF

  • Maplesden, D., von Randow, K., Tempero, E., Hosking, J.G., Grundy, J.C., Performance Analysis using Subsuming Methods: An Industrial Case Study, IEEE/ACM International Conference on Software Engineering (ICSE 2015), Florence, Italy, May 16-23 2015. -- Final publication available at DOI Author pre-published version PDF

  • Maplesden, D., Tempero, E., Hosking, J.G., Grundy, J.C., Subsuming Methods: Finding New Optimisation Opportunities in Object-Oriented Software, 5th ACM/SPEC International Conference on Software Performance Engineering (ICPE 2015), Austin, Texas, Jan 31-4 Feb 2015, ACM Press. -- Final publication available at DOI PDF Author pre-published version PDF

Energy and Cost for Cloud Computing Systems

  • Chen, F., Grundy, J.C., Schneider, J-G, Yang, Y., He, Q. StressCloud: A Tool for Analysing Performance and Energy Consumption of Cloud Applications, In Proceedings of the 2015 IEEE/ACM International Conference on Software Engineering (ICSE 2015), Florence, Italy, 18-23 May 2015, IEEE. -- DOI Video PDF

    • Chen, F., Grundy, J.C., Schneider, J-G, Yang, Y. and He, Q. Automating Performance and Energy Consumption Analysis for Cloud Applications, The IEEE SERVICES 2015 Visionary Track: The Future of Software Engineering FOR and IN Cloud, New York, USA, July 31 2015, IEEE. DOI PDF

  • Chen, F., Grundy, J.C., Schneider, J-G, Yang, Y. and He, Q. Automated Analysis of Performance and Energy Consumption for Cloud Applications, 2014 ACM/SPEC International Conference on Performance Engineering, Dublin, Ireland, Mar 23-26 2014, ACM Press. PDF

  • Chen, F., Grundy, J.C., Yang, Y., Schneider, J-G., He, Q. Experimental Analysis of Task-based Energy Consumption in Cloud Computing Systems, 4th ACM/SPEC International Conference on Performance Engineering (ICPE2013), April 21-24 2013, Praque, Czech Republic, ACM Press PDF

  • Chen, F., Schneider, J-G., Yang, Y., Grundy, J.C. and He, Q. An Energy Consumption Model and Analysis Tool for Cloud Computing Environments, 1st ICSE Workshop on Green and Sustainable Software Engineering, Zurich, Switzerland, 3rd June 2012. PDF

Enterprise Environment Emulation

  • Versteeg, S., Du, M., Grundy, J.C., Schneider, J-G, Han, J., Goyal, M. Opaque Service Virtualisation: A Practical Tool for Emulating Endpoint Systems, In IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice Track (ICSE 2016), Austin, Texas, 14-22 May 2016, ACM Press. -- Final publication available at DOI or ACM Author pre-published version PDF

  • Du, M., Schneider, J-G., Hine, C., Grundy, J.C., Versteeg, S., Generating service models by trace subsequence substitution, 9th International ACM Conference on the Quality of Software Architectures, Vancouver, Canada, June 17-21, 2013, ACM Press. PDF

  • Du, M., Versteeg, S., Schneider, J-G, Han, J. and Grundy, J.C., Interaction Traces Mining for Efficient System Responses Generation, 2nd International Workshop on Software Mining, 11th Nov 2013, Palo Alto, CA, USA. (Best paper award) PDF

MaramaMTE, ArgoMTE and Softarch/MTE

  • Cai, Y., Grundy, J.C. and Hosking, J.G. Synthesizing Client Load Models for Performance Engineering via Web Crawling, In Proceedings of the 2007 IEEE/ACM International Conference on Automated Software Engineering, Atlanta, Nov 5-9 2007, IEEE CS Press PDF

  • Grundy, J.C., Hosking, J.G., Li, L. And Liu, N. Performance engineering of service compositions, ICSE 2006 Workshop on Service-oriented Software Engineering, Shanghai, May 2006.

ACM DL Author-ize service
  • PDF. Grundy, J.C., Cai, Y. and Liu, A. SoftArch/MTE: Generating Distributed System Test-beds from High-level Software Architecture Descriptions, Automated Software Engineering, Kluwer Academic Publishers, vol. 12, no. 1, January 2005, pp. 5-39. PDF

  • Cai, Y., Grundy, J.C. and Hosking, J.G. Experiences Integrating and Scaling a Performance Test Bed Generator with an Open Source CASE Tool, In Proceedings of the 2004 IEEE International Conference on Automated Software Engineering, Linz, Austria, September 20-24, IEEE CS Press, pp. 36-45. PDF

  • Grundy, J.C., Wei, Z., Nicolescu, R. and Cai, Y. An Environment for Automated Performance Evaluation of J2EE and ASP.NET Thin-client Architectures, In Proceedings of the 2004 Australian Software Engineering Conference, Melbourne, Australia, April 14-17 2004, IEEE CS Press PDF

XSOL Virtual Database

  • Grundy, J.C., Newby, S., Whittmore, T., and Grundeman, P. Extending a persistent object framework to enhance enterprise application server performance, In Proceedings of the 2002 Australasian Database Conference, Melbourne, Australia. PDF

  • Grundy, J.C., Bai, J., Blackham, A.J., Hosking, J.G., Amor, R., An architecture for efficient, flexible system integration, 2003 International Conference on Internet Computing (IC 2003), 23-26. PDF

  • Blackham, J., Grundeman, P., Grundy, J.C., Hosking, J. and Mugridge, W. Supporting Pervasive Business via Virtual Database Aggregation, In Proceedings of Evolve’2001: Pervasive Business, Sydney, Australia, 6-9 May 2001, DSTC PDF