Papers

Research Papers

2022

• Automated repair of responsive web page layouts
  Proceedings of the 15th International Conference on Software Testing, Verification and Validation
  Althomali, Ibrahim and Kapfhammer, Gregory M. and McMinn, Phil

• A survey of flaky tests
  Transactions on Software Engineering and Methodology
  Parry, Owain and Kapfhammer, Gregory M. and Hilton, Michael and McMinn, Phil

• Evaluating features for machine learning detection of order- and non-order-dependent flaky tests
  Proceedings of the 15th International Conference on Software Testing, Verification and Validation
  Parry, Owain and Kapfhammer, Gregory M. and Hilton, Michael and McMinn, Phil

• Surveying the developer experience of flaky tests
  Proceedings of the 44th International Conference on Software Engineering – Software Engineering in Practice Track
  Parry, Owain and Kapfhammer, Gregory M. and Hilton, Michael and McMinn, Phil

• What do developer-repaired flaky tests tell us about the effectiveness of automated flaky test detection?
  Proceedings of the 3rd International Conference on Automation of Software Test
  Parry, Owain and Kapfhammer, Gregory M. and Hilton, Michael and McMinn, Phil

2021

• Automated visual classification of DOM-based presentation failure reports for responsive web pages
  Software Testing, Verification and Reliability
  Althomali, Ibrahim and Kapfhammer, Gregory M. and McMinn, Phil

2020

• Hybrid methods for reducing database schema test suites: Experimental insights from computational and human studies
  Proceedings of the 1st International Conference on Automation of Software Test
  Alsharif, Abdullah and Kapfhammer, Gregory M. and McMinn, Phil

• STICCER: Fast and effective database test suite reduction through merging of similar test cases
  Proceedings of the 13th International Conference on Software Testing, Verification and Validation
  Alsharif, Abdullah and Kapfhammer, Gregory M. and McMinn, Phil

• Flake it ‘till you make it: Using automated repair to induce and fix latent test flakiness
  Proceedings of the 1st International Workshop on Automated Program Repair
  Parry, Owain and Kapfhammer, Gregory M. and Hilton, Michael and McMinn, Phil

• Automatically identifying potential regressions in the layout of responsive web pages
  Software Testing, Verification and Reliability
  Walsh, Thomas A. and Kapfhammer, Gregory M. and McMinn, Phil

2019

• What factors make SQL test cases understandable for testers? A human study of automated test data generation techniques
  Proceedings of the 35th International Conference on Software Maintenance and Evolution
  Alsharif, Abdullah and Kapfhammer, Gregory M. and McMinn, Phil

• Automatic visual verification of layout failures in responsively designed web pages
  Proceedings of the 12th International Conference on Software Testing, Verification and Validation
  Althomali, Ibrahim and Kapfhammer, Gregory M. and McMinn, Phil

• Automatic detection and removal of ineffective mutants for the mutation analysis of relational database schemas
  Transactions on Software Engineering
  McMinn, Phil and Wright, Chris and McCurdy, Colton and Kapfhammer, Gregory M.

• An empirical study on the use of defect prediction for test case prioritization
  Proceedings of the 12th International Conference on Software Testing, Verification and Validation
  Paterson, David and Campos, José and Abreu, Rui and Kapfhammer, Gregory M. and Fraser, Gordon and McMinn, Phil

2018

• DOMINO: Fast and effective test data generation for relational database schemas
  Proceedings of the 11th International Conference on Software Testing, Verification and Validation
  Alsharif, Abdullah and Kapfhammer, Gregory M. and McMinn, Phil

• Generating test suites with DOMINO
  Proceedings of the 11th International Conference on Software Testing, Verification and Validation – Demonstrations Track
  Alsharif, Abdullah and Kapfhammer, Gregory M. and McMinn, Phil

• Running experiments and performing data analysis using SchemaAnalyst and DOMINO
  Proceedings of the 11th International Conference on Software Testing, Verification and Validation – Artefacts Track
  Alsharif, Abdullah and Kapfhammer, Gregory M. and McMinn, Phil

• Using controlled numbers of real faults and mutants to empirically evaluate coverage-based test case prioritization
  Proceedings of the 13th International Workshop on Automation of Software Test
  Paterson, David and Kapfhammer, Gregory M. and Fraser, Gordon and McMinn, Phil

2017

• Empirically evaluating greedy-based test suite reduction methods at different levels of test suite complexity
  Science of Computer Programming
  Lin, Chu-Ti and Tang, Kai-Wei and Wang, Jiun-Shiang and Kapfhammer, Gregory M.

• Automated layout failure detection for responsive web pages without an explicit oracle
  Proceedings of the International Symposium on Software Testing and Analysis
  Walsh, Thomas A. and Kapfhammer, Gregory M. and McMinn, Phil

• ReDeCheck: An automatic layout failure checking tool for responsively designed web pages
  Proceedings of the International Symposium on Software Testing and Analysis
  Walsh, Thomas A. and Kapfhammer, Gregory M. and McMinn, Phil

2016

• Hitchhikers need free vehicles! Shared repositories for statistical analysis in SBST
  Proceedings of the 9th International Workshop on Search-Based Software Testing
  Kapfhammer, Gregory M. and McMinn, Phil and Wright, Chris J.

• mrstudyr: Retrospectively studying the effectiveness of mutant reduction techniques
  Proceedings of the 32nd International Conference on Software Maintenance and Evolution
  McCurdy, Colton J. and McMinn, Phil and Kapfhammer, Gregory M.

• Automated search for good coverage criteria: Moving from code coverage to fault coverage through search-based software engineering
  Proceedings of the 9th International Workshop on Search-Based Software Testing
  McMinn, Phil and Harman, Mark and Fraser, Gordon and Kapfhammer, Gregory M.

• AVMf: An open-source framework and implementation of the alternating variable method
  Proceedings of the 8th International Symposium on Search-Based Software Engineering
  McMinn, Phil and Kapfhammer, Gregory M.

• Virtual mutation analysis of relational database schemas
  Proceedings of the 11th International Workshop on Automation of Software Test
  McMinn, Phil and Kapfhammer, Gregory M. and Wright, Chris J.

• SchemaAnalyst: Search-based test data generation for relational database schemas
  Proceedings of the 32nd International Conference on Software Maintenance and Evolution
  McMinn, Phil and Wright, Chris J. and Kinneer, Cody and McCurdy, Colton J. and Camara, Michael and Kapfhammer, Gregory M.

2015

• Automatically evaluating the efficiency of search-based test data generation for relational database schemas
  Proceedings of the 27th International Conference on Software Engineering and Knowledge Engineering
  Kinneer, Cody and Kapfhammer, Gregory M. and Wright, Chris J. and McMinn, Phil

• ExpOse: Inferring worst-case time complexity by automatic empirical study
  Proceedings of the 27th International Conference on Software Engineering and Knowledge Engineering
  Kinneer, Cody and Kapfhammer, Gregory M. and Wright, Chris J. and McMinn, Phil

• The effectiveness of test coverage criteria for relational database schema integrity constraints
  Transactions on Software Engineering and Methodology
  McMinn, Phil and Wright, Chris J. and Kapfhammer, Gregory M.

• Automatic detection of potential layout faults following changes to responsive web pages
  Proceedings of the 30th International Conference on Automated Software Engineering
  Walsh, Thomas A. and McMinn, Phil and Kapfhammer, Gregory M.

2014

• Parameter tuning for search-based test-data generation revisited: Support for previous results
  Proceedings of the 14th International Conference on Quality Software
  Kotelyanskii, Anton and Kapfhammer, Gregory M.

• Test suite reduction methods that decrease regression testing costs by identifying irreplaceable tests
  Information and Software Technology
  Lin, Chu-Ti and Tang, Kai-Wei and Kapfhammer, Gregory M.

• The impact of equivalent, redundant, and quasi mutants on database schema mutation analysis
  Proceedings of the 14th International Conference on Quality Software
  Wright, Chris J. and Kapfhammer, Gregory M. and McMinn, Phil

2013

• Search-based testing of relational schema integrity constraints across multiple database management systems
  Proceedings of the 6th International Conference on Software Testing, Verification and Validation
  Kapfhammer, Gregory M. and McMinn, Phil and Wright, Chris J.

• History-based test case prioritization with software version awareness
  Proceedings of the 18th International Conference on Engineering of Complex Computer Systems
  Lin, Chu-Ti and Chen, Cheng-Ding and Tsai, Chang-Shi and Kapfhammer, Gregory M.

• Efficient mutation analysis of relational database structure using mutant schemata and parallelisation
  Proceedings of the 8th International Workshop on Mutation Analysis
  Wright, Chris J. and Kapfhammer, Gregory M. and McMinn, Phil

2012

• An empirical comparison of Java remote communication primitives for intra-node data transmission
  Performance Evaluation Review
  Burdette, Philip F. and Jones, William F. and Blose, Brian C. and Kapfhammer, Gregory M.

• Do redundant mutants affect the effectiveness and efficiency of mutation analysis?
  Proceedings of the 7th International Workshop on Mutation Analysis
  Just, René and Kapfhammer, Gregory M. and Schweiggert, Franz

• Using non-redundant mutation operators and test suite prioritization to achieve efficient and scalable mutation analysis
  Proceedings of the 23rd International Symposium on Software Reliability Engineering
  Just, René and Kapfhammer, Gregory M. and Schweiggert, Franz

• Towards a method for reducing the test suites of database applications
  Poster Compendium of the 5th International Conference on Software Testing, Verification and Validation
  Kapfhammer, Gregory M.

• A framework to support research in and encourage industrial adoption of regression testing techniques
  Proceedings of the 7th Testing: Academic and Industrial Conference – Practice and Research Techniques
  Kauffman, Jonathan Miller and Kapfhammer, Gregory M.

• Reducing the cost of regression testing by identifying irreplaceable test cases
  Proceedings of the 6th International Conference on Genetic and Evolutionary Computing
  Lin, Chu-Ti and Tang, Kai-Wei and Chen, Cheng-Ding and Kapfhammer, Gregory M.

2011

• Localizing SQL faults in database applications
  Proceedings of the 26th International Conference on Automated Software Engineering
  Clark, Sarah R. and Cobb, Jake and Kapfhammer, Gregory M. and Jones, James A. and Harrold, Mary Jean

• Dynamic invariant detection for relational databases
  Proceedings of the 9th International Workshop on Dynamic Analysis
  Cobb, Jake and Jones, James A. and Kapfhammer, Gregory M. and Harrold, Mary Jean

• Ask and you shall receive: Empirically evaluating declarative approaches to finding data in unstructured heaps
  Proceedings of the 20th International Conference on Software Engineering and Data Engineering
  Jones, William F. and Kapfhammer, Gregory M.

• MAJOR: An efficient and extensible tool for mutation analysis in a Java compiler
  Proceedings of the 26th International Conference on Automated Software Engineering
  Just, René and Kapfhammer, Gregory M. and Schweiggert, Franz

• Using conditional mutation to increase the efficiency of mutation analysis
  Proceedings of the 6th International Workshop on Automation of Software Test
  Just, René and Kapfhammer, Gregory M. and Schweiggert, Franz

• Empirically evaluating regression testing techniques: Challenges, solutions, and a potential way forward
  Proceedings of the 1st International Workshop on Regression Testing
  Kapfhammer, Gregory M.

• Empirically identifying the best genetic algorithm for covering array generation
  Fast Abstract Compendium of the 3rd International Symposium on Search Based Software Engineering
  Yalan, Liang and Nie, Changhai and Kauffman, Jonathan M. and Kapfhammer, Gregory M. and Leung, Hareton

2010

• Empirically studying the role of selection operators during search-based test suite prioritization
  Proceedings of the 12th International Conference on Genetic and Evolutionary Computation
  Conrad, Alexander P. and Roos, Robert S. and Kapfhammer, Gregory M.

• Regression testing
  The Encyclopedia of Software Engineering
  Kapfhammer, Gregory M.

• A genetic algorithm to improve Linux kernel performance on resource-constrained devices
  Proceedings of the 12th International Conference Companion on Genetic and Evolutionary Computation
  Kukunas, James and Cupper, Robert D. and Kapfhammer, Gregory M.

• Using synthetic test suites to empirically compare search-based and greedy prioritizers
  Proceedings of the 12th International Conference Companion on Genetic and Evolutionary Computation
  Williams, Zachary and Kapfhammer, Gregory M.

2009

• An experimental study of methods for executing test suites in memory constrained environments
  Proceedings of the 4th International Workshop on the Automation of Software Test
  Bhadra, Suvarshi and Conrad, Alexander P. and Hurkes, Charles P. and Kirklin, Brian and Kapfhammer, Gregory M.

• An empirical comparison of methods for compressing test coverage reports
  Poster Compendium of the 3rd International Symposium on Empirical Software Engineering and Measurement
  Ostrofsky, Erik and Kapfhammer, Gregory M.

• Interactive coverage effectiveness multiplots for evaluating prioritized regression test suites
  Compendium of the 15th Information Visualization Conference
  Smith, Adam M. and Geiger, Joshua J. and Kapfhammer, Gregory M. and Renieris, Manos and Marai, G. Elisabeta

• An empirical study of incorporating cost into test suite reduction and prioritization
  Proceedings of the 24th Symposium on Applied Computing
  Smith, Adam M. and Kapfhammer, Gregory M.

2008

• Prioritizing test suites by finding Hamiltonian paths: Preliminary studies and initial results
  Fast Abstract Compendium of the 7th Testing: Academic and Industrial Conference – Practice and Research Techniques
  Bhadra, Suvarshi and Kapfhammer, Gregory M.

• Database-aware test coverage monitoring
  Proceedings of the 1st India Software Engineering Conference
  Kapfhammer, Gregory M. and Soffa, Mary Lou

2007

• Efficient time-aware prioritization with knapsack solvers
  Proceedings of the International Workshop on Empirical Assessment of Software Engineering Languages and Technologies
  Alspaugh, Sara and Walcott, Kristen R. and Belanich, Michael and Kapfhammer, Gregory M. and Soffa, Mary Lou

• Using coverage effectiveness to evaluate test suite prioritizations
  Proceedings of the International Workshop on Empirical Assessment of Software Engineering Languages and Technologies
  Kapfhammer, Gregory M. and Soffa, Mary Lou

• Test suite reduction and prioritization with call trees
  Proceedings of the 22nd International Conference on Automated Software Engineering – Demonstrations Track
  Smith, Adam M. and Geiger, Joshua J. and Kapfhammer, Gregory M. and Soffa, Mary Lou

2006

• Time-aware test suite prioritization
  Proceedings of the International Symposium on Software Testing and Analysis
  Walcott, Kristen R. and Soffa, Mary Lou and Kapfhammer, Gregory M. and Roos, Robert S.

2005

• Towards the measurement of tuple space performance
  Performance Evaluation Review
  Fiedler, Daniel and Walcott, Kristen R. and Richardson, Thomas and Kapfhammer, Gregory M. and Amer, Ahmed and Chrysanthis, Panos K.

• Testing in resource-constrained execution environments
  Proceedings of the 20th International Conference on Automated Software Engineering
  Kapfhammer, Gregory M. and Soffa, Mary Lou and Mossé, Daniel

• Towards the prioritization of regression test suites with data flow information
  Proceedings of the 20th Symposium on Applied Computing
  Rummel, Matthew J. and Kapfhammer, Gregory M. and Thall, Andrew

2004

• Software testing
  The Computer Science Handbook
  Kapfhammer, Gregory M.

2003

• An examination of the run-time performance of GUI creation frameworks
  Proceedings of the 2nd International Conference on the Principles and Practice of Programming in Java
  Howell, Christopher J. and Kapfhammer, Gregory M. and Roos, Robert S.

• A family of test adequacy criteria for database-driven applications
  Proceedings of the 9th European Software Engineering Conference and the 11th Symposium on the Foundations of Software Engineering
  Kapfhammer, Gregory M. and Soffa, Mary Lou

2002

• Implementation and analysis of a JavaSpace supported by a relational database
  Proceedings of the 8th International Conference on Parallel and Distributed Processing Techniques and Applications
  Arnold, Geoffrey C. and Kapfhammer, Gregory M. and Roos, Robert S.

• An approach for understanding and testing third-party software components
  Proceedings of the 48th Reliability and Maintainability Symposium
  Haddox, Jennifer and Kapfhammer, Gregory M. and Michael, C.C.

• Creation and analysis of a JavaSpace-based genetic algorithm
  Proceedings of the 8th International Conference on Parallel and Distributed Processing Techniques and Applications
  Zorman, Brian and Kapfhammer, Gregory M. and Roos, Robert S.

2001

• Creating a free, dependable software engineering environment for building Java applications
  Proceedings of the 1st International Workshop on Open Source Software Engineering
  Bittman, Marcus and Roos, Robert S. and Kapfhammer, Gregory M.

• Testing commercial-off-the-shelf components with software wrappers
  Proceedings of the 18th International Conference on Testing Computer Software
  Haddox, Jennifer and Kapfhammer, Gregory M. and Michael, C.C. and Schatz, Michael

• Automatically and transparently distributing the execution of regression test suites
  Proceedings of the 18th International Conference on Testing Computer Software
  Kapfhammer, Gregory M.

2000

• An approach to identifying and understanding problematic COTS components
  Proceedings of the 2nd International Software Assurance and Certification Conference
  Kapfhammer, Gregory M. and Michael, C.C. and Haddox, Jennifer and Colyer, Ryan

Theses

2007

• A comprehensive framework for testing database-centric applications
  PhD Dissertation
  Kapfhammer, Gregory M.

1999

• A complex object data generator specification language to facilitate automated data creation in software component test drivers
  Undergraduate Thesis
  Kapfhammer, Gregory M.

Volumes Edited

2011

• Special section: Exploring the boundaries of software test automation
  Software Quality Journal
  Chan, Wing-Kwong and Budnik, Christof J. and Kapfhammer, Gregory M. and Zhu, Hong

2010

• Special section of selected papers from the Testing: Academic and Industrial Conference – Practice and Research Techniques
  Information and Software Technology
  Bottaci, Leonardo and Kapfhammer, Gregory M. and Roper, Marc

• Special section of selected papers from the Testing: Academic and Industrial Conference – Practice and Research Techniques
  Journal of Systems and Software
  Bottaci, Leonardo and Kapfhammer, Gregory M. and Walkinshaw, Neil

• Special issue: Software test automation
  Advances in Software Engineering
  Laplante, Philip and Belli, Fevzi and Gao, Jerry and Kapfhammer, Gregory M. and Miller, Keith and Wong, W. Eric