implementing innovation in
software engineering


As an experimental computer scientist, the goal of my research is to design, implement, and rigorously evaluate techniques and tools that support the creation of useful, dependable, and efficient software. My research addresses the challenges in fields such as software engineering, software testing, and computer systems. I conduct this research with undergraduates at Allegheny College, graduate students and professors at several universities, and colleagues in industry.


My research is empirical in nature because it involves the application of the scientific method to formulate problem statements, carry out experiments, take observations, statistically analyze and visualize the data sets, and draw conclusions based on the results. Each project focuses on the development and evaluation of software artifacts that can be used in both empirical studies and real-world practice by undergraduate and graduate students, software engineers, and computer scientists in both academia and industry. In addition to supporting my professional service, my research also results in award-winning and frequently cited research papers, oft-complimented presentations, and useful free and open-source software.

My research has concentrated on several areas in software engineering and software testing, examples of which are summarized in the following list that references key papers.

  • Database Testing: Given the importance of verifying the behavior of a database application, my PhD dissertation (Kapfhammer2007d)   presented an approach for testing this type of software; a notable paper derived from my dissertation is (Kapfhammer2003)  .  Since the relational schema preserves the correctness of the database's state, my research has also focused on testing this complex artifact, with (McMinn2015)   and (McMinn2019)   being examples of papers. Recent papers such as (Alsharif2020)   and (Alsharif2020a)   present techniques for improving the efficiency of regression testing for relational database schemas.
  • Web Testing: In response to the prevalence and complexity of mobile-ready web sites, my research has developed automated techniques for checking the pages in these sites. Some examples of papers describing methods for automatically detecting defects in live web pages include (Walsh2017)   and (Walsh2017a)  .  The automated approach introduced in (Althomali2019)   can visually confirm and classify the reported responsive layout failures in a web page. Finally, the technique described in (Walsh2020)   can automatically identify potential regressions from the correct layout of a mobile-ready web page.
  • Mutation Testing: Given the challenges associated with accurately judging the quality of a test suite, my research has designed efficient and useful ways to perform test assessment through mutation analysis. Presenting and evaluating automated techniques that efficiently insert synthetic faults into both real-world Java programs and relational database schemas, some examples of papers include (Just2012b)  ,  (Wright2014)  ,  and (McMinn2019)  . 
  • Regression Testing: Since software is often incrementally developed, my work on regression testing has created automated ways to efficiently and effectively run test suites for complex programs. Some examples of papers that present and evaluate regression testing techniques include (Walcott2006)  ,  (Lin2014)  ,  and (Lin2017)  .  Leading the way in the realistic assessment of regression testing, papers such as (Paterson2018)   and (Paterson2019)   show how to conduct rigorous experiments with faults harvested from real programs.
  • Search-Based Testing: Using a fitness function as a guide to a suitable solution, search-based methods have shown promise in supporting many software engineering tasks. My work has focused on creating and maintaining frameworks that support the development of search-based tools, with (McMinn2016b)   being one example. Other papers such as (Conrad2010a)   and (Kukunas2010a)   describe search-based solutions to key software engineering challenges. Recent papers like (Alsharif2019)   present ways to involve humans when studying the usefulness of tests that were automatically generated by search-based techniques.
  • Performance Evaluation: Given the importance of equipping software engineers with the insights and tools they need to create efficient software, my work has concentrated on developing and studying tools that automatically assess program performance. Focusing on the empirical evaluation of real-world software components like databases, papers in this area include (Jones2011)  ,  (Burdette2012)  ,  and (Kinneer2015)  .  Papers such as (Kotelyanskii2014a)   highlight how my research has also characterized the influence that the parameters of a search-based algorithm have on its efficiency and effectiveness.
  • Research Methods: My surveys of software testing techniques provide a starting point for people exploring this field, with (Kapfhammer2004)   and (Kapfhammer2010)   being examples of such articles. Papers like (Kapfhammer2016)   and (McMinn2016)   show how I have articulated a research agenda for the field of software engineering that stresses, for instance, the need for well-tested statistical methods. I have also written papers, such as (Alsharif2018a)   and (Alsharif2018b)  ,  that explain how to replicate my research results.


Do you work on these topics and are you interested in collaborating with me on a project in the fields of software engineering and software testing? If so, then please contact me with your ideas.

Please support my work!

View the source.