Research

My research focusses on developing automated techniques for software testing, to help developers maintain "healthy" test suites that find bugs.

Recently my work has centred on helping developers detect and mitigate "flaky" software tests. I have also worked on mutation analysis approaches to help developers assess the quality of their test suites, including finding areas of code that while executed by tests may only be pseudo-tested. Other past areas of work have included detecting and repairing presentation failures and automatically generating tests using search-based test generation.

My work has been funded by the EPSRC and Meta. I am currently an associate editor for the Empirical Software Engineering and Software Testing, Verification and Reliability journals, and I lead Sheffield's Testing Research Group.

Team

October 2025

• Owain Parry (Post-Doctoral Research Associate); working on the Test FLARE project (Test FLakiness Automated REproduction), EPSRC grant EP/X024539/1.
• Rimsha Chaudhry (PhD Student); working on Test Flakiness.
• Zalán Lévai (PhD Student); working on Mutation Analysis for the Rust Programming Language.
• Megan Maton (PhD Student); working on Identifying Pseudo-Tested Code.
• Olek Osikowicz (PhD Student, as second supervisor — first supervisor Donghwan Shin); working on Testing Automatic Driving Systems.
• Mark Winteringham (PhD Student, as second supervisor — first supervisor Neil Walkinshaw); working on LLMs for Exploratory Testing.

We are part of the Testing Research Group at the University of Sheffield, one of the largest software testing groups in the UK.

I have previously supervised 11 PhD students to completion as first supervisor.

Publications

See my full list of my publications, also recorded on my Google Scholar and DBLP profiles.

Some of my papers that have recently appeared include:

@article{Levai2026,
  author  = "L{vai, Zal{n and Shin, Donghwan and McMinn, Phile}vai, Zalán and Shin, Donghwan and
             McMinn, Phila}n and Shin, Donghwan and McMinn, Phile}vai, Zal{n and Shin, Donghwan and
             McMinn, Phila}n and Shin, Donghwan and McMinn, Phil",
  title   = "A Comprehensive Empirical and Theoretical Analysis of Batching Algorithms for
             Efficient, Safe, Parallel Mutation Analysis in Rust",
  journal = "ACM Transactions on Software Engineering and Methodology",
  year    = "2026"
}

@inproceedings{Parry2026,
  author    = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
  title     = "Test Flimsiness: Characterizing Flakiness Induced by Mutation to the Code Under Test",
  booktitle = "International Conference on Software Engineering (ICSE)",
  year      = "2026"
}

@inproceedings{Parry2025,
  author    = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
  title     = "Systemic Flakiness: An Empirical Analysis of Co-Occurring Flaky Test Failures",
  booktitle = "International Conference on Evaluation and Assessment in Software Engineering (EASE)",
  year      = "2025",
  pages     = "476--487"
}

@inproceedings{Elgendy2025a,
  author    = "Elgendy, Islam T. and Hierons, Robert M. and McMinn, Phil",
  title     = "Empirically Evaluating the Use of Bytecode for Diversity-Based Test Case
               Prioritisation",
  booktitle = "International Conference on Evaluation and Assessment in Software Engineering (EASE)",
  year      = "2025",
  pages     = "216--226"
}

@article{Elgendy2025,
  author  = "Elgendy, Islam T. and Hierons, Robert M. and McMinn, Phil",
  title   = "A Systematic Mapping Study of the Metrics, Uses, and Subjects of Diversity-Based
             Testing Techniques",
  journal = "Software Testing, Verification and Reliability",
  year    = "2025",
  issue   = "2",
  volume  = "35"
}

Teaching

I teach the first-year COM1001 Introduction to Software Engineering module. Key to the module is team-based software development, writing automated tests, and improving code design through refactoring.

I also teach the third-year COM3529 Software Testing and Analysis module. Topics include how to write effective, maintainable tests, and how to analyse their quality. The module also covers more research-oriented topics such as automatically generating test cases (e.g., through fuzzing and search-based techniques), mutation analysis, and methods for test case priortisation.

I also supervise a range of third year dissertation projects on topics in software engineering, software testing, and on those provided by local industry partners.