Beyond Test Flakiness: A Manifesto for a Holistic Approach to Test Suite Health
Flaky Tests Workshop (FTW), 2025
@inproceedings{McMinn2025,
author = "McMinn, Phil and Roslan, Muhammad Firhard and Kapfhammer, Gregory M.",
title = "Beyond Test Flakiness: A Manifesto for a Holistic Approach to Test Suite Health",
booktitle = "Flaky Tests Workshop (FTW)",
year = "2025"
}
[Copy to Clipboard]
Empirically Evaluating Flaky Tests for Autonomous Driving Systems in Simulated Environments
Flaky Tests Workshop (FTW), 2025
@inproceedings{Osikowicz2025,
author = "Osikowicz, Aleksander M. and McMinn, Phil and Shin, Donghwan",
title = "Empirically Evaluating Flaky Tests for Autonomous Driving Systems in Simulated
Environments",
booktitle = "Flaky Tests Workshop (FTW)",
year = "2025"
}
[Copy to Clipboard]
Systemic Flakiness: An Empirical Analysis of Co-Occurring Flaky Test Failures
International Conference on Evaluation and Assessment in Software Engineering (EASE), 2025
[PDF]
[]
@inproceedings{Parry2025,
author = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
title = "Systemic Flakiness: An Empirical Analysis of Co-Occurring Flaky Test Failures",
booktitle = "International Conference on Evaluation and Assessment in Software Engineering (EASE)",
year = "2025"
}
[Copy to Clipboard]
Do Automatic Test Generation Tools Generate Flaky Tests?
International Conference on Software Engineering (ICSE), 2024
@inproceedings{Gruber2024,
author = "Gruber, Martin and Roslan, Muhammad Firhard and Parry, Owain and Scharnb{\"o}ck,
Fabian and McMinn, Phil and Fraser, Gordon",
title = "Do Automatic Test Generation Tools Generate Flaky Tests?",
booktitle = "International Conference on Software Engineering (ICSE)",
year = "2024"
}
[Copy to Clipboard]
Empirically Evaluating Flaky Test Detection Techniques Combining Test Case Rerunning and Machine Learning Models
Empirical Software Engineering, 2023
@article{Parry2023,
author = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
title = "Empirically Evaluating Flaky Test Detection Techniques Combining Test Case Rerunning
and Machine Learning Models",
journal = "Empirical Software Engineering",
year = "2023",
issue = "3",
volume = "28"
}
[Copy to Clipboard]
What Do Developer-Repaired Flaky Tests Tell Us About the Effectiveness of Automated Flaky Test Detection?
International Conference on Automation of Software Test (AST), 2022
@inproceedings{Parry2022,
author = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
title = "What Do Developer-Repaired Flaky Tests Tell Us About the Effectiveness of Automated
Flaky Test Detection?",
booktitle = "International Conference on Automation of Software Test (AST)",
year = "2022"
}
[Copy to Clipboard]
Surveying the Developer Experience of Flaky Tests
International Conference on Software Engineering — Software Engineering In Practice track (ICSE-SEIP), 2022
@inproceedings{Parry2022a,
author = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
title = "Surveying the Developer Experience of Flaky Tests",
booktitle = "International Conference on Software Engineering --- Software Engineering In
Practice track (ICSE-SEIP)",
year = "2022"
}
[Copy to Clipboard]
Evaluating Features for Machine Learning Detection of Order- And Non-Order-Dependent Flaky Tests
International Conference on Software Testing, Verification and Validation (ICST), 2022
@inproceedings{Parry2022b,
author = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
title = "Evaluating Features for Machine Learning Detection of Order- And Non-Order-Dependent
Flaky Tests",
booktitle = "International Conference on Software Testing, Verification and Validation (ICST)",
year = "2022"
}
[Copy to Clipboard]
A Survey of Flaky Tests
ACM Transactions on Software Engineering and Methodology, 2021
@article{Parry2021,
author = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
title = "A Survey of Flaky Tests",
journal = "ACM Transactions on Software Engineering and Methodology",
year = "2021"
}
[Copy to Clipboard]
Flake It 'Till You Make It: Using Automated Repair to Induce and Fix Latent Test Flakiness
International Workshop on Automated Program Repair (APR), 2020
@inproceedings{Parry2020,
author = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
title = "Flake It 'Till You Make It: Using Automated Repair to Induce and Fix Latent Test
Flakiness",
booktitle = "International Workshop on Automated Program Repair (APR)",
year = "2020"
}
[Copy to Clipboard]