Publications | Phil McMinn

Effective Automated Repair of Internationalization Presentation Failures in Web Applications Using Style Similarity Clustering and Search-Based Techniques

S Mahajan, A Alameer, P McMinn and WGJ Halfond

Software Testing, Verification and Reliability, 2021

#web-presentation-failures

#search-based-software-engineering

[PDF]

[DOI]

[GS]

Hybrid Methods for Reducing Database Schema Test Suites: Experimental Insights From Computational and Human Studies

A Alsharif, GM Kapfhammer and P McMinn

International Conference on Automation of Software Test (AST), 2020

#database-testing

#regression-testing

[PDF]

[DOI]

[GS]

STICCER: Fast and Effective Database Test Suite Reduction Through Merging of Similar Test Cases

A Alsharif, GM Kapfhammer and P McMinn

International Conference on Software Testing, Verification and Validation (ICST), 2020

#database-testing

#regression-testing

[PDF]

[DOI]

[GS]

An Investigation Into the Effect of Control and Data Dependence Chain Length on Predicate Testability

DW Binkley, J Glenn, A Alsharif and P McMinn

International Working Conference on Source Code Analysis & Manipulation (SCAM), 2020

#testability

#search-based-test-generation

[PDF]

[DOI]

[GS]

The Influence of Test Suite Properties on Automated Grading

BS Clegg, P McMinn and G Fraser

International Conference on Software Engineering Education and Training (CSEE&T), 2020

#autograding

[PDF]

[DOI]

[GS]

Flake It 'Till You Make It: Using Automated Repair to Induce and Fix Latent Test Flakiness

O Parry, M Hilton, GM Kapfhammer and P McMinn

International Workshop on Automated Program Repair (APR), 2020

#flaky-tests

[PDF]

[DOI]

[GS]

Automatically Identifying Potential Regressions in the Layout of Responsive Web Pages

TA Walsh, GM Kapfhammer and P McMinn

Software Testing, Verification and Reliability, 2020

#web-presentation-failures

[PDF]

[DOI]

[GS]

What Factors Make SQL Test Cases Understandable for Testers? A Human Study of Automatic Test Data Generation Techniques

A Alsharif, GM Kapfhammer and P McMinn

International Conference on Software Maintenance and Evolution (ICSME), 2019

#database-testing

[PDF]

[DOI]

[GS]

Automatic Visual Verification of Layout Failures in Responsively Designed Web Pages

I Althomali, GM Kapfhammer and P McMinn

International Conference on Software Testing, Verification and Validation (ICST), 2019

#web-presentation-failures

[PDF]

[DOI]

[GS]

Simulating Student Mistakes to Evaluate the Fairness of Automated Grading

BS Clegg, G Fraser, S North and P McMinn

International Conference on Software Engineering — Software Engineering Education and Training track (ICSE-SEET), 2019

#autograding

[PDF]

[DOI]

[GS]

Automatic Detection and Removal of Ineffective Mutants for the Mutation Analysis of Relational Database Schemas

P McMinn, CJ Wright, CJ McCurdy and GM Kapfhammer

IEEE Transactions on Software Engineering, 2019

#database-testing

#mutation-analysis

[PDF]

[DOI]

[GS]

An Empirical Study on the Use of Defect Prediction for Test Case Prioritization

D Paterson, J Campos, R Abreu, GM Kapfhammer, G Fraser and P McMinn

International Conference on Software Testing, Verification and Validation (ICST), 2019

#regression-testing

[PDF]

[DOI]

[GS]

Search-Based Detection of Deviation Failures in the Migration of Legacy Spreadsheet Applications

MM Almasi, H Hemmati, G Fraser, P McMinn and J Benefelds

International Symposium on Software Testing and Analysis (ISSTA), 2018

#search-based-software-engineering

[PDF]

[DOI]

[GS]

DOMINO: Fast and Effective Test Data Generation for Relational Database Schemas

A Alsharif, GM Kapfhammer and P McMinn

International Conference on Software Testing, Verification and Validation (ICST), 2018

#database-testing

[PDF]

[DOI]

[GS]

Effectively Incorporating Expert Knowledge in Automated Software Remodularisation

M Hall, N Walkinshaw and P McMinn

IEEE Transactions on Software Engineering, 2018

#software-maintenance

[PDF]

[DOI]

[GS]

Automated Repair of Internationalization Failures Using Style Similarity Clustering and Search-Based Techniques

S Mahajan, A Alameer, P McMinn and WGJ Halfond

International Conference on Software Testing, Verification and Validation (ICST), 2018

#web-presentation-failures

#search-based-software-engineering

[PDF]

[DOI]

[GS]

Automated Repair of Mobile Friendly Problems in Web Pages

S Mahajan, N Abolhassani, P McMinn and WGJ Halfond

International Conference on Software Engineering (ICSE), 2018

#web-presentation-failures

[PDF]

[DOI]

[GS]

Using Controlled Numbers of Real Faults and Mutants to Empirically Evaluate Coverage-Based Test Case Prioritization

D Paterson, GM Kapfhammer, G Fraser and P McMinn

International Conference on Automation of Software Test (AST), 2018

#regression-testing

[PDF]

[DOI]

[GS]

Random or Evolutionary Search for Object-Oriented Test Suite Generation?

S Shamshiri, JM Rojas, L Gazzola, G Fraser, P McMinn, L Mariani and A Arcuri

Software Testing, Verification and Reliability, 2018

#search-based-test-generation

[PDF]

[DOI]

[GS]

Evaluation of CAVM, Austin, and CodeScroll for Test Data Generation for C

B You, J Kim, M Kwon, P McMinn and S Yoo

Korea Conference on Software Engineering (KCSE), 2018

#search-based-test-generation

[PDF]

Evaluating CAVM: A New Search-Based Test Data Generation Tool for C

J Kim, B You, M Kwon, P McMinn and S Yoo

International Symposium on Search-Based Software Engineering (SSBSE), 2017

#search-based-test-generation

[PDF]

[DOI]

[GS]

Automated Repair of Layout Cross Browser Issues Using Search-Based Techniques

S Mahajan, A Alameer, P McMinn and WGJ Halfond

International Symposium on Software Testing and Analysis (ISSTA), 2017

#web-presentation-failures

#search-based-software-engineering

[PDF]

[DOI]

[GS]

XFix: Automated Tool for Repair of Layout Cross Browser Issues

S Mahajan, A Alameer, P McMinn and WGJ Halfond

International Symposium on Software Testing and Analysis (ISSTA), 2017

#web-presentation-failures

#search-based-software-engineering

[PDF]

[DOI]

[GS]

Disposable Testing: Avoiding Maintenance of Generated Unit Tests by Throwing Them Away

S Shamshiri, J Campos, G Fraser and P McMinn

International Conference on Software Engineering (ICSE), 2017

[PDF]

[DOI]

[GS]

Automated Layout Failure Detection for Responsive Web Pages Without an Explicit Oracle

TA Walsh, GM Kapfhammer and P McMinn

International Symposium on Software Testing and Analysis (ISSTA), 2017

#web-presentation-failures

#oracles

[PDF]

[DOI]

[GS]

ReDeCheck: An Automatic Layout Failure Checking Tool for Responsively Designed Web Pages

TA Walsh, GM Kapfhammer and P McMinn

International Symposium on Software Testing and Analysis (ISSTA), 2017

#web-presentation-failures

[PDF]

[DOI]

[GS]

Hitchhikers Need Free Vehicles! Shared Repositories for Statistical Analysis in SBST

GM Kapfhammer, CJ Wright and P McMinn

International Workshop on Search-Based Software Testing (SBST), 2016

#search-based-software-engineering

[PDF]

[DOI]

[GS]

mrstudyr: Retrospectively Studying the Effectiveness of Mutant Reduction Techniques

CJ McCurdy, P McMinn and GM Kapfhammer

International Conference on Software Maintenance and Evolution (ICSME), 2016

#mutation-analysis

[PDF]

[DOI]

[GS]

SchemaAnalyst: Search-Based Test Data Generation for Relational Database Schemas

P McMinn, CJ Wright, C Kinneer, CJ McCurdy, M Camara and GM Kapfhammer

International Conference on Software Maintenance and Evolution (ICSME), 2016

#search-based-test-generation

#database-testing

[PDF]

[DOI]

[GS]

AVMf: An Open-Source Framework and Implementation of the Alternating Variable Method

P McMinn and GM Kapfhammer

International Symposium on Search-Based Software Engineering (SSBSE), 2016

#search-based-test-generation

[PDF]

[DOI]

[GS]

Virtual Mutation Analysis of Relational Database Schemas

P McMinn, GM Kapfhammer and CJ Wright

International Workshop on Automation of Software Test (AST), 2016

#database-testing

#mutation-analysis

[PDF]

[DOI]

[GS]

Automated Search for Good Coverage Criteria: Moving From Code Coverage to Fault Coverage Through Search-Based Software Engineering

P McMinn, M Harman, G Fraser and GM Kapfhammer

International Workshop on Search-Based Software Testing (SBST), 2016

#search-based-software-engineering

[PDF]

[DOI]

[GS]

The Oracle Problem in Software Testing: A Survey

ET Barr, M Harman, P McMinn, M Shahbaz and S Yoo

IEEE Transactions on Software Engineering, 2015

#oracles

[PDF]

[DOI]

[GS]

Does Automated Unit Test Generation Really Help Software Testers? A Controlled Empirical Study

G Fraser, M Staats, P McMinn, A Arcuri and F Padberg

ACM Transactions on Software Engineering and Methodology, 2015

#search-based-test-generation

[PDF]

[DOI]

[GS]

A Memetic Algorithm for Whole Test Suite Generation

G Fraser, A Arcuri and P McMinn

Journal of Systems and Software, 2015

#search-based-test-generation

[PDF]

[DOI]

[GS]

Design and Analysis of Different Alternating Variable Searches for Search-Based Software Testing

J Kempka, P McMinn and D Sudholt

Theoretical Computer Science, 2015

#search-based-test-generation

[PDF]

[DOI]

[GS]

Automatically Evaluating the Efficiency of Search-Based Test Data Generation for Relational Database Schemas

C Kinneer, GM Kapfhammer, CJ Wright and P McMinn

International Conference on Software Engineering and Knowledge Engineering (SEKE), 2015

#database-testing

#search-based-test-generation

[PDF]

[DOI]

[GS]

EXPOSE: Inferring Worst-Case Time Complexity by Automatic Empirical Study

C Kinneer, GM Kapfhammer, CJ Wright and P McMinn

International Conference on Software Engineering and Knowledge Engineering (SEKE), 2015

[PDF]

[DOI]

[GS]

The Effectiveness of Test Coverage Criteria for Relational Database Schema Integrity Constraints

P McMinn, CJ Wright and GM Kapfhammer

ACM Transactions on Software Engineering and Methodology, 2015

#database-testing

#search-based-test-generation

[PDF]

[DOI]

[GS]

An Analysis of the Effectiveness of Different Coverage Criteria for Testing Relational Database Schema Integrity Constraints

P McMinn, CJ Wright and GM Kapfhammer

Technical Report, Department of Computer Science, University of Sheffield, 2015

#database-testing

#search-based-test-generation

[PDF]

[GS]

Automatic Generation of Valid and Invalid Test Data for String Validation Routines Using Web Searches and Regular Expressions

M Shahbaz, P McMinn and M Stevenson

Science of Computer Programming, 2015

#oracles

[PDF]

[DOI]

[GS]

Do Automatically Generated Unit Tests Find Real Faults? An Empirical Study of Effectiveness and Challenges

S Shamshiri, R Just, JM Rojas, G Fraser, P McMinn and A Arcuri

International Conference on Automated Software Engineering (ASE), 2015

#search-based-test-generation

[PDF]

[DOI]

[GS]

Random or Genetic Algorithm Search for Object-Oriented Test Suite Generation?

S Shamshiri, JM Rojas, G Fraser and P McMinn

Genetic and Evolutionary Computation Conference (GECCO), 2015

#search-based-test-generation

[PDF]

[DOI]

[GS]

Automatic Detection of Potential Layout Faults Following Changes to Responsive Web Pages

TA Walsh, P McMinn and GM Kapfhammer

International Conference on Automated Software Engineering (ASE), 2015

#web-presentation-failures

[PDF]

[DOI]

[GS]

Establishing the Source Code Disruption Caused by Automated Remodularisation Tools

M Hall, M Khojaye, N Walkinshaw and P McMinn

International Conference on Software Maintenance and Evolution (ICSME), 2014

#software-maintenance

[PDF]

[DOI]

[GS]

The Impact of Equivalent, Redundant and Quasi Mutants on Database Schema Mutation Analysis

CJ Wright, GM Kapfhammer and P McMinn

International Conference on Quality Software (QSIC), 2014

#database-testing

#mutation-analysis

[PDF]

[DOI]

[GS]

Evolving Readable String Test Inputs Using a Natural Language Model to Reduce Human Oracle Cost

S Afshan, P McMinn and M Stevenson

International Conference on Software Testing, Verification and Validation (ICST), 2013

#search-based-test-generation

[PDF]

[DOI]

[GS]

An Orchestrated Survey on Automated Software Test Case Generation

S Anand, E Burke, TY Chen, J Clark, MB Cohen, W Grieskamp, M Harman, MJ Harrold and P McMinn

Journal of Systems and Software, 2013

#search-based-test-generation

[DOI]

[GS]

Does Automated White-Box Test Generation Really Help Software Testers?

G Fraser, M Staats, P McMinn, A Arcuri and F Padberg

International Symposium on Software Testing and Analysis (ISSTA), 2013

#search-based-test-generation

[PDF]

[DOI]

[GS]

Test Suite Generation With Memetic Algorithms

G Fraser, A Arcuri and P McMinn

Genetic and Evolutionary Computation Conference (GECCO), 2013

#search-based-test-generation

[PDF]

[DOI]

[GS]

A Comprehensive Survey of Trends in Oracles for Software Testing

M Harman, P McMinn, M Shahbaz and S Yoo

Technical Report, Department of Computer Science, University of Sheffield, 2013

#oracles

[PDF]

[GS]

Search-Based Testing of Relational Schema Integrity Constraints Across Multiple Database Management Systems

GM Kapfhammer, P McMinn and CJ Wright

International Conference on Software Testing, Verification and Validation (ICST), 2013

#search-based-test-generation

#database-testing

[PDF]

[DOI]

[GS]

A Theoretical Runtime and Empirical Analysis of Different Alternating Variable Searches for Search-Based Testing

J Kempka, P McMinn and D Sudholt

Genetic and Evolutionary Computation Conference (GECCO), 2013

#search-based-test-generation

[PDF]

[DOI]

[GS]

An Identification of Program Factors That Impact Crossover Performance in Evolutionary Test Input Generation for the Branch Coverage of C Programs

P McMinn

Information and Software Technology, 2013

#search-based-test-generation

[PDF]

[DOI]

[GS]

Search-Based Propagation of Regression Faults in Automated Regression Testing

S Shamshiri, G Fraser, P McMinn and A Orso

International Workshop on Regression Testing (Regression), 2013

#search-based-test-generation

#regression-testing

[PDF]

[DOI]

[GS]

Towards the Automatic Identification of Faulty Multi-Agent Based Simulation Runs Using MASTER

CJ Wright, P McMinn and J Gallardo

Multi-Agent-Based Simulation XIII — International Workshop on Multi-Agent Simulation (MABS), 2013

#agent-based-modelling

[PDF]

[DOI]

[GS]

Efficient Mutation Analysis of Relational Database Structure Using Mutant Schemata and Parallelisation

CJ Wright, GM Kapfhammer and P McMinn

International Workshop on Mutation Analysis (Mutation), 2013

#database-testing

#mutation-analysis

[PDF]

[DOI]

[GS]

Supervised Software Modularisation

M Hall, N Walkinshaw and P McMinn

International Conference on Software Maintenance (ICSM), 2012

#software-maintenance

[PDF]

[DOI]

[GS]

Modelling Complex Biological Systems Using an Agent-Based Approach

M Holcombe, S Adra, M Bicak, S Chin, S Coakley, AI Graham, J Green, C Greenough, D Jackson, M Kiran, S MacNeil, A Maleki-Dizaji, P McMinn, M Pogson, R Poole, E Qwarnstrom, F Ratnieks, MD Rolfe, R Smallwood, T Sun and D Worth

Integrative Biology, 2012

#agent-based-modelling

[DOI]

[GS]

Input Domain Reduction Through Irrelevant Variable Removal and Its Effect on Local, Global and Hybrid Search-Based Structural Test Data Generation

P McMinn, M Harman, Y Hassoun, K Lakhotia and J Wegener

IEEE Transactions on Software Engineering, 2012

#search-based-test-generation

[PDF]

[DOI]

[GS]

Search-Based Test Input Generation for String Data Types Using the Results of Web Queries

P McMinn, M Shahbaz and M Stevenson

International Conference on Software Testing, Verification and Validation (ICST), 2012

#search-based-test-generation

[PDF]

[DOI]

[GS]

Automated Discovery of Valid Test Strings From the Web Using Dynamic Regular Expressions Collation and Natural Language Processing

M Shahbaz, P McMinn and M Stevenson

International Conference on Quality Software (QSIC), 2012

#oracles

[PDF]

[DOI]

[GS]

A Multiobjective Optimisation Approach for Dynamic Inference and Refinement of Agent-Based Model Specifications

S Adra, M Kiran, P McMinn and N Walkinshaw

Congress on Evolutionary Computation (CEC), 2011

#agent-based-modelling

[PDF]

[DOI]

[GS]

An Investigation Into Qualitative Human Oracle Costs

S Afshan and P McMinn

Psychology of Programming Interest Group Annual Workshop (PPIG), 2011

#oracles

[PDF]

[GS]

Symbolic Search-Based Testing

A Baars, M Harman, Y Hassoun, K Lakhotia, P McMinn, P Tonella and T Vos

International Conference on Automated Software Engineering (ASE), 2011

#search-based-test-generation

[PDF]

[DOI]

[GS]

Search-Based Software Engineering: Techniques, Taxonomy, Tutorial

M Harman, P McMinn, JT de Souza and S Yoo

In Empirical Software Engineering and Verification, 2011

#search-based-software-engineering

#search-based-test-generation

[PDF]

[DOI]

[GS]

Search-Based Software Testing: Past, Present and Future

P McMinn

International Workshop on Search-Based Software Testing (SBST), 2011

#search-based-test-generation

[PDF]

[DOI]

[GS]

Mutation Operators for Agent-Based Models

S Adra and P McMinn

International Workshop on Mutation Analysis (Mutation), 2010

#agent-based-modelling

#mutation-analysis

[PDF]

[DOI]

[GS]

Using Dictionary Compression Algorithms to Identify Phases in Program Traces

S Afshan, P McMinn and N Walkinshaw

Technical Report, Department of Computer Science, University of Sheffield, 2010

#software-maintenance

[PDF]

[GS]

Superstate Identification for State Machines Using Search-Based Clustering

M Hall, P McMinn and N Walkinshaw

Genetic and Evolutionary Computation Conference (GECCO), 2010

#software-maintenance

[PDF]

[DOI]

[GS]

A Theoretical and Empirical Study of Search Based Testing: Local, Global and Hybrid Search

M Harman and P McMinn

IEEE Transactions on Software Engineering, 2010

#search-based-test-generation

[PDF]

[DOI]

[GS]

Optimizing for the Number of Tests Generated in Search Based Test Data Generation With an Application to the Oracle Cost Problem

M Harman, SG Kim, K Lakhotia, P McMinn and S Yoo

International Workshop on Search-Based Software Testing (SBST), 2010

#search-based-test-generation

#oracles

[PDF]

[DOI]

[GS]

An Empirical Investigation Into Branch Coverage for C Programs Using CUTE and AUSTIN

K Lakhotia, P McMinn and M Harman

Journal of Systems and Software, 2010

#search-based-test-generation

[PDF]

[DOI]

[GS]

How Does Program Structure Impact the Effectiveness of the Crossover Operator in Evolutionary Testing?

P McMinn

International Symposium on Search-Based Software Engineering (SSBSE), 2010

#search-based-test-generation

[PDF]

[DOI]

[GS]

Reducing Qualitative Human Oracle Costs Associated With Automatically Generated Test Data

P McMinn, M Stevenson and M Harman

International Workshop on Software Test Output Validation (STOV), 2010

#oracles

#search-based-test-generation

[PDF]

[DOI]

[GS]

Using Compression Algorithms to Support the Comprehension of Program Traces

N Walkinshaw, S Afshan and P McMinn

International Workshop on Dynamic Analysis (WODA), 2010

#software-maintenance

[PDF]

[DOI]

[GS]

Automated Test Data Generation for Coverage: Haven't We Solved This Problem Yet?

K Lakhotia, P McMinn and M Harman

Testing: Academic and Industrial Conference — Practice And Research Techniques (TAIC PART), 2009

#search-based-test-generation

[PDF]

[DOI]

[GS]

Empirical Evaluation of a Nesting Testability Transformation for Evolutionary Testing

P McMinn, DW Binkley and M Harman

ACM Transactions on Software Engineering and Methodology, 2009

#search-based-test-generation

#testability-transformation

[PDF]

[DOI]

[GS]

Search-Based Failure Discovery Using Testability Transformations to Generate Pseudo-Oracles

P McMinn

Genetic and Evolutionary Computation Conference (GECCO), 2009

#oracles

#search-based-test-generation

#testability-transformation

[PDF]

[DOI]

[GS]

Testability Transformation — Program Transformation to Improve Testability

M Harman, A Baresel, DW Binkley, RM Hierons, L Hu, B Korel, P McMinn and M Roper

In Formal Methods and Testing, 2008

#testability-transformation

[PDF]

[DOI]

[GS]

Validation and Discovery From Computational Biology Models

M Kiran, S Coakley, N Walkinshaw, P McMinn and M Holcombe

BioSystems, 2008

#agent-based-modelling

[PDF]

[DOI]

[GS]

Handling Dynamic Data Structures in Search-Based Testing

K Lakhotia, M Harman and P McMinn

Genetic and Evolutionary Computation Conference (GECCO), 2008

#search-based-test-generation

[PDF]

[DOI]

[GS]

Agent Based Modelling Helps in Understanding the Rules by Which Fibroblasts Support Keratinocyte Colony Formation

T Sun, P McMinn, M Holcombe, R Smallwood and S MacNeil

PLOS ONE, 2008

#agent-based-modelling

[PDF]

[DOI]

[GS]

The Impact of Input Domain Reduction on Search-Based Test Data Generation

M Harman, Y Hassoun, K Lakhotia, P McMinn and J Wegener

Joint meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering (ESEC/FSE), 2007

#search-based-test-generation

[PDF]

[DOI]

[GS]

A Theoretical and Empirical Analysis of Evolutionary Testing and Hill Climbing for Structural Test Data Generation

M Harman and P McMinn

International Symposium on Software Testing and Analysis (ISSTA), 2007

#search-based-test-generation

[PDF]

[DOI]

[GS]

A Multi-Objective Approach to Search-Based Test Data Generation