Publications on Oracles

Automated Layout Failure Detection for Responsive Web Pages Without an Explicit Oracle
TA Walsh, GM Kapfhammer and P McMinn
International Symposium on Software Testing and Analysis (ISSTA), 2017
[PDF]
[DOI]
[]
@inproceedings{Walsh2017,
  author    = "Walsh, Thomas A. and Kapfhammer, Gregory M. and McMinn, Phil",
  title     = "Automated Layout Failure Detection for Responsive Web Pages Without an Explicit
               Oracle",
  booktitle = "International Symposium on Software Testing and Analysis (ISSTA)",
  year      = "2017",
  pages     = "192--202"
}

The Oracle Problem in Software Testing: A Survey
ET Barr, M Harman, P McMinn, M Shahbaz and S Yoo
IEEE Transactions on Software Engineering, 2015
[PDF]
[DOI]
[]
@article{Barr2015,
  author  = "Barr, Earl T. and Harman, Mark and McMinn, Phil and Shahbaz, Muzammil and Yoo, Shin",
  title   = "The Oracle Problem in Software Testing: A Survey",
  journal = "IEEE Transactions on Software Engineering",
  year    = "2015",
  pages   = "507--525",
  number  = "5",
  volume  = "41"
}

Automatic Generation of Valid and Invalid Test Data for String Validation Routines Using Web Searches and Regular Expressions
M Shahbaz, P McMinn and M Stevenson
Science of Computer Programming, 2015
[PDF]
[DOI]
[]
@article{Shahbaz2015,
  author  = "Shahbaz, Muzammil and McMinn, Phil and Stevenson, Mark",
  title   = "Automatic Generation of Valid and Invalid Test Data for String Validation Routines
             Using Web Searches and Regular Expressions",
  journal = "Science of Computer Programming",
  year    = "2015",
  pages   = "405--425",
  number  = "4",
  volume  = "97"
}

A Comprehensive Survey of Trends in Oracles for Software Testing
M Harman, P McMinn, M Shahbaz and S Yoo
Technical Report, Department of Computer Science, University of Sheffield, 2013
[PDF]
[]
@techreport{Harman2013,
  author      = "Harman, Mark and McMinn, Phil and Shahbaz, Muzammil and Yoo, Shin",
  title       = "A Comprehensive Survey of Trends in Oracles for Software Testing",
  institution = "Department of Computer Science, University of Sheffield",
  year        = "2013",
  number      = "CS-13-01"
}

Automated Discovery of Valid Test Strings From the Web Using Dynamic Regular Expressions Collation and Natural Language Processing
M Shahbaz, P McMinn and M Stevenson
International Conference on Quality Software (QSIC), 2012
[PDF]
[DOI]
[]
@inproceedings{Shahbaz2012,
  author    = "Shahbaz, Muzammil and McMinn, Phil and Stevenson, Mark",
  title     = "Automated Discovery of Valid Test Strings From the Web Using Dynamic Regular
               Expressions Collation and Natural Language Processing",
  booktitle = "International Conference on Quality Software (QSIC)",
  year      = "2012",
  pages     = "79--88"
}

An Investigation Into Qualitative Human Oracle Costs
S Afshan and P McMinn
Psychology of Programming Interest Group Annual Workshop (PPIG), 2011
[PDF]
[]
@inproceedings{Afshan2011,
  author    = "Afshan, Sheeva and McMinn, Phil",
  title     = "An Investigation Into Qualitative Human Oracle Costs",
  booktitle = "Psychology of Programming Interest Group Annual Workshop (PPIG)",
  year      = "2011"
}

Optimizing for the Number of Tests Generated in Search Based Test Data Generation With an Application to the Oracle Cost Problem
M Harman, SG Kim, K Lakhotia, P McMinn and S Yoo
International Workshop on Search-Based Software Testing (SBST), 2010
[PDF]
[DOI]
[]
@inproceedings{Harman2010a,
  author    = "Harman, Mark and Kim, Sung Gon and Lakhotia, Kiran and McMinn, Phil and Yoo, Shin",
  title     = "Optimizing for the Number of Tests Generated in Search Based Test Data Generation
               With an Application to the Oracle Cost Problem",
  booktitle = "International Workshop on Search-Based Software Testing (SBST)",
  year      = "2010",
  pages     = "182--191"
}

Reducing Qualitative Human Oracle Costs Associated With Automatically Generated Test Data
P McMinn, M Stevenson and M Harman
International Workshop on Software Test Output Validation (STOV), 2010
[PDF]
[DOI]
[]
@inproceedings{McMinn2010a,
  author    = "McMinn, Phil and Stevenson, Mark and Harman, Mark",
  title     = "Reducing Qualitative Human Oracle Costs Associated With Automatically Generated Test
               Data",
  booktitle = "International Workshop on Software Test Output Validation (STOV)",
  year      = "2010",
  pages     = "1--4"
}

Search-Based Failure Discovery Using Testability Transformations to Generate Pseudo-Oracles
P McMinn
Genetic and Evolutionary Computation Conference (GECCO), 2009
[PDF]
[DOI]
[]
@inproceedings{McMinn2009a,
  author    = "McMinn, Phil",
  title     = "Search-Based Failure Discovery Using Testability Transformations to Generate
               Pseudo-Oracles",
  booktitle = "Genetic and Evolutionary Computation Conference (GECCO)",
  year      = "2009",
  pages     = "1689--1696"
}