Evals is not enough: why we should report wall-clock time

Created by W.Langdon from gp-bibliography.bib Revision:1.4504

  author =       "John Woodward and Alexander Brownlee and 
                 Colin Johnson",
  title =        "Evals is not enough: why we should report wall-clock
  booktitle =    "Genetic Improvement 2016 Workshop",
  year =         "2016",
  editor =       "Justyna Petke and David R. White and Westley Weimer",
  pages =        "1157--1158",
  address =      "Denver",
  publisher_address = "New York, NY, USA",
  month =        jul # " 20-24",
  organisation = "SIGEvo",
  publisher =    "ACM",
  keywords =     "genetic algorithms, genetic programming, Genetic
                 Improvement, SBSE",
  URL =          "http://geneticimprovementofsoftware.com/wp-content/uploads/2016/06/Evals_is_not_enough_why_we_should_report_wall-clock_time.pdf",
  DOI =          "doi:10.1145/2908961.2931695",
  size =         "2 pages",
  abstract =     "Have you ever noticed that your car never achieves the
                 fuel economy claimed by the manufacturer? Does this
                 seem unfair? Unscientific? Would you like the same
                 situation to occur in Genetic Improvement? Comparison
                 will always be difficult [9], however, guidelines have
                 been discussed [3, 5, 4]. With two GP [8] approaches,
                 comparing the number of evaluations of the fitness
                 function is reasonably fair. This means you are
                 comparing the GP systems, and not how well they are
                 implemented, how fast the language is. However, the
                 situation with GI [6, 1] is unique. With GI we will
                 typically compare systems which are applied to the same
                 application written in the same language (i.e. a GI
                 systems targeted at Java, may not even be applied to
                 C). Thus, wall-clock time becomes more relevant. Thus,
                 this paper asks if reporting number of evaluations is
                 enough, or if wall-clock time is also important,
                 particularly in the context of GI. It argues that
                 reporting time is even more important when doing GI
                 when compared to traditional GP.",
  notes =        "GECCO 2016 Workshop

Genetic Programming entries for John R Woodward Alexander E I Brownlee Colin G Johnson