Better GP benchmarks: community survey results and proposals

White, D.R., McDermott, J., Castelli, M., Manzoni, L., Goldman, B.W., Kronberger, G., Jaśkowski, W., O’Reilly, U.-M. and Luke, S. (2013) Better GP benchmarks: community survey results and proposals. Genetic Programming and Evolvable Machines, 14(1), pp. 3-29. (doi: 10.1007/s10710-012-9177-2)

Full text not currently available from Enlighten.

Abstract

We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a "blacklist" of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:White, Dr David
Authors: White, D.R., McDermott, J., Castelli, M., Manzoni, L., Goldman, B.W., Kronberger, G., Jaśkowski, W., O’Reilly, U.-M., and Luke, S.
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Genetic Programming and Evolvable Machines
Publisher:Springer Verlag
ISSN:1389-2576
ISSN (Online):1573-7632
Published Online:18 December 2012

University Staff: Request a correction | Enlighten Editors: Update this record