back to main page

Results of the EMO'2017 Real-world Problems Track

"Raw" Result Data

On each problem participants were judged by the overall dominated hypervolume within the given budget of function evaluations. There were 10 participants in the field. The best function value per problem and participant (10 times 10 double precision numbers) is listed in this text file.

Participant Ranking

Participants were ranked based on aggregated problem-wise ranks (details here and here). The following results table lists participants with overall scores (higher is better) and the sum of ranks over all problems (lower is better) The table can be sorted w.r.t. these criteria (however, for this track the rankings happen to coincide).

rank participant method name method description software paper score  sum of ranks 
1 Simon Wessing Model-based HV-maximization 8.96415 26
2 Julien Bect BMOO EHVI / GP / SMC link 8.15735 32
3 Amin PADDS-CHC 5.56708 42
4 John T Modified multi-objective mutation-based 5.15331 43
5 Daniel Horn SMS-EGO SMS-EGO implementation from R-package mlrMBO link link 4.66084 47
6 DIKU, University of Copenhagen 2.63764 60
7 Al Jimenez Curved Trajectories Algorithm (CTA) Contact author link 1.0199 68
8 Artelys Artelys Knitro Artelys Knitro used in derivative-free mode with multistart link link 1.0116 75
9 AndersGoran 0.0953102 75
10 Matador (Bugged) 0.0953102 82