This is the performance analyzer of Iterative Optimization Heuristics (IOHs), e.g., Evolutionary Algorithms. IOHanalyzer takes as input the benchmark data from the user and provides very detailed analysis on, e.g., the empirical running time.

It provides:

• A web-based Graphical User Interface (GUI).
• Interactive plotting in two perspectives (fixed-budget and fixed-target) of both performance and tracked parameters.
• Statistical evaluation methods.
• R programming interfaces in the backend.

It takes as input:

• COCO/BBOB data format (see https://github.com/numbbo/coco),
• IOHprofiler data format, which is motivated and modified from COCO/BBOB data format (Please read the data format section for specifications on the supported data format), or
• Nevergrad data format (explained in https://github.com/facebookresearch/nevergrad).

It is built on:

• R packages data.table, Shiny, Plotly and Rcpp.

It is available through:

• a free online service available at http://iohanalyzer.liacs.nl, and
• a local installation of the package.

Installation

Software dependency

• [mandatory] R As IOHanalyzer is written as a R package, the R environment has to be installed first. The binary file and installation manual for R can be found at https://cran.r-project.org/.
• [optional] orca required to download plotly figures. Please see https://github.com/plotly/orca for the installation instruction.

Stable version

Please start up a R console and install the stable version as:

install.packages('IOHanalyzer')

which is maintained on CRAN (Comprehensive R Archive Network).

Lastest version

The lastest development is always hosted on Github. In case you’d like to try out this version, the R package devtool is needed:

install.packages('devtools')
devtools::install_github('IOHprofiler/IOHanalyzer')

Start up the Graphical User Interface

The IOHanalyzer package can be installed and loaded using the following commands:

library('IOHanalyzer')
runServer()

Have fun! For the complete reference on usage, please continue reading this documentation.