Benchopt is a package to simplify and make more transparent and reproducible the comparisons of optimization algorithms. This benchmark is dedicated to zero-order optimization of black-box functions.
This benchmark can be run using the following commands:
$ pip install -U benchopt $ git clone https://github.com/benchopt/benchmark_zero_order $ benchopt run benchmark_zero_order
Apart from the problem, options can be passed to benchopt run, to restrict the benchmarks to some solvers or datasets, e.g.:
$ benchopt run benchmark_zero_order -s solver1 -d dataset2 --max-runs 10 --n-repetitions 10
Use benchopt run -h for more details about these options, or visit https://benchopt.github.io/api.html.