Skip to content

Implement early stopping in hyperparameter tuning #48

Description

@robin-janssen

Unfortunately, Optuna does not yet support pruning in multi-objective setups.
To save some computational budget, time_pruning is already implemented, which prunes trials based on the predicted training time - if it exceeds a threshold, the trial is pruned. The main motivation for this is that training time is directly related to inference time, hence very slow trials are likely to yield very slow surrogates.

To save additional computational budget, an early stopping criterion which would end model.fit(...) prematurely when progress is slow could be implemented. Note that early-stopped trials are not pruned, they will still count as a proper trial.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions