FineTuneDPOMethod

Configuration for the DPO fine-tuning method.

{
    "hyperparameters": {
        "beta": "auto",
        "batch_size": "auto",
        "learning_rate_multiplier": "auto",
        "n_epochs": "auto"
    }
}