Pytorch Lightning Learning rate finder

The following plots the loss against learning rate in order to discover an “optimal” learning rate.

lr_finder = trainer.tuner.lr_find(lightning_module, train_dataloaders=train_dl)
fig = lr_finder.plot(suggest=True)
fig.show()

When all else fails, 1e-3.