The current code for Learning Rate Scheduler is dependent of the initial learning rate manually provided by the user.
There is a need for some sort of Learning Rate Scheduler that tries different initial learning rates to figure out the most optimal one.
The current code for Learning Rate Scheduler is dependent of the initial learning rate manually provided by the user.
There is a need for some sort of Learning Rate Scheduler that tries different initial learning rates to figure out the most optimal one.