The schedule changes which data the optimizer sees at different stages rather than sampling uniformly throughout. A useful curriculum can stabilize learning, but difficulty must be defined in a way that matches the task.
Curriculum learning presents training examples in an intentional order, often moving from easier patterns to harder ones.
The schedule changes which data the optimizer sees at different stages rather than sampling uniformly throughout. A useful curriculum can stabilize learning, but difficulty must be defined in a way that matches the task.