Teams evaluate candidates on it without using its examples for ordinary parameter updates. Repeated optimization against the same set can still overfit it, requiring a final untouched test set.
A validation set is held-out data used to choose models, prompts, thresholds, and hyperparameters during development.
Teams evaluate candidates on it without using its examples for ordinary parameter updates. Repeated optimization against the same set can still overfit it, requiring a final untouched test set.