The split type has to preserve the structure you're generalizing along
The chosen split type prior to training must mimic the split between “the known” and “the unknown” at the time of inference. Otherwise, we’re measuring the model on a task it was never trained for.