Reproducibility is the ceteris-paribus condition that makes replication-variance a clean measurement
The pipeline must run deterministically across identical runs, so that we’re sure that when we update a single axis, the run satisfies ceteris paribus. Once that condition is satisfied, replication-variance experiment can measure the variance of noise using replication knobs.