Versioning, splits and the leakage linter

Split ledger lab: L3.2's 17 defensible generated cases are appended to L3.1's 30 recorded ones and cut into dev / calibration / validation / frozen. Deal the sorted list round-robin and appending the batch re-assigns 14 of the 30 recorded cases and empties the frozen set of 3 of its 7 members. Hash the case id and the churn stops while 11 of the 17 generated cases still sit in a split other than their parent's. Hash the recorded root and twins fall to 0 and cross-split pairs to 0 — at a cost of 5 cell-slots — and the exact-tolerance linter still reports a clean dataset that is not clean.

This Evals Engineering lesson is part of a paid plan. Sign in with a plan that includes this course to read it.