LoRA Is a Subspace Constraint

4×4 weight, rank 1: 16 full parameters vs 8 in BA. Freeze W0; walk only in a rank-r subspace. Copilot adapters; QLoRA = same wall + 4-bit.

This Optimization lesson is part of a paid plan. Sign in with a plan that includes this course to read it.