Hypothesis
Some memory-saving LoRA variants trade away more update freedom than necessary.
Plan
- Build a controlled benchmark.
- Track memory, throughput, and validation quality.
- Inspect failure modes where the low-rank subspace becomes too restrictive.
Exit criteria
A useful result should explain when each adaptation method is worth using, not only which one wins on a single task.