New Zeroth-Order Method Tames Gradient-Free Fine-Tuning of Large Language Models
Researchers have introduced PLS-ZO, a zeroth-order optimization framework that confines gradient-free perturbations to a low-dimensional latent subspace, dramatically reducing the ...
