Rotation invariant algorithms struggle with noise in sparse linear problems, leading to suboptimal solutions even after seeing a sufficient number of examples.
