No, IF you're using scrolling to navigate your library, that's the way it works.
However, I have a 12k album library, and I only ever use search to pull up albums - even on a fullscreen display (e.g., an iPad or MacBook screen), scrolling is WAY too inefficient.
I also frequently Sort by...