I've also been having this same issue for months now. It's very frustrating when you have 1000+ albums and you have to manually scroll through most of them
If I want to go to an album of a band/artist that begins with any letter between L and U, it just takes me to the K artists. When I tap V it works as normal again.