@dooude Perhaps, this might help. Try turn off the crossfade in Apple Music settings. I have been switching between albums and playlists, none of the problem to comeback.
I will continue trial and error, and I will let you know if the problem reemerges.
Update:
The problem seems to comeback after I restarted my phone. No luck in trying turn the crossfade on and off. I don't have another music streaming app, so I don't know if the problem is exclusive to Apple Music, or specific to my phone only.
My phone: Xiaomi Mi A2
Android version: 10
Apple Music version: 4.0.0
Poweramp EQ build: 940-bundle-play