I'm ok with swiping in general but I often listen to audiobooks with a couple of hundred tracks.
It's no problem if I accidentally skip to the next track or something but it's quite annoying if you accidentally change to a different folder by one quick motion and you don't know which track you were at in your book..
so a specific option to disable album/folder changes would make much sense in my opinion.