Yes, I did use the Delete Cache option, but it did not change anything. I had to go to the folder and manually delete them there, where it was still full.
Also, I do have embedded album artwork, so auto-download is a no go.
Going to the folder with the cache is a bit of a PITA on Android 14, since with the introduction of 13, Google attempted to restrict people from accessing the Android/data folder, but I managed with Shizuku.