Scanning new files into library

[Jonny G]

Just installed latest Poweramp today (26/07/2020), unsure exactly what the build number is but in app changelog shows 875-879. However, this is an issue that has affected every version of Poweramp I have ever installed on my Android headunit. It's currently running version 9, on a custom rom from a guy named Hal9K available on the XDA forums. 

I've just added a few hundred meg of (correctly tagged) audio files onto my external SSD connected via USB to the headunit. Checked that the new folders are ticked and tried to rescan. Only a handful of the new files are added. Cleared cache, cleared storage, re-added the folders and tried to start a new library scan. Only a seemingly random amount of files are added to the library. The app has USB access, I have scanning set to manual only, I'm out of ideas. Could anyone with any thoughts please suggest something else I can try to get Poweramp to reliably scan new music? 

[Jonny G]

Hi, I'm still experiencing the above problem, seemingly random folders are missing from my music library despite how many times I rescan. All my folders are correctly ticked. 

I've checked the FAQ for an answer, but unfortunately haven't found what I was looking for. 

If I've not submitted this bug report correctly, please could someone just give me a pointer on how I can improve my chances of getting some assistance?

Many thanks.

[andrewilley]

It's a hard one to diagnose as you are using an unsupportable custom ROM on an unknown device, with an SSD drive connected to a USB port rather than device internal memory or normal Android SD Card access. There are so many possible variations there that it's hard to even work out where start. It sounds like file access is not occurring fast enough, but that's really more of a guess than anything. Are these regular MP3 files, or high bitrate/FLAC/etc? What happens if you try some tests using internal memory, or a more normal Android storage method?

You could try running a manual FULL Rescan and see how many songs are recognised compared the number that are present on your drive, and then immediately submit a log via Settings > Get Support > Send Log > email to gpmaxmpz @ gmail.com. Post a message here to say you have done it (or DM @maxmp so he knows to look for it).

Andre

[Jonny G]

Hi, thanks for getting back to me.

I can say for a start that I also experience this problem when using a microsd card plugged directly into the unit. 

I take your point re: the custom rom but it would seem to me that if it's possible to find and scan one track into the library, it should be possible for it to do them all.

Case in point, tracks that were previously in my library are now omitted following the full rescan. None of the filenames or locations have changed.

I can access and play all the files using the headunit's file manager, it only seems to be Poweramp that has difficulty in reading them.

The last time this issue occurred (on an older version) the only way I could get Poweramp to fully scan all my media was to scan the folders in chunks, rather than all at once. so A to D, E to H, etc, etc. The folders do contain approx 150GB of media, could it just be too much for the scanner?

[andrewilley]

The scanner can handle any amount of files, I still think the most likely cause is the speed at which your device/ROM/USB connection can read the file system. Sending a log file as I suggested might help.

Andre

[MotleyG]

6 hours ago, andrewilley said:

The scanner can handle any amount of files, I still think the most likely cause is the speed at which your device/ROM/USB connection can read the file system. Sending a log file as I suggested might help.

Andre

I have 25k+ files that are aver 250GB on an external 400GB uSD card. All tracks scan as expected in PA. So the issue is not PA specific, but something that needs to be resolved with your device.

[hrolf1713]

There definitely IS an issue with the scanner related to Poweramp (I have a full stock Samsung).

For some time now, I sometimes notice that some albums disappear from the library. Turns out that the scanner randomly removes full folders (I have each album in its dedicates folder) from the library. I have to launch a manual rescan each time for them to reappear.

Also, when Poweramp is playing and you delete a completely unrelated folder from the SD card, Poweramp stops as if you deleted the currently playing song and it disappears from the library (even though it's not, at all, the file you deleted).

[hrolf1713]

Issue still present. I was listening to an album, paused and closed the app to do something else and when coming back to resume my playing, the time Poweramp rescanned the library, that album just disappeared from the library. I had to rescan the library once again for it to reappear.

Edit: just noticed that after that issue happened, those numbers in the parameters (attached image) are completely false. That not even half of what I have in my SD card (I have at least 20'000 tracks in 2600 folders). The scanner seems to skip entire folders because each time entire folders are concerned. 

Also, please note that issue is present only in Poweramp. Until this is resolved, I have to use another player (because it happens at least once a day which makes it totally unreliable and a hassle) and it doesn't happend in other players.

 

Edited September 12, 2020 by hrolf1713

[hrolf1713]

For the record, it happened again today, in worse. After a rescan, everything goes to normal again. Still no issues with other music players. 

[MotleyG]

35 minutes ago, hrolf1713 said:

For the record, it happened again today, in worse. After a rescan, everything goes to normal again. Still no issues with other music players. 

Is it possible one of your other players is updating the file when Poweramp is not active? Either changing the file name or rating perhaps? Seems something is causing PA to lose access to these files on your phone.

I have 25k+ songs organized by Artist/Album/Track#Name and have never had this issue. I'm on Android 10 currently with an LG G8 thinQ. So not that you are not having an issue, but just providing some reference.

Maybe try turning off the Auto-Scan feature in the Library/Scanner options so it only refreshes when you force it?

[andrewilley]

When this issue occurs next, as soon as the scan has finished please can you send a log via Settings > Get Support > Send Log, and also post a comment to let @maxmp know what you've sent. It does sound like a file system issue though. Just in case it makes a difference (as you don't mention what device or Android version you have) it might be worth trying to enable Settings > Misc > File Access Legacy Mode.

Andre

[maxmp]

It can be also the issue with Android sending scan request when storage (sd card) is not yet available. Log will definitely help. Thanks!

[hrolf1713]

On 9/13/2020 at 7:58 PM, MotleyG said:

Is it possible one of your other players is updating the file when Poweramp is not active? Either changing the file name or rating perhaps?

That's very unlikely as I reinstalled another player because of this problem (I use Poweramp for almost as long as it exists, I really don't want to use another player in the long term, but I had to find a temporary solution as especially at work I close/open the player several times a day, so it happens often and is a bit of a hassle), so it happened before that.

I have a Samsung Galaxy S9 in Android 10. And my usage is relatively "sober" so it never changes much (no phone updates, no new apps since then), I just keep my apps updated and reboot my phone every now and then. I can't think of any issue that can be caused by other apps as nothing changed between before and after the issues began.

On 9/13/2020 at 7:58 PM, MotleyG said:

Maybe try turning off the Auto-Scan feature in the Library/Scanner options so it only refreshes when you force it?

That would be an acceptable resolution if it works. I'll try that, thanks.

On 9/14/2020 at 12:57 AM, andrewilley said:

When this issue occurs next, as soon as the scan has finished please can you send a log via Settings > Get Support > Send Log, and also post a comment to let @maxmp know what you've sent. It does sound like a file system issue though. Just in case it makes a difference (as you don't mention what device or Android version you have) it might be worth trying to enable Settings > Misc > File Access Legacy Mode.

Andre

I'll try the option you mentioned. Will definitely send logs the next time ! Thanks.

On 9/14/2020 at 5:43 PM, maxmp said:

It can be also the issue with Android sending scan request when storage (sd card) is not yet available. Log will definitely help. Thanks!

I will try to send logs ! Thanks.

[hrolf1713]

@maxmp, I just send you logs. It happened just after I launched a manual scan (so @MotleyG, disabling auto scan is unfortunately not a solution 😞 ), not so long after I put a new folder into my SD card. I copied the folder from a local network drive to my SD card so I haven't disconnected my SD card and I was without any issue accessing my SD card through my phone file manager just before that. It stopped what I was listening to. Also, as I have a lot of songs, each time it takes 4-5 minutes for PA to "rebuilt" the library so I have to wait that time before I can listen to anything.

Edited September 19, 2020 by hrolf1713

[andrewilley]

Can you PM Max with the email address you sent the log from, makes it easier to find specific reports.

Andre

[hrolf1713]

2 hours ago, andrewilley said:

Can you PM Max with the email address you sent the log from, makes it easier to find specific reports.

Andre

Sure !

[maxmp]

Thanks for the logs, nothing relevant (except it takes 12 sec. for 18k songs, though full rescan will be much slower), no complains in the log. If you notice something disappears when it shouldn't, please share that particular folder/album (may be just a few songs from a folder + CUE if it's there) - I'll test it's related to the particular files/CUE.

Also please note that Poweramp scanner (at least in "fast" modes, that are all rescan modes except the Full Rescan) is very date/time dependent (for both files/folder timestamp and the device time) and may react inadequately if date/time has been recently changed on the device AND some file activity happened (thus folder last modified timestamps jumped). Poweramp compares recorded modification time vs filesystem timestamp (which is device time dependent) and scans or skips scanning in fast mode, causing some folders which jumped time being removed from database. Full Rescan fixes that. Time zone changes don't affect scanning.
 

On 8/31/2020 at 10:47 PM, hrolf1713 said:

Also, when Poweramp is playing and you delete a completely unrelated folder from the SD card, Poweramp stops as if you deleted the currently playing song and it disappears from the library (even though it's not, at all, the file you deleted).

This may happen in some modes when the currently played list is changed so we can't continue (e.g. all songs, or shuffle all or other shuffle mode, which includes tracks from the removed folders). But generally Poweramp should continue, so if it happens while isolated list is played, I would be grateful for the details (what category, what format played, what repeat/shuffle mode was used, etc.). If it's a consistent behavior (happens every time) short captured video will help a lot.

Thanks!

[VIV_ID]

Sorry to resurrect an old thread, but I finally got around to jotting down my notes on this issue. I've just sent the same text with a log from the app as well.

I've been having this issue for years (literally), but I've put off reporting it for a way too long.

The issue first started occurring spontaneously and not in relation to a hardware change like a new phone or SD card. Unfortunately I don't recall the version this started happening in because I didn't report it at the time.

 

I'm currently on build 939

Samsung Galaxy S9+

Android 10

 

General observations:

• The files are actually removed from the library. Sometimes the song I'm listening to just stops and disappears from the library when a rescan decides to remove it. The removed files usually reappear on the next scan, with new "Added to library" timestamps, making my favorite sorting option useless/cumbersome.
• The missing files are also missing from playlists (they're all .m3u playlists). To reappear and be playable I have to remove the .m3u-files, rescan, put the .m3u-files back and rescan. The "Rescan / Resolve Playlists" function does not seem to handle cases like this.
• My phone is not restarted shortly before this happens. The SD card has been operational for hours and days when this happens (current uptime 676 hours).
• I do not have any other music players or other apps that access the same root music folder, at any time.
• The affected folders/albums are usually grouped (although still a random selection) in the sense that there are several missing albums from the same artist. See below for example.

For reference, my files are generally organized like this:

\SD card root\Music\Artist or Label\Album\##-Song.mp3

 

Description of actions and result in this particular instance:

I added a few new files to my SD card, in new folders, and did a manual rescan (I've disabled automatic rescans because of this issue). I then made another change to one of the same folders and did another rescan. When it finished, several older albums appeared as "Recently added". Half of these folders I have not even touched recently (for instance, all folder and file timestamps are from January in the Kim Petras folder).

Kim Petras: 6/6 folders affected

SPYAIR: 2/7

Fit For a King: 2/2

All That Remains: 2/2

Renraku: 1/5 (I deleted some files and folders here, but did not add any)

Spor: 1/17

TurboAutism: 1/2

 

These folders do not have any similarities to each other in terms of timestamps or the like.

Edited June 10, 2022 by VIV_ID

[MotleyG]

@VIV_ID is your Music Folder pointed at the root for your SD card, or to SD\Music\? I believe Android is getting more picky about file access to the root of any drive and wants at least a folder to be the start point.

And when you added new music was this done leaving the card in your device, or by removing it from the S9+ and using a card reader on your computer? I'm thinking maybe the files you are seeing are being updated if you have sync software doing this update for you

[VIV_ID]

17 minutes ago, MotleyG said:

@VIV_ID is your Music Folder pointed at the root for your SD card, or to SD\Music\? I believe Android is getting more picky about file access to the root of any drive and wants at least a folder to be the start point.

I've pointed Poweramp to \SD\Music\. It's the only folder I have selected.

Quote

And when you added new music was this done leaving the card in your device, or by removing it from the S9+ and using a card reader on your computer? I'm thinking maybe the files you are seeing are being updated if you have sync software doing this update for you

I use FX File Explorer to copy files directly from my PC with SMB over WiFi. No automation there.

Edited June 10, 2022 by VIV_ID

[MiffEnlarger]

same issue, so it isn't a one off at all. Poweramp simply stops seeing my tracks, (and often won't scan them in again). It's all set up correctly I assure you. Another player i have installed sees them ok, and this was a common occurance across two phones, so not just this one.