tracker-miner-fs-3 at 100% CPU activity for hours
I've noticed several times that after moving "a lot" of files around (e.g. in this case: several folders with ~500 files each), the tracker-miner-fs-3 process then spends a few hours at 100% CPU until it eventually calms down. Today it took around 3.5 hours to settle.
Nothing is logged to journal; tracker3 status
says "All data miners are idle, indexing complete" (and no related errors); but strace -ff -p <pid>
shows a continuous stream of the miner-fs process reading from FileSystem.db
and meta.db
the whole time, with an occassional write.
Currently I don't have anything precise to reproduce the problem (I'll try to figure this out later), although I still remember what I did today:
- Renamed ~40 folders in ~/Pictures (each folder having approx 20-200 files, but those were whole-folder renames).
- Immediately after, moved some of those folders into subfolders.
- Elsewhere in ~/Pictures, batch-renamed ~400 individual files (within ~10 folders).
- Immediately after renaming those files, moved/renamed their whole parent folders ("Volume 1/Chapter 2" ⇒ "Vol.1 Ch.2", etc).
Side note: I wonder if I could've triggered some issues by moving the same items several times? i.e. rename/move A to B, then before tracker has caught up, rename/move B again to C. (This is something I'm just generally worried about, whether with tracker or syncthing or some other indexer.)
Side note 2: At least one of the folders had a relative symlink (../../../Attic/Archive/etc/etc
), which became broken after the folder was moved. Hours later, in strace I noticed miner-fs-3 trying to call inotify_add_watch() on that symlink, getting -ENOENT (due to the symlink breaking), then after a few seconds trying again and again. (Eventually I removed the symlink and created an empty directory so that it would succeed.)
The entire system is running from an SSD.
General statistics (I'm probably a hoarder):
$ du -h ~/.cache/tracker3/files/*.db
16M ./http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Audio.db
577M ./http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Documents.db
242M ./http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23FileSystem.db
200M ./http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Pictures.db
2.4M ./http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Software.db
3.5M ./http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Video.db
160M ./meta.db
$ find ~/Documents/ ~/Pictures/ ~/Music/ | wc -l
196877
$ find ~/Pictures/ | wc -l
43072
$ find ~/Music/ | wc -l
4499
Version:
tracker3 3.3.2
tracker3-miners 3.3.1
sqlite 3.39.1-1