High CPU usage, too many open files
- Tracker 3.4.0
- Debian unstable
Since some days I see high CPU usage coming from tracker-miner-fs. The log output shows an "too many open files" error. It looks like the first error does not increase CPU load, but if I send my laptop to sleep then after wakeup the process goes crazy.
Also, I need to kill -9
2 tracker-miner-fs processes to get the system back to normal.
I see two problems that need to be solved:
- tracker-miner-fs failing not gracefully when "too many open files" occur and where to configure the max files for the process.
- tracker-miner-fs causing a high load after wakeup
Happy to help debugging and provide more information if needed.
top - 17:13:12 up 21:18, 5 users, load average: 29,75, 18,77, 13,90
Tasks: 297 total, 1 running, 296 sleeping, 0 stopped, 0 zombie
%Cpu(s): 1,4 us, 0,7 sy, 97,8 ni, 0,0 id, 0,0 wa, 0,0 hi, 0,0 si, 0,0 st
MiB Mem : 15901,4 total, 4148,0 free, 5213,8 used, 6539,5 buff/cache
MiB Swap: 976,0 total, 976,0 free, 0,0 used. 9574,2 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
26448 kai 39 19 4137516 1,1g 19956 S 775,0 7,4 185:47.43 tracker-miner-f
44475 kai 20 0 10844 3972 3348 R 12,5 0,0 0:00.02 top
5835 kai 20 0 637364 87140 65916 S 6,2 0,5 0:22.27 gnome-terminal-
38817 kai 20 0 2662076 152036 101736 S 6,2 0,9 0:20.78 Isolated Web Co
Okt 20 13:00:21 dummy tracker-miner-fs-3[26448]: (tracker-miner-fs-3:26448): Tracker-CRITICAL **: 13:00:21.884: Could not set up interface : unable to open database file (strerror of errno (not necessarily related): Too many open files)
Okt 20 13:00:21 dummy tracker-miner-fs-3[26448]: (tracker-miner-fs-3:26448): Tracker-CRITICAL **: 13:00:21.903: Could not update attached databases: unable to open database: /home/kai/.cache/tracker3/files/http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Audio.db (strerror of errno (not necessarily related): Too many open files)
Okt 20 17:05:40 dummy systemd[1689]: Starting Tracker metadata extractor...
Okt 20 17:05:42 dummy systemd[1689]: Started Tracker metadata extractor.
Okt 20 17:06:27 dummy tracker-miner-f[26448]: Endpoint failed to fully write cursor: Interrupted
Okt 20 17:06:27 dummy tracker-miner-f[26448]: Endpoint failed to fully write cursor: Interrupted
Okt 20 17:06:27 dummy tracker-miner-f[26448]: Endpoint failed to fully write cursor: Interrupted
Okt 20 17:06:27 dummy tracker-miner-f[26448]: Endpoint failed to fully write cursor: Interrupted
Okt 20 17:08:44 dummy systemd[1689]: Starting Tracker metadata extractor...
Okt 20 17:08:44 dummy systemd[1689]: Started Tracker metadata extractor.
Okt 20 17:10:49 dummy tracker-miner-f[26448]: Tracker couldn't read stopword file:'/usr/share/tracker3/stop-words/stopwords.en', Failed to open file “/usr/share/tracker3/stop-words/stopwords.en”: open() failed: Too many open files
Okt 20 17:10:49 dummy tracker-miner-f[26448]: Could not set up interface : unable to open database file (strerror of errno (not necessarily related): Too many open files)
Okt 20 17:10:49 dummy tracker-miner-f[26448]: Could not update attached databases: unable to open database: /home/kai/.cache/tracker3/files/http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Audio.db (strerror of errno (not necessarily related): Too many open files)
Okt 20 17:10:49 dummy tracker-miner-f[26448]: Could not set up interface : unable to open database: /home/kai/.cache/tracker3/files/http%3A%2F%2Ftracker.api.gnome.org%2Fontology%2Fv3%2Ftracker%23Documents.db (strerror of errno (not necessarily related): Too many open files)
Okt 20 17:14:15 dummy systemd[1689]: tracker-miner-fs-3.service: Main process exited, code=killed, status=9/KILL
Okt 20 17:14:15 dummy systemd[1689]: tracker-miner-fs-3.service: Failed with result 'signal'.
Okt 20 17:14:15 dummy systemd[1689]: tracker-miner-fs-3.service: Consumed 3h 14min 9.451s CPU time.
Okt 20 17:14:15 dummy systemd[1689]: Starting Tracker file system data miner...
Okt 20 17:14:16 dummy systemd[1689]: Started Tracker file system data miner.
Okt 20 17:14:23 dummy systemd[1689]: tracker-miner-fs-3.service: Main process exited, code=killed, status=9/KILL
Okt 20 17:14:23 dummy systemd[1689]: tracker-miner-fs-3.service: Failed with result 'signal'.
Okt 20 17:14:23 dummy systemd[1689]: tracker-miner-fs-3.service: Consumed 39.720s CPU time.