Project

General

Profile

Bug #11612

Loop over mipmap cache generation in lighttable mode

Added by Fran├žois Guerraz about 2 years ago. Updated about 2 years ago.

Status:
Closed: invalid
Priority:
Low
Assignee:
-
Category:
Lighttable
Target version:
Start date:
05/14/2017
Due date:
% Done:

0%

Affected Version:
git master branch
System:
other GNU/Linux
bitness:
64-bit
hardware architecture:
amd64/x86

Description

Hi,

I'm running the latest git revision with -d all.

Scrolling in my image collection (mostly Fuji RAF files), just going one row up for example, I very often end up waiting for a very long time (minutes at 100%CPUs) for the thumbnails to appear.

Meanwhile, the logs fill up with this block of messages looping over and over again with the same "found job already in scheduled: load image 8622 mip 2 | queue: 1 | priority: 4" (as an example, image number is the same thought until if finally succeeds):

[lighttable] expose took 0.4045 sec
[lighttable] image expose took 0.0158 sec
[lighttable] image expose took 0.0078 sec
[sql] /home/francois/Downloads/darktable-fdc/src/common/image.c:629, function dt_image_altered(): prepare "SELECT operation FROM main.history WHERE imgid = ?1" 
[lighttable] image expose took 0.0218 sec
[add_job] 0 | load image 8622 mip 2 | queue: 1 | priority: 0
[add_job] found job already in scheduled: load image 8622 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0004 sec
[lighttable] image expose took 0.0276 sec
[lighttable] image expose took 0.0177 sec
[lighttable] image expose took 0.0093 sec
[lighttable] image expose took 0.0127 sec
[lighttable] image expose took 0.0237 sec
[lighttable] image expose took 0.0227 sec
[lighttable] image expose took 0.0209 sec
[lighttable] image expose took 0.0230 sec
[lighttable] image expose took 0.0156 sec
[lighttable] image expose took 0.0167 sec
[lighttable] image expose took 0.0208 sec
[lighttable] image expose took 0.0143 sec
[lighttable] image expose took 0.0229 sec
[lighttable] image expose took 0.0174 sec
[lighttable] image expose took 0.0229 sec
[lighttable] image expose took 0.0196 sec
[lighttable] image expose took 0.0101 sec
[lighttable] image expose took 0.0109 sec
[lighttable] image expose took 0.0095 sec
[lighttable] image expose took 0.0134 sec
[lighttable] image expose took 0.0157 sec
[mipmap_cache] thumbs fill 67.98/256.00 MB (26.55%)
[mipmap_cache] float fill 0/8 slots (0.00%)
[mipmap_cache] full  fill 4/8 slots (50.00%)
[mipmap_cache] level | near match | miss | stand-in | fetches | total rq
[mipmap_cache] thumb |   6.11% |   6.11% |   -nan%  |  93.22% | 100.00%
[mipmap_cache] float |   -nan% |   -nan% |   -nan%  |   0.00% |   0.00%
[mipmap_cache] full  |   -nan% |   -nan% |   -nan%  |   6.78% |   0.00%

History

#1 Updated by Fran├žois Guerraz about 2 years ago

In the above example, it's just repeating for one image, but if I scroll more than one row, the repeated log block can look more like:

[lighttable] expose took 0.7836 sec
[sql] /home/francois/Downloads/darktable-fdc/src/common/image.c:629, function dt_image_altered(): prepare "SELECT operation FROM main.history WHERE imgid = ?1" 
[lighttable] image expose took 0.0852 sec
[lighttable] image expose took 0.1032 sec
[add_job] 21 | load image 8691 mip 2 | queue: 1 | priority: 0
[add_job] found job already in scheduled: load image 8691 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0029 sec
[add_job] 21 | load image 8694 mip 2 | queue: 1 | priority: 0
[add_job] found job already in scheduled: load image 8694 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0021 sec
[add_job] 21 | load image 8697 mip 2 | queue: 1 | priority: 0
[add_job] found job already in scheduled: load image 8697 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0012 sec
[add_job] 21 | load image 8699 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8699 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0017 sec
[add_job] 21 | load image 8701 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8701 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0082 sec
[add_job] 21 | load image 8703 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8703 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0025 sec
[add_job] 21 | load image 8705 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8705 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0031 sec
[add_job] 21 | load image 8706 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8706 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0018 sec
[add_job] 21 | load image 8708 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8708 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0133 sec
[add_job] 21 | load image 8710 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8710 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0115 sec
[add_job] 21 | load image 8712 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8712 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0058 sec
[add_job] 21 | load image 8714 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8714 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0025 sec
[add_job] 21 | load image 8716 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8716 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0019 sec
[add_job] 21 | load image 8718 mip 2 | queue: 1 | priority: 0
[add_job] found job already in queue: load image 8718 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0009 sec
[add_job] 21 | load image 8720 mip 2 | queue: 1 | priority: 0
[add_job] found job already in scheduled: load image 8720 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0016 sec
[add_job] 21 | load image 8721 mip 2 | queue: 1 | priority: 0
[add_job] found job already in scheduled: load image 8721 mip 2 | queue: 1 | priority: 4
[lighttable] image expose took 0.0011 sec
[lighttable] image expose took 0.1030 sec
[lighttable] image expose took 0.1284 sec
[lighttable] image expose took 0.0645 sec
[lighttable] image expose took 0.0590 sec
[lighttable] image expose took 0.0581 sec
[lighttable] image expose took 0.0541 sec
[lighttable] image expose took 0.0583 sec
[mipmap_cache] thumbs fill 108.46/256.00 MB (42.37%)
[mipmap_cache] float fill 0/8 slots (0.00%)
[mipmap_cache] full  fill 7/8 slots (87.50%)
[mipmap_cache] level | near match | miss | stand-in | fetches | total rq
[mipmap_cache] thumb |  38.50% |  38.07% | 100.00%  |  83.02% | 100.00%
[mipmap_cache] float |   -nan% |   -nan% |   0.00%  |   0.00% |   0.00%
[mipmap_cache] full  |   -nan% |   -nan% |   0.00%  |  16.98% |   0.00%

#2 Updated by Roman Lebedev about 2 years ago

  • Status changed from New to Closed: invalid

as per irc disscussion

#3 Updated by Roman Lebedev about 2 years ago

  • Target version set to 2.4.0

Also available in: Atom PDF