Project

General

Profile

Bug #8807

Import of DNG fails

Added by David Preuss almost 8 years ago. Updated almost 6 years ago.

Status:
Fixed
Priority:
Low
Assignee:
-
Category:
General
Target version:
Start date:
07/01/2012
Due date:
% Done:

100%

Estimated time:
Affected Version:
git development version
System:
unknown
bitness:
64-bit
hardware architecture:
amd64/x86

Description

When importing dng that have been created from jpg, the import results in weird fragmented pictures and selecting the darkroom causes asegfault. The collection is empty again afterwards.

As I could not attach the pictures here in redmine (somehow the connection gets reset by the server all the time allthough the sizelimit is ok.), I posted them here:

Japan_2002_ShichiGoSan_1.dng (5.45 MB) Japan_2002_ShichiGoSan_1.dng David Preuss, 11/02/2012 07:54 PM

History

#1 Updated by David Preuss almost 8 years ago

Sorry the link was missing

http://www.nichi-doku.de/Darktable.html

#2 Updated by Simon Spannagel almost 8 years ago

  • % Done changed from 0 to 20
  • Status changed from New to Incomplete

Hi David,

The linked file can't be found.

Beside that: Why would you create a DNG from a JPEG file? DNGs are RAW files just as the vendor ones from camera and contains mosaic data. So I'm not really sure it's a darktable problem you experience with your DNG file - could you cross-check with another raw developer (rawtherapee e.g.)

Furthermore if you get a segfault we need a backtrace in order to track down that problem - most probably it's not a problim inside darktable but in a library used by dt.
You can follow the guidance given here: http://www.darktable.org/development/#backtrace There is also a screencast linked there that gives you a nice overview.

regards,
Simon

#3 Updated by David Preuss almost 8 years ago

Hi Simon,

sorry, had some troubles with my server. The links are back up again.

As regards the jpg vs. dng question: that was just a plain mistake in the early days when I still used lightroom. I made the wrong settings without thinking and now I ended up with a lot of former jpgs (when there was nothing like RAW on the camera but only jpg) that have been converted by lightroom to dngs.

And here the backtrace:

Reading symbols from /usr/bin/darktable...Reading symbols from /usr/lib/debug/usr/bin/darktable...done.
done.
(gdb) r
Starting program: /usr/bin/darktable 
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
[New Thread 0x7fffed55f700 (LWP 8580)]
[New Thread 0x7fffecd5e700 (LWP 8581)]
[New Thread 0x7fffe7fff700 (LWP 8582)]
[New Thread 0x7fffe77fe700 (LWP 8583)]
[New Thread 0x7fffdffff700 (LWP 8584)]
[New Thread 0x7fffe6ffd700 (LWP 8585)]
[New Thread 0x7fffe67fc700 (LWP 8586)]
[New Thread 0x7fffe5ffb700 (LWP 8587)]
[New Thread 0x7fffe4d9e700 (LWP 8588)]
[New Thread 0x7fffdf6fe700 (LWP 8589)]
[New Thread 0x7fffdeefd700 (LWP 8590)]
[New Thread 0x7fffde6fc700 (LWP 8591)]
[New Thread 0x7fffddefb700 (LWP 8592)]
[New Thread 0x7fffdd6fa700 (LWP 8593)]
[New Thread 0x7fffa321a700 (LWP 8594)]
[New Thread 0x7fffa2a19700 (LWP 8595)]
[New Thread 0x7fff85e90700 (LWP 8596)]
[New Thread 0x7fff80a1a700 (LWP 8597)]
[New Thread 0x7fff7bfff700 (LWP 8598)]
[New Thread 0x7fff7b7fe700 (LWP 8599)]
[Thread 0x7fff7bfff700 (LWP 8598) exited]
[Thread 0x7fff7b7fe700 (LWP 8599) exited]
[Thread 0x7fff85e90700 (LWP 8596) exited]
[Thread 0x7fff80a1a700 (LWP 8597) exited]
[New Thread 0x7fff7b7fe700 (LWP 8600)]
[New Thread 0x7fff7bfff700 (LWP 8601)]
[New Thread 0x7fff80a1a700 (LWP 8602)]
[New Thread 0x7fff85e90700 (LWP 8603)]
[New Thread 0x7fff5f56c700 (LWP 8605)]
[New Thread 0x7fff5ed6b700 (LWP 8606)]
[New Thread 0x7fff5e56a700 (LWP 8607)]
[New Thread 0x7fff61eac700 (LWP 8609)]
[New Thread 0x7fff616ab700 (LWP 8610)]
[Thread 0x7fff61eac700 (LWP 8609) exited]
[Thread 0x7fff85e90700 (LWP 8603) exited]
[New Thread 0x7fff85e90700 (LWP 8611)]
[New Thread 0x7fff61eac700 (LWP 8612)]
[Thread 0x7fff61eac700 (LWP 8612) exited]
[Thread 0x7fff85e90700 (LWP 8611) exited]
[New Thread 0x7fff85e90700 (LWP 8613)]
[Thread 0x7fff85e90700 (LWP 8613) exited]
[New Thread 0x7fff85e90700 (LWP 8614)]
[Thread 0x7fff616ab700 (LWP 8610) exited]

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fff5e56a700 (LWP 8607)]
0x00007ffff7ab8069 in dt_iop_flip_and_zoom_8._omp_fn.3 ()
    at /build/buildd/darktable-1.0.4/src/develop/imageop.c:1334
1334    /build/buildd/darktable-1.0.4/src/develop/imageop.c: No such file or directory.
(gdb) bt
#0  0x00007ffff7ab8069 in dt_iop_flip_and_zoom_8._omp_fn.3 ()
    at /build/buildd/darktable-1.0.4/src/develop/imageop.c:1334
#1  0x00007ffff32d3eea in ?? () from /usr/lib/x86_64-linux-gnu/libgomp.so.1
#2  0x00007ffff781ae9a in start_thread ()
   from /lib/x86_64-linux-gnu/libpthread.so.0
#3  0x00007ffff75484bd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#4  0x0000000000000000 in ?? ()

I also checked out with rawtherapee and the image can be opened and processed. But from the backtrace it seems like its bad linked static lib or whatever thing. Hope that helps, hope you can help! I want to start using DT soon again.

Thanks, David

#4 Updated by David Preuss almost 8 years ago

HI there, is there anything that I can provide more? I still face the issue but would like to use DT for my complete collection.

#5 Updated by Tobias Ellinghaus over 7 years ago

Could you try if this also happens with a recent development version (i.e. a compile from git master)?

#6 Updated by David Preuss over 7 years ago

Hi Tobias,

tried it with RC1 now with 2 usecases:

1. import images
2. select "failed" imports where the lighttable shows that something was imported but can't see the pic

in both cases the output is

Starting program: /usr/bin/darktable
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
[New Thread 0x7fffed023700 (LWP 5461)]
[New Thread 0x7fffec822700 (LWP 5462)]
[New Thread 0x7fffe7fff700 (LWP 5463)]
[New Thread 0x7fffe77fe700 (LWP 5464)]
[New Thread 0x7fffe6ffd700 (LWP 5465)]
[New Thread 0x7fffe67fc700 (LWP 5466)]
[New Thread 0x7fffe5ffb700 (LWP 5467)]
[New Thread 0x7fffe57fa700 (LWP 5468)]
[New Thread 0x7fffe4ff9700 (LWP 5469)]
[New Thread 0x7fffcffff700 (LWP 5470)]
[New Thread 0x7fffcf7fe700 (LWP 5471)]
[New Thread 0x7fffce59d700 (LWP 5472)]
[New Thread 0x7fffcd99a700 (LWP 5473)]
[New Thread 0x7fffcd199700 (LWP 5474)]
[New Thread 0x7fffcc998700 (LWP 5475)]
[New Thread 0x7fffbbfff700 (LWP 5476)]
[New Thread 0x7fffbb7fe700 (LWP 5477)]
[mipmap_cache] cache is empty, file `/home/david/.cache/darktable/mipmaps-2bc3676e1c6fe175451586606e14e6daf2e32588' doesn't exist
[New Thread 0x7fff8f853700 (LWP 5478)]
[New Thread 0x7fff8f052700 (LWP 5479)]
[New Thread 0x7fff87fff700 (LWP 5480)]
Fontconfig warning: "/etc/fonts/conf.d/50-user.conf", line 9: reading configurations from ~/.fonts.conf is deprecated.
[New Thread 0x7fff6dbde700 (LWP 5497)]
[New Thread 0x7fff67a27700 (LWP 5498)]
[New Thread 0x7fff67226700 (LWP 5499)]
[Thread 0x7fff67a27700 (LWP 5498) exited]
[New Thread 0x7fff66a25700 (LWP 5500)]
[Thread 0x7fff6dbde700 (LWP 5497) exited]
[Thread 0x7fff67226700 (LWP 5499) exited]
[Thread 0x7fff66a25700 (LWP 5500) exited]
[New Thread 0x7fff66a25700 (LWP 5501)]
[New Thread 0x7fff67226700 (LWP 5502)]
[New Thread 0x7fff67a27700 (LWP 5503)]
[New Thread 0x7fff6dbde700 (LWP 5505)]
[New Thread 0x7fff4bdf6700 (LWP 5506)]
[New Thread 0x7fff4b5f5700 (LWP 5507)]
[New Thread 0x7fff51326700 (LWP 5508)]
[New Thread 0x7fff50b25700 (LWP 5509)]
[Thread 0x7fff51326700 (LWP 5508) exited]
[New Thread 0x7fff50324700 (LWP 5510)]
[New Thread 0x7fff4fb23700 (LWP 5511)]
[Thread 0x7fff50b25700 (LWP 5509) exited]
[Thread 0x7fff50324700 (LWP 5510) exited]
[Thread 0x7fff4fb23700 (LWP 5511) exited]
[New Thread 0x7fff4fb23700 (LWP 5512)]
[New Thread 0x7fff50324700 (LWP 5513)]
[New Thread 0x7fff50b25700 (LWP 5514)]
[New Thread 0x7fff51326700 (LWP 5515)]
[Thread 0x7fff50324700 (LWP 5513) exited]
[Thread 0x7fff50b25700 (LWP 5514) exited]
[Thread 0x7fff4fb23700 (LWP 5512) exited]
[Thread 0x7fff51326700 (LWP 5515) exited]
[New Thread 0x7fff51326700 (LWP 5516)]
[New Thread 0x7fff50b25700 (LWP 5517)]
[Thread 0x7fff51326700 (LWP 5516) exited]
[New Thread 0x7fff50324700 (LWP 5518)]
[Thread 0x7fff50b25700 (LWP 5517) exited]
[New Thread 0x7fff4fb23700 (LWP 5519)]
[Thread 0x7fff50324700 (LWP 5518) exited]
[Thread 0x7fff4fb23700 (LWP 5519) exited]
[New Thread 0x7fff4fb23700 (LWP 5521)]
[New Thread 0x7fff50324700 (LWP 5522)]
[Thread 0x7fff50324700 (LWP 5522) exited]
[Thread 0x7fff4fb23700 (LWP 5521) exited]
[New Thread 0x7fff4fb23700 (LWP 5523)]
[New Thread 0x7fff50324700 (LWP 5524)]
[New Thread 0x7fff50b25700 (LWP 5525)]
[New Thread 0x7fff51326700 (LWP 5526)]
[New Thread 0x7fff4ef02700 (LWP 5527)]
[New Thread 0x7fff4adf4700 (LWP 5528)]
[New Thread 0x7fff4a5f3700 (LWP 5529)]
[Thread 0x7fff50324700 (LWP 5524) exited]
[Thread 0x7fff4adf4700 (LWP 5528) exited]
[Thread 0x7fff87fff700 (LWP 5480) exited]
[Thread 0x7fff51326700 (LWP 5526) exited]
[Thread 0x7fff4ef02700 (LWP 5527) exited]
[Thread 0x7fff4fb23700 (LWP 5523) exited]
[Thread 0x7fff50b25700 (LWP 5525) exited]
[New Thread 0x7fff50b25700 (LWP 5530)]
[Thread 0x7fff4a5f3700 (LWP 5529) exited]
[New Thread 0x7fff4a5f3700 (LWP 5531)]
[Thread 0x7fff50b25700 (LWP 5530) exited]

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7fff4b5f5700 (LWP 5507)]
0x00007fff64c70f8d in process._omp_fn.2 ()
at /build/buildd/darktable-1.1~rc1/src/iop/temperature.c:288
288 /build/buildd/darktable-1.1~rc1/src/iop/temperature.c: No such file or directory.
(gdb) bt
#0 0x00007fff64c70f8d in process._omp_fn.2 ()
at /build/buildd/darktable-1.1~rc1/src/iop/temperature.c:288
#1 0x00007ffff2fde81a in ?? () from /usr/lib/x86_64-linux-gnu/libgomp.so.1
#2 0x00007ffff77a0e9a in start_thread ()
from /lib/x86_64-linux-gnu/libpthread.so.0
#3 0x00007ffff74cdcbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#4 0x0000000000000000 in ?? ()

Anything further I can do?

Thanks a lot for this wonderful piece of software! Hope I can fix my issue soon to fully utilize dt.

David

#7 Updated by Tobias Ellinghaus over 7 years ago

  • Affected Version changed from 1.0.4 to git development version

Could you upload a sample DNG somewhere? I can't promise anything, but the old URL gives 404 now.

#8 Updated by David Preuss over 7 years ago

Hi Tobias,

I attached it to the issue this time instead of uploading on my webserver.

Thanks a lot!

David

#9 Updated by Tobias Ellinghaus over 7 years ago

  • Status changed from Incomplete to Triaged
  • Category changed from Darkroom to General

#10 Updated by David Preuss over 7 years ago

Hi there,

is there any chance to get this moved? If not, I will consider to move to a different solution and it can be closed.

Thanks for the info!

David

#11 Updated by Pascal de Bruijn over 7 years ago

  • System set to unknown
  • Target version set to Future

The problem still exists in 1.1.3. As far as I know we don't supported JPEG in DNG yet, so I guess this something for the future.

On a sidenote (as a workaround), did you try extracting the JPEGs using exiv2 -ep3 TEST.DNG (or -ep2/-ep1) or using exiftool?

#12 Updated by Roman Lebedev almost 6 years ago

  • bitness set to 64-bit
  • % Done changed from 20 to 100
  • Status changed from Triaged to Fixed

Does not crash with master.
Apparently was fixed some time ago.

Also available in: Atom PDF

Go to top