Project

General

Profile

Camera Support #10868

Canon 760D noise profile

Added by Bruno Pagani over 2 years ago. Updated 3 months ago.

Status:
Fixed
Priority:
Low
Category:
-
Target version:
Start date:
01/10/2016
Due date:
% Done:

100%

Affected Version:
git development version

Description

Hi,

I recently acquired a Canon 760D camera and would like to know what exactly is needed in order to support it. According to this page: http://www.darktable.org/resources/camera-support/, it currently lacks WB preset, noise profile and colour matrix. I think that last one is going to be fixed by http://redmine.darktable.org/issues/10613, but the other two remains, especially noise profile that currently makes darktable unusable for me. :(

There might be other things too, but the following page (referred from previous one) looks (quite normally after all) outdated:
http://www.darktable.org/2012/10/whats-involved-with-adding-support-for-new-cameras/

Especially, I think that with 2.0 you removed libraw or something like that. So, my question is which steps should I follow exactly to bring all what is needed to support my camera in darktable and projects that darktable depends on (like capture this kind of pictures with those kinds of settings and provide us with them or run this script here). :) Also, it probably worth it to add a (wiki) page about this, or just directly to the aforementioned page. And if other projects are involved, links to similar pages for them. ;)

dt-noiseprofile-20160316.tar.gz (4.54 MB) Bruno Pagani, 03/16/2016 11:10 PM

dt-noiseprofile-20160430.tar.gz (3.94 MB) Bruno Pagani, 04/30/2016 05:30 PM

dt-noiseprofile-20160924.tar.gz (6.26 MB) Mandar Harshe, 09/25/2016 12:17 AM

dt-noiseprofile-20170628.tar.gz (2.15 MB) Bruno Pagani, 06/28/2017 01:21 PM

dt-noiseprofile-20180124.tar.gz (6.68 MB) Chris Elston, 01/25/2018 12:32 AM


Related issues

Related to darktable - Camera Support #10613: Enhanced Color Matrix Canon EOS 760D New 08/24/2015

Associated revisions

Revision 87529619
Added by Stefan Schöfegger 3 months ago

noise profile: Add Canon 760D, fixes #10868

Revision fb579da2
Added by Stefan Schöfegger about 2 months ago

noise profile: Add Canon 760D, fixes #10868

(cherry picked from commit 87529619acb5bf31c1a5c0f843046b6fafde5585)

History

#1 Updated by Roman Lebedev over 2 years ago

#2 Updated by Bruno Pagani about 2 years ago

  • File dt-noiseprofile-20160316.tar.gz added
  • Status changed from New to Patch attached
  • Target version set to Candidate for next minor release
  • % Done changed from 0 to 70

While waiting for more input from your side, I took the time to do some noise profiling. So here you go.

I’ve kept the original pictures if you need them too.

#3 Updated by Pedro Côrte-Real about 2 years ago

  • % Done changed from 70 to 20
  • Status changed from Patch attached to Incomplete

The noise profile graphs look very strange. Could you please upload the raw files somewhere so we can have a look?

#4 Updated by Bruno Pagani about 2 years ago

Yes, sure. Can’t upload the whole things from home, but will do from work on Tuesday afternoon.

Note that, possibly correlated to this strange look, I’m not happy with the results in DT. Picture look like pastel or something like that.

#5 Updated by Pedro Côrte-Real about 2 years ago

Yeah, that's to be expected. The fits were not good at all.

#6 Updated by Bruno Pagani about 2 years ago

Here it is (available for 60 days from now):
https://upload.obspm.fr/get?k=J93jLcsa6suq2gfAsMk

#7 Updated by Pedro Côrte-Real about 2 years ago

  • Affected Version changed from 2.0.0 to git development version

Hey, redoing the profiling with the original images results in something decent but not ideal. We could probably get a better profile if you included more tones in between full white and full black. See these examples:

http://www.darktable.org/wp-content/uploads/2012/12/example_profile.jpg
http://scratch.corujas.net/DSC04270-thumb.jpg

#8 Updated by Bruno Pagani almost 2 years ago

Hey, sorry for the huge delay, been quite busy since. Please find attached a new attempt. ;)

#9 Updated by Bruno Pagani almost 2 years ago

Hi, any news here?

#10 Updated by Roman Lebedev over 1 year ago

  • % Done changed from 20 to 70
  • Subject changed from Canon 760D support to Canon 760D noise profile
  • Status changed from Incomplete to Patch attached

#11 Updated by Mandar Harshe over 1 year ago

I just ran the noise profiling myself and generated this profile:

Hope it's useful.

#12 Updated by Bruno Pagani over 1 year ago

What’s the status here? Looks like it missed the train for 2.2, while noise profile for EOS 80D, submitted long after, seems to be in…

#13 Updated by Bruno Pagani about 1 year ago

Bumping again, Redmine seems to get way less attention than GitHub, but they aren’t issues at the GitHub repo…

#14 Updated by Stefan Schöfegger 10 months ago

The submitted noise profile differ a lot. As there was an error in creating the noise profile in older darktable versions i think the profile should be calculated again with a recent version. Afterward it can be added (and wouldn't take as long as the old profile :-) ).

#15 Updated by Stefan Schöfegger 10 months ago

  • Assignee set to Stefan Schöfegger

#16 Updated by Bruno Pagani 10 months ago

Hi, sorry for the delay. I’m currently travelling, and I don’t have either the camera or the pictures with me. I’ll try to retrieve those from my online backup, else it will have to wait for the WE.

Thanks for coming back to us! :)

#17 Updated by Bruno Pagani 10 months ago

Here you go!

By taking a look at the PDFs, it looks way different indeed, especially for ISOs of 200, 400, 3200, 6400 and 12800. Tell me if that’s good for you, else I’ll do new shots when getting back home in ten days.

#18 Updated by Stefan Schöfegger 10 months ago

Hi,

please redo the shots for ISO 3200, 6400, 12800. All other iso images look good, you can reuse them for the noise profile calculation.
Thanek you.

#19 Updated by Bruno Pagani 10 months ago

ACK, I should be able to do so on the 9th.

#20 Updated by Bruno Pagani 8 months ago

Sorry for the huge delay, I’ve made some unsuccessful attempts and then had to do a lot of other things.

I’ve made another hundred of attempts during the past week, to no avail. Curves look always completely wrong. Running the code against the previous series of pictures give the correct results, but it seems that I’m unable to choose a correct view/lighting… I’ll try again later but for now I have to let this aside again.

#21 Updated by Chris Elston 3 months ago

Hi,

I've just run noise profiles for my new 760D with the latest version of Darktable. I'm new to all this (thank goodness for the auto-script) but it looks pretty nice on the test shots I've tried.

#22 Updated by Stefan Schöfegger 3 months ago

@Chris Elston:
Profile looks good, thank you.

#23 Updated by Chris Elston 3 months ago

Thanks for quick response.

As has been noted in the OP, the blog post about noise profiling in darktable (https://www.darktable.org/2012/12/profiling-sensor-and-photon-noise/) is quite old and can be intimidating for someone who (like me) doesn't know that much about how denoising actually works and just wants their new toy to have noise profiles in Darktable. In comparison to the complexity of the post, the process for creating the noise profiles is relatively straightforward.

In order to get more users submitting their own noise profiles and improving camera support it would be very useful to have a section in the user manual with a step-by-step 'dummies guide' to profiling your gear (also including base curves, WB presets, color matrices), with reference to the original blog posts for the more techy minded. In addition, a script to actually inject the newly-created profile into a local copy of the noiseprofiles.json file (as opposed to running a one-off copy of darktable with the profiles) would be useful, pending inclusion in an official release.

I'm more than happy to contribute to such an effort (though it would need reviewing by someone more expert than me). Does anyone know how I would go about this?

Chris

#24 Updated by Stefan Schöfegger 3 months ago

  • Status changed from Patch attached to Fixed
  • % Done changed from 70 to 100

#25 Updated by Bruno Pagani 3 months ago

Thanks Chris for providing a good noiseprofile!

Now I only have to look at https://github.com/darktable-org/darktable/tree/master/tools/basecurve (but I think my pictures are AdobeRGB, so there might be an issue here).

#26 Updated by Stefan Schöfegger 3 months ago

@Chris Elston

Writing a new blog post for creating noise profiles would be nice. You can add a pull request on https://github.com/darktable-org/dtorg The original blog about profiling can be found on https://github.com/darktable-org/dtorg/tree/master/content/blog/2012-12-11-profiling-sensor-and-photon-noise

The pull request will be reviewed of course.

@Bruno Pagani

Now I only have to look at https://github.com/darktable-org/darktable/tree/master/tools/basecurve (but I think my pictures are AdobeRGB, so there might be an issue here).

New basecurves will not get merged anymore as they can not be verified.

#27 Updated by Bruno Pagani 3 months ago

Oh. What should I do then to get colours looking like the camera produced JPEG? They are way better than the default output of Darktable (which is quite flat/dull in comparison). Should I just generate a basecurve for myself and be done with it or is there a planned replacement?

#28 Updated by Roman Lebedev 3 months ago

  • Target version changed from Candidate for next minor release to 2.6.0

Also available in: Atom PDF