dlRaw

dlRaw: actual denoising status

Hi folks,

the people from digiKam have implemented the actual version of wavelet denoise (the same as dlRaw Wink) and with this they posted some comparison images, you can see them here 1, 2, 3 and 4. The RAW file is freely available (thanks to the guys from focus-numerique) so I gave it a try on my development version...

greets mike

Image quality

Hi folks,

just a few lines to let you know, that the project is not dead Wink So in the last days I've worked on one important part of RAW processing, the demosaicing. Additional filters were added, and with these image quality can be improved.

Demosaicing is the part which creates from the Bayer pattern the actual image right at the beginning of the processing. This is important when it comes down to details, noise and sharpness (and of course artifacts Wink). We're mostly talking on pixel level here, so the differences are not that big (100% view in the 1:1 pipe). I've prepared two small losslessly compressed samples (the RAWs are kindly provided by imaging-resource, I took the ISO 100 and ISO 25600 shots). So just download the files yourself and play with the settings on the 1:1 pipe (otherwise the demosaicing filters won't affect the output) to see if you can get similar results with the current version without these algorithms Wink Only settings on the camera tab are used, no additional sharpening or denoising, and no wavelet denoising on the RAW. Sure it is not perfect, but an improvement. You won't see the detail differences very often, because you really need fine structures for this, eg small patterns (moire areas) of fine bright hairs (like whiskers)... The differences in the noise on high ISO shots are far more prominant. Of course improved quality doesn't come for free, the calculation times are much higher, but it is still bearable with a modern multicore CPU, all of them are already parallelized (demosaicing of 10 MP on a Q6600 with very good quality and many refinement steps takes around 10 seconds). For more information, there is a nice comparison of demosaicing algorithms here. So, have fun to explore your RAW files for these fine structures and stay tuned for the next release Wink

greets mike

dlRaw: hotpixel reduction on bayer pattern

Hi folks,

just to let you know, the first filter for the next release is working. The automatic hotpixel reduction works now directly on the bayer pattern, to kill bad signals before they get amplified by the demosaicing algorithm. At the moment it works quite conservative to preserve as much detail as possible, but this comes with the cost, that not all are catched... but judge yourself, a small 100% sample of a night shot with my K100, demosaiced with AHD and sharpened with unsharp mask (radius 2, amount 1, threshold 0 ). The difference between the two is just the hotpixel reduction. Stay tuned Wink

greets mike

 

dlRaw: hotpixel reduction

Hi folks,

just a short update, to let you know, that work is still preceding... You probably noticed my last pictures on the blog. They are pretty clean as you see them there, but while processing them I had a problem with hotpixels. My old and trusty Pentax K100D has some bad pixels when used with higher ISO. Although it's not so bad on the pure picture, when sharpening the image bad pixels like to shine out Sad So I had to remove these small blemishes on all of them manually in gimp afterwards... Of course I didn't like that Wink During the week I tried to code an algorithm removing them; finally today I can report first results.

The algorithm works at the moment only on 1:2 and 1:4 images, because on 1:1 pipe it is better to work on the Bayer pattern directly and that is still work in progress... But on 1:2 I'm pretty satisfied with the result. The two attached images are both way oversharpened, that is just to show you how many bad pixels there are. Usually, with normal sharpening, one would only see a view of them, but those would still be distracting. The difference between the two pictures is just the hotpixel reduction nothing more.

So stay tuned for more news about dlRaw Wink

greets mike

dlRaw: memory requirement

Hi folks,

there have been some complaints about the speed of dlRaw on computers with little memory and 1:1 pipe. So just a few words about the background. Since dlRaw has so many filters it takes a while to compute them all, so to speed this up the image is cached after every tab. With this the calculation has only to start at the beginning of the tab with the last changes. The drawback, this caching needs of course some memory, increasing with the size of the image and the preview. Now, if your computer has not enough free memory it starts swapping and then it gets really slow.

I've have done some rough tests how much memory dlRaw needs at the moment:

Image 1:4 pipe 1:2 pipe 1:1 pipe
6 MP 115 MB 200 MB 700 MB
10 MP 140 MB 300 MB 1100 MB
14 MP 175 MB 420 MB 1600 MB

So, you should have at least this amount of memory free (!) when using dlRaw, otherwise it will get very slow because of swapping...

greets mike

dlRaw: update

Hi folks,

so here is a new dlRaw preview. But first the bad news. Last weekend Jos, the founder of dlRaw, announced that he will stop working on dlRaw. But without his help it would be to much work for me to get the SVN version to an equal level. So I won't switch to the SVN version any soon, I'll focus on stabilizing and improving the user experience for the preview.
This release follows this idea, not much new things, just getting a cleaner application. Some of the changes are:

  • I've cut down the gimp plugin. Now you cannot start dlRaw as a gimp plugin, instead from the standalone dlRaw you get the lossless gimp export with exif and color profile. There are several reasons for this. First it is easier to maintain, furthermore there was a conflict with the tif extension so opening tif files in gimp was a problem and finally it is easier to install now. So for your workflow there should be no changes, from dlRaw to gimp with one click Wink
  • The crop tool was reworked. Now you can draw selections in all four directions and it is possible to show additional guide lines for improving the crop.
  • There is an additional sharpen method, inverse diffusion sharpen from the CImg library. It acts completey different compared to the others and is able to give 'pixel sharpness'. Furthermore the usage of the CImg library was cleaned up.
  • The dcraw integration has been updated, so dlRaw is on the same level as UFRaw 0.16 and allows RAW processing of many current cameras.
  • The remember settings dialog has vanished. Now you can change this on an individual basis on the settings page (I know we need a preferences dialog...).
  • dlRaw does not longer depend on the start directory, so you can move you dlRaw folder freely now.
  • A few minor modifications to the GUI, 8-bit saving is back and some small bugs...

So that is it, download (20091024) and enjoy.

greets mike

dlRaw windows version

Hi folks,

for the preview yesterday, there is now a windows version available. One small drawback, up to now, I had to skip 8 bit Tiff and Ppm, but that shouldn't bother to much Wink

greets mike

dlRaw: new preview

Hi folks,

it has been a long time, but I felt, before taking the adventurous path to the trunk version with the flexible pipe, there should be some maintenance work on the old version. So besides flipping there is no new filter but there are some new things for your photography workflow.

  • Probably the weakest point of dlRaw was saving, only Jpeg and Ppm and no metadata. So now it is possible to save in Jpeg, Ppm, Tiff and Png, and Jpeg and Tiff get the full exif and the chosen output color profile attached.
  • The gimp integration is improved, so now one can choose which command starts gimp (which is nice for windows users) and also the chosen output color profile is sent to gimp. However at this stage I don't recommend using dlRaw as a plugin within gimp, instead use the standalone version and just send to gimp with the dedicated button.
  • The histogram has two modes (like before) which you choose with the "output" control beneath it. If this setting is disabled you get the histogram at the end of the linear pipe, so at the end of the eyecandy tab. When "output" is enabled you get the histogram of the image you see on the screen, and furthermore in the settings dialog you can enable the use of the output profile. So this is the first step towards softproofing, dlRaw will calculate the histogram (and show the clipped values) with respect to the output profile (which takes additional time).
  • Remember, there was this issue that images look dull in dlRaw right after opening them. So the reason is a different gamma handling compared to e.g. UFRaw. So now you'll find "sRGB gamma compensation" on the out tab, which mimiks the behaviour of the gamma handling in UFRaw for people who want that. Additional there is a base curve and a curve after gamma, which serve more sophisticated gamma corrections.
  • Last not least Wink there have been some small tweaks to the GUI and the order of the filters, that is just how I like it, and hopefully with the next preview you could change this on your own without recompiling.

Unfortunatelly there is also a bad message. Up to now I coundn't get the improved saving on windows, it seems there is an error in the imagemagick library, which we use for this. So at this point no windows version, but we try to fix this as soon as possible. On linux it works without problems (at least on my machine Wink ).

So enough words, go check it out Laughing out loud  Download!

greets mike

PS: Since dlRaw relies on qt4, the window uses your qt4 theme, mine looks like this.

dlRaw and auto contrast

Hi folks,

so in the background Jos and I are discussing how to handle the contrast problem... which contrast problem? Wink Well when you open a RAW file without any filters it looks dull... When doing the same in UFRaw it looks contrasty... Of course we want a pleasing starting point for the processing so what to do?

When looking at the code, dlRaw seems to handle the gamma applied during all the conversions more "consistent" than UFRaw. At least I don't understand completely their procedure... But the drawback for dlRaw are dull images without any filter applied... We haven't settled this question for dlRaw completely, but after numerous tests I have now a RGB curve, which should do the trick... I have attached the file to this post, so just put it in your curves directory and set it as RGB curve in dlRaw... I could only test it with RAW files from my cameras, so please test with yours and leave feedback.

greets mike

dlRaw got a wiki

Hi folks,

so it seems dlRaw gets important (at least kind of Wink ), there is now our own wiki for it. Of course we plan to fill it with the needed documentation for dlRaw, but this will be tedious work... Otherwise merging of the two versions is in progress and some issues about the background of the processing are discussed. So work as usual Wink

greets mike