Segmentation of pure noise

username: cookiereg
cooked: <p>Hi,</p>
<p>I am working on an image manipulation detection task by detecting the different types of noise in the manipulated region in comparison to the pristine region. At the moment the model I use gets as input an image and outputs the image noise in a way that pristine and manipulated regions can be distingushed visually (see images at the bottom). Now I want to separate/segment the regions and hoped that I can achive better results by using image segmentation nets instead of classical methods. Up until now I tried to use a UNet for this task. However, the dice score, F1 score or MCC score doesn’t even get above 2e-3 and I tried already a lot of different settings. So the best is probably to try a different segmentation model. But before I do this and maybe achieve no results too, I was wondering:<br>
Are the segmentation models used in practice even viable for my task? Most/All of them were design to segment objects and my data is from a completly different domain, so maybe none of them will work? What are your thoughts on this? Are there any segmentation models that could be good for segmenting pure noise?</p>
<p>The manipulated image:<br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/7/7/7754f2bac02fb744b441c4f3770c9e84f807fccf.png" data-download-href="https://discuss.pytorch.org/uploads/default/7754f2bac02fb744b441c4f3770c9e84f807fccf" title="image"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/7/7/7754f2bac02fb744b441c4f3770c9e84f807fccf_2_500x500.png" alt="image" data-base62-sha1="h1EOOtbdAD9gMwRZkk6eLAyeWgn" width="500" height="500" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/7/7/7754f2bac02fb744b441c4f3770c9e84f807fccf_2_500x500.png, https://discuss.pytorch.org/uploads/default/optimized/3X/7/7/7754f2bac02fb744b441c4f3770c9e84f807fccf_2_750x750.png 1.5x, https://discuss.pytorch.org/uploads/default/original/3X/7/7/7754f2bac02fb744b441c4f3770c9e84f807fccf.png 2x" data-dominant-color="A5A5A5"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">image</span><span class="informations">896×896 342 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>
<p>The enhanced noise:<br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/f/1/f159a83b40d6cf4bb49c3bc0f07c3fc652be4bf2.png" data-download-href="https://discuss.pytorch.org/uploads/default/f159a83b40d6cf4bb49c3bc0f07c3fc652be4bf2" title="noise"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/f/1/f159a83b40d6cf4bb49c3bc0f07c3fc652be4bf2_2_500x500.png" alt="noise" data-base62-sha1="yr59UPnIKJFBO0CN3UxCqMN526e" width="500" height="500" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/f/1/f159a83b40d6cf4bb49c3bc0f07c3fc652be4bf2_2_500x500.png, https://discuss.pytorch.org/uploads/default/optimized/3X/f/1/f159a83b40d6cf4bb49c3bc0f07c3fc652be4bf2_2_750x750.png 1.5x, https://discuss.pytorch.org/uploads/default/original/3X/f/1/f159a83b40d6cf4bb49c3bc0f07c3fc652be4bf2.png 2x" data-dominant-color="4A4A4A"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">noise</span><span class="informations">896×896 205 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>
<p>A closeup of the noise structure (Left is noise from the manipulated region, right from pristine region):<br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/f/3/f33d07f0fbe38c4f1a02fe7c53a2a699842bbf2f.png" data-download-href="https://discuss.pytorch.org/uploads/default/f33d07f0fbe38c4f1a02fe7c53a2a699842bbf2f" title="noise_closeup"><img src="https://discuss.pytorch.org/uploads/default/original/3X/f/3/f33d07f0fbe38c4f1a02fe7c53a2a699842bbf2f.png" alt="noise_closeup" data-base62-sha1="yHMMAstIFsWy98E0Z4WbfEvs6Af" width="486" height="500" data-dominant-color="4A4A4A"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">noise_closeup</span><span class="informations">740×761 27.5 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>
<p>Thanks for your input on this matter in advance!</p>