For questions related to the U-net, a neural network proposed in "U-Net: Convolutional Networks for Biomedical Image Segmentation" (2015) by Olaf Ronneberger et al. for semantic segmentation.
Questions tagged [u-net]
51 questions
8
votes
1 answer
Validation accuracy higher than training accurarcy
I implemented the unet in TensorFlow for the segmentation of MRI images of the thigh. I noticed I always get a higher validation accuracy by a small gap, independently of the initial split. One example:
So I researched when this could be…
Lis Louise
- 139
- 4
5
votes
3 answers
Why diffusion model always use U-Net?
I want to know why diffusion models always use U-Net.
In my opinion, they use U-Net because you can see features of different resolutions and skip connection is good to add detail of images. But I am not sure if it is the main reason why they use…
Penguin.jpg
- 51
- 1
- 1
- 5
4
votes
2 answers
Unet Overfitting for binary segmentation of fake images
I am working on a project where I am trying to detect and localize forgeries in images. I am using the CASIA v2 dataset and using Unet model for the task. I have the binary masks of all the images in the CASIA v2 dataset. The metric I am using for…
Yishu Malhotra
- 41
- 1
- 3
4
votes
1 answer
What are some good alternatives to U-Net for biomedical image segmentation?
Soon I will be working on biomedical image segmentation (microscopy images). There will be a small amount of data (a few dozens at best).
Is there a neural network, that can compete with U-Net, in this case?
I've spent the last few hours searching…
Nuwanda
- 41
- 1
- 3
4
votes
3 answers
If I trained a model to perform semantic segmentation on images with only one object, would it also work on images with multiple objects?
I'm working on semantic segmentation tasks in the medical space using the U-Net. Let's say that I train a U-Net model on medical images with the goal of segmenting out, say, ligaments, from a medical image. If I train that model on images that…
cmed123
- 141
- 2
4
votes
2 answers
What are the best algorithms for image segmentation tasks?
I recently started looking for networks that focus on image segmentation tasks related to biomedical applications. I could not miss the publication U-Net: Convolutional Networks for Biomedical Image Segmentation (2015) by Ronneberger, Fischer, and…
Denis Joly
- 41
- 2
4
votes
0 answers
What are some neural network models that can use auxiliary info during training for image segmentation?
What are some deep learning models that can use supplementary information other than RGB channels for image segmentation?
For example, imagine a poorly shot image of a river (blue) that shows a gap, and the supplementary information is detailed…
Nanako Honda
- 41
- 1
3
votes
0 answers
How do we stack two U-Nets to yield one final prediction?
I am trying to reproduce the model described in the paper DocUNet: Document Image Unwarping via A Stacked U-Net, i.e. stacking two U-Nets to yield one final prediction. The paper mentions that:
The deconvolution features of the first U-Net and the…
aRRay
- 31
- 1
3
votes
1 answer
How to perform latent space Interpolation between two images?
I have a variational convolutional autoencoder that has trained on 2 images and outputs a linear interpolation (inserted at the bottleneck stage) between those 2 input images.
However, the result looks (rather dissapointingly) like some Powerpoint…
James
- 167
- 4
3
votes
1 answer
What is the role of skip connections in U-Net?
I was able to find that the skip connections used in U-Net help to recover fine grained details in the prediction, however I do not understand what is meant by this. Besides, I was wondering what would happen if the U-Net does not include skip…
TRM
- 45
- 1
- 4
3
votes
2 answers
Learning an identity function with convolutional networks
I am trying to train networks to achieve what I expected to be a trivial task: learn the identity mapping. However, this is very hard to achieve, and the optimization is hard.
Moreover, I don't want to learn $f_\theta(x)=x\;\;\forall x$, but only…
Franco Marchesoni
- 109
- 2
3
votes
1 answer
What is the use of the regular convolutional layer in expansion path of U-Net?
I was going through the paper on U-Net. U-net consists of a contracting path followed by an expanding path. Both the paths use a regular convolutional layer. I understand the use of convolutional layers in the contracting path, but I can't figure…
Bhuwan Bhatt
- 404
- 2
- 13
2
votes
0 answers
Why does UNet often output noisy pattern in blank/homogeneous region?
I am recently implementing DDPM model from scratch, and I discovered that UNet often tends to give noisy output in blank region. Here is an example with FashionMNIST, my DDPM seems to generate OK samples for clothes but not very good at generating…
Dibbla
- 31
- 3
2
votes
1 answer
What does the "number of channels" correspond to in U-Net?
I'm studying the U-Net CNN architecture. I'm new to CNNs and am confused regarding the "number of channels".
Referring to the U-Net diagram, the input image is convolved with a 3x3 mask which generates a 570x570 output. This output image is then…
Izzo
- 123
- 1
- 5
2
votes
0 answers
How and why do state-of-the-art models in medical segmentation differ from general segmentation models?
I am just getting into medical image segmentation and have been able to understand the state-of-the-art architectures, like Double UNet, UNet++, and Multiresunet.
What I haven't understood yet: Why are these approaches better for medical…
Bert Gayus
- 645
- 1
- 5
- 12