“U-Net”的意思、由来-开放百科全书

The U-Net is a convolutional neural network that was developed for biomedical image segmentation at the Computer Science Department of the University of Freiburg, Germany.^[1] The network is based on the fully convolutional network ^[2] and its architecture was modified and extended to work with fewer training images and to yield more precise segmentations. Segmentation of a 512*512 image takes less than a second on a recent GPU.

Description

The U-Net is a more elegant architecture, the so-called “fully convolutional network”^[3].

The main idea is to supplement a usual contracting network by successive layers, where pooling operations are replaced by upsampling operators. Hence these layers increase the resolution of the output. What’s more, a successive convolutional layer can then learn to assemble a precise output based on this information.^[4]

One important modification in U-Net is that there are a large number of feature channels in the upsampling part, which allow the network to propagate context information to higher resolution layers. As a consequence, the expansive path is more or less symmetric to the contracting part, and yields a u-shaped architecture. The network only uses the valid part of each convolution without any fully connected layers.^[5] To predict the pixels in the border region of the image, the missing context is extrapolated by mirroring the input image. This tiling strategy is important to apply the network to large images, since otherwise the resolution would be limited by the GPU memory.

History

Network architecture

The network consists of a contracting path and an expansive path, which gives it the u-shaped architecture. The contracting path is a typical convolutional network that consists of repeated application of convolutions, each followed by a rectified linear unit (ReLU) and a max pooling operation. During the contraction, the spatial information is reduced while feature information is increased. The expansive pathway combines the feature and spatial information through a sequence of up-convolutions and concatenations with high-resolution features from the contracting path.^[8]

Applications

There are many applications of U-Net in biomedical image segmentation, such as brain image segmentation (''BRATS''^[9]) and liver image segmentation ("siliver07"^[10]). Here are some variants and applications of U-Net as follows:

(1).Pixel-wise regression using U-Net and its application on pansharpening^[11] ;

(2).3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation^[12] ;

(3).TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation.^[13]

Implementations

The basic articles on the system ^[1] ^[2] ^[12] ^[13]have been cited 3693, 7049, 442 and 22 times respectively on Google Scholar as of December 24, 2018^[16]

References

1. ^¹{{cite arxiv|last1=Ronneberger|first1=Olaf|last2=Fischer|first2=Philipp|last3=Brox|first3=Thomas|title=U-Net: Convolutional Networks for Biomedical Image Segmentation|eprint=1505.04597|date=2015|class=cs.CV}}
2. ^¹{{cite arxiv|last1=Long|first1=J.|last2=Shelhamer|first2=E.|last3=Darrell|first3=T.|title=Fully convolutional networks for semantic segmentation|eprint=1411.4038|date=2014|class=cs.CV}}
3. ^{{cite arxiv|last1=Long|first1=J.|last2=Shelhamer|first2=E.|last3=Darrell|first3=T.|title=Fully convolutional networks for semantic segmentation|eprint=1411.4038|date=2014|class=cs.CV}}
4. ^{{cite arxiv|last1=Ronneberger|first1=Olaf|last2=Fischer|first2=Philipp|last3=Brox|first3=Thomas|title=U-Net: Convolutional Networks for Biomedical Image Segmentation|eprint=1505.04597|date=2015|class=cs.CV}}
5. ^{{cite arxiv|last1=Long|first1=J.|last2=Shelhamer|first2=E.|last3=Darrell|first3=T.|title=Fully convolutional networks for semantic segmentation|eprint=1411.4038|date=2014|class=cs.CV}}
6. ^{{cite arxiv|last1=Ronneberger|first1=Olaf|last2=Fischer|first2=Philipp|last3=Brox|first3=Thomas|title=U-Net: Convolutional Networks for Biomedical Image Segmentation|eprint=1505.04597|date=2015|class=cs.CV}}
7. ^{{cite arxiv|last1=Long|first1=J.|last2=Shelhamer|first2=E.|last3=Darrell|first3=T.|title=Fully convolutional networks for semantic segmentation|eprint=1411.4038|date=2014|class=cs.CV}}
8. ^{{cite web|title=U-Net code|url=https://lmb.informatik.uni-freiburg.de/people/ronneber/u-net/}}
9. ^{{Cite web|url=https://www.med.upenn.edu/sbia/brats2017.html|title=MICCAI BraTS 2017: Scope {{!}} Section for Biomedical Image Analysis (SBIA) {{!}} Perelman School of Medicine at the University of Pennsylvania|website=www.med.upenn.edu|access-date=2018-12-24}}
10. ^{{Cite web|url=http://www.sliver07.org/|title=SLIVER07 : Home|website=www.sliver07.org|access-date=2018-12-24}}
11. ^{{Cite journal|date=2018-10-27|title=Pixel-wise regression using U-Net and its application on pansharpening|url=https://www.sciencedirect.com/science/article/pii/S0925231218307008|journal=Neurocomputing|language=en|volume=312|pages=364–371|doi=10.1016/j.neucom.2018.05.103|issn=0925-2312}}
12. ^¹{{Cite arxiv|url=https://arxiv.org/pdf/1606.06650.pdf|title=3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation|last1=Çiçek|first1=Özgün|last2=Abdulkadir|first2=Ahmed|last3=Lienkamp|first3=Soeren|date=2016|class=cs.CV|eprint=1606.06650}}
13. ^¹{{cite arxiv|last1=Iglovikov|first1=Vladimir|last2=Shvets|first2=Alexey|title=TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation|eprint=1801.05746|date=2018|class=cs.CV}}
14. ^{{Citation|last=Akeret|first=Joel|title=Generic U-Net Tensorflow implementation for image segmentation: jakeret/tf_unet|date=2018-12-24|url=https://github.com/jakeret/tf_unet|access-date=2018-12-24}}
15. ^{{Cite web|url=https://lmb.informatik.uni-freiburg.de/people/ronneber/u-net/|title=U-Net: Convolutional Networks for Biomedical Image Segmentation|website=lmb.informatik.uni-freiburg.de|access-date=2018-12-24}}
16. ^ [https://scholar.google.com/scholar?hl=en&as_sdt=0%2C33&q=U-net&btnG=] Google Scholar citation data