Semantic Segmentation for Aerial Images: A Literature Review
DOI:
https://doi.org/10.21512/emacsjournal.v2i3.6737Keywords:
Semantic Image Segmentation, Computer VisionAbstract
Semantic image segmentation is one of the fundamental applications of computer vision which can also be called pixel-level classification. Semantic image segmentation is the process of understanding the role of each pixel in an image. Over time, the model for completing Semantic Image Segmentation has developed very rapidly. Due to this rapid growth, many models related to Semantic Image Segmentation have been produced and have also been used or applied in many domains such as medical areas and intelligent transportation. Therefore, our motivation in making this paper is to contribute to the world of research by conducting a review of Semantic Image Segmentation which aims to provide a big picture related to the latest developments related to Semantic Image Segmentation. In addition, we also provide the results of performance measurements on each of the Semantic Image Segmentation methods that we discussed using the Intersectionover-Union (IoU) method. After that, we provide a comparison for each semantic image segmentation model that we discuss using the results of the IoU and then provide conclusions related to a model that has good performance. We hope this review paper can facilitate researchers in understanding the development of Semantic Image Segmentation in a shorter time, simplify understanding of the latest advancements in Semantic Image Segmentation, and can also be used as a reference for developing new Semantic Image Segmentation models in the future.
References
Azimi, S. M., Henry, C., Sommer, L., Schumann, A., & Vig, E. (2019). SkyScapes—Fine-grained semantic understanding of aerial scenes. In *2019 International Conference on Computer Vision (ICCV)*.
Bulò, S. R., Neuhold, G., & Kontschieder, P. (2017). Loss max-pooling for semantic image segmentation.
Bulò, S. R., Porzi, L., & Kontschieder, P. (2018). In-place activated batch normalization for memory-optimized training of DNNs.
Caesar, H., Uijlings, J., & Ferrari, V. (2018). COCO-Stuff: Thing and stuff classes in context.
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2017). DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs.
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018). Encoder-decoder with atrous separable convolution for semantic image segmentation.
Choi, S., Kim, J. T., & Choo, J. (2020). Cars can't fly up in the sky: Improving urban-scene segmentation via height-driven attention networks.
Cohen, A., Rivlin, E., Shimshoni, I., & Sabo, E. (2015). Memory based active contour algorithm using pixel-level classified images for colon crypt segmentation. *Computerized Medical Imaging and Graphics*, 150–164.
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016). The Cityscapes dataset for semantic urban scene understanding.
Dai, D., & Van Gool, L. V. (2018). Dark model adaptation: Semantic image segmentation from daytime to nighttime.
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. (2019). Dual attention network for scene segmentation.
Gong, K., Liang, X., Zhang, D., Shen, X., & Lin, L. (2017). Look into person: Self-supervised structure-sensitive learning and a new benchmark for human parsing. In *2017 Conference on Computer Vision and Pattern Recognition (CVPR)*.
Huang, C., Davis, L. S., & Townshend, J. R. G. (2002). An assessment of support vector machines for land cover classification. *International Journal of Remote Sensing*, 725–749.
Kong, S., & Fowlkes, C. (2017). Recurrent scene parsing with perspective understanding in the loop.
Li, P., Xu, Y., Wei, Y., & Yang, Y. (2019). Self-correction for human parsing.
Liu, X., Deng, Z., & Yang, Y. (2018). Recent progress in semantic image segmentation.
Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation.
Luo, P., Wang, G., Lin, L., & Wang, X. (2017). Deep dual learning for semantic image segmentation. In *2017 International Conference on Computer Vision (ICCV)*.
Maldonado-Bascon, S., Lafuente-Arroyo, S., Gil-Jimenez, P., Gomez-Moreno, H., & Lopez-Ferreras, F. (2007). Road-sign detection and recognition based on support vector machines. *IEEE Transactions on Intelligent Transportation Systems*, 264–278.
Mohajerani, S., & Saeedi, P. (2020). Cloud-Net+: A cloud segmentation CNN for Landsat 8 remote sensing imagery optimized with filtered Jaccard loss function.
Moon, N., Bullitt, E., Van Leemput, K., & Gerig, G. (2002). Automatic brain and tumor segmentation. In *2002 International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI)*.
Pohlen, T., Hermans, A., Mathias, M., & Leibe, B. (2017). Full-resolution residual networks for semantic segmentation in street scenes. In *2017 Conference on Computer Vision and Pattern Recognition (CVPR)*.
Rahman, M. A., & Wang, Y. (2016). Optimizing intersection-over-union in deep neural networks for image segmentation. In *2016 International Symposium on Visual Computing (ISVC)*.
Takikawa, T., Acuna, D., Jampani, V., & Fidler, S. (2019). Gated-SCNN: Gated shape CNNs for semantic segmentation.
Wang, G., Luo, P., Lin, L., & Wang, X. (2017). Learning object interactions and descriptions for semantic image segmentation. In *2017 Conference on Computer Vision and Pattern Recognition (CVPR)*.
Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., & Cottrell, G. (2018). Understanding convolution for semantic segmentation.
Wang, W., Yu, R., Huang, Q., & Neumann, U. (2019). SGPN: Similarity group proposal network for 3D point cloud instance.
Wei, G.-Q., Arbter, K., & Hirzinger, G. (1997). Automatic tracking of laparoscopic instruments by color coding. In *1997 International Conference on Medical Robotics and Computer-Assisted Surgery (MRCAS)*.
Wei, Z., Sun, Y., Wang, J., Lai, H., & Liu, S. (2017). Learning adaptive receptive fields for deep image parsing network. In *2017 Conference on Computer Vision and Pattern Recognition (CVPR)*.
Wu, Z., Shen, C., & Van den Hengel, A. (2016). Bridging category-level and instance-level semantic image segmentation.
Yang, M., Yu, K., Zhang, C., Li, Z., & Yang, K. (2018). DenseASPP for semantic segmentation in street scenes. In *2018 Conference on Computer Vision and Pattern Recognition (CVPR)*.
Yuan, Y., Chen, X., & Wang, J. (2019). Object-contextual representations for semantic segmentation.
Yu, C., Wang, J., Gao, C., Yu, G., Shen, C., & Sang, N. (2020). Context prior for scene segmentation.
Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., & Sang, N. (2018). BiSeNet: Bilateral segmentation network for real-time semantic segmentation. In *The European Conference on Computer Vision (ECCV)*.
Zhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017). Pyramid scene parsing network.
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2016). Conditional random fields as recurrent neural networks.
Zhong, Z., Lin, Z. Q., Bidart, R., Hu, X., Daya, I. B., Li, Z., Zheng, W.-S., Li, J., & Wong, A. (2020). Squeeze-and-attention networks for semantic segmentation.
Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., & Torralba, A. (2017). Scene parsing through ADE20K dataset. In *2017 Conference on Computer Vision and Pattern Recognition (CVPR)*.
Zhu, Y., Sapra, K., Reda, F. A., Shih, K. J., Newsam, S., Tao, A., & Catanzaro, B. (2019). Improving semantic segmentation via video propagation and label relaxation.
Zhuang, J., Yang, J., Gu, L., & Dvornek, N. C. (2019). ShelfNet for fast semantic segmentation.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Yongki Christian Sanjaya, Alexander Agung Santoso Gunawan, Edy Irwansyah
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License - Share Alike that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
USER RIGHTS
All articles published Open Access will be immediately and permanently free for everyone to read and download. We are continuously working with our author communities to select the best choice of license options, currently being defined for this journal as follows: Creative Commons Attribution-Share Alike (CC BY-SA)
