Search results

(1 - 2 of 2)

Title

DAMAGE ASSESSMENT OF CIVIL STRUCTURES AFTER NATURAL DISASTERS USING DEEP LEARNING AND SATELLITE IMAGERY

Creator

Jones, Scott F

Date

2019

Description

Since 1980, millions of people have been harmed by natural disasters that have cost communities across the world over three trillion dollars....
Show moreSince 1980, millions of people have been harmed by natural disasters that have cost communities across the world over three trillion dollars. After a natural disaster has occurred, the creation of maps that identify the damage to buildings and infrastructure is imperative. Currently, many organizations perform this task manually, using pre- and post-disaster images and well-trained professionals to determine the degree and extent of damage. This manual task can take days to complete. I propose to do this task automatically using post-disaster satellite imagery. I use a pre-trained neural network, SegNet, and replaced its last layer with a simple damage classification scheme. This final layer of the network is re-trained using cropped segments of the satellite image of the disaster. The data were obtained from a publicly accessible source, the Copernicus EMS system. They provided three channel (RGB) reference and damage grading maps that were used to create the images of the ground truth and the damaged terrain. I then retrained the final layer of the network to identify civil structures that had been damaged. The resulting network was 85% accurate at labelling the pixels in an image of the disaster from typhoon Haiyan. The test results show that it is possible to create these maps quickly and efficiently.
Show less

Title

IMPROVING DEEP LEARNING BASED SEMANTIC SEGMENTATION USING CONTEXT INFORMATION

Creator

Xia, Zhengyu

Date

2021

Description

Semantic segmentation is an important but challenging task in computer vision because it aims to assign each pixel a category label accurately...
Show moreSemantic segmentation is an important but challenging task in computer vision because it aims to assign each pixel a category label accurately. Nowadays, applications such as autonomous driving, path navigation, image search engine, or augmented reality require accurate semantic analysis and efficient segmentation mechanisms. In this thesis, we propose multiple models to improve the performance of semantic segmentation. In the first part, we focus on the single-task network, which aims to improve the performance of semantic segmentation. Our research includes exploiting context information using mixed spatial pyramid pooling to extract dense context-embedded features in FCN-based semantic segmentation. We also propose a GAF module to generate a global context-based attention map to guide the shallow-layer feature maps for better pixel localization. In the second part, we focus on a multi-task network that incorporates semantic segmentation to improve other computer vision tasks such as object detection. Specifically, a multi-task network, along with a learning strategy is designed to let semantic segmentation and object detection assist each other since they are highly correlated. Also, we include weakly-supervised multi-label semantic segmentation learning to deal with the shortage of high-quality training examples and to improve the performance of cross-domain object detection. In the third part, we focus on improving the performance of video panoptic segmentation, which is a unified network that incorporates semantic segmentation and instance segmentation using video streams. We design a new ConvLSTM pyramid to transmit spatio-temporal contextual information in our video panoptic segmentation network. Specifically, we propose a modified ConvLSTM to generate temporal contextual information. Also, we design an MSTPP module to obtain mixed spatio-temporal context-embedded feature maps. Experimental results on different datasets show that our proposed method achieves better performance compared with the state-of-the-art methods.
Show less