A JFSP Fire Science Exchange Network
Bringing People Together & Sharing Knowledge in the Northern Rockies

3D video semantic segmentation for wildfire smoke

Author(s): Guodong Zhu, Zhenxue Chen, Chengyun Liu, Xuewen Rong, Weikai He
Year Published: 2020

Wildfires are a serious threat to ecosystems and human life. Usually, smoke is generated before the flame, and due to the diffusing nature of the smoke, we can detect smoke from a distance, so wildfire smoke detection is especially important for early warning systems. In this paper, we propose a 3D convolution-based encoder–decoder network architecture for video semantic segmentation in wildfire smoke scenes. In the encoder stage, we use 3D residual blocks to extract the spatiotemporal features of smoke. The downsampling feature from the encoder is upsampled by the decoder three times in succession. Then, three smoke map prediction modules are, respectively, passed, the output smoke prediction map is supervised by the binary image label, and finally, the final prediction is obtained by feature map fusion. Our model can achieve end-to-end training without pretraining from scratch. In addition, a dataset including 90 smoke videos is tested and trained in this paper. The experimental results of the smoke video show that our model quickly and accurately segmented the smoke area and produced few false positives.

Citation: Zhu, Guodong; Chen, Zhenxue; Liu, Chengyun; Rong, Xuewen; He, Weikai. 2020. 3D video semantic segmentation for wildfire smoke. Machine Vision and Applications 31(6):50.
Topic(s): Mapping, Smoke & Air Quality, Smoke Emissions, Smoke Modeling & Forecasting
Ecosystem(s): None
Document Type: Book or Chapter or Journal Article
NRFSN number: 21698
FRAMES RCS number: 61659
Record updated: Aug 6, 2020