A transformer boosted UNet for smoke segmentation in complex backgrounds in multispectral LandSat imagery

Date

2024

Authors

Liu, J.
Li, J.
Peters, S.
Zhao, L.

Editors

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Journal article

Citation

Remote Sensing Applications: Society and Environment, 2024; 36(101283):101283-101283

Statement of Responsibility

Conference Name

Abstract

Many studies have been done to detect smokes from satellite imagery. However, these prior methods are not still effective in detecting various smokes in complex backgrounds. Smokes present challenges in detection due to variations in density, color, lighting, and backgrounds such as clouds, haze, and/or mist, as well as the contextual nature of thin smoke. This paper addresses these challenges by proposing a new segmentation model called VTrUNet which consists of a virtual band construction module to capture spectral patterns and a transformer boosted UNet to capture long range contextual features. The model takes imagery of six bands: red, green, blue, near infrared, and two shortwave infrared bands as input. To show the advantages of the proposed model, the paper presents extensive results for various possible model architectures improving UNet and draws interesting conclusions including that adding more modules to a model does not always lead to a better performance. The paper also compares the proposed model with very recently proposed and related models for smoke segmentation and shows that the proposed model performs the best and makes significant improvements on prediction performances.

School/Discipline

Dissertation Note

Provenance

Description

Access Status

Rights

Copyright 2024 Elsevier Access Condition Notes: Accepted manuscript available after 1 July 2026

License

Grant ID

Call number

Persistent link to this record