Real-World Evaluation of Automated Defect Detection in Masonry Bridges Using 360° Imagery with Machine Learning

Sen, Arijit and Wu, Song and Sun, Quanbin and Talebi, Saeed (2026) Real-World Evaluation of Automated Defect Detection in Masonry Bridges Using 360° Imagery with Machine Learning. Construction Innovation. ISSN 1471-4175 (In Press)

Text FULL_MANUSCRIPT_ML_DEFECT.pdf - Accepted Version Restricted to Repository staff only Available under License Creative Commons Attribution Non-commercial. Download (537kB) | Request a copy

Abstract

Purpose:
This study evaluates different deep learning approaches, CNN, transformer, hybrid, and commercial models, for automated defect detection in UK masonry railway bridges, in both laboratory and real-world settings, using high-resolution 360° imagery.
Design/methodology/approach:
Expert-annotated imagery was categorised into six defect types, with SMOTE oversampling applied to mitigate class imbalance. Four widely used architectures, EfficientNet, Swin Transformer, ConvNeXt, and Azure CustomVision, were benchmarked using compact variants in a two-stage design: laboratory data and real-world evaluation, to assess feasibility and generalisability.
Findings:
All models achieved high performance on laboratory data (0.83 - 0.91 accuracy), demonstrating feasibility in controlled environments. However, when applied to real-world evaluation, accuracies declined to 0.76 - 0.86, with the Swin Transformer showing the greatest robustness (2% drop). This decline was largely attributable to extreme class imbalance (non-defect to defect ratio around 220:1), which caused models to favour the non-defect class. While Vegetation and Loss of Section showed moderate recall, crack detection was less reliable, likely affected by limited samples and textural similarity to other classes. Consequently, overall accuracy masked substantial class-level disparities, and ensemble modelling delivered only marginal improvements under these conditions.
Originality:
This study is the first comprehensive evaluation on masonry railway bridges with 360° imagery, which advances beyond prior laboratory environment by systematically testing generalisability in real-world sceneries, generating new insights into imbalance-driven errors and class-specific detection limits.
Practical implications:
Automated detection can streamline inspections and enhance consistency, as compact models show feasibility. However, reliable deployment requires addressing imbalance, since some defect classes (e.g. cracks) remain unreliable.

Item Type:	Article
Dates:	Date Event 1 February 2026 Accepted
Uncontrolled Keywords:	Automated Defect Detection, 360o Imagery, Machine Learning, Masonry Bridge
Subjects:	CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science CAH13 - architecture, building and planning > CAH13-01 - architecture, building and planning > CAH13-01-02 - building
Divisions:	Architecture, Built Environment, Computing and Engineering > Architecture and Built Environment > Built Environment Architecture, Built Environment, Computing and Engineering > Computer Science
Depositing User:	Gemma Tonks
Date Deposited:	11 Feb 2026 15:12
Last Modified:	11 Feb 2026 15:12
URI:	https://www.open-access.bcu.ac.uk/id/eprint/16863

Actions (login required)

View Item