Enhancing Hybrid NLP Approaches with the Strategic Shift Toward retrieval-augmented generation for Design Phase Communication Documents Processing

Salimi, Ghazal and Rahimian, Farzad and Di Stefano, Alessandro and Vakaj, Edlira (2025) Enhancing Hybrid NLP Approaches with the Strategic Shift Toward retrieval-augmented generation for Design Phase Communication Documents Processing. In: Smart and Sustainable Built Environment 2025, Lille, France (SASBE2025), 3rd-5th Nov 2025, Lille, France.

Preview

Text 2665-Salimi.pdf - Published Version Available under License Creative Commons Attribution. Download (369kB)

Abstract

Hybrid Natural Language Processing (NLP) approaches have demonstrated superior performance in construction document processing, with previous research showing that combining rule-based methods with traditional Named Entity Recognition (NER) achieves 98% accuracy for information extraction tasks in roof design documentation. However, the integration of modern pre-trained transformer models into these hybrid architectures remains underexplored. This paper investigates the enhancement of established hybrid NLP frameworks by replacing conventional machine learning components with fine-tuned pre-trained transformers for improved information extraction from design phase communication documents in roof design practice. Building upon proven hybrid methodologies combining regular expression (Regex) pattern matching with machine learning components, we systematically replace traditional NER models with fine-tuned BERT-base architecture. The enhanced hybrid approach maintains rule-based preprocessing efficiency while leveraging BERT's contextual understanding capabilities. We evaluate this BERT-enhanced hybrid system on information extraction tasks using roof design communication documents and project specifications, benchmarked against the established Regex+NER baseline (98% accuracy). Experimental results demonstrate that the Regex+BERT hybrid approach achieves 99.2% accuracy, representing a 1.2 percentage point improvement over the original hybrid baseline. Detailed analysis reveals that BERT-enhanced hybrids excel in handling contextual ambiguities and formatting variations in roof design communications while retaining computational efficiency and interpretability advantages of the original hybrid architecture. The research provides practical frameworks for practitioners seeking to enhance existing hybrid NLP systems with BERT without complete architectural redesign. Results indicate that selective integration of BERT significantly improves accuracy while preserving operational advantages that make hybrid approaches attractive for roof design practice applications

Item Type:	Conference or Workshop Item (Paper)
Identification Number:	10.66408/sasbe.2025.2665
Dates:	Date Event 25 December 2025 Published Online 1 November 2025 Accepted
Uncontrolled Keywords:	Hybrid NLP, Construction Communication, Information Extraction, RAG, Early-Stage Design
Subjects:	CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions:	Architecture, Built Environment, Computing and Engineering > Computer Science
Depositing User:	Gemma Tonks
Date Deposited:	06 Nov 2026 12:26
Last Modified:	06 Nov 2026 12:26
URI:	https://www.open-access.bcu.ac.uk/id/eprint/17300

Actions (login required)

View Item