A Human Intention and Motion Prediction Framework for Applications in Human-Centric Digital Twins

Asad, Usman and Khalid, Azfar and Lughmani, Waqas Akbar and Rasheed, Shummaila and Khan, Muhammad Mahabat (2025) A Human Intention and Motion Prediction Framework for Applications in Human-Centric Digital Twins. Biomimetics, 10 (10). p. 656. ISSN 2313-7673

Preview

Text biomimetics-10-00656.pdf - Published Version Available under License Creative Commons Attribution. Download (18MB)

Abstract

In manufacturing settings where humans and machines collaborate, understanding and predicting human intention is crucial for enabling the seamless execution of tasks. This knowledge is the basis for creating an intelligent, symbiotic, and collaborative environment. However, current foundation models often fall short in directly anticipating complex tasks and producing contextually appropriate motion. This paper proposes a modular framework that investigates strategies for structuring task knowledge and engineering context-rich prompts to guide Vision–Language Models in understanding and predicting human intention in semi-structured environments. Our evaluation, conducted across three use cases of varying complexity, reveals a critical tradeoff between prediction accuracy and latency. We demonstrate that a Rolling Context Window strategy, which uses a history of frames and the previously predicted state, achieves a strong balance of performance and efficiency. This approach significantly outperforms single-image inputs and computationally expensive in-context learning methods. Furthermore, incorporating egocentric video views yields a substantial 10.7% performance increase in complex tasks. For short-term motion forecasting, we show that the accuracy of joint position estimates is enhanced by using historical pose, gaze data, and in-context examples.

Item Type:	Article
Identification Number:	10.3390/biomimetics10100656
Dates:	Date Event 28 September 2025 Accepted 1 October 2025 Published Online
Uncontrolled Keywords:	human digital twin; human intention prediction; human motion generation; human–robot collaboration; artificial intelligence
Subjects:	CAH10 - engineering and technology > CAH10-01 - engineering > CAH10-01-02 - mechanical engineering
Divisions:	Architecture, Built Environment, Computing and Engineering > Engineering
Depositing User:	Gemma Tonks
Date Deposited:	10 Oct 2025 15:10
Last Modified:	10 Oct 2025 15:10
URI:	https://www.open-access.bcu.ac.uk/id/eprint/16669

Actions (login required)

View Item