Enhancing human-robot interaction in telerobotics: investigating the impact of cognitive and information processing on human operators’ situational awareness, attention and cognitive workload

Housaini, Adib (2025). Enhancing human-robot interaction in telerobotics: investigating the impact of cognitive and information processing on human operators’ situational awareness, attention and cognitive workload. University of Birmingham. Ph.D.

Housaini2025PhD.pdf
Text - Accepted Version
Available under License Creative Commons Attribution.
Download (12MB)

Abstract

This research is motivated by the need to advance human-robot collaboration in high-stakes environments, where limited understanding and real-world research exist on the effects of information verbalisation and goal-directed tasks in telerobotic systems. In doing so this thesis delves into the interdisciplinary field of Human-Robot Interaction (HRI).The research primarily focuses on telerobotics systems and their operator. The novelty of this research lies in its exploration of how cognitive factors such as IQ and information verbalisation impact human-robot collaboration in telerobotics, providing key insights into telerobotic operator's Situational Awareness (SA), attention allocation, performance, and cognitive workload. This research contributes to advancing the design of telerobotic systems and improving human-robot collaboration, offering new perspectives on how cognitive processing affects goal-directed tasks in complex, real-time environments. The study contribution extends the understanding of how a telerobotic operator's Situational Awareness (SA), attention allocation, performance, and cognitive workload can be affected by their cognitive and information processing approaches. To achieve this, the study employed an advanced robotic system from Boston Dynamics and simulated real-world scenarios, including a nuclear station investigation and a human search and rescue mission. Data were collected from thirty participants engaged in telerobotic exercises, analysed through the lens of advanced methodologies, including a Multi-Tools Measurement Structure, across varying levels of task difficulty. The results indicate that verbalisation facilitates the benefits of Multimodal Processing, Real-time Engagement, and Self-Auditory experience, optimising attention allocation and reducing mental workload. Information verbalisation also contributes to a more efficient allocation of cognitive resources, significantly improving the operators' ability to perceive and comprehend the meaning of task elements in a remote environment. Furthermore, the study reveals a crucial link between operators' Intelligence Quotient (IQ) and their ability to acquire and maintain SA in telerobotic operations. The positive correlation between individual SA levels and IQ, suggests that IQ assessments can effectively predict an operator’s situational awareness capabilities. This research is significant for its contribution in advancing telerobotic system design and improving human-robot collaboration, by integrating findings on cognitive processing and human factors, it offers practical insights that enhance system design to better support operator situational awareness, attention allocation, and workload management. These improvements can lead to more intuitive and efficient interfaces and controls, making telerobotic systems more responsive to operator needs. Additionally, it supports industrial recruitment processes, helping organisations select candidates with cognitive skills suited to telerobotic roles. The study also provides strategies for streamlining onboarding, enabling operators to achieve proficiency faster crucial for performance in high-stakes, real-time environments.

Type of Work:

Thesis (Doctorates > Ph.D.)

Award Type:

Doctorates > Ph.D.

Supervisor(s):