Design and implementation of a behavioral sequence framework for human-robot interaction utilizing brain-computer interface and haptic feedback
View/ Open
Date
2023-05-23Author
Hazra, Sudip
Whitaker, Shane
Shiakolas, Panos S.
Metadata
Show full item recordAbstract
In assistive robotics, research in Brain Computer Interface aims to understand human intent to enhance Human-
Robot Interaction and augment human performance. In this research, a framework to enable a person with an upper
limb disability to use an assistive system towards maintaining self-reliance is introduced and its implementation and
evaluation are discussed. The framework interlinks functional components and establishes a behavioral sequence
to operate the assistive system in three stages; action classification, verification, and execution. An action is classified
based on identified human intent and verified through haptic and/or visual feedback before execution. The
human intent is conveyed through facial expressions and verified through head movements. The interlinked functional
components are an EEG sensing device, a head movement recorder, a dual-purpose glove, a visual feedback environment, and a robotic arm. Five volunteers are used to evaluate the ability of the system to recognize a facial
expression, the time required to respond using head movements, convey information through vibrotactile feedback
effects, and the ability to follow the established behavioral sequence. Based on the evaluation, a personalized training
data set should be used to calibrate facial expression recognition and define the time required to respond during
verification. Custom vibrotactile effects were effective in conveying system information to the user. The volunteers
were able to follow the behavioral sequence and control the system with a success rate of 80.00%, thus providing
confidence to recruit more volunteers to identify and address improvements and expand the operational capability
of the framework.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Human Robot Interaction with 3D-Printed Whole Body Robotic Skin
Mirza, Fahad (2016-05-10)This thesis presents work of a newly developed pressure sensor for robot skin, from fabrication to application. Robot skin similar to human skin meant to have several sensing capabilities including pressure, temperature ... -
Motion Learning And Control For Social Robots In Human-robot Interaction
Balakrishnan, NamrataIn the domain of social robotics, robots have recently been used in conversational interaction with humans. In this thesis, research was conducted to help create a system for imitation learning. In this system, a trainer ... -
ON THE DEVELOPMENT AND EVALUATION OF A FRAMEWORK FOR BRAIN-COMPUTER INTERFACE AND VIBROTACTILE FEEDBACK FOR HUMAN-ROBOT-INTERACTION IN VIRTUAL SPACES AND ROBOTIC HARDWARE
Hazra, Sudip; Whitaker, Shane; Shiakolas, Panos S. (American Society of Mechanical Engineers, 2023-02-08)Research in Brain-Computer Interface (BCI) aims to understand human intent with the goal to enhance Human-Robot Interaction (HRI) especially in the field of assistive robotics. The goal of this research is to develop a ...