ATTENTION: The works hosted here are being migrated to a new repository that will consolidate resources, improve discoverability, and better show UTA's research impact on the global community. We will update authors as the migration progresses. Please see MavMatrix for more information.
Show simple item record
dc.contributor.author | Galatas, Georgios | en_US |
dc.date.accessioned | 2014-09-17T17:31:26Z | |
dc.date.available | 2014-09-17T17:31:26Z | |
dc.date.issued | 2014-09-17 | |
dc.date.submitted | January 2013 | en_US |
dc.identifier.other | DISS-12404 | en_US |
dc.identifier.uri | http://hdl.handle.net/10106/24776 | |
dc.description.abstract | An Ambient Intelligence Environment is meant to sense and respond to the presence of people, using its embedded technology. In order to effectively sense the activities and intentions of its inhabitants, such an environment needs to utilize information captured from multiple sensors and modalities. By doing so, the interaction becomes more natural as well as accurate and robust. We have focused on 3 aspects of such an environment, using speech, localization and robotics. Speech is one of the most natural forms of communication for humans. Therefore, it can be used as one of the main information sources for deriving the intentions and needs of a person. In our work, we have extended the traditional speech recognition paradigm by introducing 3 dimensional visual articulation information for recognizing spoken words. The development of our system included the capture of a novel dataset, implementation and extended testing under a variety of audio-visual noise types, demonstrating the usefulness of 3D visual information for this task. Additionally, person localization and identification is of paramount importance in a smart environment, since by knowing each person's location, her/is actions can be derived and abnormal patterns can be recognized. Our implementation conducts person identification by means of RFID. Furthermore, three types of input are combined for multi-person localization, namely, skeletal tracking, audio localization and RFID signal strength. The system was deployed and tested in our simulated assistive apartment exhibiting high accuracy. Finally, every domestic environment changes dynamically over time, creating the need for altering the position, orientation and type of sensors used within it. In our approach, we developed a framework of sensor bearing robots with the ability to relocate automatically to compensate for such a dynamic environment. Their positioning is done in such a way so as to maximize coverage. Navigation is carried out using visual information and autonomous placement uses a decentralized algorithm. | en_US |
dc.description.sponsorship | Makedon, Fillia | en_US |
dc.language.iso | en | en_US |
dc.publisher | Computer Science & Engineering | en_US |
dc.title | Multimodal Interaction In Ambient Intelligence Environments Using Speech, Localization And Robotics | en_US |
dc.type | Ph.D. | en_US |
dc.contributor.committeeChair | Makedon, Fillia | en_US |
dc.degree.department | Computer Science & Engineering | en_US |
dc.degree.discipline | Computer Science & Engineering | en_US |
dc.degree.grantor | University of Texas at Arlington | en_US |
dc.degree.level | doctoral | en_US |
dc.degree.name | Ph.D. | en_US |
Files in this item
- Name:
- Galatas_uta_2502D_12404.pdf
- Size:
- 2.597Mb
- Format:
- PDF
This item appears in the following Collection(s)
Show simple item record