Empowering Visually Impaired Individuals With Holistic Assistance Using Real-Time Spatial Awareness System

Access to IIT electronic theses and dissertations is restricted to IIT community members with a valid iit.edu email address. Please log in using your iit.edu email address and password. Requests for external users are handled through inter-library loan and can be emailed to iitmyillms@iit.edu.

Description

The integration of artificial intelligence (AI) into daily life opens unprecedented avenues for enhancing the experiences of visually impaired individuals, offering them greater autonomy and quality of life. This thesis introduces a Visually Impaired Spatial Awareness (VISA) system designed to... Show moreThe integration of artificial intelligence (AI) into daily life opens unprecedented avenues for enhancing the experiences of visually impaired individuals, offering them greater autonomy and quality of life. This thesis introduces a Visually Impaired Spatial Awareness (VISA) system designed to assist visually impaired individuals holistically through a structured approach. At the foundational level, the VISA system incorporates several key technologies to interpret the surroundings and assist in basic navigation tasks. It utilizes Augmented Reality (AR) markers to facilitate recognition of places and aid in navigation, employs neural network models for advanced object detection and tracking, and leverages depth information for accurate object localization. Progressing to the intermediate level, the VISA system integrates the data obtained from object detection and depth sensing to assist in more complex navigational tasks such as obstacle avoidance and pathfinding toward a desired destination. At the advanced level, the VISA system synthesizes the capabilities developed at the foundational and intermediate levels to enhance the spatial awareness of visually impaired users, allowing them to undertake complex tasks, such as navigating complex environments and locating specific items. The VISA system also emphasizes efficient human-machine interaction, incorporating text-to-speech and speech-to-text technologies to facilitate natural and intuitive communication between the user and the system. The VISA system's performance was evaluated in different environments simulating real-world scenarios. The experimental results show that the user can interact with our system intuitively with minimal effort, and affirm that the VISA system can effectively assist the visually impaired user in locating and reaching for objects, navigating indoors, identifying merchandise, and recognizing both handwritten and printed texts. Show less

Details
Department

ECE / Electrical and Computer Engineering

Title

Empowering Visually Impaired Individuals With Holistic Assistance Using Real-Time Spatial Awareness System

Institution

Illinois Institute of Technology

Creator(s)

Yu, Xinrui

Advisor(s)

Saniie, Jafar

Date

2024

Description

The integration of artificial intelligence (AI) into daily life opens unprecedented avenues for enhancing the experiences of visually impaired individuals, offering them greater autonomy and... Show moreThe integration of artificial intelligence (AI) into daily life opens unprecedented avenues for enhancing the experiences of visually impaired individuals, offering them greater autonomy and quality of life. This thesis introduces a Visually Impaired Spatial Awareness (VISA) system designed to assist visually impaired individuals holistically through a structured approach. At the foundational level, the VISA system incorporates several key technologies to interpret the surroundings and assist in basic navigation tasks. It utilizes Augmented Reality (AR) markers to facilitate recognition of places and aid in navigation, employs neural network models for advanced object detection and tracking, and leverages depth information for accurate object localization. Progressing to the intermediate level, the VISA system integrates the data obtained from object detection and depth sensing to assist in more complex navigational tasks such as obstacle avoidance and pathfinding toward a desired destination. At the advanced level, the VISA system synthesizes the capabilities developed at the foundational and intermediate levels to enhance the spatial awareness of visually impaired users, allowing them to undertake complex tasks, such as navigating complex environments and locating specific items. The VISA system also emphasizes efficient human-machine interaction, incorporating text-to-speech and speech-to-text technologies to facilitate natural and intuitive communication between the user and the system. The VISA system's performance was evaluated in different environments simulating real-world scenarios. The experimental results show that the user can interact with our system intuitively with minimal effort, and affirm that the VISA system can effectively assist the visually impaired user in locating and reaching for objects, navigating indoors, identifying merchandise, and recognizing both handwritten and printed texts. Show less

Type

Dissertation

File type

application/pdf

Subject

Electrical engineering
object recognition
obstacle avoidance
visually impaired

Access

Restricted Access

Rights

In Copyright
http://rightsstatements.org/page/InC/1.0/

Identifier

http://hdl.handle.net/10560/islandora:1025174

<p></p><p></p>