The integration of artificial intelligence (AI) into daily life opens unprecedented avenues for enhancing the experiences of visually impaired... Show moreThe integration of artificial intelligence (AI) into daily life opens unprecedented avenues for enhancing the experiences of visually impaired individuals, offering them greater autonomy and quality of life. This thesis introduces a Visually Impaired Spatial Awareness (VISA) system designed to assist visually impaired individuals holistically through a structured approach. At the foundational level, the VISA system incorporates several key technologies to interpret the surroundings and assist in basic navigation tasks. It utilizes Augmented Reality (AR) markers to facilitate recognition of places and aid in navigation, employs neural network models for advanced object detection and tracking, and leverages depth information for accurate object localization. Progressing to the intermediate level, the VISA system integrates the data obtained from object detection and depth sensing to assist in more complex navigational tasks such as obstacle avoidance and pathfinding toward a desired destination. At the advanced level, the VISA system synthesizes the capabilities developed at the foundational and intermediate levels to enhance the spatial awareness of visually impaired users, allowing them to undertake complex tasks, such as navigating complex environments and locating specific items. The VISA system also emphasizes efficient human-machine interaction, incorporating text-to-speech and speech-to-text technologies to facilitate natural and intuitive communication between the user and the system. The VISA system's performance was evaluated in different environments simulating real-world scenarios. The experimental results show that the user can interact with our system intuitively with minimal effort, and affirm that the VISA system can effectively assist the visually impaired user in locating and reaching for objects, navigating indoors, identifying merchandise, and recognizing both handwritten and printed texts. Show less
