Search results

(1 - 3 of 3)
MACHINE VISION NAVIGATION SYSTEM FOR VISUALLY IMPAIRED PEOPLE
Title
MACHINE VISION NAVIGATION SYSTEM FOR VISUALLY IMPAIRED PEOPLE
Creator
Yang, Guojun
Date
2021
Description
Visually impaired people are often challenged in the efficient navigation of complex environments. Moreover, helping them navigate intuitively...
Show moreVisually impaired people are often challenged in the efficient navigation of complex environments. Moreover, helping them navigate intuitively is not a trivial task. Cognitive maps derived from visual cues play a pivotal role in navigation. In this dissertation, we present a sight-to-sound human–machine interface (STS-HMI), a novel machine vision guidance system that enables visually impaired people to navigate with instantaneous and intuitive responses. This proposed system extracts visual context from scenes and converts them into binaural acoustic cues for users to establish cognitive maps. The development of the proposed STS-HMI system encompasses four major components: (i) a machine vision–based indoor localization system that uses augmented reality (AR) markers to locate the user in GPS-denied environments (e.g., indoor); (ii) a feature-based object detection and localization system called the simultaneous localization and mapping (SLAM) algorithm, which tracks the mobility of users when AR markers are not visible; (iii) a path-planning system that creates a course towards a destination while avoiding obstacles; and (iv) an acoustic human–machine interface to navigate users in complex navigation courses. Throughout the research and development of this dissertation, each component is analyzed for optimal performance. The navigation algorithms are used to evaluate the performance of the STS-HMI system in a complicated environment with difficult navigation paths. The experimental results confirm that the STS-HMI system advances the mobility of visually impaired people with minimal effort and high accuracy.
Show less
Quantifying Localization Safety for State-of-the-Art Mobile Robot Estimation Algorithms
Title
Quantifying Localization Safety for State-of-the-Art Mobile Robot Estimation Algorithms
Creator
Abdul Hafez, Osama Mutie Fahad
Date
2023
Description
In mobile robotics, localization safety is quantified using covariance matrix or particle spread.However, such methods are insufficient for...
Show moreIn mobile robotics, localization safety is quantified using covariance matrix or particle spread.However, such methods are insufficient for mission or life-critical applications, like Autonomous Vehicles (AVs), because they only reflect nominal sensor noise without considering sensor measurement faults. Sensor faults are unknown deterministic errors that cannot be modeled using a zero mean Gaussian distribution. Ignoring sensor faults, in such applications, might result in large localization errors, which in turn deceives other reliant systems, like the controller, leading to catastrophic consequences, such as traffic accidents for AVs. Thus, other techniques need to be used to conservatively quantify pose safety.This thesis builds upon previous research in aviation safety, or what is referred to as \textit{integrity monitoring}, to quantify localization safety for mobile robots that use state-of-the-art state estimators (as localizers).Specifically, this thesis utilizes the localization \textit{integrity risk} metric, as a measure of localization safety, which is defined as the probability of the robot's pose estimate error to lie outside pre-determined acceptable limits while an alarm is not triggered. Unlike open-sky aviation applications, where Global Navigation Satellite Systems (GNSS) signals are available, mobile robots operate in GNSS-denied, or in the best case GNSS-degraded, environments, which demands utilizing more complex set of sensors to guarantee an acceptable level of localization safety. This thesis provides a conservative measure of localization safety by rigorously upper-bounding the integrity risk while accounting for both nominal lidar noise and unmodeled lidar measurement faults.The contributions of this thesis include the design and analysis of practical integrity monitoring and failure detection procedures for mobile robots utilizing map-based particle filtering, a recursive integrity monitoring method for mobile robots utilizing map-based fixed lag smoothing for both solution-separation and chi-squared as failure detectors, the synthesis of an integrity monitoring procedure for mobile robots utilizing Extended Kalman Filter-based Simultaneous Localization And Mapping (EKF-based SLAM), and a Model Predictive Control (MPC) framework that is capable of planning mobile robot's trajectory to follow a predefined robot path while maintaining a predefined minimum level of mobile robot localization safety. The proposed methodologies are validated using both simulation and experimental results conducted in real-world urban university campus environments.
Show less
Improving Localization Safety for Landmark-Based LiDAR Localization System
Title
Improving Localization Safety for Landmark-Based LiDAR Localization System
Creator
Chen, Yihe
Date
2024
Description
Autonomous ground robots have gained traction in various commercial applications, with established safety protocols covering subsystem...
Show moreAutonomous ground robots have gained traction in various commercial applications, with established safety protocols covering subsystem reliability, control algorithm stability, path planning, and localization. This thesis specifically delves into the localizer, a critical component responsible for determining the vehicle’s state (e.g., position and orientation), assessing compliance with localization safety requirements, and proposing methods for enhancing localization safety.Within the robotics domain, diverse localizers are utilized, such as scan-matching techniques like normal distribution transformations (NDT), the iterative closest point (ICP) algorithm,probabilistic maps method, and semantic map-based localization.Notably, NDT stands out as a widely adopted standalone laser localization method, prevalent in autonomous driving software such as Autoware and Apollo platforms.In addition to the mentioned localizers, common state estimators include variants of Kalman Filter, particle filter-based, and factor graph-based estimators. The evaluation of localization performance typically involves quantifying the estimated state variance for these state estimators.While various localizer options exist, this study focuses on those utilizing extended Kalman filters and factor graph methods. Unlike methods like NDT and ICP algorithms, extended Kalman filters and factor graph based approaches guarantee bounding of estimated state uncertainty and have been extensively researched for integrity monitoring.Common variance analysis, employed for sensor readings and state estimators, has limitations, primarily focusing on non-faulted scenarios under nominal conditions. This approach proves impractical for real-world scenarios and falls short for safety-critical applications like autonomous vehicles (AVs).To overcome these limitations, this thesis utilizes a dedicated safety metric: integrity risk. Integrity risk assesses the reliability of a robot’s sensory readings and localization algorithm performance under both faulted and non-faulted conditions. With a proven track record in aviation, integrity risk has recently been applied to robotics applications, particularly for evaluating the safety of lidar localization.Despite the significance of improving localization integrity risk through laser landmark manipulation, this remains an under explored territory. Existing research on robot integrity risk primarily focuses on the vehicles themselves. To comprehensively understand the integrity risk of a lidar-based localization system, as addressed in this thesis, an exploration of lidar measurement faults’ modes is essential, a topic covered in this thesis.The primary contributions of this thesis include: A realistic error estimation method for state estimators in autonomous vehicles navigating using pole-shape lidar landmark maps, along with a compensatory method; A method for quantifying the risk associated with unmapped associations in urban environments, enhancing the realism of values provided by the integrity risk estimator; a novel approach to improve the localization integrity of autonomous vehicles equipped with lidar feature extractors in urban environments through minimal environmental modifications, mitigating the impact of unmapped association faults. Simulation results and experimental results are presented and discussed to illustrate the impact of each method, providing further insights into their contributions to localization safety.
Show less