Vision Augmented State Estimation with Fault Tolerance