Autonomous Robots Lab
  • Home
  • News
  • Research
    • Autonomous Navigation and Exploration
    • Robot Perception
    • Robot Learning
    • Subterranean Robotics
    • Collision-tolerant Aerial Robots
    • Fixed-Wing UAVs
    • Agile and Physical Interaction Control
    • Underwater Autonomy
    • Intelligent Mobility
    • Robotics for Nuclear Sites
    • Autonomous Robots Arena
    • Code
    • Media
    • Research Presentations
    • Projects
  • Publications
  • Group
    • People
    • Research Collaborators
  • Education
    • Introduction to Aerial Robotics >
      • Online Textbook >
        • Modeling >
          • Frame Rotations and Representations
          • Multirotor Dynamics
        • State Estimation >
          • Inertial Sensors
          • Batch Discrete-Time Estimation
          • The Kalman Filter
        • Flight Control >
          • PID Control
          • LQR Control
          • Linear Model Predictive Control
        • Motion Planning >
          • Holonomic Vehicle BVS
          • Dubins Airplane
          • Collision-free Navigation
          • Structural Inspection Path Planning
        • Simulation Tools >
          • Simulations with SimPy
          • MATLAB & Simulink
          • RotorS Simulator >
            • RotorS Simulator Video Examples
      • Lecture Slides
      • Literature and Links
      • RotorS Simulator
      • Student Projects
      • Homework Assignments
      • Independent Study
      • Video Explanations
      • Syllabus
      • Grade Statistics
    • Autonomous Mobile Robot Design >
      • Lecture Slides
      • Semester Projects
      • Code Repository
      • Literature and Links
      • RotorS Simulator
      • Video Explanations
      • Resources for Semester Projects
      • Syllabus
    • Robotics for DDD Applications
    • CS302 - Data Structures
    • Student Projects >
      • Robot Competitions
      • Undergraduate Researchers Needed
      • ConstructionBots - Student Projects
    • EiT TTK4854 - Robotic Ocean Waste Removal
    • Aerial Robotic Autonomy >
      • Breadth Topics
      • Deep-dive Topics
      • Project & Assignments
      • Literature
    • Robotics Seminars
    • Robotics Days
    • Outreach >
      • Drones Demystified! >
        • Lecture Slides
        • Code Repository
        • Video Explanations
        • RotorS Simulator
        • Online Textbook
      • Autonomous Robots Camp >
        • RotorS Simulator
      • Outreach Student Projects
    • BadgerWorks >
      • General Study Links
      • Learn ROS
      • SubT-Edu
  • Resources
    • Autonomous Robots Arena
    • Robot Development Space
  • Contact

Augmented Reality


Augmented Reality-enhanced Structural Inspection using Aerial Robots

In this work we present a methodology for augmented reality-enhanced structural inspection using aerial robots. `

The aerial robot is computing an optimized, full coverage path given a prior model of the structure. However, as the prior models are expected to be inaccurate, outdated or generally not capturing important details (such as human-readable data), an augmented reality interface is employed to enable the human operator to command new viewpoints through appropriate head motions. To assist the operator to identify the subsets of the structure that need further inspection, we stream both the stereo views as well as the real-time dense reconstruction of the environment taking place on-board the robot.  

The augmented reality interface is based on an Android phone and a cardboard-like virtual reality device. Head motion is used to command new viewpoints in the xyz-space while the robot ensures that the initial viewpoints are also visited.

The aerial robot operates autonomously in a GPS-denied environment without the support of motion capture. A few printed markers were added for safety as the test took place in a dark environment (and we just built this robot!). 

More to come soon!

Tool for the initial inspection path using a prior model of the wattmeter structure: 
  • https://github.com/ethz-asl/StructuralInspectionPlanner 
​
Our contributions in the field can be found in the following papers: 
  • C. Papachristos, K. Alexis, "Augmented Reality–enhanced Structural Inspection using Aerial Robots", IEEE Multi-Conference on Systems and Control 2016 Buenos Aires, Argentina, September 19-22, 2016

Proudly powered by Weebly