journal article·2019-02-14Open access

Iterative Learning Method for In-Flight Auto-Tuning of UAV Controllers Based on Basic Sensory Information

Wojciech Giernacki

Applied Sciences· Volume 9· Issue 4

Abstract

With an increasing number of multirotor unmanned aerial vehicles (UAVs), solutions supporting the improvement in their precision of operation and safety of autonomous flights are gaining importance. They are particularly crucial in transportation tasks, where control systems are required to provide a stable and controllable flight in various environmental conditions, especially after changing the total mass of the UAV (by adding extra load). In the paper, the problem of using only available basic sensory information for fast, locally best, iterative real-time auto-tuning of parameters of fixed-gain altitude controllers is considered. The machine learning method proposed for this purpose is based on a modified zero-order optimization algorithm (golden-search algorithm) and bootstrapping technique. It has been validated in numerous simulations and real-world experiments in terms of its effectiveness in such aspects as: the impact of environmental disturbances (wind gusts); flight with change in mass; and change of sensory information sources in the auto-tuning procedure. The main advantage of the proposed method is that for the trajectory primitives repeatedly followed by an UAV (for programmed controller gains), the method effectively minimizes the selected performance index (cost function). Such a performance index might, e.g., express indirect requirements about tracking quality and energy expenditure. In the paper, a comprehensive description of the method, as well as a wide discussion of the results obtained from experiments conducted in the AeroLab for a low-cost UAV (Bebop 2), are included. The results have confirmed high efficiency of the method at the expected, low computational complexity.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Control Systems Optimization · Adaptive Control of Nonlinear Systems · Control Systems and Identification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Control, Robotics and Information Engineering, Electrical Department, Poznan University of Technology, Piotrowo 3a Street, 60-965 Poznan, Poland

Funding

Politechnika Poznańska

References (50)

Show source-provided references
1. Valavanis, K., and Vachtsevanos, G.J. (2015). Handbook of Unmanned Aerial Vehicles, Springer.10.1007/978-90-481-9707-1 ↗
2. State-of-the-art technologies for UAV inspections10.1049/iet-rsn.2017.0251 ↗
3. Hinas, A., Roberts, J.M., and Gonzalez, F. (2017). Vision-Based Target Finding and Inspection of a Ground Target Using a Multirotor UAV System. Sensors, 17.10.3390/s17122929 ↗
4. Sandino, J., Gonzalez, F., Mengersen, K., and Gaston, K.J. (2018). UAVs and Machine Learning Revolutionising Invasive Grass and Vegetation Surveys in Remote Arid Lands. Sensors, 18.10.3390/s18020605 ↗
5. Solid State Sensors—Practical Implementation in Unmanned Aerial Vehicles (UAVs)10.1016/j.proeng.2012.09.415 ↗
6. Gośliński, J., Giernacki, W., and Królikowski, A. (2018). A nonlinear Filter for Efficient Attitude Estimation of Unmanned Aerial Vehicle (UAV). J. Intell. Robot. Syst.10.1007/s10846-018-0949-7 ↗
7. Urbański, K. (2018, January 5–7). Control of the Quadcopter Position Using Visual Feedback. Proceedings of the 18th International Conference on Mechatronics (Mechatronika), Brno, Czech Republic.
8. A survey of Open-Source UAV flight controllers and flight simulators10.1016/j.micpro.2018.05.002 ↗
9. Lozano, R. (2010). Unmanned Aerial Vehicles: Embedded Control, John Wiley & Sons.
10. State-of-the-Art Intelligent Flight Control Systems in Unmanned Aerial Vehicles10.1109/TASE.2017.2651109 ↗
11. Multirotor aerial vehicles: Modeling, estimation, and control of quadrotor10.1109/MRA.2012.2206474 ↗
12. Ren, B., Ge, S., Chen, C., Fua, C., and Lee, T. (2012). Modeling, Control and Coordination of Helicopter Systems, Springer.10.1007/978-1-4614-1563-3 ↗
13. Stability of small-scale UAV helicopters and quadrotors with added payload mass under PID control10.1007/s10514-012-9280-5 ↗
14. Li, J., and Li, Y. (2011, January 7–10). Dynamic Analysis and PID Control for a Quadrotor. Proceedings of the 2011 IEEE International Conference on Mechatronics and Automation (ICMA), Beijing, China.10.1109/ICMA.2011.5985724 ↗
15. Linear and nonlinear controllers applied to fixed-wing UAV10.5772/53616 ↗
16. Lee, K.U., Kim, H.S., Park, J.-B., and Choi, Y.-H. (2012, January 17–21). Hovering Control of a Quadrotor. Proceedings of the 2012 12th International Conference on Control, Automation and Systems (ICCAS), JeJu Island, South Korea.
17. Aerial Grasping from a Helicopter UAV Platform, Experimental Robotics10.1007/978-3-642-28572-1_19 ↗
18. Kohout, P. (2017). A System for Autonomous Grasping and Carrying of Objects by a Pair of Helicopters. [Master’s Thesis, Czech Technical University in Prague].
19. Spica, R., Franchi, A., Oriolo, G., Bülthoff, H.H., and Giordano, P.R. (2012, January 7–12). Aerial grasping of a moving target with a quadrotor UAV. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.10.1109/IROS.2012.6385771 ↗
20. Yang, F., Xue, X., Cai, C., Sun, Z., and Zhou, Q. (2018). Numerical Simulation and Analysis on Spray Drift Movement of Multirotor Plant Protection Unmanned Aerial Vehicle. Energies, 11.10.3390/en11092399 ↗
21. Review on Application of Drone Systems in Precision Agriculture10.1016/j.procs.2018.07.063 ↗
22. Imdoukh, A., Shaker, A., Al-Toukhy, A., Kablaoui, D., and El-Abd, M. (2017, January 10–12). Semi-autonomous indoor firefighting UAV. Proceedings of the 2017 18th International Conference on Advanced Robotics (ICAR), Hong Kong, China.10.1109/ICAR.2017.8023625 ↗
23. Duan, H., and Li, P. (2014). Bio-inspired Computation in Unmanned Aerial Vehicles, Springer.10.1007/978-3-642-41196-0 ↗
24. Giernacki, W., Espinoza Fraire, T., and Kozierski, P. (2017, January 22–24). Cuttlesh Optimization Algorithm in Autotuning of Altitude Controller of Unmanned Aerial Vehicle (UAV). Proceedings of the Third Iberian Robotics Conference (ROBOT 2017), Seville, Spain.10.1007/978-3-319-70833-1_68 ↗
25. Chong, E.K.P., and Zak, S.H. (2001). An Introduction to Optimization, John Wiley & Sons. [2nd ed.].
26. Giernacki, W., Horla, D., Báča, T., and Saska, M. (2018). Real-time model-free optimal autotuning method for unmanned aerial vehicle controllers based on Fibonacci-search algorithm. Sensors, 19.10.3390/s19020312 ↗
27. Spurný, V., Báča, T., Saska, M., Pěnička, R., Krajník, T., Loianno, G., Thomas, J., Thakur, D., and Kumar, V. (2018). Cooperative Autonomous Search, Grasping and Delivering in Treasure Hunt Scenario by a Team of UAVs. J. Field Robot., 1–24.10.1002/rob.21816 ↗
28. Automatic Tuning with AUTOTUNE (2018, November 12). Ardupilot.org. Available online: http://ardupilot.org/plane/docs/automatic-tuning-with-autotune.html.
29. Rodriguez-Ramos, A., Sampedro, C., Bavle, H., de la Puente, P., and Campoy, P. (2018). A Deep Reinforcement Learning Strategy for UAV Autonomous Landing on a Moving Platform. J. Intell. Robot. Syst., 1–16.10.1109/IROS.2018.8594472 ↗
30. Koch, W., Mancuso, R., West, R., and Bestavros, A. (2018, November 12). Reinforcement Learning for UAV Attitude Control. Available online: https://arxiv.org/abs/1804.04154.
31. Panda, R.C. (2012). Introduction to PID Controllers—Theory, Tuning and Application to Frontier Areas, In-Tech.10.5772/2422 ↗
32. Derivative-free optimization: A review of algorithms and comparison of software implementations10.1007/s10898-012-9951-y ↗
33. Spall, J.C. (2003). Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control, Wiley.10.1002/0471722138 ↗
34. Iterative feedback tuning: Theory and applications10.1109/37.710876 ↗
35. Reza-Alikhani, H. (2010, January 7–9). PID type iterative learning control with optimal variable coefficients. Proceedings of the 2010 5th IEEE International Conference Intelligent Systems, London, UK.10.1109/IS.2010.5548329 ↗
36. Stochastic first-and zeroth-order methods for nonconvex stochastic programming10.1137/120880811 ↗
37. Sequential minimax search for a maximum10.1090/S0002-9939-1953-0055639-3 ↗
38. Brasch, T., Byström, J., and Lystad, L.P. (2018, December 28). Optimal Control and the Fibonacci Sequence, Available online: https://www.ssb.no/a/publikasjoner/pdf/DP/dp674.pdf.
39. Theys, B., Dimitriadis, G., Hendrick, P., and De Schutter, J. (2016, January 7–10). Influence of propeller configuration on propulsion system efficiency of multi-rotor Unmanned Aerial Vehicles. Proceedings of the 2016 International Conference on Unmanned Aircraft Systems (ICUAS), Arlington, TX, USA.10.1109/ICUAS.2016.7502520 ↗
40. Xia, D., Cheng, L., and Yao, Y. (2017). A Robust Inner and Outer Loop Control Method for Trajectory Tracking of a Quadrotor. Sensors, 17.10.3390/s17092147 ↗
41. Survey on iterative learning control, repetitive control, and run-to-run control10.1016/j.jprocont.2009.09.006 ↗
42. (2018, November 19). Multicopter PID Tuning Guide. Available online: https://docs.px4.io/en/config_mc/pid_tuning_guide_multicopter.html.
43. (2018, November 18). How to Tune PID I-Term on a Quadcopter. Available online: https://quadmeup.com/how-to-tune-pid-i-term-on-a-quadcopter/.
44. (2018, November 18). Quadcopter PID Explained. Available online: https://oscarliang.com/quadcopter-pid-explained-tuning/.
45. Bettering operation of robots by learning10.1002/rob.4620010203 ↗
46. Parrot BEBOP 2 (2018, November 26). The Lightweight, Compact HD Video Drone. Available online: https://www.parrot.com/us/drones/parrot-bebop-2.
47. (2018, December 02). AeroLab Poznan University of Technology Drone Laboratory Webpage. Available online: http://uav.put.poznan.pl/AeroLab.
48. (2018, November 18). What is Sphinx. Available online: https://developer.parrot.com/docs/sphinx/whatissphinx.html.
49. (2018, November 18). bebop_autonomy—ROS Driver for Parrot Bebop Drone (quadrocopter) 1.0 & 2.0. Available online: https://bebop-autonomy.readthedocs.io/en/latest/.
50. Optimal Tuning of Non-integer Order Controllers for Rotational Speed Control of UAV’s Propulsion Unit Based on an Iterative Batch Method