journal article·2021-12-13Open access

Using Feedback Strategies in Simulated Annealing with Crystallization Heuristic and Applications

Guilherme C. Duran, André K. Sato, Edson K. Ueda, Rogério Y. Takimoto, Hossein G. Bahabadi, Ahmad Barari, Thiago C. Martins, Marcos S. G. Tsuzuki

Applied Sciences· Volume 11· Issue 24

Abstract

This paper represents how typical advanced engineering design can be structured using a set of parameters and objective functions corresponding to the nature of the problem. The set of parameters can be in different types, including integer, real, cyclic, combinatorial, interval, etc. Similarly, the objective function can be presented in various types including integer (discrete), float, and interval. The simulated annealing with crystallization heuristic can deal with all these combinations of parameters and objective functions when the crystallization heuristic presents a sensibility for real parameters. Herein, simulated annealing with the crystallization heuristic is enhanced by combining Bates and Gaussian distributions and by incorporating feedback strategies to emphasize exploration or refinement, or a combination of the two. The problems that are studied include solving an electrical impedance tomography problem with float parameters and a partially evaluated objective function represented by an interval requiring the solution of 32 sparse linear systems defined by the finite element method, as well as an airplane design problem with several parameters and constraints used to reduce the explored domain. The combination of the proposed feedback strategies and simulated annealing with the crystallization heuristic is compared with existing simulated annealing algorithms and their benchmark results are shown. The enhanced simulated annealing approach proposed herein showed better results for the majority of the studied cases.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Probabilistic and Robust Engineering Design · Advanced Multi-Objective Optimization Algorithms · Numerical Methods and Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Laboratory of Computational Geometry, Escola Politécnica da Universidade de São Paulo, São Paulo 05508-010, Brazil

Faculty of Engineering and Applied Science, University of Ontario Institute of Technology (Ontario Tech), Oshawa, ON L1G 0C5, Canada

Funding

Coordenação de Aperfeicoamento de Pessoal de Nível Superior · National Council for Scientific and Technological Development · São Paulo Research Foundation · Universidade de São Paulo

References (53)

Show source-provided references
1. Gauss-Newton methods for a class of nonsmooth optimization problems
2. Etter, D.M., Hicks, M.J., and Cho, K.H. (1982, January 3–5). Recursive adaptive filter design using an adaptive genetic algorithm. Proceedings of the IEEE ICASSP, Paris, France.
3. Swarm Intelligence applied in synthesis of hunting strategies in a three-dimensional environment10.1016/j.eswa.2007.02.031 ↗
4. Optimization by simulated annealing: Quantitative studies10.1007/BF01009452 ↗
5. Bézier Curve Fitting With A Parallel Differential Evolution Algorithm10.3182/20130522-3-BR-4036.00098 ↗
6. A modified genetic algorithm-based approach to solve constrained solid TSP with time window using interval valued parameter10.1504/IJOR.2016.077688 ↗
7. Improving particle swarm optimization algorithm and its application to physical travelling salesman problems with a dynamic search space
8. Simulated annealing: A proof of convergence10.1109/34.295910 ↗
9. Goto, T.G., Najafabadi, H.R., Duran, G.C., Ueda, E.K., Sato, A.K., Martins, T.C., Takimoto, R.Y., Gohari, H., Barari, A., and Tsuzuki, M.S.G. (2021). Versatility of Simulated Annealing with Crystallization Heuristic: Its Application to a Great Assortment of Problems. Optimization Problems in Engineering [Working Title], IntechOpen.
10. Simulated annealing applied to the rotational polygon packing10.3182/20060517-3-FR-2903.00249 ↗
11. Rotational placement of irregular polygons over containers with fixed dimensions using simulated annealing and no-fit polygons
12. Rotational Placement using Simulated Annealing and Collision Free Region10.3182/20100701-2-PT-4011.00041 ↗
13. Equation of state calculations by fast computing machines10.1063/1.1699114 ↗
14. Optimization by simulated annealing10.1126/science.220.4598.671 ↗
15. Minimizing multimodal functions of continuous variables with the simulated annealing algorithm10.1145/29380.29864 ↗
16. Generalized simulated annealing for function optimization10.1080/00401706.1986.10488128 ↗
17. Very fast simulated re-annealing10.1016/0895-7177(89)90202-1 ↗
18. Robot path planning using simulated annealing10.3182/20060517-3-FR-2903.00105 ↗
19. Placement over containers with fixed dimensions solved with adaptive neighborhood simulated annealing
20. Joint distributions of time intervals for the occurrence of successive accidents in a generalized polya scheme10.1214/aoms/1177728429 ↗
21. Curve approximation by adaptive neighborhood simulated annealing and piecewise Bézier curves10.1007/s00500-020-05114-0 ↗
22. Ueda, E.K., Tsuzuki, M.S., and Barari, A. (2018, January 12–14). Piecewise Bézier curve fitting of a point cloud boundary by simulated annealing. Proceedings of the 13th IEEE INDUSCON, São Paulo, Brazil.10.1109/INDUSCON.2018.8627161 ↗
23. Simulated annealing with adaptive neighborhood: A case study in off-line robot path planning10.1016/j.eswa.2010.08.084 ↗
24. Fast simulated annealing with a multivariate Cauchy distribution and the configuration’s initial temperature10.3938/jkps.66.1457 ↗
25. Simulated annealing: Searching for an optimal temperature schedule10.1137/S1052623497329683 ↗
26. Moins, S. (2002). Implementation of a Simulated Annealing Algorithm for Matlab Training Performed, Linköping University.
27. (2012, November 08). Simulated Annealing (Corana’s Version)—Pagmo 2.18.0 Documentation. Available online: https://esa.github.io/pagmo2/.
28. Interval Simulated Annealing applied to Electrical Impedance Tomography image reconstruction with fast objective function evaluation10.1016/j.camwa.2016.06.021 ↗
29. Finite element modeling of electrode-sking contact impedance in electrical impedance tomography10.1109/10.222326 ↗
30. Electrical impedance tomography using the extended Kalman filter10.1109/TBME.2003.820389 ↗
31. In vivo imaging of cardiac related impedance changes10.1109/51.32404 ↗
32. Martins, T.C., and Tsuzuki, M.S.G. (September, January 28). Electrical impedance tomography reconstruction through simulated annealing with total least square error as objective function. Proceedings of the 34th IEEE EMBC, San Diego, CA, USA.
33. Influence of current injection pattern and electric potential measurement strategies in electrical impedance tomography10.1016/j.conengprac.2016.03.003 ↗
34. Investigating anisotropic EIT with simulated annealing10.1016/j.ifacol.2017.08.1574 ↗
35. Discretization error and the EIT forward problem
36. Martins, T.C., Fernandes, A.V., and Tsuzuki, M.S.G. (May, January 28). Image reconstruction by electrical impedance tomography using multi-objective simulated annealing. Proceedings of the 11th IEEE ISBI, Beijing, China.
37. Martins, T.C., and Tsuzuki, M.S.G. (2013, January 3–7). Electrical impedance tomography reconstruction through simulated annealing with multi-stage partially evaluated objective functions. Proceedings of the 35th IEEE EMBC, Osaka, Japan.
38. Electrical impedance tomography image reconstruction based on neural networks10.1016/j.ifacol.2020.12.360 ↗
39. Martins, T.C., Camargo, E.D.L.B., Lima, R.G., Amato, M.B.P., and Tsuzuki, M.S.G. (September, January 30). Electrical impedance tomography reconstruction through simulated annealing with incomplete evaluation of the objective function. Proceedings of the 33rd IEEE EMBC, Boston, MA, USA.
40. GPU acceleration of absolute EIT image reconstruction using simulated annealing10.1016/j.bspc.2017.02.007 ↗
41. Martins, T.C., and Tsuzuki, M.S.G. (2015, January 25–29). EIT image regularization by a new multi-objective simulated annealing algorithm. Proceedings of the 37th IEEE EMBC, Milan, Italy.
42. Image reconstruction using interval simulated annealing in electrical impedance tomography10.1109/TBME.2012.2188398 ↗
43. Simulated annealing with partial evaluation of objective function applied to electrical impedance tomography10.3182/20110828-6-IT-1002.01452 ↗
44. Layer stripping: A direct numerical method for impedance imaging10.1088/0266-5611/7/6/011 ↗
45. A review of electrical impedance tomography in lung applications: Theory and algorithms for absolute images10.1016/j.arcontrol.2019.05.002 ↗
46. Electrical impedance tomography reconstruction through simulated annealing using a new outside-in heuristic and GPU parallelization10.1088/1742-6596/407/1/012015 ↗
47. Development of a DSM-based methodology in an academic setting10.1115/1.4005591 ↗
48. Handling and safety enhancement of race cars using active aerodynamic systems10.1080/00423114.2014.930158 ↗
49. A unified approach for nonlinear vibration analysis of curved structures using non-uniform rational B-Spline representation10.1016/j.jsv.2015.05.022 ↗
50. NURBS representation of estimated surfaces resulting from machining errors10.1080/09511920802392730 ↗
51. Customization of automotive structural components using additive manufacturing and topology optimization10.1016/j.ifacol.2019.10.066 ↗
52. Sato, A.K., Borburema, D.M., Tsuzuki, M.S.G., Ueda, E.K., Martins, T.C., and Mariani, A.L.C. (2014, January 7–10). Simulated annealing with crystallization heuristic applied to aircraft conceptual design. Proceedings of the 11th IEEE INDUSCON, Juiz de Fora, Brazil.10.1109/INDUSCON.2014.7059421 ↗
53. Borburema, D.M., Sato, A.K., and Tsuzuki, M.S.G. (2019, January 12–14). Design and optimization of UAV for surveillance at Fernando de Noronha’s risk areas. Proceedings of the 13th IEEE INDUSCON, São Paulo, Brazil.10.1109/INDUSCON.2018.8627350 ↗