Abstract
In this paper we consider the evolutionary Particle Swarm Optimization (PSO) algorithm, for the minimization of a computationally costly nonlinear function, in global optimization frameworks. We study a reformulation of the standard iteration of PSO (Clerc and Kennedy in IEEE Trans Evol Comput 6(1) 2002), (Kennedy and Eberhart in IEEE Service Center, Piscataway, IV: 1942–1948, 1995) into a linear dynamic system. We carry out our analysis on a generalized PSO iteration, which includes the standard one proposed in the literature. We analyze three issues for the resulting generalized PSO: first, for any particle we give both theoretical and numerical evidence on an efficient choice of the starting point. Then, we study the cases in which either deterministic and uniformly randomly distributed coefficients are considered in the scheme. Finally, some convergence analysis is also provided, along with some necessary conditions to avoid diverging trajectories. The results proved in the paper can be immediately applied to the standard PSO iteration.
Similar content being viewed by others
References
Ashlock D.: Evolutionary Computation for Modeling and Optimization. Springer, Berlin (2006)
Baker, C.A.,Watson, L.T., Grossman, B., Haftka, R.T., Mason, W.H.: Parallel global aircraft configuration design space exploration. In: Proceedings of the 8th AIAA/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, Paper No. 2000–4763–CP, Long Beach, California (USA), (2000)
Campana, E.F., Fasano, G., Pinto, A.: Dynamic system analysis and initial particles position in particle swarm optimization. In: IEEE Swarm Intelligence Symposium, Indianapolis, (2006)
Campana, E.F., Fasano, G., Peri, D., Pinto, A.: Particle swarm optimization: efficient globally convergent modifications. In: Mota Soares, C.A. et al. (eds.) III European Conference on Computational mechanics Solid, Structures and Coupled Problems in Engineering, Lisbon, Portugal, 5–8 June (2006)
Campana, E.F., Liuzzi, G., Lucidi, S., Peri, D., Piccialli, V., Pinto, A.: New global optimization methods for ship design problems, Technical Report INSEAN 2005-01
Clerc, M., Kennedy, J.: The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), (2002)
Dixon L.C.W., Szego G.P.: The optimization problem: an introduction. In: Dixon, L.C.W. (eds) Towards Global Optimization II, North Holland, New York (1978)
Fourie, P.C., Groenwold, A.A.: Particle Swarms in Size and Shape Optimization, Proceedings of the International Workshop on Multidisciplinary Design Optimization, Pretoria, South Africa, August 7-10, 2000, pp. 97–106
Goldberg D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading (1989)
Gazi, V., Passino, K.M.: Stability of a one-dimensional discrete-time asynchronous swarm. In: IEEE Trans Syst Man Cybernet, Part B, (2005)
Horst R., Pardalos P.M., Thoai N.V.: Introduction to Global Optimization. Kluwer, Dodrecht (2000)
Horst R., Tuy H.: Global Optimization: deterministic approaches. Springer Verlag, Berlin (1990)
Jameson, A., Alonso, J.J.: Future research avenues in computational engineering and design. In: 4th International Congress on Industrial and Applied Mathematics (ICIAM 1999), Edinburgh, Scotland, July 5–9, (1999)
Kennedy, J.: Methods of agreement: inference among the eleMentals. In: Proceedings of the 1998 IEEE International Symposium on Intelligent Control, pp. 883–887, (1998)
Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks (Perth, Australia), IEEE Service Center, Piscataway, NJ, IV: 1942–1948, (1995)
Kolda T.G., Lewis R.M., Torczon V.: Optimization by direct search: new perspectives on some classical and modern methods. SIAM Rev. 45(3), 385–482 (2003)
Maaranen H., Miettinen K., Penttinen A.: On initial population of a genetic algorithm for continuous optimization problems. J. Glob Optim. 37, 405–436 (2007)
Mendes, R.: Population Topologies and Their Influence in Particle Swarm Performance. PhD Final Dissertation, Departamento de Informática Escola de Engenharia Universidade do Minho, (2004)
Michalewicz Z.: Genetic algorithm + data structures = evolution programs. Springer-Verlag, New York (1996)
Monson, C.K., Seppi, K.D.: The Kalman swarm—a new approach to particle motion in swarm optimization. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2004), Seattle, Washington, pp. 140–150, (2004)
Nguyen, Q.U., Nguyen, X.H., McKay, R.I., Pham, M.T.: Initializing PSO with randomized low-discrepancy sequences: the comparative results. In: CEC 2007 Conference, (2007)
Ozcan, E., Mohan, C.K.: Particle swarm optimization: surfing the waves. In: Proceedings of the 1999 IEEE Congress on Evolutionary Comnputation, IEEE Service Center, Piscataway, NJ, 1939–1944, (1999)
Parsopoulos K.E., Vrahatis M.N.: Initializing the particle swarm optimizer using the nonlinear simplex method. In: Grmela, A., Mastorakis, N.E. Advances in Intelligent Systems, Fuzzy Systems, Evolutionary Computation., pp. 216–221. WSEAS Press, Skiathos (2002)
Pinter J.D.: Global Optimization in Action. Continuous and Lipschitz Optimization: Algorithms, Implementations and Applications. Kluwer, Boston (1996)
Pinto A., Peri D., Campana E.F.: Global Optimization Algorithms in Naval Hydrodynamics. Ship Technol. Res. 51(3), 123–133 (2004)
Poli,R.: The Sampling Distribution of Particle Swarm Optimisers and their Stability, Technical Report CSM-465, University of Essex, (2007)
Sarachik P.E.: Principles of linear systems. Cambridge University Press, Cambridge (1997)
Sarker, R., Mohammadian, M., Yao, X. (eds): Evolutionary Optimization. Kluwer, Boston (2002)
Shi, Y., Eberhart, R.: Parameter Selection in Particle Swarm Optimization. In: The seventh Annual Conference on Evolutionary Computation, 1945–1950, (1998)
Suganthan, P.N., Hansen, N., Liang, J.J., Deb, K., Chen, Y.P., Auger, A., Tiwari, S.: Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization, Technical Report, Nanyang Technological University, Singapore; KanGAL Report Number 2005-005 (Kanpur Genetic Algorithms Laboratory, IIT Kanpur) (2005)
Tomassini, M.: A Survey of genetic algorithms. Ann Rev. Comput. Phys. III (World Scientific)
Trelea I.C.: The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf. Process. Lett. 85, 317–325 (2003)
Van den Berg, F.: An Analysis of Particle Swarm Optimizers. PhD thesis, Department of Computer Science, University of Pretoria, (2002)
Van den Berg, F., Engelbrecht, F.: A study of particle swarm optimization particle trajectories. Inf. Sci. J. (2005)
Venter G., Sobieszczanski-Sobieski J.: Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization. Struc. Multidiscip. Optim. 26(1–2), 121–131 (2004)
Zheng, Y.L., Ma, L.H., Zhang, L.Y., Qian, J.X.: On the convergence analysis and parameter selection in particle swarm optimization. In: Proceedings of the Second International Conference on Machine Learning and Cybernetics, Xi’an, 2–5 November (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Campana, E.F., Fasano, G. & Pinto, A. Dynamic analysis for the selection of parameters and initial population, in particle swarm optimization. J Glob Optim 48, 347–397 (2010). https://doi.org/10.1007/s10898-009-9493-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-009-9493-0