Particle swarm
3114196
Particle swarm optimization
Abstract Particle swarm optimization (PSO) has undergone many changes since its introduction in 1995. As researchers have learned about the technique, they have derived new versions, developed new applications, and published theoretical studies of the effects of the various parameters and aspects of the algorithm. This paper comprises a snapshot of particle swarming from the authors' perspective, including variations in the algorithm, current and ongoing research, applications and open problems.
Swarm Intelligence
Riccardo Poli James Kennedy Tim M Blackwell
7367791
Particle swarm optimization
A concept for the optimization of nonlinear functions using particle swarm methodology is introduced. The evolution of several paradigms is outlined, and an implementation of one of the paradigms is discussed. Benchmark testing of the paradigm is described, and applications, including nonlinear function optimization and neural network training, are proposed. The relationships between particle swarm optimization and both artificial life and genetic algorithms are described.
Proceedings of ICNN'95 International Conference on Neural Networks
James Kennedy Russell C Eberhart
14086189
A new optimizer using particle swarm theory
The optimization of nonlinear functions using particle swarm methodology is described. Implementations of two paradigms are discussed and compared, including a recently developed locally oriented paradigm. Benchmark testing of both paradigms is described, and applications, including neural network training and robot task learning, are proposed. Relationships between particle swarm optimization and both artificial life and evolutionary computation are reviewed.
MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science
Russell C Eberhart
16708577
A modified particle swarm optimizer
Evolutionary computation techniques, genetic algorithms, evolutionary strategies and genetic programming are motivated by the evolution of nature. A population of individuals, which encode the problem solutions are manipulated according to the rule of survival of the fittest through "genetic" operations, such as mutation, crossover and reproduction. A best solution is evolved through the generations. In contrast to evolutionary computation techniques, Eberhart and Kennedy developed a different algorithm through simulating social behavior (R.C. Eberhart et al. 1996; R.C. Eberhart and J. Kennedy, 1996; J. Kennedy and R.C. Eberhart, 1995; J. Kennedy, 1997) As in other algorithms, a population of individuals exists. This algorithm is called particle swarm optimization (PSO) since it resembles a school of flying birds. In a particle swarm optimizer, instead of using genetic operators, these individuals are "evolved" by cooperation and competition among the individuals themselves through generations. Each particle adjusts its flying according to its own flying experience and its companions' flying experience. We introduce a new parameter, called inertia weight, into the original particle swarm optimizer. Simulations have been done to illustrate the significant and effective impact of this new parameter on the particle swarm optimizer.
1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360)
Russell C Eberhart
4895965
Particle Swarm Optimization: A survey of historical and recent developments with hybridization perspectives
Particle Swarm Optimization (PSO) is a metaheuristic global optimization paradigm that has gained prominence in the last two decades due to its ease of application in unsupervised, complex multidimensional problems which cannot be solved using traditional deterministic algorithms. The canonical particle swarm optimizer is based on the flocking behavior and social co operation of birds and fish schools and draws heavily from the evolutionary behavior of these organisms. This paper serves to provide a thorough survey of the PSO algorithm with special emphasis on the development, deployment and improvements of its most basic as well as some of the state of the art implementations. Concepts and directions on choosing the inertia weight, constriction factor, cognition and social weights and perspectives on convergence, parallelization, elitism, niching and discrete optimization as well as neighborhood topologies are outlined. Hybridization attempts with other evolutionary and swarm paradigms in selected applications are covered and an up to date review is put forward for the interested reader.
Mach. Learn. Knowl. Extr.
Saptarshi Sengupta Sanchita Basak Richard Alan Peters
8561098
The particle swarm explosion, stability, and convergence in a multidimensional complex space
The particle swarm is an algorithm for finding optimal regions of complex search spaces through the interaction of individuals in a population of particles. This paper analyzes a particle's trajectory as it moves in discrete time (the algebraic view) then progresses to the view of it in continuous time (the analytical view) A five dimensional depiction is developed, which describes the system completely. These analyses lead to a generalized model of the algorithm, containing a set of coefficients to control the system's convergence tendencies. Some results of the particle swarm optimizer, implementing modifications derived from the analysis, suggest methods for altering the original algorithm in ways that eliminate problems and increase the ability of the particle swarm to find optima of some well studied test functions.
IEEE Trans. Evol. Comput.
Maurice Clerc James Kennedy
34518775
Particle swarm optimization algorithm: an overview
Particle swarm optimization (PSO) is a population based stochastic optimization algorithm motivated by intelligent collective behavior of some animals such as flocks of birds or schools of fish. Since presented in 1995, it has experienced a multitude of enhancements. As researchers have learned about the technique, they derived new versions aiming to different demands, developed new applications in a host of areas, published theoretical studies of the effects of the various parameters and proposed many variants of the algorithm. This paper introduces its origin and background and carries out the theory analysis of the PSO. Then, we analyze its present situation of research and application in algorithm structure, parameter selection, topology structure, discrete PSO algorithm and parallel PSO algorithm, multi objective optimization PSO and its engineering applications. Finally, the existing problems are analyzed and future research directions are presented.
Soft Comput.
Dongshu Wang Dapei Tan Lei Liu
4892504
A hybrid firefly and particle swarm optimization algorithm for computationally expensive numerical problems
Abstract Optimization in computationally expensive numerical problems with limited function evaluations provides computational advantages over constraints based on runtime requirements and hardware resources. Convergence success of a metaheuristic optimization algorithm depends on directing and balancing of its exploration and exploitation abilities. Firefly and particle swarm optimization are successful swarm intelligence algorithms inspired by nature. In this paper, a hybrid algorithm combining firefly and particle swarm optimization (HFPSO) is proposed. The proposed algorithm is able to exploit the strongpoints of both particle swarm and firefly algorithm mechanisms. HFPSO try to determine the start of the local search process properly by checking the previous global best fitness values. In experiments, several dimensional CEC 2015 and CEC 2017 computationally expensive sets of numerical and engineering, mechanical design benchmark problems are used. The proposed HFPSO is compared with standard particle swarm, firefly and other recent hybrid and successful algorithms in limited function evaluations. Runtimes and convergence accuracies are statistically measured and evaluated. The solution results quality of this study show that the proposed HFPSO algorithm provides fast and reliable optimization solutions and outperforms others in unimodal, simple multimodal, hybrid, and composition categories of computationally expensive numerical functions.
Appl. Soft Comput.
Ibrahim Berkan Aydilek
38920650
A competitive mechanism based multi objective particle swarm optimizer with fast convergence
Abstract In the past two decades, multi objective optimization has attracted increasing interests in the evolutionary computation community, and a variety of multi objective optimization algorithms have been proposed on the basis of different population based meta heuristics, where the family of multi objective particle swarm optimization is among the most representative ones. While the performance of most existing multi objective particle swarm optimization algorithms largely depends on the global or personal best particles stored in an external archive, in this paper, we propose a competitive mechanism based multi objective particle swarm optimizer, where the particles are updated on the basis of the pairwise competitions performed in the current swarm at each generation. The performance of the proposed competitive multi objective particle swarm optimizer is verified by benchmark comparisons with several state of the art multi objective optimizers, including three multi objective particle swarm optimization algorithms and three multi objective evolutionary algorithms. Experimental results demonstrate the promising performance of the proposed algorithm in terms of both optimization quality and convergence speed.
Inf. Sci.
Xingyi Zhang Xiutao Zheng Ran Cheng Jianfeng Qiu Yaochu Jin
51970965
MPSO: Modified particle swarm optimization and its applications
Abstract Particle swarm optimization (PSO) is a population based meta heuristic search algorithm that has been widely applied to a variety of problems since its advent. In PSO, the inertial weight not only has a crucial effect on its convergence, but also plays an important role in balancing exploration and exploitation during the evolution. However, PSO is easily trapped into the local optima and premature convergence appears when applied to complex multimodal problems. To address these issues, we present a modified particle swarm optimization with chaos based initialization and robust update mechanisms. On the one side, the Logistic map is utilized to generate uniformly distributed particles to improve the quality of the initial population. On the other side, the sigmoid like inertia weight is formulated to make the PSO adaptively adopt the inertia weight between linearly decreasing and nonlinearly decreasing strategies in order to achieve better tradeoff between the exploration and exploitation. During this process, a maximal focus distance is formulated to measure the particle's aggregation degree. At the same time, the wavelet mutation is applied for the particles whose fitness value is less than that of the average so as to enhance the swarm diversity. In addition, an auxiliary velocity position update mechanism is exclusively applied to the global best particle that can effectively guarantee the convergence of MPSO. Extensive experiments on CEC'13/15 test suites and in the task of standard image segmentation validate the effectiveness and efficiency of the MPSO algorithm proposed in this paper.
Swarm Evol. Comput.
Dong-ping Tian Zhongzhi Shi