An Improved Grey Wolf Optimization Algorithm with Variable Weights

Abstract

With a hypothesis that the social hierarchy of the grey wolves would be also followed in their searching positions, an improved grey wolf optimization (GWO) algorithm with variable weights (VW-GWO) is proposed. And to reduce the probability of being trapped in local optima, a new governing equation of the controlling parameter is also proposed. Simulation experiments are carried out, and comparisons are made. Results show that the proposed VW-GWO algorithm works better than the standard GWO, the ant lion optimization (ALO), the particle swarm optimization (PSO) algorithm, and the bat algorithm (BA). The novel VW-GWO algorithm is also verified in high-dimensional problems.

This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

1. Introduction

A lot of problems with huge numbers of variables, massive complexity, or having no analytical solutions were met during the behavior of exploring, exploiting, and conquering nature by human beings. The optimization methods are proposed to solve them. But unfortunately, because of the no free lunch rule [1], it is always hard to find a universal efficient way for almost all problems. Therefore, scientists and engineers around the world are still under ways to find more optimization algorithms and more suitable methods.

Traditionally, the optimization algorithms are divided into two parts: the deterministic algorithms and the stochastic algorithms [2]; the deterministic algorithms are proved to be easily trapped in local optima, while the stochastic algorithms are found to be capable of avoiding local solutions with randomness. Thus, more attention is paid to the stochastic algorithms, and more and more algorithms are proposed. Among the research on the stochastic algorithms, presentations, improvements, and applications of the nature-inspired computing (NIC) algorithms come into being a hot spot.

The NIC algorithms are proposed with inspiration of the nature, and they have been proved to be efficient to solve the problems human meet [3, 4]. One of the most important parts of NIC algorithms are the bionic algorithms, and most of the bionic algorithms are metaheuristic [5–7]. They can solve problems with parallel computing and global searching. The metaheuristic algorithms divide the swarms in global and local searching with some methods. They cannot guarantee the global optimal solutions; thus, most of the metaheuristic algorithms introduce randomness to avoid local optima. The individuals in swarms are controlled to separate, align, and cohere [8] with randomness; their current velocities are composed of the former velocities, random multipliers of the frequency [9], or Euclidean distances of specific individuals’ positions [10–14]. Some improvements are made with inertia weights modification [15–17], hybridization with invasive weed optimization [18], chaos [19], and binary [20] vectors et al. Most of these improvements result in a little better performance of the specific algorithms, but the overall structures remain unchanged.

Almost all of the metaheuristic algorithms and their improvements so far are inspired directly from the behaviors of the organisms such as searching, hunting [11, 21], pollinating [13], and flashing [14]. In the old metaheuristic algorithms, such as the genetic algorithm (GA) [22], simulated annealing (SA) [23], and the ant colony optimization (ACO) algorithm [24], the individuals are treated in the same way, and the final results are the best fitness values. Metaheuristic algorithms perform their behavior under the same governing equations. To achieve a better performance and decrease the possibility of being trapped in local optima, random walks or levy flights are introduced to the individuals when specific conditions are might [25, 26]. These mostly mean that the swarms would perform their behavior in more uncontrolling ways. Furthermore, as organisms living in swarms in nature, most of them have social hierarchies as long as they are slightly intelligent. For example, in an ant colony, the queen is the commander despite its reproduction role; the dinergates are soldiers to garden the colony, while the ergates are careered with building, gathering, and breeding. It can be concluded that the hierarchy of the ant colony is queen → dinergates → ergates if they are classified with jobs. The ergates’ behavior could be directed by their elder’s experience and their queen or the dinergates. If the ergates are commanded by the queen, some dinergates, or elders, and such operations are mathematically described and introduced to the ant colony optimization (ACO) in some way, will the ACO algorithm perform better in solving the problems? In other words, how about the social hierarchy of the swarms considered in the metaheuristic algorithms? This work was done by Mirjalili et al., and a new optimization method called the grey wolf optimization (GWO) algorithm was proposed [27].

The GWO algorithm considers the searching, hunting behavior, and the social hierarchy of the grey wolves. Due to less randomness and varying numbers of individuals assigned in global and local searching procedures, the GWO algorithm is easier to use and converges more rapidly. It has been proved to be more efficient than the PSO [27] algorithm and other bionic algorithms [28–32]. More attention had been paid to its applications due to its better performance. Efforts have been done in feature and band selection [33, 34], automatic control [29, 35], power dispatching [32, 36], parameter estimation [31], shop scheduling [28], and multiobjective optimization [37, 38]. However, the standard GWO algorithm was formulated with equal importance of the grey wolves’ positions, which is not consistent strictly with their social hierarchy. Recent developments of the GWO algorithms such as the binary GWO algorithm [34], multiobjective GWO algorithm [37], and mix with others [39], together with their applications [40–43] keep it remaining unchanged. If the searching and hunting positions of the grey wolves are also agreed to the social hierarchy, the GWO algorithm will be possibly improved. With a hypothesis that the social hierarchy of the grey wolves would be also functional in the grey wolves’ searching procedure, we report an improvement of the original GWO algorithm in this paper. And considering the applications in engineering when a maximum admissible error (MAE) is usually restricted for given problems, a declined exponentially governing equation of the controlling parameter is introduced to avoid the unknown maximum iteration number. The rest of this paper is organized as follows:

Section 2 presents the inspiration of the improvement and the revision of the controlling equations to meet the needs of the latter experiments. Experiment setup is described in Section 3, and results are compared in Section 4. Finally, Section 5 concludes the work and further research suggestions are made.

2. Algorithms

According to Mirjalili et al. [27], the grey wolves live together and hunt in groups. The searching and hunting process can be described as follows: (1) if a prey is found, they first track and chase and approach it. (2) If the prey runs, then the grey wolves pursue, encircle, and harass the prey until it stops moving. (3) Finally, the attack begins.

2.1. Standard GWO Algorithm

Mirjalili designed the optimization algorithm imitating the searching and hunting process of grey wolves. In the mathematical model, the fittest solution is called the alpha (α), the second best is beta (β), and consequently, the third best is named the delta (δ). The rest of the candidate solutions are all assumed to be omegas (ω). All of the omegas would be guided by these three grey wolves during the searching (optimizing) and hunting.

When a prey is found, the iteration begins (t = 1). Thereafter, the alpha, beta, and the delta wolves would lead the omegas to pursue and eventually encircle the prey. Three coefficients $\overrightarrow{A}$, $\overrightarrow{C}$, and $\overrightarrow{D}$ are proposed to describe the encircling behavior:$$\begin{array}{c}\text{(1)}& \overrightarrow{D_{\alpha }}=\left|\overrightarrow{C_1}\cdot \overrightarrow{X_a}-\overrightarrow{X}\left(t\right)\right|,\overrightarrow{D_{\beta }}=\left|\overrightarrow{C_2}\cdot \overrightarrow{X_{\beta }}-\overrightarrow{X}\left(t\right)\right|,\\ \overrightarrow{D_{\delta }}=\left|\overrightarrow{C_3}\cdot \overrightarrow{X_{\delta }}-\overrightarrow{X}\left(t\right)\right|,\end{array}$$where $t$ indicates the current iteration, $\overrightarrow{X}$ is the position vector of the grey wolf, and $\overrightarrow{X_1}$, $\overrightarrow{X_2}$, and $\overrightarrow{X_3}$ are the position vectors of the alpha, beta, and delta wolves. $\overrightarrow{X}$ would be computed as follows:$$\begin{array}{}\text{(2)}& \overrightarrow{X_1}=\overrightarrow{X_a}-\overrightarrow{A_1}\cdot \overrightarrow{D_{\alpha }},\text{(3)}& \overrightarrow{X_2}=\overrightarrow{X_{\beta }}-\overrightarrow{A_2}\cdot \overrightarrow{D_{\beta }},\text{(4)}& \overrightarrow{X_3}=\overrightarrow{X_{\delta }}-\overrightarrow{A_3}\cdot \overrightarrow{D_{\delta }},\text{(5)}& \overrightarrow{X}\left(t\right)=\frac{\overrightarrow{X_1}+\overrightarrow{X_2}+\overrightarrow{X_3}}{3}.\end{array}$$

The parameters $\overrightarrow{A}$ and $\overrightarrow{C}$ are combinations of the controlling parameter $a$ and the random numbers $\overrightarrow{r_1}$ and $\overrightarrow{r_2}$ [27]:$$\begin{array}{c}\text{(6)}& \overrightarrow{A}=2\alpha \overrightarrow{r_1}-\alpha ,\overrightarrow{C}=2\overrightarrow{r_2}.\end{array}$$

The controlling parameter a changes $\overrightarrow{A}$ and finally causes the omega wolves to approach or run away from the dominant wolves such as the alpha, beta, and delta. Theoretically, if $\left|\overrightarrow{A}\right|>1$, the grey wolves run away from the dominants, and this means the omega wolves would run away from the prey and explore more space, which is called a global search in optimization. And if $\left|\overrightarrow{A}\right|<1$, they approach the dominants, which means the omega wolves would follow the dominants approaching the prey, and this is called a local search in optimization.

The controlling parameter $a$ is defined to be declined linearly from a maximum value of 2 to zero while the iterations are being carried on:$$\begin{array}{}\text{(7)}& \alpha =2\left(1-\frac{\text{it}}{N}\right),\end{array}$$where $N$ is the maximum iteration number, and it is initialized at the beginning by users. It is defined as the cumulative iteration number. The application procedure can be divided in three parts. (1) The given problems are understood and mathematically described, and some elemental parameters are then known. (2) A pack of grey wolves are randomly initialized all through the space domain. (3) The alpha and other dominant grey wolves lead the pack to search, pursue, and encircle the prey. When the prey is encircled by the grey wolves and it stops moving, the search finishes and attacks begin. The pseudocode is listed in Table 1.

Table 1

Pseudocode of the GWO algorithm.

Description	Pseudocode
Set up optimization	Dimension of the given problems
	Limitations of the given problems
	Population size
	Controlling parameter
	Stop criterion (maximum iteration times or admissible errors)
Initialization	Positions of all of the grey wolves including α, β, and δ wolves
Searching	While not the stop criterion, calculate the new fitness function
	Update the positions
	Limit the scope of positions
	Refresh α, β, and δ
	Update the stop criterion
	End

2.2. Proposed Variable Weights and Their Governing Equations

We can see from the governing equation (5) that the dominants play a same role in the searching process; every one of the grey wolves approaches or runs away from the dominants with an average weight of the alpha, beta, and delta. However, although the alpha is the nearest to the prey at the beginning of the search, it might be far away from the final result, let alone the beta and delta. Therefore, at the beginning of the searching procedure, only the position of the alpha should be considered in equation (5), or its weight should be much larger than those of other dominants. On the contrary, the averaging weight in equation (5) is also against the social hierarchy hypothesis of the grey wolves. If the social hierarchy is strictly followed in the pack, the alpha is the leader and he/she might be always the nearest one to the prey. The alpha wolf should be the most important, which means that the weight of alpha’s position in equation (5) should be always no less than those of the beta and the delta. And consequently, the weight of the beta’s position should be always no less than that of the delta. Based on these considerations, we further hypothesize the following:

(1)

The searching and hunting process are always governed by the alpha, the beta plays a less important role, and the delta plays a much less role. All of the other grey wolves transfer his/her position to the alpha if he/she gets the best.

 

It should be noted that, in real searching and hunting procedures, the best position is nearest to the prey, while in optimization for a global optimum of a given problem, the best position is the maximum or minimum of the fitness value under given restrictions.

(2)

During the searching process, a hypothesized prey is always surrounded by the dominants, while in hunting process, a real prey is encircled. The dominant grey wolves are at positions surrounding the prey in order of their social hierarchy. This means that the alpha is the nearest one among the grey wolves; the beta is the nearest one in the pack except for the alpha; and the delta ranks the third. The omega wolves are involved in the processes, and they transfer their better positions to the dominants.

With hypothesis mentioned hereinbefore, the update method of the positions should not be considered the same in equation (5).

When the search begins, the alpha is the nearest, and the rest are all not important. So, his/her position should be contributed to the new searching individuals, while all of the others could be ignored. This means that the weight of the alpha should be near to 1.0 at the beginning, while the weights of the beta and delta could be near zero at this time. At the final state, the alpha, beta, and the delta wolves should encircle the prey, which means they have an equal weight, as mentioned in equation (5). Along with the searching procedure from the beginning to the end, the beta comes up with the alpha as he/she always rank the second, and the delta comes up with the beta due to his/her third rank. This means that the weights of the beta and delta arise along with the cumulative iteration number. So, the weight of the alpha should be reduced, and the weights of the beta and delta arise.

The above ideas could be formulated in mathematics. First of all, all of the weights should be varied and limited to 1.0 when they are summed up. Equation (5) is then changed as follows:$$\begin{array}{c}\text{(8)}& \overrightarrow{X}\left(t+1\right)=w_1\overrightarrow{X_1}+w_2\overrightarrow{X_2}+w_3\overrightarrow{X_3},w_1+w_2+w_3=1.\end{array}$$

Secondly, the weight of the alpha $w_1$, that of the beta $w_2$, and that of the delta $w_3$, should always satisfy $w_1\ge w_2\ge w_3$. Mathematically speaking, the weight of the alpha would be changed from 1.0 to 1/3 along with the searching procedure. And at the same time, the weights of the beta and delta would be increased from 0.0 to 1/3. Generally speaking, a cosine function could be introduced to describe w₁ when we restrict an angle θ to vary in [0, arccos(1/3)].

Thirdly, the weights should be varied with the cumulative iteration number or “it”. And we know that $w_2\cdot w_3⟶0$ when it = 0 and $w_1,w_2,w_3⟶1/3$ when it ⟶ ∞. So, we introduce an arc-tangent function about it which would be varying from 0.0 to π/2. And magically sin (π/4) = cos (π/4) = $\sqrt{2}/2$, so another angular parameter φ was introduced as follows:$$\begin{array}{}\text{(9)}& \phi =\frac{1}{2}\arctan \left(\text{it}\right).\end{array}$$

Considering $w_2$ would be increased from 0.0 to 1/3 along with it, we hypothesize that it contains sin θ and cos φ and θ ⟶ arccos(1/3) when it ⟶ ∞; therefore,$$\begin{array}{}\text{(10)}& \theta =\frac{2}{\pi }\arccos \frac{1}{3}\cdot \arctan \left(\text{it}\right),\end{array}$$when it ⟶ ∞, θ ⟶ arccos (1/3), $w_2$ = 1/3, we can then formulate $w_2$ in details. Based on these considerations, a new update method of the positions with variable weights is proposed as follows:$$\begin{array}{c}\text{(11)}& w_1=\cos \theta ,w_2=\frac{1}{2}\sin \theta \cdot \cos \phi ,\\ w_3=1-w_1-w_2.\end{array}$$

The curve of the variable weights is drawn in Figure 1. We can then find that the variable weights satisfy the hypothesis, the social hierarchy of the grey wolves’ functions in their behavior of searching.

[figure omitted; refer to PDF]

2.3. Proposed Declined Exponentially Governing Equation of the Controlling Parameter

In equation (7), the controlling parameter is declined linearly from two to zero when the iterations are carrying on from zero to the maximum N. However, an optimization is usually ended with a maximum admissible error (MAE) which is requested in engineering. This also means that the maximum iteration number N is unknown.

Furthermore, the controlling parameter is a restriction parameter for A, who is responsible for the grey wolf to approach or run away from the dominants. In other words, the controlling parameter governs the grey wolves to search globally or locally in the optimizing process. The global search probability is expected to be larger when the search begins; and consequently, the local search probability is expected to be larger when the algorithm is approaching the optimum. Therefore, to obtain a better performance of the GWO algorithm, the controlling parameter is expected to be decreased quickly when the optimization starts and converge to the optimum very fast. On the contrary, some grey wolves are expected to remain global searching to avoid being trapped in local optima. Considering these reasons, a controlling parameter declined exponentially [44] is introduced as described below:$$\begin{array}{}\text{(12)}& \alpha ={\alpha }_m{e}^{-\text{it}/M},\end{array}$$where $a_m$ is the maximum value and $M$ is an admissible maximum iteration number. The parameter $M$ restricts the algorithm to avoid long time running and nonconvergence. It is expected to be larger than 10⁴ or 10⁵ based on nowadays computing hardware used in most laboratories.

3. Empirical Studies and the Experiments Prerequisite

The goal of experiments is to verify the advantages of the improved GWO algorithm with variable weights (VW-GWO) with comparisons to the standard GWO algorithm and other metaheuristic algorithms in this paper. Classically, optimization algorithms are applied to optimize benchmark functions which were used to describe the real problems human meet.

3.1. Empirical Study of the GWO Algorithm

Although there are less numbers of parameters in the GWO algorithm than that in other algorithms such as the ALO, PSO, and bat algorithm (BA) [45], the suitable values of the parameters remain important for the algorithm to be efficient and economic. Empirical study has been carried out, and results show that the population size is expected to be 20∼50 balancing the computing complexity and the convergent rate. In an empirical study on the parameters of the maximum value a_m, the sphere function (F1) and Schwefel’s problems 2.22 (F2) and 1.2 (F3) are optimized to find the relationship between a_m and the mean least iteration times with a given error tolerance of 10⁻²⁵, as shown in Figure 2.

[figure omitted; refer to PDF]

We can know from Figure 2 the following: (1) the maximum value a_m of the controlling parameter a influences the MLIT under a given MAE; when a_m is smaller than 1.0, the smaller the a_m is, the more the MLIT would be needed. On the contrary, if the a_m is larger than 2.5, the larger the a_m is, the more the MLIT would be needed. (2) a_m should be varied in [1.0, 2.5], and a_m is found to be the best when it is 1.6 or 1.7.

3.2. Benchmark Functions

Benchmark functions are standard functions which are derived from the research on nature. They are usually diverse and unbiased, difficult to be solved with analytical expressions. The benchmark functions have been an essential way to test the reliability, efficiency, and validation of optimization algorithms. They varied from the number of ambiguous peaks in the function landscape, the shape of the basins or valleys, reparability to the dimensional. Mathematically speaking, the benchmark functions can be classified with the following five attributes [46].

(a)

Continuous or uncontinuous: most of the functions are continuous, but some of them are not.

(b)

Differentiable or nondifferentiable: some of the functions can be differenced, but some of them not.

(c)

Separable or nonseparable: some of the functions can be separated, but some of them are not.

(d)

Scalable or nonscalable: some of the functions can be expanded to any dimensional, but some of them are fixed to two or three dimensionalities.

(e)

Unimodal or multimodal: some of the functions have only one peak in their landscape, but some of them have many peaks. The former attribute is called unimodal, and the latter is multimodal.

There are 175 benchmark functions, being summarized in literature [46]. In this paper, we choose 11 benchmark functions from simplicity to complexity including all of the above five characteristics. They would be fitted to test the capability of the involved algorithms, as listed in Table 2, and they are all scalable.

Table 2

Benchmark functions to be fitted.

Label	Function name	Expressions	Domain [lb, ub]
F1	De Jong’s sphere	$y={\sum }_{i=1}^n{x}_i^2$	[−100, 100]
F2	Schwefel’s problems 2.22	$y={\sum }_{i=1}^n\lfloor x_i\rfloor +{\prod }_{i=1}^n\lfloor x_i\rfloor$	[−100, 100]
F3	Schwefel’s problem 1.2	$y={\sum }_{i=1}^n{\sum }_{j=1}^i{x}_j^2$	[−100, 100]
F4	Schwefel’s problem 2.21	$y=\underset{1\le i\le n}{\max }\lfloor x_i\rfloor$	[−100, 100]
F5	Chung Reynolds function	$y={\left({\sum }_{i=1}^n{x}_i^2\right)}^2$	[−100, 100]
F6	Schwefel’s problem 2.20	$y={\sum }_{i=1}^n\lfloor x_i\rfloor$	[−100, 100]
F7	Csendes function	$y={\sum }_{i=1}^n{x}_i^2\left(2+\sin \left(1/x_i\right)\right)$	[−1, 1]
F8	Exponential function	$y=-e^{-0.5{\sum }_{i=1}^n{x}_i^2}$	[−1, 1]
F9	Griewank’s function	$y={\sum }_{i=1}^n\left(x_i^2/4000\right)-{\prod }_{i=1}^n\cos \left(x_i/\sqrt{i}\right)+1$	[−100, 100]
F10	Salomon function	$y=1-\cos \left(2\pi \sqrt{{\sum }_{i=1}^n{x}_i^2}\right)+0.1\sqrt{{\sum }_{i=1}^n{x}_i^2}$	[−100, 100]
F11	Zakharov function	$y={\sum }_{i=1}^n{x}_i^2+{\left({\sum }_{i=1}^{n}0.5i{x}_i\right)}^2+{\left({\sum }_{i=1}^{n}0.5i{x}_i\right)}^4$	[−5, 10]

The functions are all n-dimensional, and their input vectors x = (x₁, x₂, …, x_n) are limited by the domain. Values in the domain are maximum to be ub and minimum to be lb. The single result values are all zeros theoretically for simplicity.

4. Results and Discussion

There are 11 benchmark functions being involved in this study. Comparisons are made with the standard grey wolf optimization algorithm (std. GWO) and three other bionic methods such as the ant lion optimization algorithm (ALO), the PSO algorithm, and BA.

4.1. General Reviews of the Algorithms

The randomness is all involved in the algorithms studied in this paper, for example, the random positions, random velocities, and random controlling parameters. The randomness causes the fitness values obtained during the optimization procedure to fluctuate. So, when an individual of the swarm is initialized or it randomly jumps to a position quite near the optimum, the best fitness value would be met. Table 3 lists the best and worst fitness results of some chosen benchmark functions and their corresponding algorithms. During this experiment, 100 Monte Carlo (MC) simulations are carried out for every benchmark function. The results show that the randomness indeed leads to some random work, but at most of the time, the final results would be more dependent on the algorithms.

Table 3

The best and worst simulation results and their corresponding algorithms (dim = 2).

Functions	Value	Corresponding algorithm
Best fitness
F1	1.4238e − 70	VM-GWO
F2	3.2617e − 36	VM-GWO
F3	3.6792e − 68	VM-GWO
F4	3.3655e − 66	Std. GWO
F7	7.8721e − 222	VM-GWO
F8	0	VM-GWO, Std. GWO, PSO, BA
F9	0	VM-GWO, Std. GWO
F11	2.6230e − 69	VM-GWO
Worst fitness
F1	1.0213e − 07	BA
F2	4.1489e − 04	BA
F3	5.9510e − 08	BA
F4	2.4192e − 06	PSO
F7	1.0627e − 24	BA
F8	5.7010e − 13	BA
F9	1.0850e − 01	ALO
F11	9.9157e − 09	BA

The GWO algorithms always work the best at first glance of Table 3, either the VM-GWO or the std. GWO algorithm could optimize the benchmark functions best to its optima with little absolute errors, while the proposed VM-GWO algorithm is almost always the best one. Other compared algorithms such as the PSO, ALO algorithms, and the BA would lead to the worst results at most time. These mean that the GWO algorithms are more capable, and the proposed VM-GWO algorithm is indeed improving the capability of the std. GWO algorithm. A figure about the absolute errors averaged over MC = 100 versus iterations could also lead to this conclusion, as shown in Figure 3.

[figure omitted; refer to PDF]

The convergence rate curve during the iterations of F3 benchmark function is demonstrated in Figure 3. It shows that the proposed VM-GWO algorithm would result in faster converging, low residual errors, and stable convergence.

4.2. Comparison, Statistical Analysis, and Test

General acquaintances of the metaheuristic algorithms might be got from Table 3 and Figure 3. However, the optimization problems often demand the statistical analysis and test. To do this, 100 MC simulations are carried out on the benchmark functions. The benchmark functions are all two dimensional, and they are optimized by the new proposed VM-GWO and other four algorithms over 100 times. Causing the benchmark functions are all concentrated to zeros, and the simulated fitness results are also their absolute errors. The mean values of the absolute errors and the standard deviations of the final results are listed in Table 4; some of the values are quoted from the published jobs, and references are listed correspondingly.

Table 4

Statistical analysis on the absolute errors of the selected functions (dim = 2).

Functions	VM-GWO		Std. GWO		ALO		PSO		BA
	Mean	Std. deviation	Mean	Std. deviation	Mean	Std. deviation	Mean	Std. deviation	Mean	Std. deviation
F1	7.2039e − 66	3.5263e − 65	6.59E − 28	6.34E − 5 [27]	2.59E − 10	1.65E − 10 [2]	1.36E − 4	2.02E − 4 [27]	0.773622	0.528134 [2]
F2	1.3252e − 34	3.5002e − 34	7.18E − 17	0.02901 [27]	1.84241E − 6	6.58E − 7 [2]	0.042144	0.04542 [27]	0.334583	3.186022 [2]
F3	3.7918e − 60	1.1757e − 59	3.29E − 6	79.1496 [27]	6.0685E − 10	6.34E − 10 [2]	70.12562	22.1192 [27]	0.115303	0.766036 [2]
F4	2.2262e − 46	2.8758e − 46	5.61E − 7	1.31509 [27]	1.36061E − 8	1.81E − 9 [2]	0.31704	7.3549 [27]	0.192185	0.890266 [2]
F5	3.6015e − 131	9.0004e − 131	7.8319e − 97	2.4767e − 96	2.1459e − 20	2.8034e − 20	8.4327e − 20	1.7396e − 19	1.7314e − 17	4.9414e − 17
F9	0.0047	0.0040	0.00449	0.00666 [27]	0.0301	0.0329	0.00922	0.00772 [27]	0.0436	0.0294
F10	0.0200	0.0421	0.0499	0.0526	0.01860449	0.009545 [2]	0.273674	0.204348 [2]	1.451575	0.570309 [2]
F11	1.2999e − 60	4.1057e − 60	6.8181e − 35	1.5724e − 34	1.1562e − 13	1.2486e − 13	2.3956e − 12	3.6568e − 12	5.0662e − 09	4.9926e − 09

The proposed VM-GWO algorithm and its compared algorithms are almost all capable of searching the global optima of the benchmark functions. The detailed values in Table 4 show that the standard deviations of the 100 MC simulations are all small. We can further draw the following conclusions:

(1)

All of the algorithms involved in this study were able to find the optimum.

(2)

All of the benchmark functions tested in this experiment could be optimized, whether they are unimodal or multimodal, under the symmetric or unsymmetric domain.

(3)

Comparatively speaking, although the bat algorithm is composed of much more randomness, it did the worst job. The PSO and the ALO algorithm did a little better.

(4)

The GWO algorithms implement the optimization procedure much better. The proposed VM-GWO algorithm optimized most of the benchmark functions involved in this simulation at the best, and it did much better than the standard algorithm.

Therefore, the proposed VM-GWO algorithm is better performed in optimizing the benchmark functions than the std. GWO algorithm as well as the ALO, PSO algorithm, and the BA, which can be also obtained from the Wilcoxon rank sum test [47] results, as listed in Table 5.

Table 5

$p$ values of the Wilcoxon rank sum test for VM-GWO over benchmark functions (dim = 2).

	F1	F2	F3	F4	F5	F6	F7	F8	F9	F10	F11
Std. GWO	0.000246	0.00033	0.000183	0.00044	0.000183	0	0.000183	—	0.466753	0.161972	0.000183
PSO	0.000183	0.000183	0.000183	0.000183	0.472676	0	0.000183	0.167489	0.004435	0.025748	0.000183
ALO	0.000183	0.000183	0.000183	0.000183	0.472676	0	0.000183	0.36812	0.790566	0.025748	0.000183
BA	0.000183	0.000183	0.000183	0.000183	0.000183	0	0.000183	0.000747	0.004435	0.01133	0.000183

In Table 5, the $p$ values of the Wilcoxon rank sum test is reported and show that the proposed VM-GWO algorithm has superiority over most of the benchmark functions except F5: Rosenbrock function.

4.3. Mean Least Iteration Times (MLIT) Analysis over Multidimensions

Compared with other bionic algorithms, the GWO algorithm has fewer numbers of parameter. Compared with the std. GWO algorithm, the proposed VM-GWO algorithm does not generate additional uncontrolling parameters. It furthermore improves the feasibility of the std. GWO algorithm by introducing an admissible maximum iteration number. On the contrary, there are large numbers of randomness in the compared bionic algorithms such as the ALO, PSO algorithms, and the BA. Therefore, the proposed algorithm is expected to be fond by the engineers, who need the fastest convergence, the most precise results, and which are under most control. Thus, there is a need to verify the proposed algorithm to be fast convergent, not only a brief acquaintance from Figure 3.

Generally speaking, the optimization algorithms are usually used to find the optima under constrained conditions. The optimization procedure must be ended in reality, and it is expected to be as faster as capable. The admissible maximum iteration number M forbids the algorithm to be run endlessly, but the algorithm is expected to be ended quickly at the current conditions. This experiment will calculate the mean least iteration times (MLIT) under a maximum admissible error. The absolute values of MAE are constrained to be less than 1.0 × 10⁻³ and M = 1.0 × 10⁵. In this experiment, 100 MC simulations are carried out, and for simplicity, not all classical benchmark functions are involved in this experiment. The final statistical results are listed in Tables 6–8. Note that the complexity of the ALO algorithm is very large, and it is time exhausted based on the current simulation hardware described in Appendix. So, it is not included in this experiment.

Table 6

MLITs and statistical results for F1.

dim	Algorithm	Best	Worst	Mean	t-test (α = 0.05)	Std. deviation	Number
2	VW-GWO	6	12	9.90	1.7180e − 193	1.0493	100
	Std. GWO	7	13	10.38	1.8380e − 22	1.2291	100
	PSO	48	1093	357.97	3.2203e − 22	205.3043	100
	BA	29	59	41.00	1.3405e − 101	5.8517	100
10	VW-GWO	53	66	59.97	4.1940e − 177	2.7614	100
	Std. GWO	74	89	80.40	1.9792e − 80	2.7614	100
	PSO	5713	11510	9279.22	2.9716e − 76	1300.8485	88
	BA	6919	97794	44999.04	7.5232e − 26	25133.3096	78
30	VW-GWO	55	67	59.85	1.2568e − 122	2.4345	100
	Std. GWO	71	86	80.07	2.6197e − 79	3.3492	100
	PSO	5549	12262	9314.78	9.6390e − 83	1316.3384	96
	BA	7238	92997	44189.16	5.2685e − 26	24831.7443	79

Table 7

MLITs and statistical results for F7.

dim	Algorithm	Best	Worst	Mean	t-test (α = 0.05)	Std. deviation	Number
2	VW-GWO	1	3	1.46	6.3755e − 226	0.5397	100
	Std. GWO	1	2	1.41	1.0070e − 229	0.4943	100
	PSO	2	2	2.00	0	0	100
	BA	1	3	1.02	8.5046e − 269	0.200	100
10	VW-GWO	5	9	7.65	5.7134e − 199	0.9468	100
	Std. GWO	5	11	7.48	5.1288e − 191	1.1413	100
	PSO	4	65	24.23	1.6196e − 85	10.9829	100
	BA	13	49	25.29	5.9676e − 109	6.2366	100
30	VW-GWO	13	22	17.14	9.6509e − 167	1.7980	100
	Std. GWO	15	30	20.80	1.3043e − 148	2.6208	100
	PSO	54	255	133.32	5.7600e − 12	42.5972	100
	BA	40	101	62.68	1.8501e − 53	11.8286	100

Table 8

MLITs and statistical results for F11.

dim	Algorithm	Best	Worst	Mean	t-test (α = 0.05)	Std. deviation	Number
2	VW-GWO	3	9	6.63	5.6526e − 188	1.2363	100
	Std. GWO	4	10	6.66	3.5865e − 186	1.2888	100
	PSO	6	125	46.35	1.6006e − 37	26.0835	100
	BA	5	62	27.58	1.6166e − 83	11.0080	100
10	VW-GWO	10	200	65.57	2.8562e − 12	43.2281	100
	Std. GWO	14	246	68.68	2.6622e − 11	41.7104	100
	PSO	15	1356	231.74	1.2116e − 6	257.1490	94
	BA	15	214	113.19	5.1511e − 2	66.9189	100
30	VW-GWO	49	1179	312.24	1.2262e − 18	194.7643	100
	Std. GWO	65	945	294.45	3.1486e − 21	160.7119	100
	PSO	32	5005	1086.11	6.0513e − 13	980.3386	72
	BA	66	403	221.60	1.9072e − 51	40.5854	100

Table 8 lists the MLIT data when VW-GWO, std. GWO, PSO algorithm, and BA are applied to the unimodal benchmark function F1. The best, worst, and the standard deviation MLIT values are listed. The mean values are also calculated, and t-tested are carried out with α = 0.05. The last column lists the remaining MC simulation numbers discarding all of the data when the searching processes reach the admissible maximum iteration number M. The final results demonstrate the best performance of the proposed VM-GWO algorithm on unimodal benchmark functions compared to other four algorithms involved. The data in Tables 6–8 are under the same conditions, and only difference is that Table 6 lists the data obtained when the algorithms are applied to a multimodal benchmark function with the symmetrical domain. However, Table 8 lists the data obtained when the algorithms applied to a multimodal benchmark function with the unsymmetrical domain. A same conclusion could be drawn.

Note that, in this experiment, the dimensions of the benchmark functions are varied from 2 to 10 and 30. The final results also show that if the dimensions of the benchmark functions are raised, the MLIT values would be increased dramatically. This phenomenon would lead to the doubt whether it also performs the best and is capable to solve high-dimensional problems.

4.4. High-Dimensional Availability Test

Tables 6–8 show that the larger the dimensions are, the more the MLIT values would be needed to meet to experiment constraints. However, as described in the first part, the optimization algorithms are mostly developed to solve the problems with huge number of variables, massive complexity, or having no analytical solutions. Thus, the high-dimensional availability is quite interested. As described in the standard GWO algorithm, the proposed VM-GWO algorithm should also have the merits to solve the large-scale problems. An experiment with dim = 200 is carried out to find the capability of the algorithms solving the high-dimensional problems. For simplicity, three classical benchmark functions, such as F4: Schwefel’s problem 2.21 function, F8: exponential function, and F11: Zakharov function, are used to demonstrate the results, as listed in Table 9. The final results of 100 MC experiments will be evaluated and counted, and each time the search procedure will be also iterated for a hundred times.

Table 9

Statistical analysis on the absolute errors of the selected functions (dim = 200).

Functions	VM-GWO		Std. GWO		ALO		PSO		BA
	Mean	Std. deviation	Mean	Std. deviation	Mean	Std. deviation	Mean	Std. deviation	Mean	Std. deviation
F4	3.3556e − 53	8.7424e − 53	1.6051e − 46	2.2035e − 46	4.2333e − 07	2.9234e − 07	3.0178e − 07	6.5449e − 07	1.6401e − 07	2.1450e − 07
F8	0	0	0	0	3.3307e − 17	7.4934e − 17	1.1102e − 17	3.5108e − 17	1.4466e − 14	1.9684e − 14
F11	0.0115	0.0193	0.0364	0.0640	8.3831	10.3213	12.6649	13.0098	4.7528e + 16	2.8097e + 16

The data listed in Table 9 show that the GWO algorithms would be quickly convergent, and the proposed algorithm is the best to solve the large-scale problems.

To test its capability even further, we also carry out an experiment to verify the capability solving some benchmark function in high dimensions with restrictions MC = 100 and MLIT = 500. In this experiment, we change the dimensions from 100 to 1000, and the final results which are also the absolute errors averaged over MC times, being shown in Figure 4.

[figure omitted; refer to PDF]

We can see from Figure 4 that the VM-GWO is capable to solve high-dimensional problems.

5. Conclusions

In this paper, an improved grey wolf optimization (GWO) algorithm with variable weights (VW-GWO algorithm) is proposed. A hypothesize is made that the social hierarchy of the packs would also be functional in their searching positions. And variable weights are then introduced to their searching process. To reduce the probability of being trapped in local optima, a governing equation of the controlling parameter is introduced, and thus, it is declined exponentially from the maximum. Finally, three types of experiments are carried out to verify the merits of the proposed VW-GWO algorithm. Comparisons are made to the original GWO and the ALO, PSO algorithm, and BA.

All the selected experiment results show that the proposed VW-GWO algorithm works better under different conditions than the others. The variance of dimensions cannot change its first position among them, and the proposed VW-GWO algorithm is expected to be a good choice to solve the large-scale problems.

However, the proposed improvements are mainly focusing on the ability to converge. It leads to faster convergence and wide applications. But it is not found to be capable for all the benchmark functions. Further work would be needed to tell the reasons mathematically. Other initializing algorithms might be needed to let the initial swarm individuals spread all through the domain, and new searching rules when the individuals are at the basins would be another hot spot of future work.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

Zheng-Ming Gao formulated the governing equations of variable weights, constructed the work, and wrote the paper. Juan Zhao proposed the idea on the GWO algorithm and programmed the work with Matlab. Her major contribution is in the programmed work and the proposed declined exponentially governing equations of the controlling parameter. Juan Zhao contributed equally to this work.

Acknowledgments

This work was supported in part by Natural Science Foundation of Jingchu University of Technology with grant no. ZR201514 and the research project of Hubei Provincial Department of Education with grant no. B2018241.

Appendix

Appendix

The simulation platform, as described in Section 3.3, is run on an assembled desktop computer being configured as follows: CPU: Xeon E3-1231 v3; GPU: NVidia GeForce GTX 750 Ti; memory: DDR3 1866 MHz; motherboard: Asus B85-Plus R2.0; hard disk: Kingston SSD.

References

[1] D. H. Wolpert, W. G. Macready, "No free lunch theorems for optimization," IEEE Transactions on Evolutionary Computation, vol. 1 no. 1, pp. 67-82, DOI: 10.1109/4235.585893, 1997.

[2] S. Mirjalili, "The ant lion optimizer," Advances in Engineering Software, vol. 83, pp. 80-98, DOI: 10.1016/j.advengsoft.2015.01.010, 2015.

[3] Y. Xin-She, Nature-Inpsired Optimization Algorithms, 2014.

[4] H. Zang, S. Zhang, K. Hapeshi, "A review of nature-inspired algorithms," Journal of Bionic Engineering, vol. 7 no. 4, pp. S232-S237, DOI: 10.1016/s1672-6529(09)60240-7, 2010.

[5] X. S. Yang, S. F. Chien, T. O. Ting, "Chapter 1-bio-inspired computation and optimization: an overview," Bio-Inspired Computation in Telecommunications, 2015.

[6] A. Syberfeldt, S. Lidberg, "Real-world simulation-based manufacturing optimization using cuckoo search, simulation conference (WSC)," Proceedings of the 2012 Winter Simulation Conference (WSC), .

[7] L. D. S. Coelho, V. C. Mariani, "Improved firefly algorithm approach applied to chiller loading for energy conservation," Energy and Buildings, vol. 59, pp. 273-278, DOI: 10.1016/j.enbuild.2012.11.030, 2013.

[8] C. W. Reynolds, "Flocks, herds and schools: a distributed behavioral model," ACM SIGGRAPH Computer Graphics, vol. 21 no. 4, pp. 25-34, DOI: 10.1145/37402.37406, 1987.

[9] Z. Juan, G. Zheng-Ming, The Bat Algorithm and Its Parameters, Electronics, Communications and Networks IV, 2015.

[10] J. J. Q. Yu, V. O. K. Li, "A social spider algorithm for global optimization," Applied Soft Computing, vol. 30, pp. 614-627, DOI: 10.1016/j.asoc.2015.02.014, 2015.

[11] R. Azizi, "Empirical study of artificial fish swarm algorithm," International Journal of Computing, Communications and Networking, vol. 3 no. 1–3, 2014.

[12] L. Yan-Xia, L. Lin, Zhaoyang, "Improved ant colony algorithm for evaluation of graduates’ physical conditions, measuring technology and mechatronics automation (ICMTMA)," Proceedings of the 2014 Sixth International Conference on Measuring Technology and Mechatronics Automation, pp. 333-336, .

[13] Z. Xiu, Z. Xin, S. L. Ho, W. N. Fu, "A modification of artificial bee colony algorithm applied to loudspeaker design problem," IEEE Transactions on Magnetics, vol. 50 no. 2, pp. 737-740, DOI: 10.1109/tmag.2013.2281818, 2014.

[14] M. K. Marichelvam, T. Prabaharan, X. S. Yang, "A discrete firefly algorithm for the multi-objective hybrid flowshop scheduling problems," IEEE Transactions on Evolutionary Computation, vol. 18 no. 2, pp. 301-305, DOI: 10.1109/tevc.2013.2240304, 2014.

[15] Y. A. N. Chun-man, G. U. O. Bao-long, W. U. Xian-xiang, "Empirical study of the inertia weight particle swarm optimization with constraint factor," International Journal of Soft Computing and Software Engineering [JSCSE], vol. 2 no. 2, 2012.

[16] Y. Shi, R. C. Eberhart, "Empirical study of particle swarm optimization," Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), pp. 345-357, .

[17] S. Yılmaz, E. U. Küçüksille, "A new modification approach on bat algorithm for solving optimization problems," Applied Soft Computing, vol. 28, pp. 259-275, DOI: 10.1016/j.asoc.2014.11.029, 2015.

[18] A. Basak, D. Maity, S. Das, "A differential invasive weed optimization algorithm for improved global numerical optimization," Applied Mathematics and Computation, vol. 219 no. 12, pp. 6645-6668, DOI: 10.1016/j.amc.2012.12.057, 2013.

[19] X. Yuan, T. Zhang, Y. Xiang, X. Dai, "Parallel chaos optimization algorithm with migration and merging operation," Applied Soft Computing, vol. 35, pp. 591-604, DOI: 10.1016/j.asoc.2015.05.050, 2015.

[20] M. Kang, J. Kim, J. M. Kim, "Reliable fault diagnosis for incipient low-speed bearings using fault feature analysis based on a binary bat algorithm," Information Sciences, vol. 294, pp. 423-438, DOI: 10.1016/j.ins.2014.10.014, 2015.

[21] Z. Chen, Y. Zhou, M. Lu, "A simplied adaptive bat algorithm based on frequency," Journal of Computational Information Systems, vol. 9, pp. 6451-6458, 2013.

[22] J. H. Holland, Adaptation in Natural and Artificial Systems, 1975.

[23] N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, "Equation of state calculations by fast computing machines," Journal of Chemical Physics, vol. 21 no. 6, pp. 1087-1092, DOI: 10.1063/1.1699114, 1953.

[24] M. Dorigo, M. Birattari, "Ant colony optimization," IEEE Computational Intelligence Magazine, vol. 1 no. 4, pp. 28-39, DOI: 10.1109/mci.2006.329691, 2006.

[25] X. S. Yang, "A new metaheuristic bat-inspired algorithm," Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), 2010.

[26] H. Haklı, H. Uğuz, "A novel particle swarm optimization algorithm with Levy flight," Applied Soft Computing, vol. 23, pp. 333-345, DOI: 10.1016/j.asoc.2014.06.034, 2014.

[27] S. Mirjalili, S. M. Mirjalili, A. Lewis, "Grey wolf optimizer," Advances in Engineering Software, vol. 69, pp. 46-61, DOI: 10.1016/j.advengsoft.2013.12.007, 2014.

[28] G. M. Komaki, V. Kayvanfar, "Grey wolf optimizer algorithm for the two-stage assembly flow shop scheduling problem with release time," Journal of Computational Science, vol. 8, pp. 109-120, DOI: 10.1016/j.jocs.2015.03.011, 2015.

[29] Y. Sharma, L. C. Saikia, "Automatic generation control of a multi-area ST-thermal power system using grey wolf optimizer algorithm based classical controllers," International Journal of Electrical Power & Energy Systems, vol. 73, pp. 853-862, DOI: 10.1016/j.ijepes.2015.06.005, 2015.

[30] B. Mahdad, K. Srairi, "Blackout risk prevention in a smart grid based flexible optimal strategy using grey wolf-pattern search algorithms," Energy Conversion and Management, vol. 98, pp. 411-429, DOI: 10.1016/j.enconman.2015.04.005, 2015.

[31] X. Song, L. Tang, S. Zhao, "Grey wolf optimizer for parameter estimation in surface waves," Soil Dynamics and Earthquake Engineering, vol. 75, pp. 147-157, DOI: 10.1016/j.soildyn.2015.04.004, 2015.

[32] N. Jayakumar, S. Subramanian, S. Ganesan, E. B. Elanchezhian, "Grey wolf optimization for combined heat and power dispatch with cogeneration systems," International Journal of Electrical Power & Energy Systems, vol. 74, pp. 252-264, DOI: 10.1016/j.ijepes.2015.07.031, 2016.

[33] S. A. Medjahed, T. A. Saadi, A. Benyetto, M. Ouali, "Gray wolf optimizer for hyperspectral band selection," Applied Soft Computing, vol. 40, pp. 178-186, DOI: 10.1016/j.asoc.2015.09.045, 2016.

[34] E. Emary, H. M. Zawbaa, A. E. Hassanien, "Binary grey wolf optimization approaches for feature selection," Neurocomputing, vol. 172, pp. 371-381, DOI: 10.1016/j.neucom.2015.06.083, 2016.

[35] D. Guha, P. K. Roy, S. Banerjee, "Load frequency control of interconnected power system using grey wolf optimization," Swarm and Evolutionary Computation, vol. 27, pp. 97-115, DOI: 10.1016/j.swevo.2015.10.004, 2016.

[36] M. H. Sulaiman, Z. Mustaffa, M. R. Mohamed, O. Aliman, "Using the gray wolf optimizer for solving optimal reactive power dispatch problem," Applied Soft Computing, vol. 32, pp. 286-292, DOI: 10.1016/j.asoc.2015.03.041, 2015.

[37] S. Mirjalili, S. Saremi, S. M. Mirjalili, L. D. S. Coelho, "Multi-objective grey wolf optimizer: a novel algorithm for multi-criterion optimization," Expert Systems with Applications, vol. 47, pp. 106-119, DOI: 10.1016/j.eswa.2015.10.039, 2016.

[38] E. Emary, W. Yamany, A. E. Hassanien, V. Snasel, "Multi-objective gray-wolf optimization for attribute reduction," Procedia Computer Science, vol. 65, pp. 623-632, DOI: 10.1016/j.procs.2015.09.006, 2015.

[39] S. Saremi, S. Z. Mirjalili, S. M. Mirjalili, "Evolutionary population dynamics and grey wolf optimizer," Neural Computing and Applications, vol. 26 no. 5, pp. 1257-1263, DOI: 10.1007/s00521-014-1806-7, 2015.

[40] R. E. Precup, R. C. David, E. M. Petriu, A. I. Szedlak-Stinean, C. A. Bojan-Dragos, "Grey wolf optimizer-based approach to the tuning of pi-fuzzy controllers with a reduced process parametric sensitivity," IFAC-PapersOnLine, vol. 49 no. 5, pp. 55-60, DOI: 10.1016/j.ifacol.2016.07.089, 2016.

[41] A. Noshadi, J. Shi, W. S. Lee, P. Shi, A. Kalam, "Optimal PID-type fuzzy logic controller for a multi-input multi-output active magnetic bearing system," Neural Computing and Applications, vol. 27 no. 7, pp. 2031-2046, DOI: 10.1007/s00521-015-1996-7, 2016.

[42] P. B. de Moura Oliveira, H. Freire, E. J. Solteiro Pires, "Grey wolf optimization for PID controller design with prescribed robustness margins," Soft Computing, vol. 20 no. 11, pp. 4243-4255, DOI: 10.1007/s00500-016-2291-y, 2016.

[43] S. Khalilpourazari, S. Khalilpourazary, "Optimization of production time in the multi-pass milling process via a Robust Grey Wolf Optimizer," Neural Computing and Applications, vol. 29 no. 12, pp. 1321-1336, DOI: 10.1007/s00521-016-2644-6, 2018.

[44] R. El Sehiemy, A. Shaheen, A. Abou El-Ela, "Multi-objective fuzzy-based procedure for enhancing reactive power management," IET Generation, Transmission & Distribution, vol. 7 no. 12, pp. 1453-1460, DOI: 10.1049/iet-gtd.2013.0051, 2013.

[45] A. H. Gandomi, X.-S. Yang, A. H. Alavi, S. Talatahari, "Bat algorithm for constrained optimization tasks," Neural Computing and Applications, vol. 22 no. 6, pp. 1239-1255, DOI: 10.1007/s00521-012-1028-9, 2013.

[46] M. Jamil, X. S. Yang, "A literature survey of benchmark functions for global optimisation problems," International Journal of Mathematical Modelling and Numerical Optimisation, vol. 4 no. 2, pp. 150-194, DOI: 10.1504/ijmmno.2013.055204, 2013.

[47] J. Derrac, S. García, D. Molina, F. Herrera, "A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms," Swarm and Evolutionary Computation, vol. 1 no. 1,DOI: 10.1016/j.swevo.2011.02.002, 2011.