A Novel Hybrid Algorithm Based on Grey Wolf Optimizer and Fireworks Algorithm

Abstract

Grey wolf optimizer (GWO) is a meta-heuristic algorithm inspired by the hierarchy of grey wolves (Canis lupus). Fireworks algorithm (FWA) is a nature-inspired optimization method mimicking the explosion process of fireworks for optimization problems. Both of them have a strong optimal search capability. However, in some cases, GWO converges to the local optimum and FWA converges slowly. In this paper, a new hybrid algorithm (named as FWGWO) is proposed, which fuses the advantages of these two algorithms to achieve global optima effectively. The proposed algorithm combines the exploration ability of the fireworks algorithm with the exploitation ability of the grey wolf optimizer (GWO) by setting a balance coefficient. In order to test the competence of the proposed hybrid FWGWO, 16 well-known benchmark functions having a wide range of dimensions and varied complexities are used in this paper. The results of the proposed FWGWO are compared to nine other algorithms, including the standard FWA, the native GWO, enhanced grey wolf optimizer (EGWO), and augmented grey wolf optimizer (AGWO). The experimental results show that the FWGWO effectively improves the global optimal search capability and convergence speed of the GWO and FWA.

1. Introduction

Finding an optimal solution in high-dimensional complex space is a common issue in many engineering fields [1]. When solving such problems, deterministic algorithms find it difficult to find the optimal value, the calculation cost is too high, and the calculation time is too long [2]. The meta-heuristic optimization algorithm has, due to its simplicity and strong searching ability, been widely used in solving complex problems. In recent years, scholars around the world have done a lot of research on these algorithms. Many natural-inspired meta-heuristic algorithms have been proposed, such as Particle Swarm Optimization (PSO) [3], Ant Colony Optimization (ACO) [4], Artificial bee colony algorithm (ABC) [5], Whale Optimization Algorithm (WOA) [6], Bird Swarm Algorithm (BSA) [7], Grey Wolf Optimizer (GWO) [8], Fireworks Algorithm (FWA) [9], Biogeography-based optimization (BBO) [10], and Moth Flame Optimization (MFO) [11].

Inspired by the leadership hierarchy and the mechanism of hunting of grey wolves, Gray Wolf Optimizer, a new meta-heuristic optimization algorithm, was proposed by Mirjalili in 2014 [8]. The GWO algorithm mimics the hunting mechanism to search the optima. In [8], several benchmark functions are used to evaluate the performance of GWO. The experimental results show that the GWO algorithm is feasible and superior to PSO, Gravitational Search Algorithm (GSA) [12], and Differential Evolution (DE) [13] in the accuracy of the solution and convergence speed. Due to the advantages of fewer adjustment parameters and a faster convergence, the GWO algorithm has been applied in a series of engineering problems such as the speed control of DC motors [14], parameter estimation in surface waves [15], and load frequency control of the Multi-microgrid System [16]. However, when facing problems with multi optimal solutions like multidimensional feature selection, GWO converges to local optima and fails to find the global optimal solution. Inspired by observing fireworks explosions, Tan and Zhu proposed the fireworks algorithm (FWA) in 2010. FWA mimics the explosion of fireworks that produce sparks and illuminate the surrounding area. The global optimal solution was found by controlling the amplitude of the explosion and the number of sparks generated by explosion. Several benchmark functions are employed to test the competence of FWA. The experimental results [9] show that FWA has a better solution accuracy and faster convergence speed than SPSO (Standard particle swarm optimization) [17] and CPSO (Clonal particle swarm optimization) [18].

When searching for the optimal value in a high-dimensional space, the single meta-heuristic algorithm always has some disadvantages, such as a low accuracy, poor generalization ability, and poor local optima avoidance ability. The hybrid algorithm utilizes the differences between the two optimization algorithms, combines their advantages, and makes up for shortcomings to improve the overall performance of solving complex optimization problems [19]. The solution searched for by the genetic algorithm (GA) [20] is not accurate enough, and the evolutionary strategy (ES) tends to fall into a local minimum when searching for the optimal value. Therefore, a hybrid algorithm in [21] combined GA and ES to make up for these shortcomings. This algorithm is used for electromagnetic optimization problems and achieved satisfactory results. In [22], two hybrid models were established by Mafarja to design feature selection techniques based on WOA. In the first model, the simulated annealing (SA) algorithm is inserted into the WOA algorithm. In the second model, SA and WOA are used separately. SA is used to exploit the search space found by the WOA algorithm. In [23], Alomoush proposed a hybrid algorithm based on Gray Wolf Optimizer (GWO) and Harmony Search (HS). GWO is used to update the pitch adjustment rate and bandwidth in the HS to improve the global optimization capabilities of the hybrid algorithm. In [24], the grey wolf optimizer and crow search algorithm are combined by Sankalap Arora. The hybrid algorithm is tested on 21 data sets as a feature selection technique. The results show that the algorithm has many advantages in solving complex optimization problems. In [25], biogeography-based optimization (BBO) and differential evolution (DE) are fused by sharing population information. In BBO/DE, the migration operators in BBO are changed as the increase of the iteration count. The results indicate that the hybrid algorithm is more effective when compared to traditional BBO and DE. In [26], a novel hybrid algorithm combining grey wolf optimizer (GWO) with particle swarm optimization (PSO) is used as a load balancing technique in the cloud computing environment. The conclusions indicate that the hybrid algorithm improves the convergence speed and simplicity when compared with other algorithms. In [27], ZHU proposed a novel hybrid algorithm based on the grey wolf optimizer (GWO) and differential evolution (DE). This algorithm is tested on 23 benchmark functions and a non-deterministic polynomial hard problem. The experimental results show that this algorithm has a good performance in exploration. A global optimization algorithm combining biogeography-based optimization (BBO) with fireworks algorithm (FWA) is proposed in [28]. The BBO migration operators have been inserted into the FWA to enhance the information exchange between the population and to improve the global optimization capability. In [29], WOA-SCA, composed of the whale optimization algorithm (WOA) and sine cosine algorithm (SCA) is proposed. SCA and WOA are used for exploration and exploitation, respectively. The WOA-SCA optimization algorithm is used to distribute DGs (distributed generators) and DSTATCOMs (distribution flexible alternating current transmission devices) to enhance the voltage profile by minimizing the total power losses in the system.

As mentioned above, GWO advances itself strongly on exploitation. However, in some cases it converges prematurely and gets trapped in a local optimum. FWA not only has a high exploration capability, but also has the disadvantage of a slow convergence speed compared to the recent algorithms. This paper proposes a new hybrid algorithm which combines the exploration ability of FWA with the exploitation ability of GWO to increase the convergence characteristics. The major work of this paper is summarized as follows:

(1) A novel hybrid algorithm based on GWO and FWA is proposed.

(2) The proposed algorithm is tested on 16 benchmark functions with a wide range of dimensions and varied complexities.

(3)

The performance of the proposed approach is compared with standard GWO, FWA, Moth Flame Optimization (MFO), Crow Search Algorithm (CSA) [30], improved Particle Swarm Optimization(IPSO) [31], Biogeography-based optimization (BBO), Particle Swarm Optimization (PSO), Enhanced GWO (EGWO) [32], and Augmented GWO (AGWO) [33].

The rest of paper is arranged as follows: Section 2 introduces the GWO algorithm and FWA algorithm used in this paper. In Section 3, the FWGWO hybrid algorithm is proposed. Section 4 shows the experimental results and comparison of the algorithms used in the test function. Finally, the conclusions are given in Section 5.

2. Algorithms 2.1. Grey Wolf Optimizer

The Grey Wolf Optimizer (GWO) is a meta-heuristic algorithm proposed by Mirgalili et al. [8] in 2014. The GWO algorithm mimics the hunting mechanism and the leadership hierarchy of wolves to search the optima. Grey wolves are social animals, with an average of 5 to 12 wolves in each group. They also have a strict hierarchy. There are four levels in wolves’ hierarchy, called alpha (α), beta (β), delta (δ), and omega (ω). Alpha is the first level. It is responsible for making decisions like hunting, finding a place to sleep, the waking time, and so on. The second level is alpha’s candidate, the beta wolves, which help alpha in making decisions or in engaging in other activities. The third level is delta. The delta wolves are under the command of the first two levels, mainly responsible for reconnaissance, sentry, guard, and other tasks. The last level of a pack is omega. Omega wolves have to submit to the wolves in the first three levels. The omega wolves maintain the integrity of the hierarchical structure. The mathematical model of the GWO algorithm’s hierarchy and hunting behavior is as follows:

2.1.1. Hierarchical Structure

The GWO algorithm is a mathematical model based on the social hierarchy of wolves. The fittest solution found is considered as the alpha (α). The second and third best solutions are beta (β) and delta (δ), respectively. The rest of the solutions are omega (ω). In the GWO algorithm, alpha, beta, and delta collectively command omega to search for the solution space.

2.1.2. Encircling Prey

The grey wolf encircles the prey when hunting. The mathematical equations for this behavior are shown in Equations (1) and (2):

D→=|C→·_XP→(t)−X→(t)|

X→(t+1)=_XP→(t)−A→·D→

whereD→is the distance from the wolf to the prey.X→and_Xp→represent the position vector of the grey wolf and the position vector of the prey, respectively.tindicates the current iteration.A→andC→are coefficient vectors and are calculated as follows:

A→=2a→·_r1→−a→

C→=2·_r2→

wherea→decreases linearly with the number of iterations from 2 to 0._r1→and_r2→are the random vectors in [0,1].

2.1.3. Hunting

The grey wolves can easily encircle the prey with the ability to recognize its location. The whole hunting process is usually led by the alpha. However, in a complex search space, it is impossible to get the location of the prey at the beginning. Therefore, GWO consider that the first three best solutions, alpha, beta, and delta, have more information about the location of the prey. Then, the other wolves update their positions based on these three positions, as shown in Figure 1.

The mathematical equations of this phase are as follows:

_Dα→=|_C→1·_X→α−X→|,_Dβ→=|_C→2·_X→β−X→|,_Dδ→=|_C→3·_X→δ−X→|

_X→1=_X→α−_A→1·(_D→α),_X→2=_X→β−_A→2·(_D→β),_X→3=_X→δ−_A→3·(_D→δ)

_X→(t+1)=_X→1+_X→2+_X→33

where,_X→α,_X→β, and_X→δare the position vectors of alpha, beta, and delta;_Dα→,_Dβ→, and_Dδ→represent the distances from the search agent to alpha, beta, and delta respectively;_C→1,_C→2, and_C→3are coefficient vectors; and_X→1,_X→2, and_X→3are the step lengths in the direction toward alpha, beta, and delta.X→and_X→(t+1)indicate the position of the search agent before and after the update.

2.1.4. Search for Prey (Exploration) and Attacking Prey (Exploitation)

When the prey stops moving, the grey wolf completes the hunting process by attacking. In order to mimic the process of the grey wolf approaching the prey, the GWO algorithm causesa⇀to linearly decrease from 2 to 0, as shown in Equation (8):

a→=2−(2×t/Ma_xiter)

According to Equation (3),A→is a random value that lies in the range [−2a, 2a]. GWO usesA→to force wolves to move closer or farther away from their prey. IfA→< 1, the wolf will be forced to attack towards the prey. IfA→> 1, the wolf will be forced to diverge from the prey (local minimum) to find a new fitter prey.C→is a random value that lies in the range [0,2] which is employed to help GWO avoid being trapped in the local optima. The pseudo code of the GWO algorithm is presented in Algorithm 1.

Algorithm 1 Pseudo Code of GWO

1.Initialize the wolf population Xi(i=1,2,…,n)2.Initialize a,A,and C3. Calculate the fitness of each search agent4. Xα=the best search agent5. Xβ=the second best search agent6. Xδ=the third best search agent7. while (t<Max number of iterations)8.for each search agent9.Update the position of the current search agent by equation(7)10.end for11.Updatea,A,andC12.Calculate the fitness of all search agents13.UpdateXα,Xβ,and Xδ14.t=t+115. end while16. return Xα

2.2. Fireworks Algorithm Inspired by the behavior according to which fireworks burst into sparks in the night sky and illuminate the surrounding area, Tan and Zhu proposed the Fireworks Algorithm (FWA) in 2010. In FWA, a firework is considered as a viable solution in the search space of the optimization problem. Furthermore, the process of sparking fireworks is deemed as the process of searching the neighborhood of these fireworks. The specific steps of the fireworks algorithm are as follows:

(1) N fireworks are randomly generated in the search space, and each firework represents a feasible solution.

(2)

Evaluate the quality of these fireworks. Consider that the optimal location may be close to the fireworks with a better fitness; these fireworks get a smaller search amplitude and more explosion sparks to search the surrounding area. On the contrary, those fireworks with a bad fitness will get fewer explosion sparks and a larger search amplitude. The number of explosion sparks and the explosion amplitude of fireworks are calculated as shown in Equations (9) and (10):

_Si=m·_ymax−f(_xi)+ξ∑i=1n(_ymax−f(_xi))+ξ

_Ai=A^·f(_xi)−_ymin+ξ∑i=1n(f(_xi)−_ymin)+ξ

where_Siis the number of explosion sparks._Airepresents the amplitude of the explosion._ymin=min(f(_xi)),(i=1,2,…,N)is the minimum fitness among theNfireworks._ymax=max(f(_xi)),(i=1,2,…,N)is the maximum fitness value among theNfireworks.mandA^are parameters controlling the total number of sparks and the maximum explosion amplitude, respectively.ξis the smallest constant in the computer, utilized to avoid a zero-division-error. To avoid that the good fireworks produce far more explosive sparks than the fireworks with a poor fitness, Equation (11) is used to bound the number of sparks that are generated:

_S^i={round(a·m)_{if Si}<amround(b·m)_{if Si}>bm,a<b<1round(_Si)_{if Si} otherwise

wherea,bare constant parameters, andround()represents the rounding function.

(3)

To guarantee the diversity of the fireworks, another method of generating sparks, Gaussian explosion, is designed in FWA. For the randomly selected fireworks, a number of dimensions are randomly selected and updated, as shown in Equation (12), to get the position of a Gaussian spark at the dimension k:

_x^ik=_xik×e

wheree∼N(1,1),N(1,1)is a Gaussian random value with mean 1 and standard deviation 1.

The generated explosion sparks and Gaussian sparks may exceed the boundaries of the search space. Equation (13) maps the sparks beyond the boundary at dimension k to a new position:

_x˜kj=_xkmin+|_x˜kj|%(_xkmax−_xkmin)

where_xkmaxrepresents the upper bound of the search space at dimension k, and_xkminis the lower bound of the search space at dimension k.

(4)

Nlocations should be selected as the next generation of fireworks from the explosion sparks, Gaussian sparks, and the current fireworks. In FWA, the location with the best fitness is always kept for the next iteration. Then,N−1locations are chosen, determined by their distance to other locations. The distance and the selection probability of_xiis defined as follows:

R(_xi)=∑j∈kd(_xi,_xj)=∑j∈k‖_xi−_xj‖

p(_xi)=R(_xi)∑j∈kR(_xj)

In this selection strategy, if there are many other locations around_xi, the selection probability will be reduced to keep the diversity of the next generation.

The execution flow of the FWA algorithm is shown in Algorithm 2.

Algorithm 2 Pseudo Code of FWA

1. Randomly select n locations for fireworks2. while stop criteria=flase do3.Set off n fireworks respectively at the n locations4.foreach fireworkxido5.Calculate the number of sparks that the firework yields by equation (9)6.Obtain locations of each sparks of the fireworkxi7.end for8. for k=1:number of Gaussian sparks do9.Randomly select a fireworkxj10.Generate a Gaussian spark for the firework11. end for12. Select the best location and keep it for next explosion generation13. Randomly select n−1 locations from the two types of sparks and the current fireworks14. according to the probability given in equation (15)15. end while

3. Hybrid FWGWO Algorithm 3.1. Establishment of FWGWO

As mentioned in Section 2, GWO is strong at exploitation but weak at avoiding a premature convergence and local optimum. The FWA algorithm has a strong exploration capability, but it lacks in exploitation. In this section, the FWGWO hybrid algorithm is proposed to combine the GWO exploitation capability with the FWA exploration capability to obtain a better global optimization capability. FWGWO alternately uses the FWA algorithm for exploration in the search space and the GWO algorithm for exploitation to search the global optimum without changing the general operation of the GWO and FWA algorithms. In order to balance the exploration with the exploitation, an adaptive equilibrium coefficient is proposed in this paper. Updating the position_Xαmeans that the best fitness has been changed. When the current position is closer to the optimal solution, the coefficientpwill be updated to change the search strategy, as shown in Equation (16):

p=0.9×(1−cos(π2·tMa_xiter))

whereprepresents the adaptive balance coefficient.tis the current number of iterations.Ma_xiterindicates the maximum number of iterations.

A random valuerin [0, 1] is set for a comparison with the adaptive balance coefficientp. Ifr>p, the next iteration will be executed using the FWA algorithm. Otherwise, the GWO algorithm is used for this iteration. The function curve ofp is shown in Figure 2. The value ofpis small and slowly increases in the early optimization stage to make sure that FWGWO explores a huge search space by multiple calls of FWA to avoid being trapped in the local minimum. In the later optimization phases, the algorithm exploits small regions to efficiently search the optimum with the rapidly increasingp. To avoid that only GWO is executed in the final stage of the FWGWO algorithm, the value ofpis growing in [0, 0.9]. In some cases, after one iteration of the FWA algorithm, the FWGWO algorithm will proceed to the next iteration of the FWA algorithm without further exploitation so as to escape the current local optimal space and miss the global optimal solution. To avoid these cases, the FWGWO algorithm exploits the current region with at leastTiterations of the GWO algorithm before proceeding to the next FWA algorithm. In this paper,Tis set to 10. The variablekis defined to count how many GWO iterations have occurred since the last FWA iteration.kis initialized at the beginning of FWGWO. After each GWO iteration,kincreases itself by 1. Ifk>Tandr>p, FWA will be used to execute the iteration. At the last of these iterations,kwill be set to 0.

The pseudo code of the hybrid FWGWO algorithm is shown in Algorithm 3.

Algorithm 3 Pseudo Code of FWGWO

1. Initialize the wolf population Xi(i=1,2,…,n)2. Initialize a, A, k, t and C3. Calculate the fitness of each search agent4. Xα=the best search agent5. Xβ=the second best search agent6. Xδ=the third best search agent7. while (t<Max number of iterations)8.foreach search agent9.Update the position of the current search agent by equation (7)10.end for11.Updatea,A,andC12.Calculate the fitness of all search agents13.UpdateXα,Xβ,and Xδ14.ifXα changed then15.Update the adaptive balance coefficient (p) by equation (16)16.end if17.if k >= T and rand() > p then18.for eachsearchagent xi do19.Generate explosion sparks20.end for21.GeneratemGaussian spark for the search agents22.Selecnewsearchagentsbyequation (15)23.t=t+124.k=025.end if26.k=k+1t=t+127.end while28.return Xα

3.2. Time Complexity Analysis of FWGWO

The time complexity of FWGWO is mainly determined by the population sizen, dimensions of the solution spaced, and max number of iterationst. O (FWGWO) = O (population initialization) + O (Calculation of fitness for the entire population) + O (Update of population position). The time complexity of the population initialization is O (n×d), and the time complexity for calculating the fitness of the entire population is O (t×n×d). As for the part with the updating position, the time complexity consists of two parts: O = O (position update with GWO) + O (position update with FWA). The time complexity of this part is O (10/11×t×n×d+1/11×t×3×n×d) ≈ O(t×n×d). Therefore, the time complexity of the FWGWO algorithm is O (n×d+t×n×d+t×n×d) = O ((2t+1)×n×d). For comparison, the time complexity of GWO is O ((2t+1)×n×d), and the time complexity of FWA is O ((4t+1)×n×d). The time complexity of FWGWO is the same as that of GWO and smaller than that of FWA.

4. Experimental Section and Results In this section, 16 benchmark functions with different characteristics are used to evaluate the proposed FWGWO hybrid algorithm. The experiment results are compared with nine other algorithms to verify the superiority of FWGWO. 4.1. Compared Algorithms

A total of nine algorithms, including IPSO, PSO, BBO, CSA, MFO, FWA, GWO, AGWO, and EGWO, were selected for comparison with the FWGWO algorithm proposed in this paper. These nine algorithms contain both classical algorithms and new algorithms proposed in recent years. The parameter settings of these algorithms are shown in Table 1. These parameters are chosen based on the parameters of these algorithms in the original papers. For all algorithms in this experiment, the size of the population is 20, the dimension is 100 dimensions, and the maximum number of iterations is 500. This experiment has been carried out with different experimental parameters. The size of the population has been set to 10, 20, 30, and 50. The dimension has been set to 20, 50, 100, and 500. The results of these experiments are similar. Considering the length of this paper, the typical parameters mentioned above are taken as an example.

4.2. Benchmark Functions

Sixteen benchmark functions listed in Table A1 (see in Appendix A) are utilized to evaluate the optimized performance of FWGWO. These benchmark functions can be divided into two categories. In the first category, the unimodal functions f1-f8 with only one global optimum are used to test the exploitation capability. In the second category, the multimodal functions f9–f16 with more than two local optima are utilized to assess the ability of FWGWO to find global optima.

4.3. Performance Metrics

Three performance indicators, the mean fitness, fitness variance, and best fitness, are selected in this paper to evaluate the results of the experiments. The mathematical equations are defined as follows:

MeanFitness=1M∑i=1M_Gi

std=_∑i=1M^{(_Gi−MeanFitness)2}M

whereMrepresents the total number of independently repeated experiments.Mis 30 in this paper.Grepresents the function fitness of each experiment, andiis the count of repeated experiments.

In addition, a nonparametric statistical test, Wilcoxon’s rank-sum test [34], is utilized to show that the proposed FWGWO algorithm provides a significant improvement over other algorithms. The test was carried out with the results of the FWGWO and other algorithms in each benchmark function at a 5% significance level. All experiments are carried out using MATLAB R2017a on a computer with Inter i5-5200U 2.2GHz and an 8 GB memory.

4.4. Comparison and Analysis of Simulation Results

Thirty independently repeated experiments were implemented using the 10 algorithms mentioned above on each benchmark function. Table 2 shows the test results of these algorithms on each benchmark function. The best, mean, and variance of the fitness obtained by each algorithm are listed in Table 2, and the best results are bolded. Compared with other algorithms, the average of the fitness obtained by the FWGWO algorithm after 500 iterations is better and closer to the global optimal value on most of the benchmark functions. In terms of the best fitness obtained in 30 repetitions, FWGWO has a better performance than other algorithms in all 16 functions. What is more, the best fitness obtained by FWGWO is 0 on functions f9, f11, and f16. This shows that the FWGWO algorithm has found the global optimal value on these functions. These cases verified the superiority of FWGWO over other algorithms.

Furthermore, the variances of the results of these 30 independent experiments are also smaller. As can be seen in Table 2, the optimization results of FWGWO on the unimodal functions f1–f5, whether the mean or the variance, are superior to other algorithms. As mentioned above, the unimodal function is utilized to test the exploitation ability of the algorithm. From these results, it can be seen that, compared with FWA, GWO, and other algorithms, FWGWO can find a better solution in a limited number of iterations and has a better exploitation ability. It can also be seen from Table 2 that FWGWO has better results in seven of the eight functions on the multimodal functions f9–f16. The multimodal functions are used to test the exploration ability of the algorithm. It can be known from the experiment results that the FWGWO algorithm has a better global optimization ability than other algorithms used in this paper, including the original GWO, the standard FWA, and the enhanced GWO.

Figure 3 and Figure 4 show the convergence process of FWGWO and other algorithms mentioned in this paper on 16 reference benchmark functions. The curves we provided in Figure 3 and Figure 4 are the average fitness curves of 30 repetitions. As shown in Figure 3, at the first few iterations, FWGWO’s convergence is slightly slower than that of other algorithms. In this process, the algorithm explores a lot to search for a better exploitation of the local areas. In the following convergence process, FWGWO converges quickly in this region, searching for a better solution than other algorithms after a total of 500 iterations. Figure 4 shows the comparison of the convergence of FWGWO with other algorithms on multimodal functions. As mentioned above, the multimodal functions are used to test the local optima avoidance ability of the algorithm.

In Figure 4, we can see that unlike other algorithms that have been trapped in the local optimum, FWGWO continues to search for a better fitness on most benchmark functions and keeps approaching global optima. This proves that the FWGWO algorithm has a better global optimization searching ability when compared with other algorithms. According to the above comprehensive description, the hybrid algorithm FWGWO is superior to other algorithms in both the accuracy of the solution and the convergence. It can be concluded that the FWGWO algorithm has better overall performances on most optimization problems than other algorithms.

The mean running time of 30 repetitions has been shown in Table 3. The results show that the running time of the FWGWO algorithm is a little bigger than that of GWO and much smaller than that of FWA. As mentioned in Section 3, FWA has a larger time complexity, while GWO has a smaller time complexity. The location update strategy of FWA has been used in FWGWO a few times. Therefore, FWGWO has a bigger running time than GWO. Considering the improvement of the convergence performance, it is acceptable to sacrifice a little running time.

Wilcoxon’s nonparametric statistical test is conducted at the 5% significance level in order to determine whether the FWGWO provides a significant improvement compared to other algorithms or not. The results of different algorithms on the benchmark function were employed to test the Wilcoxon rank sum, andpandhvalues were obtained as significant level indicators. If thepvalue is less than 0.05, the null hypothesis is rejected. At this time, thehvalue is 1, and the two algorithms tested are considered significantly different. Conversely, when thepvalue is greater than 0.05, theh value is 0, and the two algorithms tested are considered to not be significantly different. In this paper, the Wilcoxon rank sum is tested with the results of 30 repeated experiments on 16 benchmark functions by the FWGWO algorithm and other algorithms. The test results are shown in Table 4. In most cases, thehvalues of the test results are 1, except that the results’pvalues for AGWO and FWGWO on f8, f11, f15, and f16 are greater than 0.05 and thehvalues are 0. This means that the optimization efficiency of FWGWO and AGWO is similar in f8, f11, f15, and f16. The results show that in most cases the performance of the FWGWO algorithm is significantly improved when compared with other algorithms.

5. Conclusions In this paper, a hybrid algorithm FWGWO based on Grey Wolf Optimizer (GWO) and Fireworks Algorithm (FWA) is proposed for the optimization of multidimensional complex space. The FWGWO algorithm combines the good exploitation ability of GWO with the strong exploration ability of the FWA algorithm. In order to balance the exploitation with the exploration, an adaptive balance coefficient is employed in this algorithm. The probability of exploitation or exploration is controlled by the balance coefficient. By changing the balance coefficient, the FWGWO algorithm can avoid the local optimal value as much as possible and has a fast convergence speed. In order to verify the performance superiority of the FWGWO algorithm, the FWGWO algorithm was tested 30 times with IPSO, PSO, BBO, CSA, MFO, FWA, GWO, AGWO, and EGWO algorithms on 16 benchmark functions, and their test results were compared with each other. The compared results show that the FWGWO algorithm has a better global optimization ability and faster convergence speed compared with other algorithms. In addition, the Wilcoxon rank sum test was used to test the optimization results. The test results show that the FWGWO algorithm has a significant improvement compared to other algorithms. This paper presents a new method for combining two algorithms. In the future, this method could be used in combination with other enhanced algorithms. Furthermore, the FWGWO can be applied to solve single- and multi-objective optimization problems like the feature selection problem.

Figure 1. Position updating in GWO.

Figure 2. Adaptive balance coefficient.

Figure 3. Convergence curves of the unimodal functions.

Figure 4. Convergence curves of the multimodal functions.

	Parameter	Value(s)
GWO	a	Linearly decreased from 2 to 0
FWA	Total number of sparks	50
	Maximum explosion amplitude	40
	Number of Gaussian sparks	5
	a	0.04
	b	0.8
ISPO	Inertia w(wMin,wMax)	[0.4,0.9]
	Acceleration constants(c1,c2)	[2,2]
PSO	Inertia w(wMin,wMax)	[0.6,0.9]
	Acceleration constants(c1,c2)	[2,2]
AGWO	a	a=2−(cos(rand())×t/Max_iter)
EGWO	a	a=rand()
BBO	Immigration probability	[0,1]
	Mutation probability	0.005
	Habitat modification probability	1.0
	Step size	1.0
	Migration rate	1.0
	Maximum immigration	1.0
CSA	Flight length	2
	Awareness probability	0.1
MFO	a	a=−1+Iteration×((−1)/Max_iteration)

Function		GWO	FWA	IPSO	PSO	AGWO	EGWO	BBO	CSA	MFO	FWGWO
F1	Mean	1.99 × 10−10	3.73 × 102	1.57 × 104	2.21 × 102	3.93 × 10−17	1.45 × 10−13	2.87 × 102	1.06 × 103	7.04 × 104	5.16 × 10−18
	Std	1.19 × 10−10	5.49 × 103	5.18 × 103	3.01 × 101	7.20 × 10−17	6.23 × 10−14	2.47 × 101	1.83 × 102	1.35 × 104	1.93 × 10−16
	Best	2.70 × 10−11	4.84	7.40 × 103	1.50 × 102	4.61 × 10−18	6.15 × 10−16	2.54 × 102	7.09 × 102	4.69 × 104	6.68 × 10−24
F2	Mean	1.53 × 103	6.14 × 104	1.44 × 105	2.71 × 104	1.79 × 104	3.34 × 104	5.74 × 104	8.49 × 103	2.70 × 105	1.74
	Std	1.35 × 103	7.11 × 104	3.11 × 104	6.72 × 103	1.81 × 104	1.41 × 104	8.78 × 103	1.52 × 103	5.48 × 104	6.01 × 101
	Best	1.20 × 102	1.32 × 101	8.33 × 104	1.55 × 104	2.54 × 102	6.75 × 103	4.38 × 104	5.54 × 103	1.64 × 105	4.97 × 10−7
F3	Mean	3.03	3.36 × 101	6.00 × 101	1.54 × 101	4.99 × 101	7.28 × 101	2.99 × 101	1.57 × 101	9.41 × 101	1.02 × 10−3
	Std	2.17	1.44 × 101	4.32	1.66	3.13 × 101	7.82	3.01	1.40	1.72	3.06 × 10−3
	Best	2.24 × 10−1	8.24 × 10−1	4.84 × 101	1.26 × 101	6.56 × 10−1	5.61 × 101	2.35 × 101	1.32 × 101	9.13 × 101	5.61 × 10−7
F4	Mean	9.81 × 101	9.38 × 103	9.12 × 106	2.95 × 105	9.82 × 101	9.83 × 101	7.86 × 103	4.01 × 104	2.04 × 108	9.00 × 101
	Std	5.22 × 10−1	2.50 × 106	3.99 × 106	6.54 × 104	5.50 × 10−1	6.68 × 10−1	1.39 × 103	1.80 × 104	8.37 × 107	1.74 × 101
	Best	9.65 × 101	1.00 × 102	4.79 × 106	1.87 × 105	9.71 × 101	9.63 × 101	5.16 × 103	2.26 × 104	6.98 × 107	1.66 × 101
F5	Mean	1.16 × 101	2.61 × 103	1.59 × 104	2.13 × 102	1.50 × 101	1.56 × 101	2.86 × 102	1.03 × 103	7.46 × 104	3.02 × 10−2
	Std	9.88 × 10−1	2.14 × 103	4.71 × 103	3.34 × 101	6.26 × 10−1	9.66 × 10−1	2.88 × 101	1.07 × 102	1.39 × 104	2.42 × 10−2
	Best	9.54	2.44 × 101	8.20 × 103	1.56 × 102	1.40 × 101	1.40 × 101	2.26 × 102	7.95 × 102	5.23 × 104	1.27 × 10−2
F6	Mean	1.69 × 10−29	1.73	3.58	3.72 × 101	2.42 × 10−39	3.44 × 10−23	1.58 × 10−4	2.79 × 10−2	1.80 × 101	2.09 × 10−35
	Std	2.50 × 10−29	4.11 × 10−1	2.52	1.11 × 101	1.03 × 10−35	6.04 × 10−22	2.03 × 10−3	1.65 × 10−2	5.18	1.21 × 10−34
	Best	4.86 × 10−34	8.30 × 10−8	1.05 × 10−1	1.18 × 101	5.32 × 10−46	1.38 × 10−35	6.48 × 10−7	8.35 × 10−3	2.00	1.80 × 10−46
F7	Mean	2.47 × 10−7	2.39 × 107	4.13 × 108	8.83 × 106	7.99 × 10−14	1.13 × 10−10	1.14 × 107	2.89 × 107	1.46 × 109	1.06 × 10−13
	Std	1.62 × 10−7	8.81 × 107	2.66 × 108	2.57 × 106	8.94 × 10−14	1.44 × 10−10	2.50 × 106	9.00 × 106	8.26 × 108	2.12 × 10−12
	Best	4.80 × 10−8	1.31 × 101	6.05 × 107	4.00 × 106	3.74 × 10−15	1.15 × 10−12	7.24 × 106	1.75 × 107	1.16 × 108	1.00 × 10−18
F8	Mean	5.38 × 10−11	3.72 × 102	7.33 × 103	1.02 × 104	1.80 × 10−17	2.54 × 10−14	1.68 × 102	4.68 × 102	3.30 × 104	4.94 × 10−16
	Std	4.61 × 10−11	7.11 × 102	2.62 × 103	1.30 × 103	2.04 × 10−17	1.31 × 10−14	2.58 × 101	7.19 × 101	7.03 × 103	5.01 × 10−16
	Best	1.19 × 10−11	4.81 × 10−2	3.38 × 103	7.58 × 103	5.21 × 10−19	2.86 × 10−16	1.35 × 102	3.14 × 102	1.40 × 104	1.42 × 10−21
F9	Mean	1.09 × 101	2.66 × 102	5.88 × 102	1.24 × 103	2.54 × 10−1	8.72 × 102	3.97 × 102	3.72 × 102	8.99 × 102	4.43 × 10−2
	Std	8.83	1.04 × 102	6.85 × 101	9.61 × 101	6.46 × 10−5	1.80 × 102	5.40 × 101	4.50 × 101	7.18 × 101	8.31 × 10−2
	Best	5.96 × 10−7	3.06 × 10−2	4.79 × 102	1.05 × 103	0.00	4.45 × 102	3.17 × 102	3.04 × 102	6.92 × 102	0.00
F10	Mean	1.27 × 10−6	4.98	1.58 × 101	6.96	1.06 × 10−9	2.37 × 10−8	3.71	6.80	1.99 × 101	4.21 × 10−10
	Std	3.85 × 10−7	2.93	9.91 × 10−1	3.72 × 10−1	7.18 × 10−10	2.69 × 10−8	1.18 × 10−1	5.39 × 10−1	1.52 × 10−1	5.61 × 10−10
	Best	6.16 × 10−7	1.05 × 10−2	1.43 × 101	6.06	1.97 × 10−10	1.55 × 10−9	3.49	6.07	1.95 × 101	2.93 × 10−14
F11	Mean	4.78 × 10−3	3.71 × 10−2	2.52	1.03	1.20 × 10−3	1.00 × 10−2	8.33 × 10−1	1.09	7.73	1.11 × 10−17
	Std	1.09 × 10−2	4.83 × 10−1	3.68 × 10−1	2.44 × 10−2	9.13 × 10−3	1.22 × 10−2	3.47 × 10−2	1.60 × 10−2	1.52	1.20 × 10−16
	Best	1.52 × 10−13	3.47 × 10−2	1.70	9.72 × 10−1	0.00	0.00	7.60 × 10−1	1.07	4.44	0.00
F12	Mean	3.83 × 10−1	3.34	3.57 × 106	1.87 × 101	5.37 × 10−1	1.38 × 101	7.95	1.10 × 101	4.31 × 108	2.13 × 10−3
	Std	6.78 × 10−2	5.95 × 105	1.56 × 106	4.44	4.11 × 10−2	8.57	2.37	3.03	1.65 × 108	6.89 × 10−3
	Best	2.41 × 10−1	1.20	1.56 × 105	7.79	4.06 × 10−1	6.15 × 10−1	2.33	6.06	1.34 × 108	6.35 × 10−4
F13	Mean	7.37	1.21 × 101	1.69 × 107	8.76 × 102	8.32	4.50 × 101	1.68 × 101	1.67 × 102	8.61 × 108	1.29 × 10−1
	Std	4.10 × 10−1	7.62 × 106	1.19 × 107	8.25 × 102	3.16 × 10−1	3.71 × 101	2.36	3.12 × 101	3.28 × 108	7.60 × 10−2
	Best	6.36	1.01 × 101	1.87 × 106	1.97 × 102	7.59	9.89	1.26 × 101	8.56 × 101	2.15 × 108	3.67 × 10−2
F14	Mean	4.50 × 10−3	1.64	5.10 × 101	1.05 × 102	7.70 × 10−5	1.25 × 102	2.19 × 101	2.46 × 101	8.11 × 101	2.46 × 10−6
	Std	2.87 × 10−3	9.69	1.17 × 101	1.26 × 101	8.55 × 10−4	2.23 × 101	3.88	8.16	1.41 × 101	6.63 × 10−6
	Best	7.96 × 10−7	6.83 × 10−3	3.26 × 101	7.72 × 101	5.32 × 10−12	6.85 × 101	1.28 × 101	1.50 × 101	5.54 × 101	1.06 × 10−14
F15	Mean	1.41 × 10−2	4.92 × 10−1	5.00 × 10−1	3.95 × 10−1	4.32 × 10−3	1.30 × 10−2	4.99 × 10−1	4.88 × 10−1	5.00 × 10−1	3.13 × 10−3
	Std	2.33 × 10−3	1.46 × 10−1	4.43 × 10−5	1.71 × 10−2	1.45 × 10−3	2.74 × 10−3	6.33 × 10−4	2.78 × 10−3	2.05 × 10−6	1.18 × 10−3
	Best	9.29 × 10−3	1.91 × 10−2	5.00 × 10−1	3.56 × 10−1	3.13 × 10−3	6.22 × 10−3	4.97 × 10−1	4.82 × 10−1	5.00 × 10−1	2.58 × 10−6
F16	Mean	1.38 × 10−10	8.50	1.07 × 103	7.13 × 102	7.40 × 10−18	2.48 × 10−13	7.18 × 101	1.58 × 102	4.92 × 103	1.87 × 10−15
	Std	7.46 × 10−11	7.48 × 101	3.89 × 102	9.40 × 101	7.97 × 10−17	1.04 × 101	3.26	9.91	1.30 × 103	2.09 × 10−15
	Best	2.63 × 10−11	4.28 × 10−1	5.92 × 102	4.96 × 102	0.00	0.00	6.25 × 101	1.23 × 102	2.89 × 103	0.00

Function	GWO	FWA	IPSO	PSO	AGWO	EGWO	BBO	CSA	MFO	FWGWO
F1	0.65625	6.1875	0.828125	0.5625	0.59375	0.53125	10.65625	1.296875	0.953125	1.390625
F2	2.0625	11.5	1.8125	1.828125	2.09375	1.734375	13.89063	4.890625	2.34375	2.46875
F3	0.375	6.75	0.234375	0.15625	0.25	0.171875	9.46875	0.890625	0.453125	0.8125
F4	0.453125	5.5625	0.25	0.1875	0.328125	0.203125	8.671875	0.890625	0.453125	0.671875
F5	0.40625	6.21875	0.21875	0.15625	0.25	0.140625	10.57813	0.75	0.421875	0.671875
F6	1.03125	8.53125	0.8125	0.796875	0.84375	0.71875	9.09375	2.640625	1.0625	2.5
F7	0.609375	6.640625	0.4375	0.375	0.515625	0.375	9.671875	1.296875	0.625	0.90625
F8	0.359375	5.375	0.21875	0.15625	0.234375	0.140625	9.4375	0.71875	0.453125	0.671875
F9	0.421875	6.328125	0.3125	0.25	0.265625	0.1875	8.28125	1.046875	0.453125	0.734375
F10	0.421875	7.171875	0.3125	0.25	0.28125	0.1875	8.3125	0.96875	0.421875	0.703125
F11	0.453125	6.265625	0.328125	0.25	0.34375	0.1875	8.609375	0.90625	0.484375	1.484375
F12	0.953125	7.5625	0.828125	0.71875	1	0.65625	9.09375	2.3125	1.046875	1.28125
F13	1.015625	8.046875	0.796875	0.734375	0.890625	0.703125	9.078125	2.359375	1.046875	1.34375
F14	0.515625	5.875	0.234375	0.21875	0.21875	0.15625	8.5625	0.953125	0.4375	0.625
F15	0.53125	7.25	0.265625	0.1875	0.328125	0.15625	8.125	0.921875	0.421875	0.65625
F16	0.453125	6.109375	0.296875	0.234375	0.28125	0.1875	8.3125	1.015625	0.484375	0.78125

Function		GWO	FWA	IPSO	PSO	AGWO	EGWO	BBO	CSA	MFO
F1	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	1.82 × 10−7	7.86 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F2	p-value	7.86 × 10−12	1.65 × 10−11	6.51 × 10−12	6.51 × 10−12	7.15 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F3	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F4	p-value	2.05 × 10−10	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	1.72 × 10−10	6.28 × 10−10	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F5	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F6	p-value	7.15 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.29 × 10−3	1.14 × 10−11	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F7	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	2.05 × 10−2	7.08 × 10−11	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F8	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	8.45 × 10−2	4.13 × 10−11	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	0	1	1	1	1
F9	p-value	3.14 × 10−12	1.73 × 10−12	1.16 × 10−12	1.16 × 10−12	1.19 × 10−3	1.16 × 10−12	1.16 × 10−12	1.16 × 10−12	1.16 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F10	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	1.27 × 10−7	7.86 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F11	p-value	5.54 × 10−13	5.54 × 10−13	5.54 × 10−13	5.54 × 10−13	3.62 × 10−1	6.72 × 10−7	5.54 × 10−13	5.54 × 10−13	5.54 × 10−13
	h-value	1	1	1	1	0	1	1	1	1
F12	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F13	p-value	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F14	p-value	9.47 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	2.36 × 10−3	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12	6.51 × 10−12
	h-value	1	1	1	1	1	1	1	1	1
F15	p-value	2.05 × 10−10	6.51 × 10−12	1.11 × 10−10	6.51 × 10−12	1.12 × 10−1	4.81 × 10−8	1.01 × 10−10	8.47 × 10−11	1.21 × 10−10
	h-value	1	1	1	1	0	1	1	1	1
F16	p-value	1.71 × 10−12	1.71 × 10−12	1.71 × 10−12	1.71 × 10−12	6.75 × 10−2	1.99 × 10−10	1.71 × 10−12	1.71 × 10−12	1.71 × 10−12
	h-value	1	1	1	1	0	1	1	1	1

Author Contributions

Data curation, Z.Y.; Formal analysis, Z.Y.; Funding acquisition, S.Z. and W.X.; Methodology, Z.Y.; Resources, Z.Y.; Software, Z.Y.; Supervision, S.Z.; Validation, Z.Y.; Writing - original draft, Z.Y.; Writing - review & editing, Z.Y. and S.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the National Natural Science Foundation of China under grant No. 61673056 and 61673055, the Beijing Natural Science Foundation under grant No.4182039, and the National Key Research and Development Program of China under Grant 2017YFB1401203.

Acknowledgments

This work is supported by the National Natural Science Foundation of China under grant No. 61673056 and 61673055, the Beijing Natural Science Foundation under grant No.4182039, and the National Key Research and Development Program of China under Grant 2017YFB1401203. The authors would like to thank the anonymous reviewers for their insightful suggestions that will help us to improve the quality of this paper.

Conflicts of Interest

The authors declare no conflict interest.

Appendix A

Table

Table A1.Benchmark functions.

Table A1.Benchmark functions.

Function	Range	fmin
F1=∑i=1Dxi2	[-100,100]	0
F2=∑i=1D(∑j=1ixj)	[-100,100]	0
F3=max{|xi|,1≤i≤D}	[-100,100]	0
F4=∑i=1D-1[100(xi+1-xi2)2+(xi-1)2]	[-30,30]	0
F5=∑i=1D[xi+0.5]2	[-100,100]	0
F6=106·x12+∑i=2Dxi6	[-1,1]	0
F7=∑i=2D(106)(i-1)/(n-1)·xi2	[-100,100]	0
F8=∑i=2Dixi2	[-10,10]	0
F9=∑i=1D[xi2-10cos(2πxi)+10]	[-5.12,5.12]	-418.982
F10=-20exp(-0.21D∑i=1Dxi2)-exp(1D∑i=1Dcos(2πxi))+20+e	[-32,32]	0
F11=14000∑i=1Dxi2-∏i=1Dcos(xii)+1	[-60,60]	0
F12=πn{10sin(πy1)+∑i=1D-1(yi-1)2[1+10sin2(πyi+1)]+(yn-1)2}+∑i=1Du(xi,5,100,4)	[-50,50]	0
F13=0.1{sin(3πx1)+∑i=1D-1(xi-1)2[1+10sin2(3πxi+1)]+(xn-1)2}+∑i=1Du(xi,5,100,4)	[-50,50]	0
F14=∑i=1D|xisin(xi)+0.1xi|	[-10,10]	0
F15=0.5+((sin(∑i=1Dxi2))2-0.5)·(1+0.001(∑i=1Dxi2))-2	[-100,100]	0
F16=∑i=1D-1[xi2+2xi+12-0.3cos(3πxi)-0.4cos(4πxi+1)+0.7]	[-15,15]	0

References

1. Şenel, F.A.; Gökçe, F.; Yüksel, A.S.; Yiğit, T. A novel hybrid PSO-GWO algorithm for optimization problems. Eng. Comput. 2018, 35, 1359-1373.

2. Brownlee, J. Clever Algorithms: Nature-Inspired Programming Recipes; Lulu Press: Morrisville, NC, USA, 2011.

3. Poli, R.; Kennedy, J.; Blackwell, T. Particle swarm optimization. Swarm Intell. 2007, 1, 33-57.

4. Colorni, A.; Dorigo, M.; Maniezzo, V. Distributed optimization by ant colonies. In Proceedings of the European Conference on Artificial Life, Paris, France, 11-13 December 1991.

5. Karaboga, D. An Idea Based on Honey Bee Swarm for Numerical Optimization; Technical Report-TR06; Erciyes University: Kayseri, Turkey, 2005.

6. Mirjalili, S.; Lewis, A. The whale optimization algorithm. Adv. Eng. Softw. 2016, 95, 51-67.

7. Meng, X.; Gao, X.Z.; Lu, L.; Liu, Y.; Zhang, H. A new bio-inspired optimization algorithm: Bird swarm algorithm. J. Exp. Theor. Artif. Intell. 2016, 28, 673-687.

8. Mirjalili, S.; Mirjalili, S.M.; Lewis, A. Grey wolf optimizer. Adv. Eng. Softw. 2014, 69, 46-61.

9. Tan, Y.; Zhu, Y. Fireworks algorithm for optimization. Comput. Vis. 2010, 6145, 355-364.

10. Simon, D. Biogeography-based optimization. IEEE Trans. Evol. Comput. 2008, 12, 702-713.

11. Mirjalili, S. Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm. Knowl.-Based Syst. 2015, 89, 228-249.

12. Rashedi, E.; Nezamabadi-Pour, H.; Saryazdi, S. GSA: A gravitational search algorithm. Inf. Sci. 2009, 179, 2232-2248.

13. Storn, R.; Price, K. Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 1997, 11, 341-359.

14. Agarwal, J.; Parmar, G.; Gupta, R.; Sikander, A. Analysis of grey wolf optimizer based fractional order PID controller in speed control of DC motor. Microsyst. Technol. 2018, 24, 4997-5006.

15. Song, X.; Tang, L.; Zhao, S.; Zhang, X.; Li, L.; Huang, J.; Cai, W. Grey wolf optimizer for parameter estimation in surface waves. Soil Dyn. Earthq. Eng. 2015, 75, 147-157.

16. Yammani, C.; Maheswarapu, S. Load frequency control of multi-microgrid system considering renewable energy sources using grey wolf optimization. Smart Sci. 2019, 7, 198-217.

17. Bratton, D.; Kennedy, J. Defining a standard for particle swarm optimization. In Proceedings of the IEEE Swarm Intelligence Symposium, Honolulu, HI, USA, 1-5 April 2007; pp. 120-127.

18. Tan, Y.; Xiao, Z.M. Clonal particle swarm optimization and its applications. In Proceedings of the IEEE Congress on Evolutionary Computation, Singapore, 25-28 September 2007; pp. 2303-2309.

19. Mirjalili, S.; Wang, G.-G.; Coelho, L.D.S. Binary optimization using hybrid particle swarm optimization and gravitational search algorithm. Neural Comput. Appl. 2014, 25, 1423-1435.

20. Goldberg, D.E. Genetic Algorithms in Search Optimization and Machine Learning; Addison-Wesley: Boston, MA, USA, 1989.

21. Choi, K.; Jang, D.-H.; Kang, S.-I.; Lee, J.-H.; Chung, T.-K.; Kim, H.-S.; Jung, T.-K. Hybrid algorithm combing genetic algorithm with evolution strategy for antenna design. IEEE Trans. Magn. 2015, 52, 1-4.

22. Mafarja, M.; Mirjalili, S. Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing 2017, 260, 302-312.

23. Alomoush, A.A.; Alsewari, A.A.; Alamri, H.S.; Alamri, H.S.; Zamli, K.Z. Hybrid Harmony search algorithm with grey wolf optimizer and modified opposition-based learning. IEEE Access 2019, 7, 68764-68785.

24. Arora, S.; Singh, H.; Sharma, M.; Sharma, S.; Anand, P. A new hybrid algorithm based on grey wolf optimization and crow search algorithm for unconstrained function optimization and feature selection. IEEE Access 2019, 7, 26343-26361.

25. Kumar, S.; Pant, M.; Dixit, A.; Bansal, R. BBO-DE: Hybrid algorithm based on BBO and DE. In Proceedings of the International Conference on Computing, Communication and Automation (ICCCA), Greater Noida, India, 5-6 May 2017; pp. 379-383.

26. Gohil, B.N.; Patel, D.R. A hybrid GWO-PSO algorithm for load balancing in cloud computing environment. In Proceedings of the Second International Conference on Green Computing and Internet of Things (ICGCIoT), Bangalore, India, 16-18 August 2018; pp. 185-191.

27. Zhu, A.; Xu, C.; Li, Z.; Wu, J.; Liu, Z. Hybridizing grey wolf optimization with differential evolution for global optimization and test scheduling for 3D stacked SoC. J. Syst. Eng. Electron. 2015, 26, 317-328.

28. Zhang, B.; Zhang, M.-X.; Zheng, Y. A hybrid biogeography-based optimization and fireworks algorithm. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC), Beijing, China, 6-11 July 2014; pp. 3200-3206.

29. Selim, A.; Kamel, S.; Jurado, F. Voltage profile improvement in active distribution networks using hybrid WOA-SCA optimization algorithm. In Proceedings of the Twentieth International Middle East Power Systems Conference (MEPCON), Cairo, Egypt, 18-20 December 2018; pp. 1064-1068.

30. Alireza, A. A novel metaheuristic method for solving con- strained engineering optimization problems: Crow search algorithm. Comput. Struct. 2016, 169, 1-12.

31. Jiang, Y.; Hu, T.; Huang, C.; Wu, X. An improved particle swarm optimization algorithm. Appl. Math. Comput. 2007, 193, 231-239.

32. Sharma, S.; Salgotra, R.; Singh, U. An enhanced grey wolf optimizer for numerical optimization. In Proceedings of the International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), Coimbatore, India, 17-18 March 2017; pp. 1-6.

33. Hamour, H.; Kamel, S.; Nasrat, L.; Yu, J. Distribution network reconfiguration using augmented grey wolf optimization algorithm for power loss minimization. In Proceedings of the International Conference on Innovative Trends in Computer Engineering (ITCE), Aswan, Egypt, 2-4 February 2019; pp. 450-454.

34. Derrac, J.; García, S.; Molina, D.; Herrera, F.; Cabrera, D.M. A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol. Comput. 2011, 1, 3-18.