Optimized quantum LSTM using modified electric Eel foraging optimization for real-world intelligence engineering systems
DOI:
https://doi.org/10.1016/j.asej.2024.102982الكلمات المفتاحية:
Machine learningMetaheuristicsQuantum LSTMElectric Eel foraging optimizationTriangular mutation operatorالملخص
The integration of metaheuristics with machine learning methodologies presents significant advantages, particularly in optimization and computational intelligence. This amalgamation leverages the global search capabilities of metaheuristics alongside the pattern recognition and predictive prowess of machine learning, facilitating enhanced convergence rates and solution quality in complex problem spaces. The Quantum Long Short-Term Memory (QLSTM) emerges as a highly efficient deep learning model tailored to tackle such intricate engineering problems. The QLSTM's architecture, comprising data encoding, variational, and quantum measurement layers, facilitates the effective encoding and processing of civil engineering data, leading to heightened prediction accuracy. However, the task of determining optimal values for QLSTM parameters presents challenges due to its NP-problem nature and time-consuming characteristics. To address this, we propose an alternative technique to optimize the QLSTM based on a modified Electric Eel Foraging Optimization (MEEFO). The MEEFO is a modified version of the original EEFO that applies triangular mutation operators to boost the search capability of the traditional EEFO. Thus, the MEEFO optimizes the QLSTM and boosts its prediction performance. To validate the efficacy of our proposed method, we conduct comprehensive experiments utilizing five real-world engineering datasets related to construction and structure engineering. The evaluation outcomes unequivocally demonstrate that the MMEFO significantly enhances the performance of the QLSTM.المراجع
1. T. Hartmann, A. Trappey, "Advanced engineering informatics-philosophical and methodological foundations with examples from civil and construction engineering," Develop Built Environ, vol. 4, Art. no. 100020, 2020.
2. J.-S. Chou, D.-B. Fleshman, D.-N. Truong, "Comparison of machine learning models to provide preliminary forecasts of real estate prices," J Housing Built Environ, vol. 37, pp. 2079-2114, 2022.
3. J.-S. Chou, M.A. Karundeng, D.-N. Truong, M.-Y. Cheng, "Identifying deflections of reinforced concrete beams under seismic loads by bio-inspired optimization of deep residual learning," Struct Control Health Monit, vol. 29, Art. no. e2918, 2022.
4. J.-S. Chou, D.-N. Truong, T.-L. Le, T.T.H. Truong, "Bio-inspired optimization of weighted-feature machine learning for strength property prediction of fiber-reinforced soil," Expert Syst Appl, vol. 180, Art. no. 115042, 2021.
5. N. Grillanda, A. Chiozzi, G. Milani, A. Tralli, "Efficient meta-heuristic mesh adaptation strategies for nurbs upper–bound limit analysis of curved three-dimensional masonry structures," Comput Struct, vol. 236, Art. no. 106271, 2020.
6. C. Zhang, M.-x. Tao, C. Wang, C. Yang, J.-s. Fan, "Differentiable automatic structural optimization using graph deep learning," Adv Eng Inform, vol. 60, Art. no. 102363, 2024.
7. A. Arabameri, S.C. Pal, F. Rezaie, O.A. Nalivan, I. Chowdhuri, A. Saha, et al., "Modeling groundwater potential using novel gis-based machine-learning ensemble techniques," J Hydrol Reg Stud, vol. 36, Art. no. 100848, 2021.
8. D.-N. Truong, J.-S. Chou, "Fuzzy adaptive jellyfish search-optimized stacking machine learning for engineering planning and design," Autom Constr, vol. 143, Art. no. 104579, 2022.
9. J.-S. Chou, M.-Y. Cheng, Y.-M. Hsieh, I.-T. Yang, H.-T. Hsu, "Optimal path planning in real time for dynamic building fire rescue operations using wireless sensors and visual guidance," Autom Constr, vol. 99, pp. 1-17, 2019.
10. J.P.G. Carvalho, D.E. Vargas, B.P. Jacob, B.S. Lima, P.H. Hallak, A.C. Lemonge, "Multi-objective structural optimization for the automatic member grouping of truss structures using evolutionary algorithms," Comput Struct, vol. 292, Art. no. 107230, 2024.
11. E. Ficarella, L. Lamberti, S. Degertekin, "Comparison of three novel hybrid metaheuristic algorithms for structural optimization problems," Comput Struct, vol. 244, Art. no. 106395, 2021.
12. M. Jahangiri, M.A. Hadianfard, M.A. Najafgholipour, M. Jahangiri, M.R. Gerami, "Interactive autodidactic school: a new metaheuristic optimization algorithm for solving mathematical and structural design optimization problems," Comput Struct, vol. 235, Art. no. 106268, 2020.
13. Y. Zhang, W. Zhong, Y. Li, L. Wen, "A deep learning prediction model of densenet-lstm for concrete gravity dam deformation based on feature selection," Eng Struct, vol. 295, Art. no. 116827, 2023.
14. W. Jiang, Y. Xie, W. Li, J. Wu, G. Long, "Prediction of the splitting tensile strength of the bonding interface by combining the support vector machine with the particle swarm optimization algorithm," Eng Struct, vol. 230, Art. no. 111696, 2021.
15. M. Alyami, M. Khan, M.F. Javed, M. Ali, H. Alabduljabbar, T. Najeh, et al., "Application of metaheuristic optimization algorithms in predicting the compressive strength of 3d-printed fiber-reinforced concrete," Develop Built Environ, vol. 17, Art. no. 100307, 2024.
16. A. Kaveh, S.R. Ardebili, "An improved plasma generation optimization algorithm for optimal design of reinforced concrete frames under time-history loading," Structures, vol. 34, pp. 758-770, 2021.
17. P. Parsa, H. Naderpour, "Shear strength estimation of reinforced concrete walls using support vector regression improved by teaching–learning-based optimization, particle swarm optimization, and harris hawks optimization algorithms," J Build Eng, vol. 44, Art. no. 102593, 2021.
18. H.-B. Ly, M.H. Nguyen, B.T. Pham, "Metaheuristic optimization of Levenberg–Marquardt-based artificial neural network using particle swarm optimization for prediction of foamed concrete compressive strength," Neural Comput Appl, vol. 33, pp. 17331-17351, 2021.
19. I. Negrin, M. Kripka, V. Yepes, "Metamodel-assisted meta-heuristic design optimization of reinforced concrete frame structures considering soil-structure interaction," Eng Struct, vol. 293, Art. no. 116657, 2023.
20. M. Ehsani, P. Hamidian, P. Hajikarimi, F.M. Nejad, "Optimized prediction models for faulting failure of jointed plain concrete pavement using the metaheuristic optimization algorithms," Constr Build Mater, vol. 364, Art. no. 129948, 2023.
21. L. Jie, P. Sahraeian, K.I. Zykova, M. Mirahmadi, M.L. Nehdi, "Predicting friction capacity of driven piles using new combinations of neural networks and metaheuristic optimization algorithms," Case Stud Construct Mater, vol. 19, Art. no. e02464, 2023.
22. E.M. Golafshani, A. Behnood, M. Arashpour, "Predicting the compressive strength of eco-friendly and normal concretes using hybridized fuzzy inference system and particle swarm optimization algorithm," Artif Intell Rev, vol. 56, pp. 7965-7984, 2023.
23. N. Concha, J.R. Aratan, E.M. Derigay, J.M. Martin, R.E. Taneo, "A hybrid neuro-swarm model for shear strength of steel fiber reinforced concrete deep beams," J Build Eng, vol. 76, Art. no. 107340, 2023.
24. S. Selcuk, P. Tang, "A metaheuristic-guided machine learning approach for concrete strength prediction with high mix design variability using ultrasonic pulse velocity data," Develop Built Environ, vol. 15, Art. no. 100220, 2023.
25. F. Daneshfar, S.J. Kabudian, "Speech emotion recognition using discriminative dimension reduction by employing a modified quantum-behaved particle swarm optimization algorithm," Multimed Tools Appl, vol. 79, pp. 1261-1289, 2020.
26. F. Daneshfar, M.J. Aghajani, "Enhanced text classification through an improved discrete laying chicken algorithm," Expert Syst, Art. no. e13553, 2024.
27. F. Daneshfar, S.J. Kabudian, "Speech emotion recognition using a new hybrid quaternion-based echo state network-bilinear filter," in 2021 7th international conference on signal processing and intelligent systems (ICSPIS), IEEE, pp. 1-5, 2021.
28. A. Yadhav, S. Gosavi, M. Kulkarni, "Nonlinear behaviour of a reinforced concrete building subjected to blast load and optimisation using a meta-heuristic algorithm," Asian J Civil Eng, pp. 1-16, 2023.
29. A. Kaveh, N. Khavaninzadeh, "Efficient training of two anns using four meta-heuristic algorithms for predicting the frp strength," Structures, vol. 52, pp. 256-272, 2023.
30. F. Di Trapani, A.P. Sberna, G.C. Marano, "A genetic algorithm-based framework for seismic retrofitting cost and expected annual loss optimization of non-conforming reinforced concrete frame structures," Comput Struct, vol. 271, Art. no. 106855, 2022.
31. H.-L. Minh, T. Sang-To, S. Khatir, M.A. Wahab, T. Cuong-Le, "Damage identification in high-rise concrete structures using a bio-inspired meta-heuristic optimization algorithm," Adv Eng Softw, vol. 176, Art. no. 103399, 2023.
32. S. Wang, P. Xia, K. Chen, F. Gong, H. Wang, Q. Wang, et al., "Prediction and optimization model of sustainable concrete properties using machine learning, deep learning and swarm intelligence: a review," J Build Eng, Art. no. 108065, 2023.
33. F. Kang, Y. Wu, J. Ma, J. Li, "Structural identification of super high arch dams using gaussian process regression with improved salp swarm algorithm," Eng Struct, vol. 286, Art. no. 116150, 2023.
34. D. Martínez-Muñoz, J. García, J. Martí, V. Yepes, "Discrete swarm intelligence optimization algorithms applied to steel–concrete composite bridges," Eng Struct, vol. 266, Art. no. 114607, 2022.
35. S.Y.-C. Chen, S. Yoo, Y.-L.L. Fang, "Quantum long short-term memory," in ICASSP 2022-2022 IEEE international conference on acoustics, speech and signal processing (ICASSP), IEEE, pp. 8622-8626, 2022.
36. Y.Y. Hong, J.B.D. Santos, "Day-ahead spatiotemporal wind speed forecasting based on a hybrid model of quantum and residual long short-term memory optimized by particle swarm algorithm," IEEE Syst J, 2023.
37. D. Li, "Multivariate time series prediction based on quantum enhanced lstm models," in Second international conference on electronic information technology (EIT 2023), vol. 12719, SPIE, pp. 491-497, 2023.
38. Y. Yu, G. Hu, C. Liu, J. Xiong, Z. Wu, "Prediction of solar irradiance one hour ahead based on quantum long short-term memory network," IEEE Trans Quantum Eng, 2023.
39. Shapna Akter M, Shahriar H, Alam Bhuiya Z. "Automated vulnerability detection in source code using quantum natural language processing," 2023. [Online]. Available: arXiv:2303.xxxxx
40. Y. Cao, X. Zhou, X. Fei, H. Zhao, W. Liu, J. Zhao, "Linear-layer-enhanced quantum long short-term memory for carbon price forecasting," Quant Mach Intell, vol. 5, p. 26, 2023.
41. W. Zhao, L. Wang, Z. Zhang, H. Fan, J. Zhang, S. Mirjalili, et al., "Electric eel foraging optimization: a new bio-inspired optimizer for engineering applications," Expert Syst Appl, vol. 238, Art. no. 122200, 2024.
42. D.S. Asudani, N.K. Nagwani, P. Singh, "A comparative evaluation of machine learning and deep learning algorithms for question categorization of vqa datasets," Multimed Tools Appl, pp. 1-31, 2023.
43. C. Lou, M.A. Al-qaness, D. AL-Alimi, A. Dahou, M. Abd Elaziz, L. Abualigah, et al., "Land use/land cover (lulc) classification using hyperspectral images: a review," Geo-Spatial Inf Sci, pp. 1-42, 2024.
44. M. Kordzanganeh, M. Buchberger, B. Kyriacou, M. Povolotskii, W. Fischer, A. Kurkin, et al., "Benchmarking simulated and physical quantum processing units using quantum and hybrid algorithms," Adv Quantum Technol, vol. 6, Art. no. 2300043, 2023.
45. K. Mitarai, M. Negoro, M. Kitagawa, K. Fujii, "Quantum circuit learning," Phys Rev A, vol. 98, Art. no. 032309, 2018.
46. V. Bergholm, J. Izaac, M. Schuld, C. Gogolin, S. Ahmed, V. Ajith, et al., "Pennylane: automatic differentiation of hybrid quantum-classical computations," 2018. [Online]. Available: arXiv:1811.04968
47. A.W. Mohamed, "An improved differential evolution algorithm with triangular mutation for global numerical optimization," Comput Ind Eng, vol. 85, pp. 359-375, 2015.
48. M.A. Elaziz, L. Abualigah, A.A. Ewees, M.A. Al-qaness, R.R. Mostafa, D. Yousri, et al., "Triangular mutation-based manta-ray foraging optimization and orthogonal learning for global optimization and engineering problems," Appl Intell, vol. 53, pp. 7788-7817, 2023.
49. Z.U. Khan, "Modeling and parameter ranking of construction labor productivity," Ph.D. thesis, Concordia University, 2005.
50. F. Wang, "On-site labor productivity estimation using neural networks," Ph.D. thesis, Concordia University, 2005.
51. A. Sharafati, S.B.H.S. Asadollah, N. Al-Ansari, "Application of bagging ensemble model for predicting compressive strength of hollow concrete masonry prism," Ain Shams Eng J, vol. 12, pp. 3521-3530, 2021.
52. J.-w. Park, D. Kuchma, "Strut-and-tie model analysis for strength prediction of deep beams," ACI Struct J, vol. 104, p. 657, 2007.
53. N.-T. Ngo, H.A. Le, Q.-T. Nguyen, et al., "Axial strength prediction of steel tube confined concrete columns using a hybrid machine learning model," Structures, vol. 36, pp. 765-780, 2022.
54. H. Park, G. Kweon, S.R. Lee, "Prediction of resilient modulus of granular subgrade soils and subbase materials using artificial neural network," Road Mater, Pavement Des, vol. 10, p. 647, 2009.
