Optimized quantum LSTM using modified electric Eel foraging optimization for real-world intelligence engineering systems
DOI:
https://doi.org/10.1016/j.asej.2024.102982الكلمات المفتاحية:
Machine learningMetaheuristicsQuantum LSTMElectric Eel foraging optimizationTriangular mutation operatorالملخص
The integration of metaheuristics with machine learning methodologies presents significant advantages, particularly in optimization and computational intelligence. This amalgamation leverages the global search capabilities of metaheuristics alongside the pattern recognition and predictive prowess of machine learning, facilitating enhanced convergence rates and solution quality in complex problem spaces. The Quantum Long Short-Term Memory (QLSTM) emerges as a highly efficient deep learning model tailored to tackle such intricate engineering problems. The QLSTM's architecture, comprising data encoding, variational, and quantum measurement layers, facilitates the effective encoding and processing of civil engineering data, leading to heightened prediction accuracy. However, the task of determining optimal values for QLSTM parameters presents challenges due to its NP-problem nature and time-consuming characteristics. To address this, we propose an alternative technique to optimize the QLSTM based on a modified Electric Eel Foraging Optimization (MEEFO). The MEEFO is a modified version of the original EEFO that applies triangular mutation operators to boost the search capability of the traditional EEFO. Thus, the MEEFO optimizes the QLSTM and boosts its prediction performance. To validate the efficacy of our proposed method, we conduct comprehensive experiments utilizing five real-world engineering datasets related to construction and structure engineering. The evaluation outcomes unequivocally demonstrate that the MMEFO significantly enhances the performance of the QLSTM.المراجع
Alharbi, E. M., & Rajeh, A. (2022). Tailoring the structural, optical, dielectric, and electrical properties of PEO/PVA blend using graphene nanoplates for energy storage devices. Journal of Materials Science: Materials in Electronics, 33(27), 22196–22207. https://doi.org/10.1007/s10854-022-08999-9
Alghamdi, H. M., & Rajeh, A. (2025). Integrating the structural, optical, magnetic, electrical, and dielectric properties of PAM/PEO/NiCo2O4 nanocomposites for opto-magnetic and energy storage applications. Ceramics International, 51(12), 18045–18055. https://doi.org/10.1016/j.ceramint.2025.01.581
Al-Mhyawi, S. R., Al-Sulami, A. I., AlSulami, F. M. H., & et al. (2025). Preparation and modulating of the thermal, optical, dielectric, and electrical properties of PCL/PMMA-NiO/SnO2 nanocomposites for energy storage devices. Ceramics International, 51(20), 32623–32636. https://doi.org/10.1016/j.ceramint.2025.04.440
Alyami, M., Khan, M., Javed, M. F., Ali, M., Alabduljabbar, H., Najeh, T., & et al. (2024). Application of metaheuristic optimization algorithms in predicting the compressive strength of 3d-printed fiber-reinforced concrete. Developments in the Built Environment, 17, Article 100307. https://doi.org/10.1016/j.dibe.2024.100307
Alzahrani, H. S., Almaghamsi, H., Al-Balawi, S. A., & et al. (2024). Study of structural, optical, photoluminescence, dielectric, and conductivity properties of PVDF/PVP-SnO2 nanocomposites for optoelectronics and micro-supercapacitors. Journal of Energy Storage, 102, Article 114034. https://doi.org/10.1016/j.est.2024.114034
Alsulami, Q. A., & Rajeh, A. (2023). Modification and development in the microstructure of PVA/CMC-GO/Fe3O4 nanocomposites films as an application in energy storage devices and magnetic electronics industry. Ceramics International, 49(9), 14399–14407. https://doi.org/10.1016/j.ceramint.2023.01.029
Al-Ojeery, A., & Farea, M. O. (2023). Optical and dielectric properties of polymer nanocomposite based on PEG/NaAlg blend and Ag/Au nanoparticles prepared by green synthesis method for energy storage applications. Optical and Quantum Electronics, 55(11), Article 988. https://doi.org/10.1007/s11082-023-05243-4
Arabameri, A., Pal, S. C., Rezaie, F., Nalivan, O. A., Chowdhuri, I., Saha, A., & et al. (2021). Modeling groundwater potential using novel gis-based machine-learning ensemble techniques. Journal of Hydrology: Regional Studies, 36, Article 100848. https://doi.org/10.1016/j.ejrh.2021.100848
Asudani, D. S., Nagwani, N. K., & Singh, P. (2023). A comparative evaluation of machine learning and deep learning algorithms for question categorization of vqa datasets. Multimedia Tools and Applications, 1–31. https://doi.org/10.1007/s11042-023-15025-5
Bergholm, V., Izaac, J., Schuld, M., Gogolin, S., Ahmed, S., Ajith, V., & et al. (2018). Pennylane: Automatic differentiation of hybrid quantum-classical computations. arXiv preprint arXiv:1811.04968.
Cao, Y., Zhou, X., Fei, H., Zhao, H., Liu, W., & Zhao, J. (2023). Linear-layer-enhanced quantum long short-term memory for carbon price forecasting. Quantum Machine Intelligence, 5(2), Article 26. https://doi.org/10.1007/s42484-023-00114-1
Carvalho, J. P. G., Vargas, D. E., Jacob, B. P., Lima, B. S., Hallak, P. H., & Lemonge, A. C. (2024). Multi-objective structural optimization for the automatic member grouping of truss structures using evolutionary algorithms. Computers & Structures, 292, Article 107230. https://doi.org/10.1016/j.compstruc.2023.107230
Chen, S. Y.-C., Yoo, S., & Fang, Y.-L. L. (2022). Quantum long short-term memory. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 8622–8626). IEEE. https://doi.org/10.1109/ICASSP43903.2022.9746312
Chou, J.-S., & Fleshman, D.-B. (2022). Comparison of machine learning models to provide preliminary forecasts of real estate prices. Journal of Housing and the Built Environment, 37(4), 2079–2114. https://doi.org/10.1007/s10901-021-09915-y
Chou, J.-S., Karundeng, M. A., Truong, D.-N., & Cheng, M.-Y. (2022). Identifying deflections of reinforced concrete beams under seismic loads by bio-inspired optimization of deep residual learning. Structural Control and Health Monitoring, 29(4), Article e2918. https://doi.org/10.1002/stc.2918
Chou, J.-S., Truong, D.-N., Le, T.-L., & Truong, T. T. H. (2021). Bio-inspired optimization of weighted-feature machine learning for strength property prediction of fiber-reinforced soil. Expert Systems with Applications, 180, Article 115042. https://doi.org/10.1016/j.eswa.2021.115042
Chou, J.-S., Cheng, M.-Y., Hsieh, Y.-M., Yang, I.-T., & Hsu, H.-T. (2019). Optimal path planning in real time for dynamic building fire rescue operations using wireless sensors and visual guidance. Automation in Construction, 99, 1–17. https://doi.org/10.1016/j.autcon.2018.11.019
Concha, N., Aratan, J. R., Derigay, E. M., Martin, J. M., & Taneo, R. E. (2023). A hybrid neuro-swarm model for shear strength of steel fiber reinforced concrete deep beams. Journal of Building Engineering, 76, Article 107340. https://doi.org/10.1016/j.jobe.2023.107340
Daneshfar, F., & Aghajani, M. J. (2024). Enhanced text classification through an improved discrete laying chicken algorithm. Expert Systems, Article e13553. https://doi.org/10.1111/exsy.13553
Daneshfar, F., & Kabudian, S. J. (2020). Speech emotion recognition using discriminative dimension reduction by employing a modified quantum-behaved particle swarm optimization algorithm. Multimedia Tools and Applications, 79(3), 1261–1289. https://doi.org/10.1007/s11042-019-08246-y
Daneshfar, F., & Kabudian, S. J. (2021). Speech emotion recognition using a new hybrid quaternion-based echo state network-bilinear filter. In 2021 7th International Conference on Signal Processing and Intelligent Systems (ICSPIS) (pp. 1–5). IEEE. https://doi.org/10.1109/ICSPIS54653.2021.9729363
Ehsani, M., Hamidian, P., Hajikarimi, P., & Nejad, F. M. (2023). Optimized prediction models for faulting failure of jointed plain concrete pavement using the metaheuristic optimization algorithms. Construction and Building Materials, 364, Article 129948. https://doi.org/10.1016/j.conbuildmat.2022.129948
Elaziz, M. A., Abualigah, L., Ewees, A. A., Al-qaness, M. A., Mostafa, R. R., & Yousri, D. (2023). Triangular mutation-based manta-ray foraging optimization and orthogonal learning for global optimization and engineering problems. Applied Intelligence, 53(7), 7788–7817. https://doi.org/10.1007/s10489-022-03822-8
Ficarella, E., Lamberti, L., & Degertekin, S. (2021). Comparison of three novel hybrid metaheuristic algorithms for structural optimization problems. Computers & Structures, 244密, Article 106395. https://doi.org/10.1016/j.compstruc.2020.106395
Golafshani, E. M., Behnood, A., & Arashpour, M. (2023). Predicting the compressive strength of eco-friendly and normal concretes using hybridized fuzzy inference system and particle swarm optimization algorithm. Artificial Intelligence Review, 56(8), 7965–7984. https://doi.org/10.1007/s10462-022-10382-4
Grillanda, N., Chiozzi, A., Milani, G., & Tralli, A. (2020). Efficient meta-heuristic mesh adaptation strategies for nurbs upper–bound limit analysis of curved three-dimensional masonry structures. Computers & Structures, 236, Article 106271. https://doi.org/10.1016/j.compstruc.2020.106271
Hartmann, T., & Trappey, A. (2020). Advanced engineering informatics-philosophical and methodological foundations with examples from civil and construction engineering. Developments in the Built Environment, 4, Article 100020. https://doi.org/10.1016/j.dibe.2020.100020
Hong, Y. Y., & Santos, J. B. D. (2023). Day-ahead spatiotemporal wind speed forecasting based on a hybrid model of quantum and residual long short-term memory optimized by particle swarm algorithm. IEEE Systems Journal, 17(4), 5122–5134. https://doi.org/10.1109/JSYST.2023.3289011
Jahangiri, M., Hadianfard, M. A., Najafgholipour, M. A., Jahangiri, M., & Gerami, M. R. (2020). Interactive autodidactic school: A new metaheuristic optimization algorithm for solving mathematical and structural design optimization problems. Computers & Structures, 235, Article 106268. https://doi.org/10.1016/j.compstruc.2020.106268
Jie, L., Sahraeian, P., Zykova, K. I., Mirahmadi, M., & Nehdi, M. L. (2023). Predicting friction capacity of driven piles using new combinations of neural networks and metaheuristic optimization algorithms. Case Studies in Construction Materials, 19, Article e02464. https://doi.org/10.1016/j.cscm.2023.e02464
Jiang, W., Xie, Y., Li, W., Wu, J., & Long, G. (2021). Prediction of the splitting tensile strength of the bonding interface by combining the support vector machine with the particle swarm optimization algorithm. Engineering Structures, 230, Article 111696. https://doi.org/10.1016/j.engstruct.2020.111696
Kang, F., Wu, Y., Ji, M., & Li, J. (2023). Structural identification of super high arch dams using gaussian process regression with improved salp swarm algorithm. Engineering Structures, 286, Article 116150. https://doi.org/10.1016/j.engstruct.2023.116150
Kaveh, A., & Ardebili, S. R. (2021). An improved plasma generation optimization algorithm for optimal design of reinforced concrete frames under time-history loading. Structures, 34, 758–770. https://doi.org/10.1016/j.istruc.2021.08.044
Kaveh, A., & Khavaninzadeh, N. (2023). Efficient training of two anns using four meta-heuristic algorithms for predicting the frp strength. Structures, 52, 256–272. https://doi.org/10.1016/j.istruc.2023.03.112
Khan, Z. U. (2005). Modeling and parameter ranking of construction labor productivity (Ph.D. thesis). Concordia University, Montreal, Canada.
Kordzanganeh, M., Buchberger, M., Kyriacou, B., Povolotskii, M., Fischer, W., Kurkin, A., & et al. (2023). Benchmarking simulated and physical quantum processing units using quantum and hybrid algorithms. Advanced Quantum Technologies, 6(10), Article 2300043. https://doi.org/10.1002/qute.202300043
Li, D. (2023). Multivariate time series prediction based on quantum enhanced lstm models. In Second International Conference on Electronic Information Technology (EIT 2023) (Vol. 12719, pp. 491–497). SPIE. https://doi.org/10.1117/12.2681524
Lou, C., Al-qaness, M. A., AL-Alimi, D., Dahou, A., Elaziz, M. A., Abualigah, L., & et al. (2024). Land use/land cover (lulc) classification using hyperspectral images: A review. Geo-Spatial Information Science, 1–42. https://doi.org/10.1080/10095020.2023.2285431
Ly, H.-B., Nguyen, M. H., & Pham, B. T. (2021). Metaheuristic optimization of Levenberg–Marquardt-based artificial neural network using particle swarm optimization for prediction of foamed concrete compressive strength. Neural Computing and Applications, 33(24), 17331–17351. https://doi.org/10.1007/s00521-021-06300-z
Martínez-Muñoz, D., García, J., Martí, J., & Yepes, V. (2022). Discrete swarm intelligence optimization algorithms applied to steel–concrete composite bridges. Engineering Structures, 266, Article 114607. https://doi.org/10.1016/j.engstruct.2022.114607
Minh, H.-L., Sang-To, T., Khatir, S., Wahab, M. A., & Cuong-Le, T. (2023). Damage identification in high-rise concrete structures using a bio-inspired meta-heuristic optimization algorithm. Advanced Engineering Software, 176, Article 103399. https://doi.org/10.1016/j.advengsoft.2022.103399
Mitarai, K., Negoro, M., Kitagawa, M., & Fujii, K. (2018). Quantum circuit learning. Physical Review A, 98(3), Article 032309. https://doi.org/10.1103/PhysRevA.98.032309
Mohamed, A. W. (2015). An improved differential evolution algorithm with triangular mutation for global numerical optimization. Computers & Industrial Engineering, 85, 359–375. https://doi.org/10.1016/j.cie.2015.04.007
Negrin, I., Kripka, M., & Yepes, V. (2023). Metamodel-assisted meta-heuristic design optimization of reinforced concrete frame structures considering soil-structure interaction. Engineering Structures, 293, Article 116657. https://doi.org/10.1016/j.engstruct.2023.116657
Ngo, N.-T., Le, H. A., & Nguyen, Q.-T. (2022). Axial strength prediction of steel tube confined concrete columns using a hybrid machine learning model. Structures, 36, 765–780. https://doi.org/10.1016/j.istruc.2021.12.045
Park, H., Kweon, G., & Lee, S. R. (2009). Prediction of resilient modulus of granular subgrade soils and subbase materials using artificial neural network. Road Materials and Pavement Design, 10(3), 647–663. https://doi.org/10.1080/14680629.2009.9690218
Park, J.-W., & Kuchma, D. (2007). Strut-and-tie model analysis for strength prediction of deep beams. ACI Structural Journal, 104(6), 657–666.
Parsa, P., & Naderpour, H. (2021). Shear strength estimation of reinforced concrete walls using support vector regression improved by teaching–learning-based optimization, particle swarm optimization, and harris hawks optimization algorithms. Journal of Building Engineering, 44, Article 102593. https://doi.org/10.1016/j.jobe.2021.102593
Selcuk, S., & Tang, P. (2023). A metaheuristic-guided machine learning approach for concrete strength prediction with high mix design variability using ultrasonic pulse velocity data. Developments in the Built Environment, 15, Article 100220. https://doi.org/10.1016/j.dibe.2023.100220
Sharafati, A., Asadollah, S. B. H. S., & Al-Ansari, N. (2021). Application of bagging ensemble model for predicting compressive strength of hollow concrete masonry prism. Ain Shams Engineering Journal, 12(4), 3521–3530. https://doi.org/10.1016/j.asej.2021.04.016
Shapna Akter, M., Shahriar, H., & Alam Bhuiya, Z. (2023). Automated vulnerability detection in source code using quantum natural language processing. arXiv preprint arXiv:2303.11542.
Trapani, F. D., Sberna, A. P., & Marano, G. C. (2022). A genetic algorithm-based framework for seismic retrofitting cost and expected annual loss optimization of non-conforming reinforced concrete frame structures. Computers & Structures, 271, Article 106855. https://doi.org/10.1016/j.compstruc.2022.106855
Truong, D.-N., & Chou, J.-S. (2022). Fuzzy adaptive jellyfish search-optimized stacking machine learning for engineering planning and design. Automation in Construction, 143, Article 104579. https://doi.org/10.1016/j.autcon.2022.104579
Wang, F. (2005). On-site labor productivity estimation using neural networks (Ph.D. thesis). Concordia University, Montreal, Canada.
Wang, S., Xia, P., Chen, K., Gong, F., Wang, H., Wang, Q., & et al. (2023). Prediction and optimization model of sustainable concrete properties using machine learning, deep learning and swarm intelligence: A review. Journal of Building Engineering, 79, Article 108065. https://doi.org/10.1016/j.jobe.2023.108065
Yadhav, A., Gosavi, S., & Kulkarni, M. (2023). Nonlinear behaviour of a reinforced concrete building subjected to blast load and optimisation using a meta-heuristic algorithm. Asian Journal of Civil Engineering, 24(8), 1–16. https://doi.org/10.1007/s42107-023-00685-z
Yu, Y., Hu, G., Liu, C., Xiong, J., & Wu, Z. (2023). Prediction of solar irradiance one hour ahead based on quantum long short-term memory network. IEEE Transactions on Quantum Engineering, 4, 1–12. https://doi.org/10.1109/TQE.2023.3290514
Zhang, C., Tao, M.-X., Wang, C., Yang, C., & Fan, J.-S. (2024). Differentiable automatic structural optimization using graph deep learning. Advanced Engineering Informatics, 60, Article 102363. https://doi.org/10.1016/j.aei.2024.102363
Zhang, Y., Zhong, W., Li, Y., & Wen, L. (2023). A deep learning prediction model of densenet-lstm for concrete gravity dam deformation based on feature selection. Engineering Structures, 295, Article 116827. https://doi.org/10.1016/j.engstruct.2023.116827
Zhao, W., Wang, L., Zhang, Z., Fan, H., Zhang, J., Mirjalili, S., & et al. (2024). Electric eel foraging optimization: A new bio-inspired optimizer for engineering applications. Expert Systems with Applications, 238, Article 122200. https://doi.org/10.1016/j.eswa.2023.122200
