Predicting Compressive Strength of Concrete Using Histogram-Based Gradient Boosting Approach for Rapid Design of Mixtures

Document Type : Research Papers

Authors

Assistant Professor, Civil Engineering Department, Faculty of Engineering Technology, Al-Balqa Applied University, Amman, Jordan.

Abstract

Applications of machine learning techniques in concrete properties' prediction have great interest to many researchers worldwide. Indeed, some of the most common machine learning methods are those based on adopting boosting algorithms. A new approach, histogram-based gradient boosting, was recently introduced to the literature. It is a technique that buckets continuous feature values into discrete bins to speed up the computations and reduce memory usage. Previous studies have discussed its efficiency in various scientific disciplines to save computational time and memory. However, the algorithm's accuracy is still unclear, and its application in concrete properties estimation has not yet been considered. This paper is devoted to evaluating the capability of histogram-based gradient boosting in predicting concrete's compressive strength and comparing its accuracy to other boosting methods. Generally, the results of the study have shown that the histogram-based gradient boosting approach is capable of achieving reliable prediction of concrete compressive strength. Additionally, it showed the effects of each model's parameters on the accuracy of the estimation.

Keywords

References

Ahmad, A., Ahmad, W., Aslam, F. and Joyklad, P. (2022). “Compressive strength prediction of fly ash-based geopolymer concrete via advanced machine learning techniques”, Case Studies in Construction Materials, 16(1 June), e00840, https://doi.org/10.1016/j.cscm.2021.e00840.
Al Houri, A., Habib, A., Elzokra, A. and Habib, M. (2020). “Tensile testing of soils: History, equipment and methodologies”, Civil Engineering Journal, 6(3), 591-601, https://doi.org/10.28991/cej-2020-03091494.
Amidi, Y., Nazari, B., Sadri, S. and Yousefi, A. (2021). “Parameter estimation in multiple dynamic synaptic coupling model using Bayesian Point Process State-Space Modeling framework”, Neural Computation, 33(5), 1269-1299, https://doi.org/10.1162/neco_a_01375.
Asteris, P.G., Skentou, A.D., Bardhan, A., Samui, P. and Pilakoutas, K. (2021). “Predicting concrete compressive strength using hybrid ensembling of surrogate machine learning models”, Cement and Concrete Research, 145(1 July), 106449, https://doi.org/10.1016/j.cemconres.2021.106449.
Cai, J., Li, X., Tan, Z. and Peng, S. (2021). “An assembly-level neutronic calculation method based on LightGBM algorithm”, Annals of Nuclear Energy, 150(1 January), 107871, https://doi.org/10.1016/j.anucene.2020.107871.
Chaabene, W.B., Flah, M. and Nehdi, M.L. (2020). “Machine learning prediction of mechanical properties of concrete: Critical review”, Construction and Building Materials, 260(10 November), 119889, https://doi.org/10.1016/j.conbuildmat.2020.119889.
Chen, T., and Guestrin, C. (2016). “Xgboost: A scalable tree boosting system”, Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining (pp. 785-794), San Francisco, California, USA.
Chopra, P., Sharma, R.K. and Kumar, M. (2016). “Prediction of compressive strength of concrete using artificial neural network and genetic programming”, Advances in Materials Science and Engineering, 2016(10 January), Article ID 7648467, https://doi.org/10.1155/2016/7648467. 
DeRousseau, M.A., Kasprzyk, J.R. and Srubar III, W.V. (2018). “Computational design optimization of concrete mixtures: A review”, Cement and Concrete Research, 109(1 July), 42-53, https://doi.org/10.1016/j.cemconres.2018.04.007.
Drucker, H. (1997). Improving regressors using boosting techniques”, 97th International Conference on Machine Learning (ICML), Vol. 97, pp. 107-115, https://doi.org/10.1155/2016/7648467.
Elzokra, A., Al Houri, A., Habib, A., Habib, M. and Malkawi, A.B. (2020). “Shrinkage behavior of conventional and nonconventional concrete: A review”, Civil Engineering Journal, 6(9), 1839-1851, https://doi.org/10.28991/cej-2020-03091586.
Farooq, F., Nasir Amin, M., Khan, K., Rehan Sadiq, M., Faisal Javed, M., Aslam, F. and Alyousef, R. (2020). “A comparative study of random forest and genetic engineering programming for the prediction of compressive strength of high strength concrete (HSC)”, Applied Sciences, 10(20), 7330, https://doi.org/10.3390/app10207330.
Feng, D.C., Liu, Z.T., Wang, X.D., Chen, Y., Chang, J.Q., Wei, D.F. and Jiang, Z.M. (2020). “Machine learning-based compressive strength prediction for concrete: An adaptive boosting approach”, Construction and Building Materials, 230(10 January), 117000, https://doi.org/10.1016/j.conbuildmat.2019.117000.
Freund, Y., and Schapire, R.E. (1997). “A decision-theoretic generalization of on-line learning and an application to boosting”, Journal of Computer and System Sciences, 55(1), 119-139, https://doi.org/10.1006/jcss.1997.1504.
Gholamzadeh Chitgar, A. and Berenjian, J. (2021). “Performance evaluation of RBF networks with various variables to forecast the properties of SCCs”, Civil Engineering Infrastructures Journal, 54(1), 59-73.
Guryanov, A. (2019). “Histogram-based algorithm for building gradient boosting ensembles of piecewise linear decision trees”, International Conference on Analysis of Images, Social Networks and Texts (pp. 39-50), Springer, Cham, https://doi.org/10.1007/978-3-030-37334-4_4.
Habib, A., Houri, A.A., Habib, M., Elzokra, A. and Yildirim, U. (2021). “Structural performance and Finite Element modeling of roller compacted concrete dams: A review”, Latin American Journal of Solids and Structures, 18(13 May), https://doi.org/10.1590/1679-78256467.
Habib, A. and Yildirim, U. (2021). “Prediction of the dynamic properties in rubberized concrete”, Computers and Concrete, 27(3), 185-197, https://doi.org/10.12989/cac.2021.27.3.185.
Han, Q., Gui, C., Xu, J. and Lacidogna, G. (2019). “A generalized method to predict the compressive strength of high-performance concrete by improved random forest algorithm”, Construction and Building Materials, 226(30 November), 734-742, https://doi.org/10.1016/j.conbuildmat.2019.07.315.
Kaloop, M.R., Kumar, D., Samui, P., Hu, J.W. and Kim, D. (2020). “Compressive strength prediction of high-performance concrete using gradient tree boosting machine”, Construction and Building Materials, 264(20 December), 120198, https://doi.org/10.1016/j.conbuildmat.2020.120198.
Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q. and Liu, T.Y. (2017). “Lightgbm: A highly efficient gradient boosting decision tree”, NeurIPS Proceedings, Advances in Neural Information Processing Systems (NIPS 2017), 30, 3146-3154.  
Ke, X., and Duan, Y. (2021). “A Bayesian machine learning approach for inverse prediction of high-performance concrete ingredients with targeted performance”, Construction and Building Materials, 270(8 February), 121424, https://doi.org/10.1016/j.conbuildmat.2020.121424.
Khademi, F., Akbari, M., Jamal, S.M. and Nikoo, M. (2017). “Multiple linear regression, artificial neural network, and fuzzy logic prediction of 28 days compressive strength of concrete”, Frontiers of Structural and Civil Engineering, 11(1), 90-99, https://doi.org/10.1007/s11709-016-0363-9.
Kim, B., Lee, D. E., Hu, G., Natarajan, Y., Preethaa, S. and Rathinakumar, A.P. (2022). “Ensemble machine learning-based approach for predicting of FRP-concrete interfacial bonding”, Mathematics, 10(2), 231, https://doi.org/10.3390/math10020231.
Lee, S.C. (2003). “Prediction of concrete strength using artificial neural networks”, Engineering Structures, 25(7), 849-857, https://doi.org/10.1016/S0141-0296(03)00004-X.
Loh, W.Y. (2011). “Classification and regression trees”, Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 1(1), 14-23.
Lu, H., Karimireddy, S.P., Ponomareva, N. and Mirrokni, V. (2020). “Accelerating gradient boosting machines”, International Conference on Artificial Intelligence and Statistics, (pp. 516-526), PMLR.
Malkawi, A.B., Habib, M., Aladwan, J. and Alzubi, Y. (2020). “Engineering properties of fibre reinforced lightweight geopolymer concrete using palm oil biowastes”, Australian Journal of Civil Engineering, 18(1), 82-92, https://doi.org/10.1080/14488353.2020.172195.
Mease, D. and Wyner, A.J. (2008). “Evidence contrary to the statistical view of boosting”, Journal of Machine Learning Research, 9, 131- 156.
Nguyen-Sy, T., Wakim, J., To, Q.D., Vu, M.N., Nguyen, T.D. and Nguyen, T.T. (2020). “Predicting the compressive strength of concrete from its compositions and age using the extreme gradient boosting method”, Construction and Building Materials, 260(10 November), 119757, https://doi.org/10.1016/j.conbuildmat.
Ni, H.G. and Wang, J.Z. (2000). “Prediction of compressive strength of concrete by neural networks”, Cement and Concrete Research, 30(8), 1245-1250, https://doi.org/10.1016/S0008-8846(00)00345-8.
Salimbahrami, S.R. and Shakeri, R. (2021). “Experimental investigation and comparative machine-learning prediction of compressive strength of recycled aggregate concrete”, Soft Computing, 25(2), 919-932, https://doi.org/10.1007/s00500-021-05571-1.
Shepovalov, M. and Akella, V. (2020). “FPGA and GPU-based acceleration of ML workloads on Amazon cloud-A case study using gradient boosted decision tree library”, Integration, 70(1 January), 1-9, https://doi.org/10.1016/j.vlsi.2019.09.007.
Topcu, I.B. and Sarıdemir, M. (2008). “Prediction of compressive strength of concrete containing fly ash using artificial neural networks and fuzzy logic”, Computational Materials Science, 41(3), 305-311, https://doi.org/10.1016/j.commatsci.2007.04.009.
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V. and Vanderplas, J. (2011). “Scikit-learn: Machine learning in Python”, The Journal of Machine Learning Research, 12(1 November), 2825-2830.
Wardeh, G., Ghorbel, E. and Gomart, H. (2015). “Mix design and properties of recycled aggregate concretes: applicability of Eurocode 2”, International Journal of Concrete Structures and Materials, 9(1), 1-20, https://doi.org/10.1007/s40069-014-0087-y.
Yeh, I.C. (1998). “Modeling of strength of high-performance concrete using artificial neural networks”, Cement and Concrete Research, 28(12), 1797-1808, https://doi.org/10.1016/j.commatsci.2007.04.009.
Yeh, I.C. (2006). “Analysis of strength of concrete using design of experiments and neural networks”, Journal of Materials in Civil Engineering, 18(4), 597-604, https://doi.org/10.1061/(ASCE)0899-1561(2006)18:4(597).
Yeh, I.C. (2007). “Computer-aided design for optimum concrete mixtures”, Cement and Concrete Composites, 29(3), 193-202, https://doi.org/10.1016/j.cemconcomp.2006.11.001.
Ziolkowski, P. and Niedostatkiewicz, M. (2019). “Machine learning techniques in concrete mix design”, Materials, 12(8), 1256, https://doi.org/10.3390/ma12081256.
Civil Engineering Infrastructures Journal
Volume 56, Issue 1
June 2023
Pages 159-172

Files

History

  • Receive Date: 21 January 2022
  • Revise Date: 14 March 2022
  • Accept Date: 04 April 2022

Share

How to cite

Statistics