Demand Forecasting in Retail Business Using the Ensemble Machine Learning Framework - A Stacking Approach

Authors

  • Chukwuka Izuchukwu C. Obi 101, 635 57 Avenue, SW, Calgary. Alberta. T2V0H5. Canada

Keywords:

Stacking Ensemble, Multilayer Perceptron , Demand Forecasting

Abstract

Demand forecasting is an integral component of organizational and supply chain operations. Its primary objective is to anticipate the future demand for products, thereby informing and refining strategic decisions related to inventory management. Despite the inherent complexities in achieving precise demand forecasts, many methodologies have been proposed for the establishment of efficient forecasting systems. Such methodologies encompass traditional statistical approaches, hybrid techniques, and advanced methodologies rooted in machine learning and deep learning. Scholarly investigations within demand forecasting indicate a growing preference for deep learning paradigms, especially when confronted with data characterized by multivariate attributes, high dimensionality, and unpredictable demand fluctuations. Given the research emphasis on the retail domain, a sector inherently marked by data that is both multivariate and possesses volatile demand characteristics, this study devised a Stacking Ensemble learner. A comparative assessment was subsequently conducted, evaluating this ensemble against a trained Multilayer Perceptron , a deep learning archetype. The evaluation utilized a historical sales dataset sourced from ten Walmart outlets across Texas, California, and Wisconsin. Evaluative metrics were employed to discern the forecasting proficiencies of the respective frameworks. The evaluation determined that the Stacking Ensemble model outperformed the Multilayer Perceptron in terms of accurate predictions.

References

S. Punia, K. Nikolopoulos, S. P. Singh, J. K. Madaan, and K. Litsiou, “Deep learning with long short-term memory networks and random forests for demand forecasting in multi-channel retail,” International Journal of Production Research, vol. 58, no. 16, pp. 4964–4979, Mar. 2020, doi: 10.1080/00207543.2020.1735666.

Kiefer, Grimm, Bauer, and Van, “Demand forecasting intermittent and lumpy time series: Comparing statistical, machine learning and deep learning methods,” Proceedings of the Annual Hawaii International Conference on System Sciences, 2021, doi: 10.24251/hicss.2021.172.

Farzana and Prakash, “Machine learning in demand forecasting - a review,” SSRN Electronic Journal, 2020, doi: 10.2139/ssrn.3733548.

Ingle, Bakliwal, Jain, Singh, Kale, and Chhajed, “Demand forecasting?: Literature review on various methodologies,” 2021 12th International Conference on Computing Communication and Networking Technologies (ICCCNT), Jul. 2021, doi: 10.1109/icccnt51525.2021.9580139.

Kilimci et al., “An improved demand forecasting model using deep learning approach and proposed decision integration strategy for supply chain,” Complexity, vol. 2019, pp. 1–15, Mar. 2019, doi: 10.1155/2019/9067367.

Y.-H. Kuo and A. Kusiak, “From data to big data in production research: the past and future trends,” International Journal of Production Research, vol. 57, no. 15–16, pp. 4828–4853, Mar. 2018, doi: 10.1080/00207543.2018.1443230.

B. Shen, T.-M. Choi, and S. Minner, “A review on supply chain contracting with information considerations: information updating and information asymmetry,” International Journal of Production Research, vol. 57, no. 15–16, pp. 4898–4936, May 2018, doi: 10.1080/00207543.2018.1467062.

S. Huang, A. Potter, and D. Eyers, “Social media in operations and supply chain management: State-of-the-Art and research directions,” International Journal of Production Research, vol. 58, no. 6, pp. 1893–1925, Dec. 2019, doi: 10.1080/00207543.2019.1702228.

Yeasmin, Amin, and Tosarkani, “Machine learning techniques for grocery sales forecasting by analyzing historical data,” Learning and Analytics in Intelligent Systems, pp. 21–36, Dec. 2021, doi: 10.1007/978-3-030-85383-9_2.

Benidis et al., “Deep learning for time series forecasting: Tutorial and literature survey,” ACM Computing Surveys, May 2022, doi: 10.1145/3533382.

D. Wiyanti, I. Kharisudin, A. Setiawan, and A. Nugroho, “Machine-learning algorithm for demand forecasting problem,” Journal of Physics: Conference Series, vol. 1918, no. 4, p. 042012, Jun. 2021, doi: 10.1088/1742-6596/1918/4/042012.

Wang, Liu, and Liu, “A selection of advanced technologies for demand forecasting in the retail industry,” 2019 IEEE 4th International Conference on Big Data Analytics (ICBDA), Mar. 2019, doi: 10.1109/icbda.2019.8713196.

Ghosh, “Forecasting of demand using ARIMA model,” American Journal of Applied Mathematics and Computing, vol. 1, no. 2, 2020, [Online]. Available: https://ajamc.smartsociety.org/wp-content/uploads/2020/09/paper4.pdf

Silva, Figueiredo, and Braga, “Demand forecasting: A case study in the food industry,” Computational Science and Its Applications – ICCSA 2019, pp. 50–63, 2019, doi: 10.1007/978-3-030-24302-9_5.

R. Priyadarshi, A. Panigrahi, S. Routroy, and G. K. Garg, “Demand forecasting at retail stage for selected vegetables: a performance analysis,” Journal of Modelling in Management, vol. 14, no. 4, pp. 1042–1063, Oct. 2019, doi: 10.1108/jm2-11-2018-0192.

Aishwarya, Aishwarya, Kumari, Mishra, and Rashmi, “Food demand prediction using machine learning,” International Research Journal of Engineering and Technology, vol. 7, no. 6, 2020, [Online]. Available: https://www.irjet.net/archives/V7/i6/IRJET-V7I6686.pdf

Ramya and Vedavathi, “An advanced sales forecasting using machine learning algorithm.,” International Journal of Innovative Science and Research Technology, vol. 5, no. 5, 2020, [Online]. Available: https://www.ijisrt.com/assets/upload/files/IJISRT20MAY134.pdf

Lakshmanan, Vivek Raja, and Kalathiappan, “Sales demand forecasting using LSTM network,” Advances in Intelligent Systems and Computing, pp. 125–132, 2020, doi: 10.1007/978-981-15-0199-9_11.

IBM Cloud Education, “Machine learning,” IBM Cloud Education, Jul. 15, 2020. https://www.ibm.com/cloud/learn/machine-learning

Date, “Holt-Winters exponential smoothing,” Time Series Analysis, Regression and Forecasting, Sep. 30, 2021. https://timeseriesreasoning.com/contents/holt-winters-exponential-smoothing/

Hebbar, “Time series forecasting with ARIMA model in python for temperature prediction,” Medium, Dec. 15, 2021. https://medium.com/swlh/temperature-forecasting-with-arima-model-in-python-427b2d3bcb53

Hyndman and Athanasopoulos, Forecasting: Principles and practice. OTexts, 2018.

D. Painuli, D. Mishra, S. Bhardwaj, and M. Aggarwal, “Forecast and prediction of COVID-19 using machine learning,” Data Science for COVID-19, pp. 381–397, 2021, doi: 10.1016/b978-0-12-824536-1.00027-7.

Ray, “A quick review of machine learning algorithms,” 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon), Feb. 2019, doi: 10.1109/comitcon.2019.8862451.

Maulud and Abdulazeez, “A review on linear regression comprehensive in machine learning,” Journal of Applied Science and Technology Trends, vol. 1, no. 4, pp. 140–147, Dec. 2020, doi: 10.38094/jastt1457.

S. Glen, “Lasso regression: Simple definition,” Statistics How To, Apr. 27, 2021. https://www.statisticshowto.com/lasso-regression/

?. Özlem and O. F. Tan, “Predicting cash holdings using supervised machine learning algorithms,” Financial Innovation, vol. 8, no. 1, May 2022, doi: 10.1186/s40854-022-00351-8.

N. Vairagade, D. Logofatu, F. Leon, and F. Muharemi, “Demand forecasting using random forest and artificial neural network for supply chain management,” Computational Collective Intelligence, pp. 328–339, 2019, doi: 10.1007/978-3-030-28377-3_27.

G. Behera and N. Nain, “A comparative study of big mart sales prediction,” Communications in Computer and Information Science, pp. 421–432, 2020, doi: 10.1007/978-981-15-4015-8_37.

R. A. Abbasi, N. Javaid, M. N. J. Ghuman, Z. A. Khan, S. Ur Rehman, and Amanullah, “Short term load forecasting using XGBoost,” Advances in Intelligent Systems and Computing, pp. 1120–1131, 2019, doi: 10.1007/978-3-030-15035-8_108.

P. Saha, N. Gudheniya, R. Mitra, D. Das, S. Narayana, and M. K. Tiwari, “Demand Forecasting of a Multinational Retail Company using Deep Learning Frameworks,” IFAC-PapersOnLine, vol. 55, no. 10, pp. 395–399, 2022, doi: 10.1016/j.ifacol.2022.09.425.

Benidis et al., “Neural forecasting: Introduction and literature overview.,” arXiv: Learning, Apr. 2020, [Online]. Available: https://deepai.org/publication/neural-forecasting-introduction-and-literature-overview

R. M. Cantón Croda, D. E. Gibaja Romero, and S. O. Caballero Morales, “Sales prediction through neural networks for a small dataset,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 5, no. 4, p. 35, 2019, doi: 10.9781/ijimai.2018.04.003.

F. Anifowose, “Hybrid Machine Learning Explained in Nontechnical Terms,” JPT, Feb. 06, 2020. https://jpt.spe.org/hybrid-machine-learning-explained-nontechnical-terms

A. Sharma, “What makes LightGBM lightning fast? - towards data science,” Medium, Nov. 14, 2022. https://towardsdatascience.com/what-makes-lightgbm-lightning-fast-a27cf0d9785e

Z. Khan, N. Gul, N. Faiz, A. Gul, W. Adler, and B. Lausen, “Optimal trees selection for classification via Out-of-Bag assessment and Sub-Bagging,” IEEE Access, vol. 9, pp. 28591–28607, Jan. 2021, doi: 10.1109/access.2021.3055992.

M. Schonlau and R. Y. Zou, “The random forest algorithm for statistical learning,” The Stata Journal, vol. 20, no. 1, pp. 3–29, Mar. 2020, doi: 10.1177/1536867x20909688.

Y. Nie, P. Jiang, and H. Zhang, “A novel hybrid model based on combined preprocessing method and advanced optimization algorithm for power load forecasting,” Applied Soft Computing, vol. 97, p. 106809, Dec. 2020, doi: 10.1016/j.asoc.2020.106809.

M. G. Meharie, W. J. Mengesha, Z. A. Gariy, and R. N. Mutuku, “Application of stacking ensemble machine learning algorithm in predicting the cost of highway construction projects,” Engineering, Construction and Architectural Management, vol. 29, no. 7, pp. 2836–2853, Jun. 2021, doi: 10.1108/ecam-02-2020-0128.

Y. Lai and D. A. Dzombak, “Use of the Autoregressive Integrated Moving Average (ARIMA) model to forecast Near-Term regional temperature and precipitation,” Weather and Forecasting, vol. 35, no. 3, pp. 959–976, Apr. 2020, doi: 10.1175/waf-d-19-0158.1.

Downloads

Published

2024-10-10

Issue

Section

Articles

How to Cite

Chukwuka Izuchukwu C. Obi. (2024). Demand Forecasting in Retail Business Using the Ensemble Machine Learning Framework - A Stacking Approach. American Scientific Research Journal for Engineering, Technology, and Sciences, 98(1), 309-329. https://www.asrjetsjournal.org/American_Scientific_Journal/article/view/11010