• P-ISSN 0974-6846 E-ISSN 0974-5645

Indian Journal of Science and Technology


Indian Journal of Science and Technology

Year: 2023, Volume: 16, Issue: 30, Pages: 2287-2296

Original Article

Robust Weighted Support Vector Regression Approach for Predictive Modeling

Received Date:18 May 2023, Accepted Date:18 June 2023, Published Date:05 August 2023


Objectives: To improve the robustness of Support Vector Regression (SVR), Robust Weighted Support Vector Regression (RWSVR) procedure has been proposed by using Hampel’s weight function. It overcomes the drawback by adding weight to each sample observations. Methods: Regression analysis plays a vital role in many areas of science. In this article, the classical regression method, robust regression methods, Support Vector Regression and proposed Robust Weighted Support Vector Regression method are presented. A type of Support Vector Machine (SVM) known as Support Vector Regression (SVR) supports both linear and non-linear regression. This work mainly focuses on Support Vector Regression method. The datasets which are used for this study is StarsCYG, Carbonation and Prostate. Simulation study of three cases are considered with sample size 50,100 and 500 with the contamination levels of 0%, 5%, 10% and 20%. Findings: The most commonly used classical procedure is Least Squares, which is less efficient and very sensitive when the data contains outliers. This work mainly focuses on increasing the accuracy of Proposed method. It overcomes the drawback by adding weight to each sample observations. The efficiency of the proposed method has been observed with the existing regression methods such as Least Squares (LS), Robust Linear Model (RLM) and Support Vector Regression (SVR) by computing various error measures such as Mean Absolute Error (MAE), Median Absolute Error (MDAE), Mean Absolute Percent Error (MAPE) and Root Mean Square Error (RMSE). The proposed RWSVR method is used for the researchers whenever the data contains outliers. Novelty: For getting more accuracy over the conventional SVR, robust Hampel’s weight function is proposed. Newly developed function has a higher mapping power than the commonly used SVR function. The experimental results were carried out on real datasets and simulation study. It shows that the proposed RWSVR is significantly more robust than other regression methods.

Keywords: Least Squares; Robust Regression; Supervised Learning; Support Vector Regression; Hampel’s Weight Function


  1. Dharani NP, Bojja P, Kumari PR. Evaluation of performance of an LR and SVR models to predict COVID-19 pandemic. Materials Today: Proceedings. 2021. Available from: http://dx.doi.org/10.1016/j.matpr.2021.02.166
  2. Balasundaram S, Meena Y. Robust Support Vector Regression in Primal with Asymmetric Huber Loss. Neural Processing Letters. 2019;49(3):1399–1431. Available from: https://doi.org/10.1007/s11063-018-9875-8
  3. Sahoo RBB, Jha A, Kumar DS. Application of Support Vector Regression for Modeling Low Flow Time Series. KSCE Journal of Civil Engineering. 2019;23:923–934. Available from: https://link.springer.com/article/10.1007/s12205-018-0128-1
  4. Basha DK, Venkateswarlu T. Linear Regression Supporting Vector Machine and Hybrid LOG Filter-Based Image Restoration. Journal of Intelligent Systems. 2019;29(1):1480–1495. Available from: https://doi.org/10.1515/jisys-2018-0492
  5. Muthiah H, Saadah U, Efendi A. Support Vector Regression (SVR) Model for Seasonal Time Series Data. The Second Asia Pacific International Conference on Industrial Engineering and Operations Management. 2021;p. 3191–3200. Available from: http://ieomsociety.org/proceedings/2021indonesia/574.pdf
  6. Liu Q, Liu W, Mei J, Si G, Xia T, Quan J. A New Support Vector Regression Model for Equipment Health Diagnosis with Small Sample Data Missing and Its Application. Shock and Vibration. 2021;2021:1–11. Available from: https://doi.org/10.1155/2021/6675078
  7. Wang L, Ma Y, Chang X, Gao C, Qu Q, Chen X. Projection wavelet weighted twin support vector regression for OFDM system channel estimation. Artificial Intelligence Review. 2021;54(1):469–489. Available from: https://doi.org/10.1007/s10462-020-09853-2
  8. Perez RR, Bajorath J. Evolution of Support Vector Machine and Regression Modeling in Chemoinformatics and Drug Discovery. Journal of Computer-Aided Molecular Design. 2022;36:355–362. Available from: https://link.springer.com/article/10.1007/s10822-022-00442-9
  9. Huang H, Wei X, Zhou Y. An overview on twin support vector regression. Neurocomputing. 2022;490:80–92. Available from: https://doi.org/10.1016/j.neucom.2021.10.125
  10. Shoko C, Sigauke C. Short-term forecasting of COVID-19 using support vector regression: An application using Zimbabwean data. American Journal of Infection Control. 2023;2023:1–13. Available from: https://doi.org/10.1016/j.ajic.2023.03.010
  11. Muthukrishnan R, Kalaivani S. Data depth approach in fitting linear regression models. Materials Today: Proceedings. 2022;57(15):2212–2215. Available from: https://doi.org/10.1016/j.matpr.2021.12.321
  12. Muthukrishnan R, Kalaivani S. Robust regression algorithms with kernel functions in Support vector regression models. Reliability: Theory & Applications. 2022;17(4):186–191. Available from: https://doi.org/10.1016/j.matpr.2021.12.321


© 2023 Muthukrishnan & Kalaivani. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)


Subscribe now for latest articles and news.