A modified Dai–Yuan method with restart mechanism for nonlinear system of equations with a signal recovery

Authors

  • A. S. Halilu
    Faculty of Informatics and Computing, Universiti Sultan Zainal Abidin, Campus Besut, 22200 Terengganu, Malaysia
    Department of Mathematics, Sule Lamido University Kafin Hausa, Nigeria
    Numerical Optimization Research Group, Bayero University, Kano, Nigeria
    Mathematical Innovation and Applications Research Group, Sule Lamido University Kafin Hausa, Nigeria
  • M.A. Mohamed
    Faculty of Informatics and Computing, Universiti Sultan Zainal Abidin, Campus Besut, 22200 Terengganu, Malaysia
  • I. A. R. Moghrabi
    Information Systems and Technology Department, Kuwait Technical College, Kuwait
    Department of Computer Science, College of Arts and Sciences, University of Central Asia, Naryn, Kyrgyz Republic
  • K. Ahmed
    Numerical Optimization Research Group, Bayero University, Kano, Nigeria
    Department of Mathematical Sciences, Bayero University, Kano, Nigeria
    Department of Mathematics, Federal University, Dutse, Nigeria
  • S. M. Ibrahim
    College of Applied and Health Sciences, A’Sharqiyah University, 400 Ibra, Sultanate of Oman
  • M. Y. Waziri
    Numerical Optimization Research Group, Bayero University, Kano, Nigeria
    Department of Mathematical Sciences, Bayero University, Kano, Nigeria
  • S. Murtala
    Numerical Optimization Research Group, Bayero University, Kano, Nigeria
    Information Systems and Technology Department, Kuwait Technical College, Kuwait
    Department of Mathematics, Federal University, Dutse, Nigeria
  • H. Abdullahi
    Department of Mathematics, Sule Lamido University Kafin Hausa, Nigeria
    Mathematical Innovation and Applications Research Group, Sule Lamido University Kafin Hausa, Nigeria
    Department of Mathematical Sciences, Bayero University, Kano, Nigeria
  • M. A. Jada
    Mathematical Innovation and Applications Research Group, Sule Lamido University Kafin Hausa, Nigeria
    Department of Mathematical Sciences, Bayero University, Kano, Nigeria

Keywords:

Conjugate gradient methods, Lipschitz condition, Signal reconstruction, Singular values

Abstract

The Dai--Yuan method is an important iterative scheme for solving unconstrained optimization problems, but it often requires exact or Wolfe-type line searches to satisfy descent or sufficient descent conditions. It may also perform poorly due to the jamming phenomenon. This paper presents a modified three-term Dai--Yuan method for solving constrained systems of nonlinear monotone equations. The search direction of the proposed method includes a nonnegative parameter whose value is determined through singular-value analysis of the iteration matrix. The method also incorporates a restart mechanism that ensures global convergence regardless of the line-search procedure used. Theoretical analysis establishes the global convergence and convergence rate of the proposed scheme under suitable assumptions. Numerical experiments on constrained nonlinear equations and sparse signal reconstruction demonstrate the efficiency of the method compared with related algorithms.

Dimensions

[1] A. S. Halilu, A. Majumder, M.Y. Waziri & K. Ahmed, ``Signal recovery with convex constrained nonlinear monotone equations through conjugate gradient hybrid approach'', Mathematics with computers in simulation 187 (2021) 520. https://doi.org/10.1016/j.matcom.2021.03.020.

[2] A. S. Halilu, A. Majumder, M. Y. Waziri, A. M. Awwal & K. Ahmed, ``On solving double direction methods for convex constrained monotone nonlinear equations with image restoration'', Computational and applied mathematics 40 (2021) 1. https://doi.org/10.1007/s40314-021-01624-1.

[3] J. K. Liu & S. J. Li, ``A projection method for convex constrained monotone nonlinear equations with applications'', Computers and mathematics with applications 70 (2015) 2442. https://doi.org/10.1016/j.camwa.2015.09.014.

[4] W. W. Hager & H. Zhang, ``A survey of nonlinear conjugate gradient methods'', Pacific journal of optimization 2 (2006) 35. https://www.researchgate.net/publication/228389054_A_survey_of_nonlinear_conjugate_gradient_method.

[5] Y. Narushima & H. Yabe, ``A survey of sufficient descent conjugate gradient methods for unconstrained optimization'', SUT Journal of mathematics 50 (2014) 167. https://doi.org/10.55937/sut/1424782608.

[6] R. Fletcher & C. Reeves, ``Function minimization by conjugate gradients'', The computer journal 7 (1964) 149. https://doi.org/10.1093/comjnl/7.2.149.

[7] R. Fletcher, Practical methods of optimization, 2nd ed., John Wiley & Sons, New York, NY, 1982. https://doi.org/10.1137/1024028.

[8] Y. H. Dai and Y. Yuan, ``A nonlinear conjugate gradient method with a strong global convergence property'', SIAM journal on optimization 10 (1999) 177. https://doi.org/10.1137/S105262349731899.

[9] M. R. Hestenes & E. L. Stiefel, ``Methods of conjugate gradients for solving linear systems'', Journal of research of the national bureau of standards 49 (1952) 409. https://doi.org/10.6028/JRES.049.044.

[10] E. Polak & G. Ribi´ere, “Note Sur la convergence de directions conjugees”, ESAIM: Mathematical Modelling and Numerical Analysis ` 3 (1969) 35. https://doi.org/10.1051/m2an/196903R100351.

[11] B. T. Polyak, “The conjugate gradient method in extreme problems”, USSR Computational Mathematics and Mathematical Physics 9 (1969) 94. https://doi.org/10.1016/0041-5553(69)90035-4.

[12] Y. Liu, & C. Storey, ``Efficient generalized conjugate gradient algorithms'', Journal of optimization theory and applications 69 (1991) 129. https://doi.org/10.1007/BF00940464.

[13] N. Andrei, ``A Dai–yuan conjugate gradient algorithm with sufficient descent and conjugacy conditions for unconstrained optimization'', Applied mathematics letters 21 (2008) 165. https://doi.org/10.1016/j.aml.2007.05.002.

[14] N. Andrei, ``Another hybrid conjugate gradient algorithm for unconstrained optimization'', Numerical algorithms 47 (2008) 143. https://doi.org/10.1007/s11075-007-9152-9.

[15] D. H. Li & M. Fukushima, ``A modified BFGS method and its global convergence in nonconvex minimization'', Journal of computational and applied mathematics 129 (2001) 15. https://doi.org/10.1016/S0377-0427(00)00540-9.

[16] Z. Wei, S. Yao, L. & Liu, ``The convergence properties of some new conjugate gradient methods'', Applied mathematics and computation 183 (2006) 1341. https://doi.org/10.1016/j.amc.2006.05.150.

[17] L. Zhang, W. Zhou & D. Li, ``Global convergence of a modified Fletcher-reeves conjugate gradient method with Armijo-type line search'', Numerische mathematik 104 (2006) 561. https://doi.org/10.1007/s00211-006-0028-z.

[18] L. Zhang, ``Two modified Dai-yuan nonlinear conjugate gradient methods'', Numerical algorithms 50 (2009) 1. https://doi.org/10.1007/s11075-008-9213-8.

[19] S. Babaie-Kafaki, ``A hybrid conjugate gradient method based on a quadratic relaxation of the Dai–yuan hybrid conjugate gradient parameter'', Optimization 62 (2013) 929. https://doi.org/10.1080/02331934.2011.611512.

[20] X. Jiang & J. Jian, ``A sufficient descent Dai–yuan type nonlinear conjugate gradient method for unconstrained optimization problems'', Nonlinear dynamics 72 (2013) 101. https://doi.org/10.1007/s11071-012-0694-6.

[21] G, Zhou & N. Qin, ``A spectral Dai-yuan-type conjugate gradient method for unconstrained optimization'', Mathematical problems in engineering 2015 (2015) 1. https://dx.doi.org/10.1155/2015/839659.

[22] X. Jiang, X. & J. Jian, ``Improved fletcher-reeves and Dai-yuan conjugate gradient methods with the strong wolfe line search'' Journal of computational and applied mathematics 348 (2018) 525. https://doi.org/10.1016/j.cam.2018.09.012.

[23] Z. Zhu, D. Zhang & S. Wang, ``Two modified DY conjugate gradient methods for unconstrained optimization problems'' Applied mathematics and computation 373 (2020) 125004. https://doi.org/10.1016/j.amc.2019.125004.

[24] S. K. Mishra, M. E. Samei, S. K. Chakraborty & B. Ram, ``On q-variant of Dai–yuan conjugate gradient algorithm for unconstrained optimization problems'', Nonlinear dynamics 104 (2021) 2471. https://doi.org/10.1007/s11071-021-06378-3.

[25] S. Narayanan & P. Kaelo, ``A linear hybridization of Dai-Yuan and Hestenes-stiefel conjugate gradient method for unconstrained optimization'', Numerical mathematics: theory, methods and application 14 (2021) 539. https://doi.org/ 10.4208/nmtma.OA-2020-0056.

[26] A. L. Yoksal, M. K. Hisham, M. N. Edrees, & K. A. Khalil, ``A hybridization of the Hestenes-stiefel and Dai-yuan conjugate gradient methods'', European journal of pure and applied mathematics 16 (2023) 1059. https://doi.org/10.29020/nybg.ejpam.v16i2.4746.

[27] J. K. Liu, & S. J. Li, ``Spectral DY-type projection methods for nonlinear monotone system of equations'', Journal of computational mathematics 33 (2015) 341. https://doi.org/10.4208/jcm.1412-m4494.

[28] J. M. Barzilai & M. Borwein, ``Two point step size gradient methods'', IMA journal of numerical analysis 8 (1988) 141. https://doi.org/10.1093/imanum/8.1.141.

[29] M. V. Solodov & B. F. Svaiter, ``A globally convergent inexact newton method for systems of monotone equations'', in: M. Fukushima, L. Qi (Eds.), reformulation: nonsmooth, piecewise smooth, semismooth and smoothing methods, Kluwer academic publishers 22 (1998) 355. https://doi.org/10.1007/978-1-4757-6388-1-18.

[30] J. Liu & S. Li, ``Multivariate spectral projection method for convex constrained nonlinear monotone equations'', Journal of industrial and management optimization 13 (2017) 283. https://doi.org/10.3934/jimo.2016017.

[31] G. H. Yu, S. Z. Niu & J.H. Ma, ``Multivariate spectral gradient projection method for non-linear monotone equations with convex constraints'', Journal of industrial management and optimization 9 (2013) 117. https://doi.org/10.3934/jimo.2013.9.117.

[32] Q. N. Li & D. H. Li, ``A class of derivative-free methods for large-scale nonlinear monotone equations'', IMA journal of numerical analysis 31 (2011) 1625. https://doi.org/10.1093/imanum/drq015.

[33] J. Liu & Y. Feng, ``A derivative-free iterative method for nonlinear monotone equations with convex constraints'', Numerical algorithms 82 (2019) 245. https://doi.org/10.1007/s11075-018-0603-2.

[34] S. Aji, P. Kumam, A. M. Awwal, M. M. Yahaya & K. Sitthithakerngkiet, ``An efficient DY-type spectral conjugate gradient method for system of nonlinear monotone equations with application in signal recovery'', AIMS Mathematics 6 (2021) 8078. https://doi.org/10.3934/math.2021469.

[35] A. Althobaiti, J. Sabi'u, H. Emadifar, P. Junsawang & S. K. Sahoo, ``A scaled Dai--Yuan projection-based conjugate gradient method for solving monotone equations with applications'', Symmetry 14 (2022) 1401. https://doi.org/10.3390/sym14071401.

[36] M. Y. Waziri, K. Ahmed & A. S. Halilu, ``Adaptive three-term family of conjugate residual methods for system of monotone nonlinear equations'', São Paulo Journal of mathematical sciences 16 (2023) 957. https://doi.org/10.1007/s40863-022-00293-0.

[37] K. Ahmed, M. Y. Waziri, A. S. Halilu, & S. Murtala, ``Sparse signal reconstruction via Hager-zhang-type schemes for constrained system of nonlinear equations'', Optimization 73 (2024) 1949. https://doi.org/10.1080/02331934.2023.2187255.

[38] A. S. Halilu, A. Majumder, M. Y. Waziri, K. Ahmed & A. M. Awwal, ``Motion control of the two joint planar robotic manipulators through accelerated Dai-liao method for solving system of nonlinear equations'', Engineering computations 39 (2022) 1802. https://doi.org/10.1108/EC-06-2021-0317.

[39] A. I. Kiri, M. Y. Waziri & K. Ahmed, ``A modified Liu-storey scheme for nonlinear systems with an application to image recovery'', Iranian journal of numerical analysis and optimization (2022) 1. https://doi.org/10.22067/ijnao.2022.75413.1107.

[40] M. Y. Waziri, K. Ahmed & J. Sabi'u, ``A family of Hager--Zhang conjugate gradient methods for system of monotone nonlinear equations'', Applied mathematics and computation 361 (2022) 645. https://doi.org/10.1016/j.amc.2019.06.012.

[41] M. Y. Waziri, K. Ahmed, A.S. Halilu & J. Sabi'u, “Two new Hager-Zhang iterative schemes with improved parameter choices for monotone nonlinear systems and their applications in compressed sensing”, Rairo operations research 56 (2021) 239. https://doi.org/10.1051/ro/2021190.

[42] M. Y. Waziri, K. Ahmed & J. Sabi’u, ``A Dai-Liao conjugate gradient method via modified secant equation for system of nonlinear equations'', Arabian journal of mathematics 9 (2021) 443. https://doi.org/10.1007/s40065-019-0264-6.

[43] M. Y. Waziri, K. Ahmed, J. Sabi'u & A.S. Halilu, ``Enhanced Dai-Liao conjugate gradient methods for systems of monotone nonlinear equations'', SeMA Journal 78 (2020) 15. https://doi.org/10.1007/s40324-020-00228-9.

[44] K. Ahmed, M. Y. Waziri, A. S. Halilu & S. Murtala, ``Image recovery via modified Dai--Kou method for constrained system of nonlinear equations'', Journal of computational and applied mathematics 484 (2026) 117537. https://doi.org/10.1016/j.cam.2026.117537.

[45] J. Yin, J. Jian, X. Jiang, M. Liu & L Wang, ``A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications'', Numerical algorithms 88 (2021) 389. https://doi.org/10.1007/s11075-020-01043-z.

[46] P. Thakur & P. Gulial, ``Nonlinear thermo-mechanics of smart functionally graded rotating disks for adaptive hydromechatronics'', International journal of hydromechatronics. https://doi.org/10.1504/IJHM.2025.10073599.

[47] F. Arenas, R. Pérez, M. Gonzalez-Lima & C. A. Arias, ``A centered newton method for nonlinear complementarity problem'', Journal of computational and applied mathematics 484 (2026) 117473. https://doi.org/10.1016/j.cam.2026.117473.

[48] J. Puhan & A. Burmen ``On the optimal parameter values of the Nelder–mead simplex algorithm'', Journal of computational and applied mathematics 484 (2026) 117521. https://doi.org/10.1016/j.cam.2026.117521.

[49] X. L. Dong, H. W. Liu, Y. B. He & X. M. Yang, ``A modified Hestenes-stiefel conjugate gradient method with sufficient descent and conjugacy condition'', Journal of computational and applied mathematics 281 (2015) 239. https://doi.org/10.1016/j.cam.2014.11.058.

[50] Z. Aminifard & S. Babaie-Kafaki, ``A modified descent Polak-ribiere-polyak conjugate gradient method with global convergence property for nonconvex functions'', Calcolo 56 (2019) 1. https://doi.org/10.1007/s10092-019-0312-9.

[51] W. Sun & Y. H. Yuan, ``Optimization theory and methods: Nonlinear programming'', New York: Springer, (2006). https://doi.org/10.1007/b106451.

[52] D. S. Watkins, ``Fundamentals of matrix computations'', Wiley, New York, 2000. https://doi.org/10.1002/0471249718.

[53] A. B. Abubakar, P. Kumam, H. Mohammad, A H. Ibrahim, T. Seangwattana & B. A. Hassan, ``A hybrid BFGS-Like method for monotone operator equations with applications'', Journal of computational and applied mathematics 446 (2024) 115857. https://doi.org/10.1016/j.cam.2024.115857.

[54] L. Pengjie, ``A three-term derivative-free projection method with BFGS-like update and its accelerated variant'', Optimization, 75 (2026) 2055. https://doi.org/10.1080/02331934.2025.2526727.

[55] M. Rehman, J. Sabi'u, M. Sohaib & A. Shah, ``A projection-based derivative free DFP approach for solving system of nonlinear convex constrained monotone equations with image restoration applications'', Journal of applied mathematics and computation 69 (2023) 3645. https://doi.org/10.1007/s12190-023-01897-1.

[56] W. L. Cruz, ``A Spectral algorithm for large-scale systems of nonlinear monotone equations'', Numerical algorithms 76 (2017) 1109. https://doi.org/10.1007/s1107-017-0299-8.

[57] W. L. Cruz, J. M. Martinez & M. Raydan, ``Spectral residual method without gradient information for solving large-scale nonlinear systems of equations'', theory and experiments, Technical Report RT-04-08, 75 (2004) 1429. https://www.ams.org/journals/mcom/2006-75-255/S0025-5718-06-01840-0/S0025-5718-06-01840-0.pdf

[58] P. T. Gao & C. J. He, ``An efficient three-term conjugate gradient method for nonlinear monotone equations with convex constraints'' Calcolo 55 (2018) 1. https://doi.org/10.1007/s10092-018-0291-2.

[59] E. D. Dolan & J. J. More, ``Benchmarking optimization software with performance profiles'', Mathematical programming 91 (2002) 201. https://doi.org/10.1007/s101070100263.

[60] E. J. Candes & T. Tao, ``Near-optimal signal recovery from random projections: Universal encoding strategies'', Institute of electrical and electronics engineers transactions on information theory 52 (2006) 5406. https//doi.org/10.1109/TIT.2006.885507.

[61] D. L. Donoho, ``Compressed sensing'', Institute of electrical and electronics engineers transactions on information theory 52 (2006) 1289. https://dx.doi.org/10.1109/TIT.2006.871582.

[62] T. Elaine, Y. Wotao & Z. Yin, ``A fixed-point continuation method for $ell_1-$regularized minimization with applications to compressed sensing'', CAAM TR07-07, Rice University, (2007) 43. https://www.researchgate.net/publication/238445979_A_fixed-point_continuation_method_for_'1-Regularized_minimization_with_applications_to_compressed_sensing.

[63] A. T. Mario, R. Figueiredo & D. Nowak, ``An EM algorithm for wavelet-based image restoration'', IEEE transactions on image processing. 12(2003) 906. https://doi.org/10.1109/TIP.2003.814255.

[64] J. S. Pang, ``Inexact Newton methods for the nonlinear complementarity problem'', Mathematical programming 36 (1986) 54. https://doi.org/10.1007/BF02591989.

[65] M.A.T. Figueiredo, R. Nowak & S. J. Wright, ``Gradient projection for sparse reconstruction, application to compressed sensing and other inverse problems'', IEEE J-STSP IEEE press, Piscataway, NJ. (2007) 586. https://doi.org/10.1137/070698920.

[66] Y. Xiao, Q. Wang & Q. Hu, ``Non-smooth equations based method for $ell_1-norm$ problems with applications to compressed sensing'', Nonlinear analysis theory methods and applications 74 (2011) 3570. https://doi.org/10.1016/j.na.2011.02.040.

[67] A. B. Abubakar, P. Kumam, H. Mohammad, A. M. Awwal & K. Sitthithakerngkiet, ``A modified fletcher--reeves conjugate gradient method for monotone nonlinear equations with some applications'', Mathematics 7 (2022) 745. https://doi.org/10.3390/math7080745.

[68] Y. Xia, X. Ma & D. Li, ``An improved LS-RMIL-type conjugate gradient projection algorithm for systems of nonlinear equations and impulse noise image restoration'', AIMS mathematics 10 (2025) 13640. https://doi.org/10.3934/math.2025614.

[69] Z. Wan, J. Guo, J. Liu & W. Liu, ``A modified spectral conjugate gradient projection method for signal recovery'', Signal, image and video processing 12 (2018) 1455. https://doi.org/10.1007/s11760-018-1300-2.

fig 1

Published

2026-06-09

How to Cite

A modified Dai–Yuan method with restart mechanism for nonlinear system of equations with a signal recovery. (2026). Journal of the Nigerian Society of Physical Sciences, 8(3), 3051. https://doi.org/10.46481/jnsps.2026.3051

Issue

Volume 8, Issue 3, August 2026 (In Progress)

Section

Mathematics & Statistics
Copyright & Licensing

Copyright (c) 2026 A. S. Halilu, M.A. Mohamed, I. A. R. Moghrabi, K. Ahmed, S. M. Ibrahim, M. Y. Waziri, S. Murtala, H. Abdullahi, M. A. Jada (Author)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

A modified Dai–Yuan method with restart mechanism for nonlinear system of equations with a signal recovery. (2026). Journal of the Nigerian Society of Physical Sciences, 8(3), 3051. https://doi.org/10.46481/jnsps.2026.3051

Similar Articles

11-20 of 211

You may also start an advanced similarity search for this article.

Most read articles by the same author(s)