A Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems
In our paper, we introduce a sparse and symmetric matrix completion quasi-Newton model using automatic differentiation, for solving unconstrained optimization problems where the sparse structure of the Hessian is available. The proposed method is a kind of matrix completion quasi-Newton method and h...
Guardado en:
Autores principales: | , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
MDPI AG
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/fd2e320392a24448bd2496d54df4470e |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:fd2e320392a24448bd2496d54df4470e |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:fd2e320392a24448bd2496d54df4470e2021-11-25T19:06:41ZA Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems10.3390/sym131120932073-8994https://doaj.org/article/fd2e320392a24448bd2496d54df4470e2021-11-01T00:00:00Zhttps://www.mdpi.com/2073-8994/13/11/2093https://doaj.org/toc/2073-8994In our paper, we introduce a sparse and symmetric matrix completion quasi-Newton model using automatic differentiation, for solving unconstrained optimization problems where the sparse structure of the Hessian is available. The proposed method is a kind of matrix completion quasi-Newton method and has some nice properties. Moreover, the presented method keeps the sparsity of the Hessian exactly and satisfies the quasi-Newton equation approximately. Under the usual assumptions, local and superlinear convergence are established. We tested the performance of the method, showing that the new method is effective and superior to matrix completion quasi-Newton updating with the Broyden–Fletcher–Goldfarb–Shanno (BFGS) method and the limited-memory BFGS method.Huiping CaoXiaomin AnMDPI AGarticlesymmetric quasi-Newton methodunconstrained optimization problemsmatrix completionautomatic differentiationsuperlinear convergenceBroyden–Fletcher–Goldfarb–Shanno methodMathematicsQA1-939ENSymmetry, Vol 13, Iss 2093, p 2093 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
symmetric quasi-Newton method unconstrained optimization problems matrix completion automatic differentiation superlinear convergence Broyden–Fletcher–Goldfarb–Shanno method Mathematics QA1-939 |
spellingShingle |
symmetric quasi-Newton method unconstrained optimization problems matrix completion automatic differentiation superlinear convergence Broyden–Fletcher–Goldfarb–Shanno method Mathematics QA1-939 Huiping Cao Xiaomin An A Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems |
description |
In our paper, we introduce a sparse and symmetric matrix completion quasi-Newton model using automatic differentiation, for solving unconstrained optimization problems where the sparse structure of the Hessian is available. The proposed method is a kind of matrix completion quasi-Newton method and has some nice properties. Moreover, the presented method keeps the sparsity of the Hessian exactly and satisfies the quasi-Newton equation approximately. Under the usual assumptions, local and superlinear convergence are established. We tested the performance of the method, showing that the new method is effective and superior to matrix completion quasi-Newton updating with the Broyden–Fletcher–Goldfarb–Shanno (BFGS) method and the limited-memory BFGS method. |
format |
article |
author |
Huiping Cao Xiaomin An |
author_facet |
Huiping Cao Xiaomin An |
author_sort |
Huiping Cao |
title |
A Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems |
title_short |
A Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems |
title_full |
A Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems |
title_fullStr |
A Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems |
title_full_unstemmed |
A Sparse Quasi-Newton Method Based on Automatic Differentiation for Solving Unconstrained Optimization Problems |
title_sort |
sparse quasi-newton method based on automatic differentiation for solving unconstrained optimization problems |
publisher |
MDPI AG |
publishDate |
2021 |
url |
https://doaj.org/article/fd2e320392a24448bd2496d54df4470e |
work_keys_str_mv |
AT huipingcao asparsequasinewtonmethodbasedonautomaticdifferentiationforsolvingunconstrainedoptimizationproblems AT xiaominan asparsequasinewtonmethodbasedonautomaticdifferentiationforsolvingunconstrainedoptimizationproblems AT huipingcao sparsequasinewtonmethodbasedonautomaticdifferentiationforsolvingunconstrainedoptimizationproblems AT xiaominan sparsequasinewtonmethodbasedonautomaticdifferentiationforsolvingunconstrainedoptimizationproblems |
_version_ |
1718410318139359232 |