On the construction of quadratic models for derivative-free trust-region algorithms

We consider derivative-free trust-region algorithms based on sampling approaches for convex constrained problems and discuss two conditions on the quadratic models for ensuring their global convergence. The first condition requires the poisedness of the sample sets, as usual in this context, while t...

Description complète

Enregistré dans:
Détails bibliographiques
Auteurs principaux: Adriano Verdério, ElizabethW. Karas, LucasG. Pedroso, Katya Scheinberg
Format: article
Langue:EN
Publié: Elsevier 2017
Sujets:
Accès en ligne:https://doaj.org/article/cac5197b999a4be48e4bcfd4100b7410
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
Description
Résumé:We consider derivative-free trust-region algorithms based on sampling approaches for convex constrained problems and discuss two conditions on the quadratic models for ensuring their global convergence. The first condition requires the poisedness of the sample sets, as usual in this context, while the other one is related to the error between the model and the objective function at the sample points. Although the second condition trivially holds if the model is constructed by polynomial interpolation, since in this case the model coincides with the objective function at the sample set, we show that it also holds for models constructed by support vector regression. These two conditions imply that the error between the gradient of the trust-region model and the objective function is of the order of δk, where δk controls the diameter of the sample set. This allows proving the global convergence of a trust-region algorithm that uses two radii, δk and the trust-region radius. Preliminary numerical experiments are presented for minimizing functions with and without noise.