Sequential Learning of Principal Curves: Summarizing Data Streams on the Fly

When confronted with massive data streams, summarizing data with dimension reduction methods such as PCA raises theoretical and algorithmic pitfalls. A principal curve acts as a nonlinear generalization of PCA, and the present paper proposes a novel algorithm to automatically and sequentially learn...

Full description

Saved in:
Bibliographic Details
Main Authors: Le Li, Benjamin Guedj
Format: article
Language:EN
Published: MDPI AG 2021
Subjects:
Q
Online Access:https://doaj.org/article/16617bdbcbda4d09a3e9fb9cc38aeb99
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:When confronted with massive data streams, summarizing data with dimension reduction methods such as PCA raises theoretical and algorithmic pitfalls. A principal curve acts as a nonlinear generalization of PCA, and the present paper proposes a novel algorithm to automatically and sequentially learn principal curves from data streams. We show that our procedure is supported by regret bounds with optimal sublinear remainder terms. A greedy local search implementation (called slpc, for sequential learning principal curves) that incorporates both sleeping experts and multi-armed bandit ingredients is presented, along with its regret computation and performance on synthetic and real-life data.