Revisiting the Dissimilarity Representation in the Context of Regression

In machine learning, a natural way to represent an instance is by using a feature vector. However, several studies have shown that this representation may not accurately characterize an object. For classification problems, the dissimilarity paradigm has been proposed as an alternative to the standar...

Full description

Saved in:
Bibliographic Details
Main Authors: Vicente Garcia, J. Salvador Sanchez, Rafael Martinez-Pelaez, Luis C. Mendez-Gonzalez
Format: article
Language:EN
Published: IEEE 2021
Subjects:
Online Access:https://doaj.org/article/bcf6a3c7b90c46798ec66106b046576c
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In machine learning, a natural way to represent an instance is by using a feature vector. However, several studies have shown that this representation may not accurately characterize an object. For classification problems, the dissimilarity paradigm has been proposed as an alternative to the standard feature-based approach. Encoding each object by pairwise dissimilarities has been demonstrated to improve the data quality because it mitigates some complexities such as class overlap, small disjuncts, and low-sample size. However, its suitability and performance when applied to regression problems have not been fully explored. This study redefines the dissimilarity representation for regression. To this end, we have carried out an extensive experimental evaluation on 34 datasets using two linear regression models. The results show that the dissimilarity approach decreases the error rates of both the traditional linear regression and the linear model with elastic net regularization, and it also reduces the complexity of most regression datasets.