Structured sparse support vector machine with ordered features
© 2020 Informa UK Limited, trading as Taylor & Francis Group.
Publié dans: | Journal of applied statistics. - 1991. - 49(2022), 5 vom: 09., Seite 1105-1120 |
---|---|
Auteur principal: | |
Autres auteurs: | , , |
Format: | Article en ligne |
Langue: | English |
Publié: |
2022
|
Accès à la collection: | Journal of applied statistics |
Sujets: | Journal Article Structured sparse local oracle property support vector machine variable selection |
Résumé: | © 2020 Informa UK Limited, trading as Taylor & Francis Group. In the application of high-dimensional data classification, several attempts have been made to achieve variable selection by replacing the ℓ 2 -penalty with other penalties for the support vector machine (SVM). However, these high-dimensional SVM methods usually do not take into account the special structure among covariates (features). In this article, we consider a classification problem, where the covariates are ordered in some meaningful way, and the number of covariates p can be much larger than the sample size n. We propose a structured sparse SVM to tackle this type of problems, which combines the non-convex penalty and cubic spline estimation procedure (i.e. penalizing second-order derivatives of the coefficients) to the SVM. From a theoretical point of view, the proposed method satisfies the local oracle property. Simulations show that the method works effectively both in feature selection and classification accuracy. A real application is conducted to illustrate the benefits of the method |
---|---|
Description: | Date Revised 16.07.2022 published: Electronic-eCollection Citation Status PubMed-not-MEDLINE |
ISSN: | 0266-4763 |
DOI: | 10.1080/02664763.2020.1849053 |