High-dimensional interactions detection with sparse principal hessian matrix

Cheng Yong Tang, Ethan X. Fang, Yuexiao Dong

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

In statistical learning framework with regressions, interactions are the contributions to the response variable from the products of the explanatory variables. In high-dimensional problems, detecting interactions is challenging due to combinatorial complexity and limited data information. We consider detecting interactions by exploring their connections with the principal Hessian matrix. Specifically, we propose a one-step synthetic approach for estimating the principal Hessian matrix by a penalized M-estimator. An alternating direction method of multipliers (ADMM) is proposed to efficiently solve the encountered regularized optimization problem. Based on the sparse estimator, we detect the interactions by identifying its nonzero components. Our method directly targets at the interactions, and it requires no structural assumption on the hierarchy of the interactions effects. We show that our estimator is theoretically valid, computationally efficient, and practically useful for detecting the interactions in a broad spectrum of scenarios.

Original languageEnglish (US)
JournalJournal of Machine Learning Research
Volume21
StatePublished - Jan 1 2020

Keywords

  • ADMM
  • Interaction Detection
  • Principal Hessian Matrix
  • Sparse M-Estimator

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Statistics and Probability
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'High-dimensional interactions detection with sparse principal hessian matrix'. Together they form a unique fingerprint.

Cite this