Abstract:In the era of "big data", it is becoming more of a challenge to not only build state-of-the-art predictive models, but also gain an understanding of what's really going on in the data. For example, it is often of interest to know which, if any, of the predictors in a fitted model are relatively influential on the predicted outcome. Some modern algorithms---like random forests and gradient boosted decision trees---have a natural way of quantifying the importance or relative influence of each feature. Other algorithms---like naive Bayes classifiers and support vector machines---are not capable of doing so and model-free approaches are generally used to measure each predictor's importance. In this paper, we propose a standardized, model-based approach to measuring predictor importance across the growing spectrum of supervised learning algorithms. Our proposed method is illustrated through both simulated and real data examples. The R code to reproduce all of the figures in this paper is available in the supplementary materials.
| Subjects: | Machine Learning (stat.ML); Machine Learning (cs.LG) |
| Cite as: | arXiv:1805.04755 [stat.ML] |
| (or arXiv:1805.04755v1 [stat.ML] for this version) | |
| https://doi.org/10.48550/arXiv.1805.04755 arXiv-issued DOI via DataCite |
Submission history
From: Brandon Greenwell [view email]
[v1]
Sat, 12 May 2018 18:05:28 UTC (4,483 KB)