Common feature exploration functions for Data Science Competitions in R
✓ Published0🌍 Public
Aaakansh9
Last edited May 29, 2016
Created on May 26, 2016
This R script provides a collection of feature-exploration functions for data science competitions, demonstrating common preprocessing tasks. It shows how to remove duplicate and highly correlated columns, one-hot encode categorical variables, and apply deviation encoding for high-cardinality factors. The code uses the `caret` package's `findCorrelation` for correlation-based feature removal, `model.matrix` for dummy encoding, and `doMC` for parallel correlation computation via `bigcorPar`. It also leverages `dplyr` for grouped summarization in deviation encoding, with the `ff` package for large correlation matrices.
AI-generated description