
Why XGBoost Still Beats Deep Learning At The Tabular Data Game
Gradient boosted decision trees (GBDTs) are the current state of the art on tabular data. They are used in many Kaggle competitions and are the go-to model for many data scientists, as they tend to get better performance than neural networks while being easier and faster to train. Neural networks, on the other hand, are the state of the art in many other tasks, such as image classification, natural language processing, and speech recognition....