Why do tree-based models still outperform deep learning on tabular data? · HackerPapers discussions

Why do tree-based models still outperform deep learning on tabular data? — mentioned by babel_

Thu, 28 Mar 2024 13:59:52 GMT

So, from the perspective I have within the subfield I work in, explainable AI (XAI), we're seeing a bunch of fascinating developments. First, as you mentioned, Rudin continues to prove that the reason for using AI/ML is that we don't understand the problem well enough; otherwise we wouldn't even think to use it! So, pushing our focus to better understand the problem, and then levy ML concepts and techniques (including "classical AI" and statistical learning), we're able to make something that not only outperforms some state-of-the-art in most metrics, but often even is much less resource…

Paper and discussion history. A mention is not an endorsement.

Why do tree-based models still outperform deep learning on tabular data? — mentioned by hackerlight

Tue, 26 Mar 2024 10:04:08 GMT

What paper says the opposite? This is what I can find: https://arxiv.org/abs/2207.08815 https://arxiv.org/abs/2305.02997

Paper and discussion history. A mention is not an endorsement.

Why do tree-based models still outperform deep learning on tabular data? — HN submission

Tue, 05 Mar 2024 10:44:01 GMT

Why do tree-based models still outperform deep learning on tabular data? (2022)

212 points; 111 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Why do tree-based models still outperform deep learning on tabular data? — mentioned by wenc

Wed, 11 Oct 2023 23:39:26 GMT

DL also don’t win at medium scale tabular data. This paper mentions why and how DL could might better (if it indeed can, with limited sized data) Why do tree-based models still outperform deep learning on tabular data? https://arxiv.org/abs/2207.08815

Paper and discussion history. A mention is not an endorsement.

Why do tree-based models still outperform deep learning on tabular data? — HN submission

Wed, 03 Aug 2022 16:08:02 GMT

Why do tree-based models still outperform deep learning on tabular data?

315 points; 139 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Why do tree-based models still outperform deep learning on tabular data? — HN submission

Sun, 24 Jul 2022 13:22:51 GMT

Why do tree-based models still outperform deep learning on tabular data?

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.