Well-tuned Simple Nets Excel on Tabular Datasets · HackerPapers discussions

Well-tuned Simple Nets Excel on Tabular Datasets — mentioned by ersiees

Wed, 03 Aug 2022 19:12:56 GMT

Our lab works on changing this. I think it might still take some years for a full solution, but so far we are successful with NNs for small datasets with meta-learning (https://arxiv.org/abs/2207.01848) and large datasets with regularisation (https://arxiv.org/abs/2106.11189). The first is very new, but the second is also cited in this paper, but they didn’t run it as a baseline.

Paper and discussion history. A mention is not an endorsement.

Well-tuned Simple Nets Excel on Tabular Datasets — mentioned by jwilber

Wed, 03 Aug 2022 17:02:33 GMT

If you’re interested in how tree-based models work, I wrote an interactive explanation on decision trees here: https://mlu-explain.github.io/decision-tree/ and random forests here: https://mlu-explain.github.io/random-forest/ It’s also worth noting that a recentish paper shows neural networks can perform well on tabular data if well-regularized: https://arxiv.org/abs/2106.11189v1?utm_source=jesper&utm_med...

Paper and discussion history. A mention is not an endorsement.

Well-tuned Simple Nets Excel on Tabular Datasets — HN submission

Tue, 22 Jun 2021 18:29:06 GMT

Regularization is all you need: simple neural nets can excel on tabular data

216 points; 93 discussion replies on HN. Paper and source history. A submission is not an endorsement.