Tabular Data: Deep Learning is Not All You Need · HackerPapers discussions

Tabular Data: Deep Learning is Not All You Need — mentioned by antipaul

Fri, 26 Jul 2024 15:34:12 GMT

Like others say, usually just go for XGBoost, which is increasingly even shown (proven?) in literature, eg: https://arxiv.org/abs/2106.03253 You can also start with scikit-learn's `LogisticRegressionCV`, if a linear model is more palatable to your audience. The bigger challenge is to reliably estimate how good your model is. It's not about getting the best performance – it's about getting the "real" performance. How will your model _really_ do on future unseen datasets? The answer to this challenge is cross-validation. But what are the questions? There are 2 very different questions for which…

Paper and discussion history. A mention is not an endorsement.

Tabular Data: Deep Learning is Not All You Need — mentioned by gnyeki

Mon, 01 Jul 2024 16:03:51 GMT

This area is covered by non-parametric statistics more generally. There are many other methods to non-parametrically estimate functions (that satisfy some regularity conditions). Tree-based methods are one family of such methods, and the consensus still seems to be that they perform better than neural networks on tabular data. For example: https://arxiv.org/abs/2106.03253

Paper and discussion history. A mention is not an endorsement.

Tabular Data: Deep Learning is Not All You Need — mentioned by bluecoconut

Wed, 14 Sep 2022 22:25:18 GMT

Wow! Love it, this is the most exciting thing I've seen in a while. I'm working on something similar, and it's so great to see others who seem to get-it and are chasing generalization in AI systems! A few questions: 1. I'm curious if you're representing the task-operations using RL techniques (as many personal assistant systems seem to be) or if this is entirely a seq2seq transformer style model for predicting actions? 2. Assumption: Due to scaling of transformers, I assume that this is not directly working on the image data of a screen, and instead is working off of DOM trees; (2a) is this…

Paper and discussion history. A mention is not an endorsement.

Tabular Data: Deep Learning is Not All You Need — mentioned by audi0slave

Tue, 22 Jun 2021 19:06:19 GMT

This paper compares xgboost vs nueural nets and an ensemble [Tabular Data: Deep Learning is Not All You Need] https://arxiv.org/abs/2106.03253

Paper and discussion history. A mention is not an endorsement.

Tabular Data: Deep Learning is Not All You Need — HN submission

Thu, 10 Jun 2021 14:17:42 GMT

Tabular Data: Deep Learning Is Not All You Need [pdf]

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.