Troubling Trends in Machine Learning Scholarship · HackerPapers discussions

Troubling Trends in Machine Learning Scholarship — mentioned by nybsjytm

Thu, 13 Mar 2025 19:03:40 GMT

There's a related section about 'mathiness' in section 3.3 of the article "Troubling Trends in Machine Learning Scholarship" https://arxiv.org/abs/1807.03341. I would say the situation has only gotten worse since that paper was written (2018). However the discussion there is more about math which is unnecessary to a paper, not so much about the problem of math which is unintelligible or, if intelligible, then incorrect. I don't have other papers off the top of my head, although by now it's my default expectation when I see a math-centric AI paper. If you have any such papers in mind, I could…

Paper and discussion history. A mention is not an endorsement.

Troubling Trends in Machine Learning Scholarship — mentioned by thatguysaguy

Tue, 24 Sep 2024 22:53:38 GMT

It's very bad in CS as well. See e.g.: https://arxiv.org/abs/1807.03341 IIRC there was also a paper analyzing how often results in some NLP conference held up when a different random seed or hyperparameters were used. It was quite depressing.

Paper and discussion history. A mention is not an endorsement.

Troubling Trends in Machine Learning Scholarship — mentioned by bonoboTP

Tue, 13 Oct 2020 22:08:29 GMT

You may like the article "Troubling Trends in Machine Learning Scholarship", Lipton & Steinhardt, 2018 https://arxiv.org/abs/1807.03341 Especially the trend of "misuse of language, e.g., by choosing terms of art with colloquial connotations or by overloading established technical terms"

Paper and discussion history. A mention is not an endorsement.

Troubling Trends in Machine Learning Scholarship — HN submission

Sat, 30 Nov 2019 12:29:30 GMT

Troubling trends in machine learning scholarship (2018)

197 points; 62 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Troubling Trends in Machine Learning Scholarship — mentioned by joshvm

Sun, 29 Sep 2019 17:02:18 GMT

> Would you say that you'd have got an AI researcher position without a Ph.D.? It's difficult to get any true researcher position without a PhD. It doesn't mean that PhD has to be in AI. Research involves a lot of reading and writing papers, which a PhD is supposedly training you how to do. That said most places will say "equivalent practical experience" and it's entirely possible to be competent in AI/ML without a PhD. I did a PhD in space science, I now do machine learning in ecology and spent the summer working on machine learning for disaster management. The interesting jobs (to me) are…

Paper and discussion history. A mention is not an endorsement.

Troubling Trends in Machine Learning Scholarship — HN submission

Sat, 14 Jul 2018 00:57:24 GMT

Troubling Trends in Machine Learning Scholarship

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.