Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations · HackerPapers discussions

Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations — HN submission

Wed, 23 Jul 2025 15:02:52 GMT

Weak baselines and reporting biases lead to overoptimism in ML for fluid PDEs

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations — mentioned by cherryteastain

Fri, 20 Dec 2024 11:56:10 GMT

For physics sims, I'd say it's useless. Imagine you discretize a cube into 1000 gridpoints in each direction, that's 1000^3 = 1 billion nodes/"tokens". Plus you typically time-march some sort of equation so you need the solutions previous 3-5 timesteps as well so that's 3-5 billion tokens. If you are gonna do that in the first place, you may as well just use the traditional solver. Traditional solvers usually set up and solve a matrix equation like Ax=b with an iterative method like multigrid which is O(n) as opposed to transformer's O(n^2). It'll give you a much more accurate answer much…

Paper and discussion history. A mention is not an endorsement.

Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations — mentioned by al_th

Fri, 22 Nov 2024 14:34:20 GMT

Interesting work. Given, the recent noise around this paper https://arxiv.org/pdf/2407.07218 about "weak baselines" in ML x CFD work, I wonder how it resonates with this specific work.. I am not super familiar with DEM, but I know that other particle based model such as SPH benefit immensely from GPU acceleration. Does it make sense to compare with a CPU implementation ? Besides, the output of the NeuralDEM seems to be rather coarse fields, correct ? In that sense, and again I'm not an expert of granular models so I might be entirely wrong, but does it make sense to compare with a method that…

Paper and discussion history. A mention is not an endorsement.