structure over models for scientific discovery
a position paper argues that in high-dimensional settings, many different mechanisms can produce the same data, so predictive success does not prove a model has found the true mechanism, and large language models can hide this by giving a single fluent explanation.