Large Tabular Models: An Overlooked Opportunity for Advancing Machine Learning and Scientific Discovery

Tabular data is ubiquitous in the real world, yet it has been significantly overlooked in the machine learning research community. Developing large, foundational tabular models (LTMs) could revolutionize how science and machine learning utilize tabular data, enabling few-shot learning, automated data science, synthetic data generation, and empowering multidisciplinary discovery.