Search

The ambiguous use of “falsifiability” in materials AI literature poses a significant challenge to the scientific status of AI-generated claims, as researchers frequently present predictive or generative outputs—such as “this perovskite structure is stable at room temperature” or “this inverse-designed alloy exhibits a target bandgap of 1.8 eV”—without clarifying whether these statements could, in principle, be contradicted by empirical observation. Rooted in Karl Popper's philosophy of science and extended through contemporary applications to machine learning, falsifiability serves as the demarcation criterion that distinguishes scientific claims from non-scientific ones by requiring that they logically forbid certain observations rather than merely accommodate data. This paper proposes precise definitions for falsifiable, verified, and testable AI-generated materials claims, tailored specifically to the challenges of data-driven discovery in solid-state systems, generative models, and inverse design. It further introduces a four-component framework for assessing the falsifiability of such claims, centering on claim specification, forbidden observation specification, test design, and falsification protocol. These conceptual foundations carry profound implications for materials AI practice, requiring authors to articulate disconfirming evidence explicitly, reviewers to demand falsifiability statements, and the broader community to adopt standards that elevate predictive modeling from statistical correlation to genuine scientific inquiry. By confronting the boundary between data-driven heuristics and empirically falsifiable science, the present work offers a definitional scaffold that can guide the field toward greater epistemic rigor amid the accelerating integration of artificial intelligence into materials discovery.

Machine learning has transformed materials engineering through graph neural networks, equivariant architectures, generative models, and early autonomous laboratories. These advances enabled accurate property prediction, data-efficient force fields, and initial inverse design of inorganic crystals, supported by community databases such as the Materials Project and JARVIS. Generative frameworks now propose novel structures, while closed-loop platforms demonstrate early integration of prediction, synthesis, and robotic experimentation. However, major gaps remain: weak extrapolation beyond training distributions, inadequate handling of long-range interactions, poorly calibrated uncertainty quantification, limited synthesis prediction, underrepresentation of disordered materials, and insufficient experimental validation. Persistent unlearned lessons include benchmark biases that inflate generalization performance, poor reproducibility practices, misuse of invariant models for tensor properties, omission of random baselines in active learning, weak validity filtering in generative workflows, and near-absent failure reporting. This review critically assesses a decade of progress and shortcomings, grounded in 38 peer-reviewed publications. It highlights that hype around foundation models, generative inverse design, and autonomous labs often exceeds demonstrated impact. Realizing the field’s potential requires prioritizing extrapolation-focused architectures, mandatory experimental validation, shared failure registries, and stronger evidentiary standards to accelerate reliable discovery of functional materials.