Search

The accelerating integration of artificial intelligence into materials selection processes has brought unprecedented efficiency to high-throughput screening and discovery campaigns, yet it has also introduced a subtle but profound failure mode that remains largely unrecognized in the field: scientific regret. This paper identifies scientific regret as a distinct failure mode in AI-driven materials science—the ex-post realization that a better material or research direction was passed over due to an AI recommendation, often under conditions of irreducible uncertainty and vast combinatorial search spaces. Unlike traditional statistical errors, scientific regret captures the experiential and consequential dimension of missed opportunities in research trajectories that are difficult or impossible to reverse. Drawing on foundational work in decision theory and recent advances in Bayesian optimization for materials discovery, the paper defines scientific regret, delineates its mechanisms of production within AI systems, develops a typology tailored to materials contexts, and outlines principles for its detection and mitigation. By analyzing how premature search space pruning, overconfidence in negative predictions, and misaligned acquisition functions contribute to regret, this analysis reveals how current AI paradigms may systematically undervalue exploration in favor of short-term gains. The implications for materials AI practice are significant, calling for the design of regret-sensitive systems that better balance exploitation with the long-term costs of locked-in choices. Ultimately, embracing scientific regret as a core design constraint promises to foster more robust, reflective, and innovative approaches to autonomous materials research. Scientific regret is not merely an abstract philosophical concern but a practical barrier to genuine progress in materials science. When AI systems guide researchers away from promising chemistries or structures, the subsequent realization of a missed opportunity can stall entire research programs, waste limited experimental resources, and distort the collective knowledge base of the field. This failure mode is especially insidious because materials discovery operates in enormous design spaces where exhaustive enumeration is impossible and where negative predictions are rarely revisited once resources are committed elsewhere. By foregrounding scientific regret as a failure mode, this analysis seeks to reorient the community toward decision frameworks that explicitly account for the irreversible nature of many AI-influenced choices in materials selection.

Materials machine learning has achieved remarkable success in building accurate predictive models for properties such as formation energy, band gap, and mechanical strength. Yet the ultimate purpose of the field is not prediction but design: the discovery of new materials that deliver target properties under real-world constraints. This perspective argues that the community must shift from prediction-centric to optimization-centric workflows. Prediction-centric approaches focus on minimizing mean absolute error on randomly held-out test sets, while optimization-centric workflows aim to maximize (or minimize) a target property value within practical budgets, constraints, and sequential decision-making. These are fundamentally different objectives that demand different methods, evaluation metrics, and research priorities. A prediction-centric model may achieve low error on interpolation tasks yet fail catastrophically when asked to guide the search for extreme or out-of-distribution materials. In contrast, optimization-centric workflows treat the machine-learning model as a surrogate within an iterative loop that actively selects the next experiment or simulation. Four core principles underpin this shift: explicit goal specification that includes both the objective and all relevant constraints; robust constraint handling that distinguishes hard feasibility requirements from soft trade-offs; uncertainty awareness, where every prediction is accompanied by well-calibrated uncertainty estimates essential for balancing exploration and exploitation; and closed-loop integration that connects the model directly to automated or high-throughput experimentation and simulation. Adopting these principles will require new evaluation protocols that measure the best material discovered, sample efficiency, regret, constraint satisfaction, and extrapolation distance rather than isolated accuracy metrics. The implications extend to model development, benchmark design, journal standards, and funding priorities. Only by embracing optimization-centric workflows can materials machine learning fulfill its promise of accelerating discovery and delivering materials that solve pressing societal challenges.

Multi-fidelity learning has been positioned as a transformative tool for high-throughput materials screening, offering the ability to fuse inexpensive low-fidelity data—generated from classical force fields, tight-binding models, or CALPHAD thermodynamics—with costly high-fidelity calculations such as density functional theory (DFT). The central premise is straightforward: surrogate models can learn systematic discrepancies between fidelity levels, delivering near-DFT accuracy at a fraction of the computational expense and thereby enabling the rapid exploration of vast compositional and structural spaces that would otherwise remain inaccessible. A substantial body of work in journals including npj Computational Materials, Machine Learning: Science and Technology, Digital Discovery, Journal of Chemical Theory and Computation, Journal of Chemical Physics, and Nature Machine Intelligence has explored this paradigm through linear corrections, Gaussian process discrepancy modeling, neural network transfer learning, multi-fidelity Bayesian optimization, ensemble approaches, and hierarchical correction chains. Yet the promises remain largely unfulfilled. Despite hundreds of reported case studies, the literature reveals few, if any, experimentally validated novel materials discovered solely through multi-fidelity acceleration. Efficiency gains rarely exceed 2–5× in realistic workflows, uncertainty estimates are frequently miscalibrated outside training domains, and extrapolation to chemically distinct regions consistently collapses to the accuracy of the underlying low-fidelity baseline. Overclaims regarding order-of-magnitude cost reductions, guaranteed high-fidelity fidelity, and accelerated discovery have not materialized in practice. This review provides the first systematic synthesis of the 34 peer-reviewed publications that directly address multi-fidelity surrogate strategies in materials screening. It categorizes surrogate architectures, contrasts theoretical assumptions with empirical performance, inventories six recurring broken promises, and distills actionable lessons from the collective evidence. By foregrounding the persistent gaps between theory and application—non-stationary bias, limited transferability, and evaluation practices that favor interpolation over genuine discovery—this work offers a sober roadmap for future research in computational and data-driven materials engineering. The field must move beyond optimistic benchmarks toward honest reporting of real-world discovery metrics if multi-fidelity learning is to fulfill even a modest fraction of its original vision.

Computational materials engineering has undergone a transformative shift with the integration of data-driven methodologies and artificial intelligence, enabling accelerated discovery and design of novel materials. Uncertainty quantification (UQ) plays a pivotal role in this paradigm, addressing inherent variabilities in simulations, experimental data, and model predictions to ensure reliable decision-making in materials development. This review synthesizes recent advancements in UQ methods within computational and data-driven materials engineering, focusing on probabilistic modeling, sensitivity analysis, and Bayesian inference techniques deployed across multiscale simulations and machine learning frameworks. We examine deployment contexts ranging from molecular dynamics to additive manufacturing, highlighting how UQ enhances robustness in property prediction, process optimization, and autonomous discovery systems. By integrating insights from high-impact studies the review delineates a systems-level perspective on UQ infrastructures, emphasizing their role in bridging computational predictions with experimental validation. Key challenges such as computational efficiency and data scarcity are contextualized, alongside opportunities for multimodal integration. Ultimately, this synthesis positions UQ as an essential infrastructure for advancing materials informatics toward industrial applicability, offering a forward-looking outlook on scalable, uncertainty-aware workflows in materials engineering.

Closed-loop systems have become foundational to computational and data-driven materials engineering, integrating automated experimentation, machine learning inference, and orchestration software to compress the design-make-test-analyze cycle. These pipelines rely on continuous flows of data, models, and decisions, yet the mechanisms governing the transfer of decision authority between human experts and autonomous agents remain conceptually underdeveloped. Existing infrastructures emphasize optimization and execution but offer limited interpretive frameworks for how authority is dynamically delegated across epistemic states and pipeline stages. This manuscript presents the Decision Authority Delegation Cascade (DADC) Framework, an original systems-level architecture that formalizes delegated experimentation as a structured cascade of authority transfer. The framework delineates layered pipelines—from data representation through model inference and steering logics to execution and feedback—while emphasizing infrastructure trade-offs in representation fidelity, uncertainty quantification, and delegation thresholds. Synthesizing advances in Bayesian active learning, self-driving laboratories, and orchestration platforms, the DADC Framework interprets authority transfer not as a binary handover but as a continuous, computationally steered process that modulates discovery dynamics. The framework offers interpretive insights into scalable computational ecosystems, highlighting pathways to align human epistemic oversight with autonomous operation and to mitigate bottlenecks in closed-loop materials discovery. Its application reframes infrastructure design around explicit delegation logics, with implications for the next generation of autonomous materials platforms.