Institute for Advanced Materials Research Press Institute for Advanced Materials Research Press

Search

Search results:
Failure, Uncertainty, and Risk in Materials AI — How Negative Outcomes Are Handled Across the Literature: A Review Study
The integration of artificial intelligence (AI) and machine learning (ML) in materials science has accelerated discovery and design processes, yet it introduces challenges related to failure, uncertainty, and risk. This narrative review examines how the materials AI literature addresses negative outcomes, including model uncertainties, predictive failures, and associated risks in application. Drawing on peer-reviewed studies, we explore uncertainty quantification techniques, robustness evaluations, and risk mitigation strategies. Key themes include Bayesian methods for uncertainty estimation, benchmark studies on prediction reliability, and strategies to handle data scarcity and extrapolation errors. The review highlights gaps in handling adversarial conditions and real-world failures, proposing future directions for more resilient AI frameworks in materials research. By synthesizing these insights, we aim to foster a more cautious and effective use of AI in advancing materials innovation.
Journal of Artificial Intelligence for Materials Science
Review | Open access | 18 January 2026 | Article: 95

Uncertainty Quantification for ML Interatomic Potentials: A Review of Methods, Hidden Assumptions, and Unresolved Questions
Uncertainty quantification (UQ) has become indispensable for the trustworthy deployment of machine learning interatomic potentials (MLIPs) in materials science and molecular modeling, where predictions of energies, forces, and derived properties directly inform high-stakes decisions in materials discovery, long-time-scale molecular dynamics, and autonomous design workflows. Without reliable uncertainty estimates, MLIPs risk propagating errors that compromise simulation stability, mislead experimental prioritization, or produce unphysical results in extrapolation regimes critical to novel alloy or molecular discovery. This review synthesizes the literature on UQ methods specifically developed for or applied to MLIPs, drawing exclusively from the compiled reference set to provide a focused, critical overview of progress during this formative period. The scope is deliberately restricted to UQ techniques for interatomic potentials themselves (including GAP, DeepMD, ANI-series, SchNet-derived, and E(3)-equivariant models such as NequIP), excluding standalone ML property prediction unless the method directly supports force-field uncertainty. A systematic taxonomy organizes existing approaches into five methodological families—Bayesian and probabilistic methods, ensemble methods, Gaussian process and kernel methods, conformal prediction and frequentist methods, and heuristic and ad hoc methods—highlighting their distinct mathematical foundations and practical implementations in MLIP contexts. Hidden assumptions pervading these families are identified and dissected, including independence of atomic errors, Gaussianity of predictive distributions, homoscedasticity across chemical space, kernel-imposed smoothness in Gaussian processes, approximation quality in variational or Monte-Carlo inference, and exchangeability in conformal frameworks. These assumptions frequently remain unstated yet profoundly influence calibration and reliability when MLIPs are deployed in production simulations. Unresolved questions are articulated with precision: how to treat correlated uncertainties along molecular-dynamics trajectories, the absence of a true ground-truth uncertainty given DFT approximations, the prohibitive computational overhead of scalable UQ, evaluation under distribution shift, vectorial uncertainty for forces rather than scalar energies, detection of physical inconsistencies, and hierarchical fusion of model, data, and ab-initio uncertainties. Future outlook points toward integrated UQ-driven active learning, force-aware uncertainty representations, and hybrid methods that balance calibration, sharpness, and efficiency for next-generation autonomous materials engineering.
Journal of Computational and Data-Driven Materials Engineering
Review | Open access | 18 July 2022 | Article: 9

When Data Steers Design: Feedback Dynamics in AI-Guided Materials Exploration Pipelines
The integration of computational tools and data-driven methodologies has transformed materials engineering, enabling accelerated discovery through AI-assisted pipelines that link data acquisition, model training, and experimental validation. In this paradigm, materials informatics leverages vast datasets from high-throughput computations and multimodal sources to inform design decisions, yet inherent feedback dynamics often introduce biases that steer exploration trajectories in unintended ways. This conceptual manuscript identifies a critical gap in understanding how data-model-experiment loops can self-reinforce certain pathways, leading to narrowed exploration spaces and amplified discovery biases. To address this, we introduce the Feedback Steering Framework (FSF), a systems-level architecture that interprets the interplay between data representations, model inferences, and iterative design cycles. The framework elucidates mechanisms such as reinforcement discovery bias, where initial data patterns perpetuate model preferences, and exploration narrowing, wherein computational steering logics constrain the search space over successive iterations. By conceptualizing these dynamics, FSF provides insights into optimizing AI-guided materials exploration for broader epistemic coverage. Implications extend to computational materials science ecosystems, including enhanced uncertainty management in autonomous systems and more robust inverse design strategies, ultimately fostering resilient infrastructures for next-generation materials innovation. This work underscores the need for interpretive tools that balance computational efficiency with comprehensive discovery potential in data-steered environments.
Journal of Computational and Data-Driven Materials Engineering
Original Research | Open access | 18 March 2022 | Article: 79

Uncertainty Quantification in Computational Materials Engineering: Methods and Deployment Contexts
Computational materials engineering has undergone a transformative shift with the integration of data-driven methodologies and artificial intelligence, enabling accelerated discovery and design of novel materials. Uncertainty quantification (UQ) plays a pivotal role in this paradigm, addressing inherent variabilities in simulations, experimental data, and model predictions to ensure reliable decision-making in materials development. This review synthesizes recent advancements in UQ methods within computational and data-driven materials engineering, focusing on probabilistic modeling, sensitivity analysis, and Bayesian inference techniques deployed across multiscale simulations and machine learning frameworks. We examine deployment contexts ranging from molecular dynamics to additive manufacturing, highlighting how UQ enhances robustness in property prediction, process optimization, and autonomous discovery systems. By integrating insights from high-impact studies the review delineates a systems-level perspective on UQ infrastructures, emphasizing their role in bridging computational predictions with experimental validation. Key challenges such as computational efficiency and data scarcity are contextualized, alongside opportunities for multimodal integration. Ultimately, this synthesis positions UQ as an essential infrastructure for advancing materials informatics toward industrial applicability, offering a forward-looking outlook on scalable, uncertainty-aware workflows in materials engineering.
Journal of Computational and Data-Driven Materials Engineering
Review | Open access | 18 March 2022 | Article: 83

Discovery Acceleration vs Epistemic Depth: Speed–Understanding Trade-Offs in Computational Design
The field of computational and data-driven materials engineering has witnessed a paradigm shift toward accelerated discovery pipelines, leveraging machine learning and high-throughput computations to navigate vast materials spaces. However, this emphasis on speed often comes at the expense of epistemic depth, where understanding of underlying mechanisms is sidelined by predictive efficiency. This manuscript introduces a conceptual framework that examines the inherent trade-offs between discovery acceleration and epistemic comprehension in computational design ecosystems. By integrating insights from materials informatics, representation learning, and uncertainty quantification, we propose a systems-level architecture that balances rapid iteration with interpretive rigor. The framework delineates how data infrastructures, model architectures, and feedback loops influence the speed–understanding continuum, highlighting computational steering logics that mitigate epistemic risks without compromising efficiency. Implications extend to autonomous discovery systems, inverse design strategies, and multimodal datasets, fostering more resilient AI-guided materials engineering. Ultimately, this approach advocates for hybrid paradigms where acceleration serves as a scaffold for deeper mechanistic insights, potentially transforming how computational tools are deployed in materials research.
Journal of Computational and Data-Driven Materials Engineering
Original Research | Open access | 18 September 2022 | Article: 87

Property Prediction vs Mechanistic Insight: A Conceptual Divide in Materials AI
In computational materials engineering, the integration of artificial intelligence (AI) has transformed discovery pipelines from labor-intensive simulations to data-driven infrastructures capable of navigating vast chemical spaces. High-throughput computations and machine learning architectures, such as graph neural networks, have enabled rapid property prediction, accelerating the screening of candidates for applications ranging from energy storage to structural alloys. Yet, this paradigm emphasizes forward modeling—mapping inputs to outputs—often at the expense of mechanistic insight, which requires disentangling causal interactions within atomic-scale dynamics. The conceptual divide between property prediction and mechanistic insight manifests in epistemic tensions: predictive models excel in interpolation but falter in extrapolation, while insight-oriented approaches demand representations that encode not just structural motifs but relational hierarchies across scales. This manuscript introduces the Interpretive Cascade Framework, a systems-level conceptualization that reframes materials AI as a layered cascade of representation, inference, and steering logics. By integrating multimodal data streams with feedback-mediated discovery workflows, the framework elucidates how computational infrastructures can balance predictive efficiency with interpretive depth, mitigating risks of epistemic opacity in closed-loop experimentation. Structural layers delineate data ingestion to hypothesis refinement, incorporating uncertainty propagation as a steering mechanism rather than a mere byproduct. Implications for the field lie in reorienting AI ecosystems toward hybrid discovery logics, where representation learning informs inverse design without sacrificing traceability. This interpretive lens fosters resilient infrastructures, enabling materials science to evolve beyond black-box predictions toward epistemically robust computational paradigms that sustain long-term innovation in data-driven materials engineering.
Journal of Computational and Data-Driven Materials Engineering
Original Research | Open access | 18 September 2022 | Article: 90

The Compression–Fidelity Trade-Off in Materials Embedding Architectures
Computational materials engineering has evolved through the integration of data-driven paradigms, where embedding architectures serve as pivotal intermediaries in transforming raw materials data into actionable discovery insights. These architectures, encompassing graph neural networks and representation learning models, facilitate the encoding of complex structural and compositional information into compact vector spaces that underpin predictive modeling and inverse design workflows. However, a fundamental tension emerges in this process: the compression–fidelity trade-off, wherein efforts to distill high-dimensional materials descriptors into efficient embeddings inevitably modulate the retention of epistemic nuances critical for robust inference. This conceptual manuscript delineates the systemic implications of this trade-off within materials embedding architectures, framing it not as a mere technical artifact but as a structural determinant of discovery pipelines. Drawing from ecosystems of materials informatics, high-throughput computation, and AI-guided systems, the analysis synthesizes how compression strategies—ranging from dimensionality reduction in multimodal datasets to latent space optimizations in foundation models—influence fidelity across simulation–experiment couplings and uncertainty quantification. The proposed framework, termed the Embedment Dynamics Lattice (EDL), reinterprets this trade-off through layered interactions of representational compression, inferential propagation, and epistemic feedback, offering a systems-level lens for navigating infrastructure-level constraints in autonomous discovery. By conceptualizing embedding as a dynamic lattice of trade-off vectors, EDL illuminates how architectural choices steer computational workflows toward balanced regimes of efficiency and interpretability, without presuming empirical validation. This interpretive approach underscores the need for infrastructure-aware design in materials AI, where compression–fidelity dynamics inform the orchestration of closed-loop experimentation and inverse materials paradigms. Implications extend to fostering resilient data infrastructures that accommodate representational fluidity, ultimately enhancing the epistemic integrity of data-driven materials engineering in an era of accelerating computational scale.
Journal of Computational and Data-Driven Materials Engineering
Original Research | Open access | 18 September 2022 | Article: 91

Topology without Physics: Structural Abstraction Limits in Graph-Based Materials Models
The advent of computational and data-driven approaches in materials engineering has transformed discovery pipelines, leveraging machine learning and graph-based representations to navigate vast chemical spaces. However, these models often prioritize topological abstractions over intrinsic physical mechanisms, leading to epistemic constraints in predictive accuracy and interpretability. This manuscript introduces a conceptual framework that dissects the structural abstraction limits inherent in graph-based materials models, emphasizing the trade-offs between computational efficiency and physical fidelity. By synthesizing insights from materials informatics and representation learning, we explore how graph neural networks decouple topological features from underlying physics, potentially hindering autonomous discovery systems and inverse design workflows. The framework delineates layers of abstraction, from data ingestion to inference, highlighting feedback loops that amplify abstraction-induced uncertainties. Implications extend to high-throughput computation, multimodal datasets, and uncertainty quantification, advocating for integrated infrastructures that balance abstraction with mechanistic reintegration. This analysis fosters a deeper understanding of computational steering in materials AI, guiding future developments toward more robust, physics-aware discovery paradigms without empirical validation. Ultimately, addressing these limits could enhance the reliability of data-driven materials engineering ecosystems.
Journal of Computational and Data-Driven Materials Engineering
Original Research | Open access | 18 September 2022 | Article: 92

Uncertainty as Infrastructure: Governing Confidence in Data-Driven Materials Pipelines
The field of computational and data-driven materials engineering has transformed traditional discovery processes through the integration of machine learning, high-throughput computations, and autonomous systems. However, as these pipelines scale, the management of uncertainty emerges as a foundational infrastructure rather than a mere analytical byproduct. This manuscript conceptualizes uncertainty not as an obstacle but as an enabling framework for governing confidence in materials informatics workflows. By synthesizing recent advancements in representation learning, graph neural networks, and uncertainty quantification, we identify epistemic gaps in current data-driven ecosystems, where confidence in predictions often remains opaque or inadequately integrated into discovery loops. We introduce the Confidence Governance Framework (CGF), a layered conceptual architecture that embeds uncertainty quantification as a core infrastructural element, facilitating dynamic interactions between data representations, model inferences, and discovery steering. This framework emphasizes computational trade-offs in multimodal datasets and simulation-experiment couplings, promoting robust, interpretable pipelines. Implications extend to enhanced autonomy in inverse design and closed-loop experimentation, fostering resilient materials engineering paradigms. Through this lens, uncertainty becomes a strategic asset for calibrating epistemic risks and optimizing resource allocation in AI-assisted materials research.
Journal of Computational and Data-Driven Materials Engineering
Original Research | Open access | 18 September 2022 | Article: 93
Filters
Clear All





Access type