Institute for Advanced Materials Research Press Institute for Advanced Materials Research Press

Search

Search results:
Conceptual Models of Trust in Materials AI — Frameworks, Dimensions, and Open Questions
The rapid integration of artificial intelligence (AI) into materials science has transformed workflows for property prediction, inverse design, and autonomous experimentation. Yet, it has simultaneously introduced profound challenges regarding when and how human researchers should trust AI-generated recommendations in high-stakes contexts. This review systematically examines conceptual models of trust in materials AI by synthesizing interdisciplinary insights from human factors engineering, psychology, and human-computer interaction with domain-specific literature on automated materials discovery. A targeted literature search across Web of Science, Scopus, arXiv, and the ACM Digital Library, employing search strings focused on trust in AI systems, trust calibration, trustworthiness, and human-AI interaction in scientific discovery, yielded approximately 450 initial records. After applying inclusion criteria limited to peer-reviewed English-language publications from 2017 to 2024 that addressed conceptual foundations, frameworks, or applications of trust in AI (with explicit relevance to scientific or materials contexts), 30 studies were selected for in-depth analysis following a PRISMA-style screening process. Conceptual foundations of trust are reviewed, drawing on foundational definitions that position trust as an attitude that an agent will help achieve goals under conditions of uncertainty and vulnerability, while distinguishing it from mere reliance and emphasizing the necessity of calibration for appropriate reliance levels. Existing frameworks for trust in AI are surveyed, revealing recurring components such as competence, integrity, benevolence, performance, process, and purpose, each evaluated for strengths and limitations when transposed to materials AI environments characterized by black-box models, rare events, and high economic or safety stakes. The current state of trust research in materials AI demonstrates a pronounced gap: the majority of studies prioritize predictive accuracy and scalability, with only emergent attention to trustworthiness, explainability, or human trust dynamics. Dimensions of trust tailored to materials AI—predictive competence, uncertainty calibration, transparency, robustness, benevolence, and accountability—are proposed and analyzed in relation to domain-specific challenges. This review articulates open questions surrounding trust establishment, post-failure dynamics, and stakeholder variations while offering recommendations for trust-aware design, evaluation, and reporting. By bridging broader AI trust literature with materials science realities, the work advocates for a paradigm shift from accuracy-centric evaluation toward integrated trust models that ensure safe, effective, and ethically sound human-AI collaboration in materials discovery and innovation.
Journal of Artificial Intelligence for Materials Science
Review | Open access | 18 July 2024 | Article: 128

Conceptual Models of the AI-Materials Scientist Interface — From Tool to Collaborator: A Review Study
This review systematically examines conceptual models of the AI-materials scientist interface, tracing the evolution from AI as a passive computational tool to AI as an active collaborator capable of shared reasoning and autonomous contribution in materials discovery workflows. Drawing exclusively on 35 peer-reviewed publications spanning 2017–2025, the analysis integrates literature from human-computer interaction, artificial intelligence, and materials science to map the dominant metaphors, emerging conceptual shifts, existing interface models, and critical dimensions that define effective human-AI partnership. The tool metaphor, which positions AI strictly as a calculator, database, or predictor under full human control, is shown to dominate current practice yet reveals significant limitations once AI systems exhibit greater autonomy, opacity, and generative capacity. Conceptual shifts—moving from passive execution to active proposal, controlled operation to adaptive autonomy, and subordinate assistance to epistemic partnership—are documented as necessary preconditions for reframing AI as a scientific teammate. Existing models of the interface, including human-in-the-loop, human-on-the-loop, human-in-command, shared cognitive partnership, and full autonomy variants, are surveyed with concrete examples from materials research. In contrast, six core dimensions (autonomy level, communication modality, shared understanding, trust dynamics, goal alignment, and role flexibility) are articulated as the foundational axes along which collaboration quality can be assessed. Persistent gaps, such as the scarcity of empirical studies on real-world collaboration effectiveness and the absence of validated metrics beyond task performance, are identified, leading to targeted future directions that emphasize empirical teaming studies, adaptive interface design, and ethical frameworks for AI-scientist relationships. Ultimately, the review argues that materials science stands at a pivotal transition point where embracing AI as a collaborator, rather than a tool, will be essential for unlocking the next generation of accelerated, creative, and trustworthy discovery processes.
Journal of Artificial Intelligence for Materials Science
Review | Open access | 18 January 2025 | Article: 138
Filters
Clear All





Access type