TY - JOUR
T1 - Toward Community-Agreed Metrics for Generative Materials Models: A Position on Inverse Design Reporting
AU - Sven Larsson
AU - Erik Johansson
AU - Anna Nilsson
JF - Journal of Computational and Data-Driven Materials Engineering
JO - J. Comput. Data-Driven Mater. Eng.
SN - 3149-9368
Y1 - 2024
VL - 3
IS - 1
DO - 10.68159/h197852185
SP - 27
N2 - Generative models for materials inverse design, including variational autoencoders, generative adversarial networks, and diffusion models, have rapidly emerged as powerful tools for proposing crystal structures conditioned on target properties. Yet, despite significant methodological progress, evaluation practices remain fragmented and inconsistent, limiting comparability and obscuring genuine scientific advancement. This review introduces a unified five-dimensional taxonomy—validity, novelty, diversity, property optimization, and stability—and uses it to diagnose systematic distortions in current reporting. Across the literature, metrics are defined heterogeneously, diversity is frequently omitted, stability is selectively assessed, and baseline comparisons are often absent. These inconsistencies inflate reported performance and prevent reliable benchmarking. In response, a minimal reporting standard is proposed, requiring transparent multi-metric evaluation, explicit dataset and split disclosure, baseline-controlled property assessment, distribution-level reporting, and computational-cost transparency. Establishing such community-agreed protocols is essential for transforming generative materials research into a reproducible, comparable, and cumulatively advancing field.
UR - https://iamrp.net/h197852185
ER -