TY - JOUR
T1 - Revisiting Graph Attention Mechanisms for Crystal Property Prediction: Beyond Mean Aggregation
AU - Jose Martinez
AU - Carmen Lopez
JF - Journal of Computational and Data-Driven Materials Engineering
JO - J. Comput. Data-Driven Mater. Eng.
SN - 3149-9368
Y1 - 2025
VL - 4
IS - 2
DO - 10.68159/l509692136
SP - 57
N2 - Most crystal graph neural networks rely on mean aggregation to combine information from neighboring atoms when predicting material properties. This simple averaging of neighbor features works well for many bulk properties that depend on average coordination environments. Yet it carries fundamental limitations: it erases information about local variance, extreme values from individual neighbors, and complex interaction patterns that are essential in real crystals. Graph attention mechanisms, which learn to weight neighbors dynamically according to relevance, have emerged as a promising way to overcome these shortcomings. However, even standard attention often reduces to a form of weighted averaging and therefore inherits many of the same restrictions. This conceptual framework revisits graph attention specifically for crystal property prediction. It first clarifies precisely what mean aggregation captures and, more importantly, what it systematically misses in crystalline systems. It then introduces a structured set of attention variants that move beyond simple averaging while remaining fully compatible with the symmetries and periodicity of crystals. Five attention variants are defined—variance-aware attention, max-attention for extreme values, multi-head attention with mixed aggregations, directional attention, and set-based attention—each tailored to different physical demands of crystal properties. A core contribution is a set of six design principles that guide the selection and implementation of these mechanisms. The principles emphasize matching the aggregation strategy to the target property, preserving permutation invariance, accounting for directional bond information, balancing expressivity against computational cost, and systematically testing aggregation sensitivity. By shifting attention from default mean aggregation to property-aware, richer aggregation strategies, the framework aims to unlock higher predictive fidelity for diverse crystal properties ranging from formation energies in ordered compounds to defect sensitivities and anisotropic tensor properties in disordered or low-symmetry materials. The proposed conceptual lens provides a blueprint for next-generation crystal graph neural networks that better respect the rich local physics of atomic arrangements.
UR - https://iamrp.net/l509692136
ER -