A Conceptual Distinction between Generalization and Transfer in Materials Machine Learning

iamrp.net-Xpzi-1791515265-q862149980 1791515265 Institute for Advanced Materials Research Press info@iamrp.net Institute for Advanced Materials Research Press Journal of Artificial Intelligence for Materials Science J. Artif. Intell. Mater. Sci. 3149-8957 2023 2 1 A Conceptual Distinction between Generalization and Transfer in Materials Machine Learning Hiroshi Nakamura Yuta Kato 2023 10.68159/q862149980 https://iamrp.net/pub/journal/1/article/q862149980 De Mello RF, Ponti MA. Statistical learning theory. Mach Learn. 2018;3. Panigrahi S, Nanda A, Swarnkar T. A survey on transfer learning. In: Intelligent and cloud computing; AHFE 2019. Singapore: Springer; 2021. p. 781-9. Feng S, Fu H, Zhou H, Wu Y, Lu Z, Dong H. A general and transferable deep learning framework for predicting phase formation in materials. npj Comput Mater. 2021;7(1):10. Butler KT, Davies DW, Cartwright H, Isayev O, Walsh A. Machine learning for molecular and materials science. Nature. 2018;559(7715):547-55. Schmidt J, Marques MR, Botti S, Marques MA. Recent advances and applications of machine learning in solid-state materials science. npj Comput Mater. 2019;5(1):83. Chen C, Ye W, Zuo Y, Zheng C, Ong SP. Graph networks as a universal machine learning framework for molecules and crystals. Chem Mater. 2019;31(9):3564-72. Zunger A. Inverse design in search of materials with target functionalities. Nat Rev Chem. 2018;2(4):0121. Jha D, Choudhary K, Tavazza F, Liao WK, Choudhary A, Campbell C, et al. Enhancing materials property prediction by leveraging computational and experimental data using deep transfer learning. Nat Commun. 2019;10(1):5316. Gupta V, Choudhary K, Tavazza F, Campbell C, Liao WK, Choudhary A, et al. Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data. Nat Commun. 2021;12(1):6595. Chen C, Ong SP. AtomSets as a hierarchical transfer learning framework for small and large materials datasets. npj Comput Mater. 2021;7(1):173. Zhong X, Gallagher B, Liu S, Kailkhura B, Hiszpanski A, Han TY. Explainable machine learning in materials science. npj Comput Mater. 2022;8(1):204. Oviedo F, Ferres JL, Buonassisi T, Butler KT. Interpretable and explainable machine learning for materials science and chemistry. Acc Mater Res. 2022;3(6):597-607. Kauwe SK, Graser J, Murdock R, Sparks TD. Can machine learning find extraordinary materials? Comput Mater Sci. 2020;174:109498. Ojih J, Al-Fahdi M, Rodriguez AD, Choudhary K, Hu M. Efficiently searching extreme mechanical properties via boundless objective-free exploration and minimal first-principles calculations. npj Comput Mater. 2022;8(1):143. Meredig B, Antono E, Church C, Hutchinson M, Ling J, Paradiso S, et al. Can machine learning identify the next high-temperature superconductor? Examining extrapolation performance for materials discovery. Mol Syst Des Eng. 2018;3(5):819-25. Chang R, Wang YX, Ertekin E. Towards overcoming data scarcity in materials science: Unifying models and datasets with a mixture of experts framework. npj Comput Mater. 2022;8(1):242. Yamada H, Liu C, Wu S, Koyama Y, Ju S, Shiomi J, et al. Predicting materials properties with little data using shotgun transfer learning. ACS Cent Sci. 2019;5(10):1717-30. De Breuck PP, Hautier G, Rignanese GM. Materials property prediction for limited datasets enabled by feature selection and joint learning with MODNet. npj Comput Mater. 2021;7(1):83. Wang AY, Kauwe SK, Murdock RJ, Sparks TD. Compositionally restricted attention-based network for materials property predictions. npj Comput Mater. 2021;7(1):77. Gupta T, Zaki M, Krishnan NA, Mausam. MatSciBERT: A materials domain language model for text mining and information extraction. npj Comput Mater. 2022;8(1):102. Li K, DeCost B, Choudhary K, Greenwood M, Hattrick-Simpers J. A critical examination of robustness and generalizability of machine learning prediction of materials properties. npj Comput Mater. 2023;9(1):55. Banchi L, Pereira J, Pirandola S. Generalization in quantum machine learning: A quantum information standpoint. PRX Quantum. 2021;2(4):040321. Stoll A, Benner P. Machine learning for material characterization with an application for predicting mechanical properties. GAMM-Mitt. 2021;44(1):e202100003. Caro MC, Huang HY, Cerezo M, Sharma K, Sornborger A, Cincio L, et al. Generalization in quantum machine learning from few training data. Nat Commun. 2022;13(1):4919. Peterson GG, Brgoch J. Materials discovery through machine learning formation energy. J Phys Energy. 2021;3(2):022002. Choudhary K, DeCost B, Chen C, Jain A, Tavazza F, Cohn R, et al. Recent advances and applications of deep learning methods in materials science. npj Comput Mater. 2022;8(1):59. Schmidt J, Pettersson L, Verdozzi C, Botti S, Marques MA. Crystal graph attention networks for the prediction of stable materials. Sci Adv. 2021;7(49):eabi7948. Fung V, Zhang J, Juarez E, Sumpter BG. Benchmarking graph neural networks for materials chemistry. npj Comput Mater. 2021;7(1):84. Kolluru A, Shoghi N, Shuaibi M, Goyal S, Das A, Zitnick CL, et al. Transfer learning using attentions across atomic systems with graph neural networks (TAAG). J Chem Phys. 2022;156(18).