iamrp.net-XLB8-1791491021-k186505028 1791491021 Institute for Advanced Materials Research Press info@iamrp.net Institute for Advanced Materials Research Press Journal of Computational and Data-Driven Materials Engineering J. Comput. Data-Driven Mater. Eng. 3149-9368 2023 2 2 James Walker Olivia Harris 2023 10.68159/k186505028 https://iamrp.net/pub/journal/2/article/k186505028 Thomas N, Smidt T, Kearnes S, Yang L, Li L, Kohlhoff K, et al. Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds. arXiv preprint arXiv:1802.08219. 2018. Batzner S, Musaelian A, Sun L, Geiger M, Mailoa JP, Kornbluth M, et al. E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials. Nat Commun. 2022;13(1):2453. 10.1038/s41467-022-29939-5 Batatia I, Kovács DP, Simm GNC, Ortner C, Csányi G. MACE: Higher order equivariant message passing neural networks for fast and accurate force fields. Adv Neural Inf Process Syst. 2022;35:11423-36. Gasteiger J, Becker F, Günnemann S. GemNet: Universal directional graph neural networks for molecules. Adv Neural Inf Process Syst. 2021;34:6790-802. Garcia Satorras V, Hoogeboom E, Welling M. E(n) equivariant graph neural networks. Proc Mach Learn Res. 2021;139:9323-32. Du W, Zhang H, Du Y, Meng Q, Chen W, Zheng N, et al. SE(3) equivariant graph neural networks with complete local frames. Proc Mach Learn Res. 2022;162:5583-608. Thölke P, De Fabritiis G. TorchMD-Net: Equivariant transformers for neural network based molecular potentials. arXiv preprint arXiv:2202.02541. 2022. Schütt KT, Sauceda HE, Kindermans PJ, Tkatchenko A, Müller KR. SchNet: A deep learning architecture for molecules and materials. J Chem Phys. 2018;148(24):241722. 10.1063/1.5019779 Musaelian A, Batzner S, Johansson A, Sun L, Owen CJ, Kornbluth M, et al. Learning local equivariant representations for large-scale atomistic dynamics. Nat Commun. 2023;14(1):579. 10.1038/s41467-023-36329-y Geiger M, Smidt T, Alby M, Miller BK, Boomsma W, Dice B, et al. e3nn/e3nn: 2022-04-13 [software]. Zenodo; 2022. 10.5281/zenodo.6459381 Geiger M, Smidt T. e3nn: Euclidean neural networks. arXiv preprint arXiv:2207.09453. 2022. Kondor R, Trivedi S. On the generalization of equivariance and convolution in neural networks to the action of compact groups. Proc Mach Learn Res. 2018;80:2747-55. Keriven N, Peyré G. Universal invariant and equivariant graph neural networks. Adv Neural Inf Process Syst. 2019;32. Ko TW, Ong SP. Recent advances and outstanding challenges for machine learning interatomic potentials. Nat Comput Sci. 2023;3(12):998-1000. 10.1038/s43588-023-00561-9 Lee J, Asahi R. Transfer learning for materials informatics using crystal graph convolutional neural network. Comput Mater Sci. 2021;190:110314. 10.1016/j.commatsci.2021.110314 Xie T, Grossman JC. Crystal graph convolutional neural networks for an accurate and interpretable prediction of material properties. Phys Rev Lett. 2018;120(14):145301. 10.1103/PhysRevLett.120.145301 Du W, Du Y, Wang L, Feng D, Wang G, Ji S, et al. A new perspective on building efficient and expressive 3D equivariant graph neural networks. Adv Neural Inf Process Syst. 2023;36:66647-74. Batzner SL. Equivariant deep learning interatomic potentials [dissertation]. Cambridge (MA): Harvard University Graduate School of Arts and Sciences; 2023. Weiler M, Geiger M, Welling M, Boomsma W, Cohen TS. 3D steerable CNNs: Learning rotationally equivariant features in volumetric data. Adv Neural Inf Process Syst. 2018;31. Poulenard A, Guibas LJ. A functional approach to rotation equivariant non-linearities for Tensor Field Networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2021. p. 13174-83. 10.1109/CVPR46437.2021.01297 Anderson B, Hy TS, Kondor R. Cormorant: Covariant molecular neural networks. Adv Neural Inf Process Syst. 2019;32. Fuchs F, Worrall D, Fischer V, Welling M. SE(3)-Transformers: 3D roto-translation equivariant attention networks. Adv Neural Inf Process Syst. 2020;33:1970-81. Romero D, Bekkers E, Tomczak J, Hoogendoorn M. Attentive group equivariant convolutional networks. Proc Mach Learn Res. 2020;119:8188-99. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. Adv Neural Inf Process Syst. 2017;30:5998-6008. Gasteiger J, Groß J, Günnemann S. Directional message passing for molecular graphs. arXiv preprint arXiv:2003.03123. 2020. Kozinsky B, Musaelian A, Johansson A, Batzner S. Scaling the leading accuracy of deep equivariant models to biomolecular simulations of realistic size. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis; 2023. p. 1-12. 10.1145/3581784.3627041 He L, Chen Y, Dong Y, Wang Y, Lin Z. Efficient equivariant network. Adv Neural Inf Process Syst. 2021;34:5290-302. Garcia Satorras V, Hoogeboom E, Fuchs F, Posner I, Welling M. E(n) equivariant normalizing flows. Adv Neural Inf Process Syst. 2021;34:4181-92. Frankle J, Schwab DJ, Morcos AS. The early phase of neural network training. arXiv preprint arXiv:2002.10365. 2020. Chen Z, Andrejevic N, Smidt T, Ding Z, Xu Q, Chi YT, et al. Direct prediction of phonon density of states with Euclidean neural networks. Adv Sci (Weinh). 2021;8(12):2004214. 10.1002/advs.202004214 Lubbers N, Smith JS, Barros K. Hierarchical modeling of molecular energies using a deep neural network. J Chem Phys. 2018;148(24):241715. 10.1063/1.5011181 Liu M, Gao H, Ji S. Towards deeper graph neural networks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining; 2020. p. 338-48. 10.1145/3394486.3403076 Wiersma R, Eisemann E, Hildebrandt K. CNNs on surfaces using rotation-equivariant features. ACM Trans Graph. 2020;39(4):92:1-12. 10.1145/3386569.3392437 Gao L, Lin G, Zhu W. Deformation robust roto-scale-translation equivariant CNNs. arXiv preprint arXiv:2111.10978. 2021. Aghdam HH, Heravi EJ. Guide to convolutional neural networks: A practical application to traffic-sign detection and classification. Cham: Springer; 2017. 10.1007/978-3-319-57550-6 Ketkar N, Moolayil J. Convolutional neural networks. In: Deep learning with Python: Learn best practices of deep learning models with PyTorch. Berkeley (CA): Apress; 2021. p. 197-242. 10.1007/978-1-4842-5364-9_6 Islam M, Chen G, Jin S. An overview of neural network. Am J Neural Netw Appl. 2019;5(1):7-11. 10.11648/j.ajnna.20190501.12 Choi RY, Coyner AS, Kalpathy-Cramer J, Chiang MF, Campbell JP. Introduction to machine learning, neural networks, and deep learning. Transl Vis Sci Technol. 2020;9(2):14. 10.1167/tvst.9.2.14 Sarlin PE, DeTone D, Malisiewicz T, Rabinovich A. SuperGlue: Learning feature matching with graph neural networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2020. p. 4938-47. 10.1109/CVPR42600.2020.00499 De Cao N, Kipf T. MolGAN: An implicit generative model for small molecular graphs. arXiv preprint arXiv:1805.11973. 2018. Veličković P. Everything is connected: Graph neural networks. Curr Opin Struct Biol. 2023;79:102538. 10.1016/j.sbi.2023.102538 Xu K, Hu W, Leskovec J, Jegelka S. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826. 2018. Gurney K. An introduction to neural networks. Boca Raton (FL): CRC Press; 2018. Wu YC, Feng JW. Development and application of artificial neural network. Wirel Pers Commun. 2018;102(2):1645-56. 10.1007/s11277-017-5224-x Luo S, Li J, Guan J, Su Y, Cheng C, Peng J, et al. Equivariant point cloud analysis via learning orientations for message passing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2022. p. 18932-41. 10.1109/CVPR52688.2022.01836