The field of materials science has undergone a transformative shift with the integration of computational and data-driven approaches, particularly through representation learning techniques that enable efficient handling of complex materials data. This review synthesizes recent advancements in architectures for representation learning, encompassing graph neural networks, attention-based models, and physics-inspired embeddings, which facilitate the extraction of meaningful features from diverse data modalities such as atomic structures, stoichiometries, and spectroscopic data. By bridging traditional computational methods with machine learning, these representations have accelerated property prediction, inverse design, and materials discovery applications, addressing challenges in high-dimensional spaces and sparse datasets. The scope of this narrative review covers the evolution from basic informatics to sophisticated multimodal integrations, highlighting how data ecosystems and learning frameworks contribute to autonomous discovery pipelines. A systems-level perspective is adopted to integrate cross-study insights, revealing synergies between representation learning and closed-loop systems that couple simulations with experiments. Looking ahead, the review posits that continued refinement of these architectures will drive scalable, AI-guided materials engineering, fostering innovations in energy, electronics, and structural materials while emphasizing the need for robust, interpretable models in real-world applications.