In the rapidly evolving field of materials artificial intelligence (AI), a fundamental tension arises between optimization- and discovery-driven approaches. Optimization focuses on refining known materials properties or processes to achieve incremental improvements, often leveraging machine learning techniques to maximize performance metrics within established parameter spaces. In contrast, discovery emphasizes the exploration of novel materials or unexpected phenomena, requiring expansive search strategies that may sacrifice short-term efficiency for long-term innovation. This conceptual paper examines this tension, synthesizing recent literature to highlight how optimization-centric paradigms can inadvertently constrain the serendipitous aspects of scientific inquiry in materials science. By analyzing the interplay between algorithmic efficiency and exploratory breadth, the discussion reveals potential pitfalls where over-reliance on optimization algorithms limits the identification of paradigm-shifting materials. A novel conceptual framework is proposed that delineates the optimization-discovery continuum and suggests pathways to balance these objectives through adaptive AI architectures. This framework underscores the need for integrating uncertainty quantification and multi-objective considerations to foster both refinement and novelty. Ultimately, addressing this tension could enhance the transformative potential of AI in materials research, ensuring that technological advancements are not confined to predictable trajectories but extend to uncharted domains. The analysis draws on peer-reviewed studies, emphasizing conceptual insights without empirical data or methods.