The role of artificial intelligence (AI), machine learning (ML), and deep reinforcement learning (DRL) in the evolution of smart cities is explored and various research challenges and future research directions where the aforementioned techniques can play an outstanding role to realize the concept of a smart city are presented.