Facebook’s AI research director Yann LeCun called GAN “the most interesting idea in the last 10 years in ML. Generative Adversarial Networks are a powerful class of neural networks used for unsupervised learning. This article is the first of a
Attention Mechanism in deep learning has led to major performance improvements both in NLP and computer vision. All sequence models now implement attention resulting in state-of-the-art architectures. Let’s try to understand the evolution of attention mechanism.