Deep Learning for NLP: ANNs, RNNs and LSTMs explained!

Ever fantasied about having your own personal assistant to answer any questions you can ask, or have conversations with? Well, thanks to Machine Learning and Deep Neural Networks , this is not so far from happening. Think of the amazing capabilities exhibited by Apple’s Siri or Amazon’s Alexa. Don’t get too excited, in this next series of posts we are not going to create an omnipotent Artificial Intelligence, rather we will create a simple chatbot that given some input information and a question about such information, responds to yes/no questions regarding what it has been told. It is nowhere near to Siri’s or Alexa’s capabilities, but it illustrates very well how even using very simple deep neural network structures, amazing results can be obtained. In this post we will learn about Artificial Neural Networks, Deep Learning, Recurrent Neural Networks and Long-Short Term Memory Networks. In the next post we will use them on a real project to make a question answering bot. Before we start with all the fun regarding Neural Networks, I want you to first take a close look at the following image . In it there are two pictures; one of a school bus driving through a road, and one of an ordinary living room, which have had descriptions attached by human annotators . Figure with two different images with a text description made by human annotators. Done? Lets get on with it then! The beginning— Artificial Neural Networks To construct the neural network model that will be used to create the chatbot, Keras , a very popular Python Library for Neural Networks will be used. However, before going any further, we first have to understand what an Artificial Neural Network or ANN is. ANNs are Machine Learning models that try to mimic the functioning of […]

Click here to view full article