Deep neural networks (DNN's for short) are neural networks that include 2 or more hidden layers. This architecture was created to enable machines to be able to find patterns in data through performing tasks like classification and regression. Deep neural networks are typically feedforward neural network but can take on different architectures as well.