In general, a Deep Neural Network has an input layer, an output layer and at least one layer in between. The higher the number of layers, the deeper the network. Each of these layers performs different types of specific sorting and categorization in a process called "feature hierarchy".