Abstract: Deep neural network (DNN) are becoming common in the industry due to their exceptional performance. This growing utilizations requires larger networks to achieve better performance.