**6. Softmax Function**

* Softmax function is used to force inputs such that the total sum of output values will be equal to one (in other words, to represent probability distribution). *

*Confusing?? Let me give an example input and output.*

*input values=[2,4,5]*

*output values will be=[0.035,0.265,0.70]*

*so if you observe, the input 2 is converted to ->0.035*

*4-->0.265*

*5-->0.70*

*If you sum up all the output values, it would be equal to 1. i.e., 0.035+0.265+0.70=1*

*The equation is given by:*

*\(f(x_j)=\frac{e^{x_j}}{\sum\limits_{k=1}^{K}e^{x_k}} \; for\; j=1,2,3...K\).*