Why we need bias in Neural Networks

mediumThis post was originally published by Łukasz Gebel at Medium [AI]

One time when bias is not something bad

Neuron, Mózgu, Neurony, Nerwy, Synapsy, NaukaImage by skylarvision on Pixabay

High variance learning curves (image by Author).
High bias learning curves (image by Author).
Simple Neural Network (image by Author).
Neuron realizing linear regression (image by Author).
Sum of inputs and weights products (image by Author).
Linear regression by Neural Network (image by Author).
Linear regression by Neural Network without bias (image by Author).
Line can change the slope but crosses origin (image by Author).
With bias, line doesn’t need to cross origin (image by Author).
Sigmoid function (image by Author).
Sigmoid shift according to bias value (image by Author).
Spread the word

This post was originally published by Łukasz Gebel at Medium [AI]

Related posts