Recently a new activation function named Exponential Linear Unit or its widely known name ELU was introduced. Researchs reveal that…
Facial Expression Recognition with Keras
Kaggle announced facial expression recognition challenge in 2013. Researchers are expected to create models to detect 7 different emotions from human…
A Gentle Introduction to Cross-Entropy Loss Function
Neural networks produce multiple outputs in multi-class classification problems. However, they do not have ability to produce exact outputs, they…
Transfer Learning in Keras Using Inception V3
Machine learning researchers would like to share outcomes. They might spend a lot of time to construct a neural networks…
Logarithm of Sigmoid As a Neural Networks Activation Function
Previously, we’ve reviewed sigmoid function as activation function for neural networks. Logarithm of sigmoid states it modified version. Unlike to…
A Step by Step ID3 Decision Tree Example
Decision tree algorithms transfom raw data to rule based decision making trees. Herein, ID3 is one of the most common…
How Random Forests Can Keep You From Decision Tree
Life cycle of a tree begins with a seed. Then seed grows and becomes a young plant. Young plant is…
Softsign as a Neural Networks Activation Function
Activation functions play pivotal role in neural networks. As an alternative to hyperbolic tangent, softsign is an activation function for…
Softmax as a Neural Networks Activation Function
In fact, convolutional neural networks popularize softmax so much as an activation function. However, softmax is not a traditional activation function.…
Developers vs Mathematicians
Fermat’s last theorem has been waiting almost 350 years to be proven. Now, we can call it theorem but until 90s…
