Machine learning researchers would like to share outcomes. They might spend a lot of time to construct a neural networks…

# Logarithm of Sigmoid As a Neural Networks Activation Function

Previously, we’ve reviewed sigmoid function as activation function for neural networks. Logarithm of sigmoid states it modified version. Unlike to…

# A Step by Step ID3 Decision Tree Example

Decision tree algorithms transfom raw data to rule based decision making trees. Herein, ID3 is one of the most common…

# How Random Forests Can Keep You From Decision Tree

Life cycle of a tree begins with a seed. Then seed grows and becomes a young plant. Young plant is…

# Softsign as a Neural Networks Activation Function

Activation functions play pivotal role in neural networks. As an alternative to hyperbolic tangent, softsign is an activation function for…

# Softmax as a Neural Networks Activation Function

Convolutional neural networks popularize softmax so much as an activation function. However, softmax is not a traditional activation function. The…

# Developers vs Mathematicians

Fermat’s last theorem has been waiting almost 350 years to be proven. Now, we can call it theorem but until 90s…