Neural Networks
Activation Function
Neural Networks· Intermediate
Definition
A mathematical function applied to a neuron's output, introducing non-linearity that enables networks to learn complex patterns. Common functions: ReLU (most widely used), Sigmoid (binary output), Tanh, GELU (used in transformers).
Tags
#ReLU#sigmoid#non-linearity#GELU
MS
Maxx Stacks Editorial
Reviewed by enterprise AI practitioners
Maxx University
Keep learning. Keep building.
250+ terms. 5 learning paths. AI maturity assessment. Jargon translator. All free, always.