The neuron is the basic working unit of the brain, a specialized cell designed to transmit information to other nerve cells, muscle, or gland cells.
Pecerptron
A (simplified) math model for a single neuron. A pecerptron takes a D-dimensional input vector, outputs a scalar value, and has its parameters as a D+1 dimensional weights (with a bias term). The model multiplies the input vector with its weights and optionally applies an activation function.
Step function
A function that takes a scalar value as input, and output 0 if the input <0 or 1 if the input >=0.
Sigmoid function
A function with a S-shaped curve that maps a real-valued input to an output in the range of (0, 1). This is the same as the logistic function.
XOR
Exclusive OR operation that outputs true only when two inputs differ.