The Biological Neuron & McCulloch-Pitts Model

The Story That Started Everything

Before building artificial neurons, we need to understand the real one. The biological neuron is the fundamental unit of the nervous system. The human brain contains roughly 86 billion of them, each connected to thousands of others — forming the most complex information-processing system we know of.

Anatomy of a Biological Neuron

A neuron has three functional zones, each with a precise mathematical counterpart in the McCulloch-Pitts model. Understanding this mapping is the entire point of this tutorial.

The McCulloch-Pitts Neuron — The Maths

The McCulloch-Pitts neuron computes two things in sequence:

Biological Parts → Model Parts

A Worked Example — AND Gate

Let's wire a McCulloch-Pitts neuron to behave like a logical AND gate. It should fire only when both inputs are 1.

Inhibitory Inputs — The Biological Veto

Python Implementation

Basic McCulloch-Pitts Neuron

import numpy as np

def mcculloch_pitts(inputs, weights, threshold):
    """
    A single McCulloch-Pitts neuron.
    inputs    : list/array of binary inputs  [x1, x2, ...]
    weights   : list/array of synaptic weights [w1, w2, ...]
    threshold : firing threshold θ
    returns   : 1 (fire) or 0 (silent)
    """
    inputs  = np.array(inputs,  dtype=float)
    weights = np.array(weights, dtype=float)

    z = np.dot(weights, inputs)        # soma: weighted sum
    y = 1 if z >= threshold else 0    # axon: step activation
    return y, z                         # output + raw sum for inspection

# ── AND gate: w=[1,1], θ=2 ──────────────────────────────────
print("AND Gate Truth Table")
print("-" * 35)
for x1, x2 in [(0,0), (0,1), (1,0), (1,1)]:
    y, z = mcculloch_pitts([x1, x2], weights=[1,1], threshold=2)
    print(f"  x1={x1}, x2={x2}  →  z={z:.1f}  →  output={y}")

# ── OR gate: w=[1,1], θ=1 ───────────────────────────────────
print("\nOR Gate Truth Table")
print("-" * 35)
for x1, x2 in [(0,0), (0,1), (1,0), (1,1)]:
    y, z = mcculloch_pitts([x1, x2], weights=[1,1], threshold=1)
    print(f"  x1={x1}, x2={x2}  →  z={z:.1f}  →  output={y}")

Object-Oriented Neuron — With Inhibitory Support

import numpy as np

class MPNeuron:
    """McCulloch-Pitts neuron with excitatory and inhibitory inputs."""

    def __init__(self, weights, threshold):
        self.weights   = np.array(weights, dtype=float)
        self.threshold = threshold

    def fire(self, inputs):
        x = np.array(inputs, dtype=float)
        z = np.dot(self.weights, x)
        return 1 if z >= self.threshold else 0, z

# ── Demo: NAND gate ─────────────────────────────────────────
# NAND = NOT AND → fires on every input combo EXCEPT (1,1)
# weights = [-1,-1], threshold = -1
nand = MPNeuron(weights=[-1, -1], threshold=-1)

print("NAND Gate")
for x1, x2 in [(0,0), (0,1), (1,0), (1,1)]:
    y, z = nand.fire([x1, x2])
    print(f"  ({x1},{x2})  z={z:+.0f}  → {y}")

# ── Demo: Inhibitory veto ────────────────────────────────────
# x3 is an inhibitory signal: weight = -10
# Even if x1=x2=1, x3=1 will silence the neuron
veto_neuron = MPNeuron(weights=[1, 1, -10], threshold=1.5)

print("\nInhibitory Veto Test")
tests = [(1,1,0), (1,1,1)]    # last: inhibitory fires
for x1, x2, x3 in tests:
    y, z = veto_neuron.fire([x1, x2, x3])
    label = "🔥 FIRES" if y else "🔕 SILENT"
    print(f"  x=({x1},{x2},{x3})  z={z:+.0f}  → {label}")

Limitations — Why MP Neurons Led to the Perceptron

The Family Tree — From Neuron to GPT

Golden Rules