- 2073 Bhadra · 3+7 marks
Hebbian learning; AND function
Short answer
Hebbian learning updates weights by Δw_i = x_i * y, strengthening connections between simultaneously active neurons. For an AND function with bipolar inputs, after processing all patterns, final weights are w1=2, w2=2, bias b=-2.
Define Hebbian learning. Use Hebbian learning algorithm to construct a Hebbian Network which performs like AND function.
Hebbian learning
Hebbian learning (Donald Hebb, 1949) is an unsupervised-style rule stating "neurons that fire together wire together": the weight between two neurons is strengthened when both are active together.
Rule: Δw_i = x_i · y (for supervised Hebb nets, y = target t), Δb = y; w_i(new) = w_i(old) + x_i·y.
Hebb net for the AND function
Use bipolar inputs and targets (1 = true, −1 = false). Initial w1 = w2 = b = 0.
| x1 | x2 | t | Δw1 = x1·t | Δw2 = x2·t | Δb = t | w1 | w2 | b |
|---|---|---|---|---|---|---|---|---|
| 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 1 | −1 | −1 | −1 | 1 | −1 | 0 | 2 | 0 |
| −1 | 1 | −1 | 1 | −1 | −1 | 1 | 1 | −1 |
| −1 | −1 | −1 | 1 | 1 | −1 | 2 | 2 | −2 |
Final weights: w1 = 2, w2 = 2, b = −2.
Testing: net = 2x1 + 2x2 − 2, output = +1 if net > 0, else −1
| x1 | x2 | net | output | target |
|---|---|---|---|---|
| 1 | 1 | 2 | 1 | 1 |
| 1 | −1 | −2 | −1 | −1 |
| −1 | 1 | −2 | −1 | −1 |
| −1 | −1 | −6 | −1 | −1 |
All outputs match, so the net has learned AND.
x1 --(2)-->\
( Σ + b ) --> sign --> y
x2 --(2)-->/ ^ b = -2
Decision line: 2x1 + 2x2 − 2 = 0, i.e. x1 + x2 = 1.
✓ Answer checked by Claude Opus 5.5 (high effort)
Related questions
- Machine learning, GA, operators, areas · Artificial Intelligence, chapter 6 · asked 2×
- GA vs fuzzy based learning · Artificial Intelligence, chapter 6
- Machine learning; Boltzmann machines · Artificial Intelligence, chapter 6
- Neural network; back-propagation · Artificial Intelligence, chapter 6
- Back propagation algorithm · Artificial Intelligence, chapter 6 · asked 3×
- Neural network; supervised vs unsupervised · Artificial Intelligence, chapter 6
- Mapping function and replacement algorithm · Computer Organization and Architecture, chapter 6
- Voltage ratio transfer function of two-section LC network · Electrical Circuit Theory, chapter 5
- Poles and zeros of a network function · Electrical Circuit Theory, chapter 5
- Short note: Neural network, perceptron rule · Data Mining, chapter 3