Outlines
General ideas about Hebbian learning rule
 Hebbian learning: correlationbased learning
 Longterm potentiation: persistent increase in the efficacy.
 Strong highfrequency pulses which evokes spikes will increase the efficacy.
 The change in synaptic weight will persist many hours, thus longterm potentiation.
 Joint activity of pre and postsynaptic, i.e., correlated activity, could increase the synaptic weight.
 Presynaptic has to precede the postsynaptic in order to increase the rate.
Ratebased Hebbian learning

Locality: change of synaptic efficacy depends only local variables, pre and post firing rates, and efficacy.

Cooperativity: timing of the pre and postsynaptic activity. Naively we would simply implement a correlation function into $F$. But the book used Taylor expansion. However, I think we should expand over some kind of contant activity that we could have instead of 0’s that the book is using. They should give us the same results. In Taylor expansion, the second order is bilinear which contains the property we need. By keeping only the second order expansion, we have
 We could choose $c^{\text{corr}}(w_{ij}) = \gamma (w_{ij}^{\text{max}}  w_{ij})$. As $w_{ij}$ approaches its max, the learning will saturate.
 Weigth decays, so we need the first term of Taylor expansion, $c_0(w_{ij})$. We could choose $c_0(w_{ij}) =  \gamma_0 w_{ij}$.
 Final form: Eqn. 10.6
 Competition: growth of synaptic weight is at the expense of weakening of other weights.
 Other learning rules are possible. Eqn. 10.7
Spiketimedependent Plasticity
 If spike trains are applied, we would expect the effect to be a summation of the single spike rules. Eqn. 10.13 and Eqn. 10 14