Structural changes associated with memory include both the number of neurons and synapses.
For example, the long-term potentiation (LTP) is a phenomenon of formation or strengthening of new synapses with repeated stimulation of excitatory-neurons. It is the underlying mechanism of long-term memory.
Thus, the blanks can be filled with synapses; neurons.