From von Neumann to Memory-Augmented Neural Networks

towards-data-science

This post was originally published by Iulia Turc at Towards Data Science

The interaction of the neural memory with the external world is mediated by a controller. Figure 1 in Graves et al. [1]

The derivative of a function at a specific point. Image from Wikipedia.

RAM is accessed based on location — read operations specify the exact address to read from. Neural memories are typically accessed based on content — queries specify what to read, not where to read from.

Illustration by the author.

Spread the word

This post was originally published by Iulia Turc at Towards Data Science

Related posts